2024-04-25T11:05:56.119 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T11:05:56.120 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124 --owner scheduled_pdonnell@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/orig.config.yaml 2024-04-25T11:05:56.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T11:05:56.267 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} email: pdonnell@redhat.com first_in_suite: false job_id: '7673124' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGE7UQn3qoQpNcxP/DOUyuXwn1IegK3NJT3q0xmanalI6MdEUitE3IclBq80cT0eeZ03RXc4YBLb1wUp/VOvE6c= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB0LjbxoPWqvoBCKd1tNcCPwz24NvzKjS2Sz45ujLpmSY2/vQcPHAoowY49k2ov3J6hGBcBmQoK42Co/h2bBEfk= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9fj0ND0FQxG1hfuTfg6zW2+odcU5lAzp9WdecQL1NQEKIRxTuKYrJHWyY5G+iWn2/Kwk3fgMwjF0aSDbMYtWo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T11:05:56.267 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T11:05:56.268 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T11:05:56.268 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T11:05:56.270 INFO:teuthology.task.internal:Checking packages... 2024-04-25T11:05:56.293 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T11:05:56.293 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T11:05:56.293 INFO:teuthology.packaging:ref: None 2024-04-25T11:05:56.293 INFO:teuthology.packaging:tag: None 2024-04-25T11:05:56.293 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T11:05:56.293 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:05:56.294 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T11:05:56.552 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T11:05:56.554 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T11:05:56.560 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T11:05:56.560 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T11:05:56.578 INFO:teuthology.task.internal:Saving configuration 2024-04-25T11:05:56.603 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T11:05:56.609 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T11:05:56.633 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 11:00:53.531290', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGE7UQn3qoQpNcxP/DOUyuXwn1IegK3NJT3q0xmanalI6MdEUitE3IclBq80cT0eeZ03RXc4YBLb1wUp/VOvE6c='} 2024-04-25T11:05:56.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 11:00:53.527760', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB0LjbxoPWqvoBCKd1tNcCPwz24NvzKjS2Sz45ujLpmSY2/vQcPHAoowY49k2ov3J6hGBcBmQoK42Co/h2bBEfk='} 2024-04-25T11:05:56.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 11:00:53.529762', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9fj0ND0FQxG1hfuTfg6zW2+odcU5lAzp9WdecQL1NQEKIRxTuKYrJHWyY5G+iWn2/Kwk3fgMwjF0aSDbMYtWo='} 2024-04-25T11:05:56.687 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T11:05:56.692 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-25T11:05:56.692 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-25T11:05:56.692 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-25T11:05:56.692 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T11:05:56.785 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f37741b50d0>, signals=[15]) 2024-04-25T11:05:56.786 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T11:05:56.791 INFO:teuthology.task.internal:Opening connections... 2024-04-25T11:05:56.792 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:05:56.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T11:05:56.870 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-04-25T11:05:56.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T11:05:56.945 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-04-25T11:05:56.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T11:05:57.021 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T11:05:57.027 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-04-25T11:05:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-04-25T11:05:57.045 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-25T11:05:57.102 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-25T11:05:57.102 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-25T11:05:57.102 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-25T11:05:57.102 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-25T11:05:57.102 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-25T11:05:57.102 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T11:05:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T11:05:57.104 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-25T11:05:57.126 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-04-25T11:05:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-04-25T11:05:57.144 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-04-25T11:05:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T11:05:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T11:05:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T11:05:57.202 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-25T11:05:57.226 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-04-25T11:05:57.243 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-04-25T11:05:57.244 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-04-25T11:05:57.300 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T11:05:57.301 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T11:05:57.302 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-04-25T11:05:57.326 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T11:05:57.336 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T11:05:57.342 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T11:05:57.342 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-04-25T11:05:57.345 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-04-25T11:05:57.347 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-04-25T11:05:57.363 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T11:05:57.369 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T11:05:57.369 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-04-25T11:05:57.401 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-04-25T11:05:57.404 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-04-25T11:05:57.500 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T11:05:57.576 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T11:05:57.590 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T11:05:57.590 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-25T11:05:57.590 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-25T11:05:57.591 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T11:05:57.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:05:57.607 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-04-25T11:05:57.664 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-437.el9.x86_64 2024-04-25T11:05:57.664 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.14.0-437.el9.x86_64 2024-04-25T11:05:57.664 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-04-25T11:06:00.394 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.0 MB 00:01 2024-04-25T11:06:05.052 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-04-25T11:06:09.436 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.2 MB 00:00 2024-04-25T11:06:11.053 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 16 kB 00:00 2024-04-25T11:06:12.696 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T11:06:17.787 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-04-25T11:06:19.685 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T11:06:19.685 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T11:06:19.777 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T11:06:19.778 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-04-25T11:06:19.778 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T11:06:19.897 DEBUG:teuthology.orchestra.run.smithi080:> echo no | sudo yum reinstall kernel || true 2024-04-25T11:06:20.399 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 11:06:17 AM UTC. 2024-04-25T11:06:20.523 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T11:06:20.533 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T11:06:20.534 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-25T11:06:20.534 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T11:06:20.534 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-25T11:06:20.534 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T11:06:20.534 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:06:20.534 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T11:06:20.534 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T11:06:20.535 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:06:20.535 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-25T11:06:20.535 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-25T11:06:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:Operation aborted. 2024-04-25T11:06:20.602 INFO:teuthology.orchestra.run.smithi080.stdout:Is this ok [y/N]: 2024-04-25T11:06:20.603 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum reinstall -y kernel || true 2024-04-25T11:06:21.095 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 11:06:17 AM UTC. 2024-04-25T11:06:21.210 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T11:06:21.211 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T11:06:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-25T11:06:21.211 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T11:06:21.211 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-25T11:06:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T11:06:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:06:21.212 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T11:06:21.212 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-25T11:06:21.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:06:21.212 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-25T11:06:21.212 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-25T11:06:21.212 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-25T11:06:21.522 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-04-25T11:06:21.523 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-25T11:06:21.523 INFO:teuthology.orchestra.run.smithi080.stdout:Total 820 kB/s | 255 kB 00:00 2024-04-25T11:06:21.542 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-25T11:06:21.717 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-25T11:06:21.717 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-25T11:06:21.722 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-25T11:06:21.722 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-25T11:06:21.852 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-25T11:06:21.940 INFO:teuthology.orchestra.run.smithi080.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T11:06:21.940 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T11:06:22.638 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T11:06:22.638 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T11:06:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T11:06:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:06:23.342 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalled: 2024-04-25T11:06:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T11:06:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:06:23.342 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T11:06:23.518 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T11:06:23.564 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T11:06:23.564 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T11:06:23.564 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T11:06:23.565 DEBUG:teuthology.parallel:result is None 2024-04-25T11:06:23.565 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T11:06:23.573 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T11:06:23.573 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T11:06:23.575 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T11:06:23.578 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T11:06:23.595 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T11:06:23.614 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T11:06:23.623 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T11:06:23.623 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T11:06:23.630 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T11:06:23.635 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T11:06:23.748 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T11:06:23.755 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T11:06:23.755 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T11:06:23.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:06:23.772 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T11:06:23.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:06:23.788 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T11:06:23.790 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T11:06:23.815 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T11:06:23.822 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T11:06:23.841 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T11:06:23.861 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T11:06:23.861 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T11:06:23.880 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T11:06:23.886 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T11:06:23.888 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T11:06:23.895 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T11:06:23.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T11:06:23.897 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T11:06:23.900 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T11:06:23.956 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T11:06:23.964 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T11:06:23.964 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T11:06:23.966 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T11:06:23.969 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T11:06:24.012 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T11:06:24.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T11:06:24.108 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T11:06:24.185 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T11:06:24.227 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:06:24.227 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T11:06:24.290 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T11:06:24.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T11:06:24.375 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T11:06:24.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T11:06:24.497 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:06:24.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T11:06:24.562 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T11:06:24.605 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T11:06:24.655 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T11:06:24.737 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T11:06:24.780 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:06:24.780 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T11:06:24.846 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-04-25T11:06:24.849 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-04-25T11:06:24.851 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-04-25T11:06:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T11:06:24.885 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T11:06:24.932 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T11:06:25.282 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T11:06:25.290 INFO:teuthology.task.internal:Starting timer... 2024-04-25T11:06:25.290 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T11:06:25.299 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T11:06:25.307 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T11:06:25.307 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-04-25T11:06:25.354 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-04-25T11:06:25.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-04-25T11:06:25.408 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-04-25T11:06:25.410 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-04-25T11:06:25.462 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-04-25T11:06:25.464 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T11:06:25.464 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-04-25T11:06:25.488 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-04-25T11:06:25.489 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-04-25T11:06:25.519 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-04-25T11:06:25.520 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-04-25T11:06:25.546 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-04-25T11:06:25.546 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-04-25T11:06:25.546 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T11:06:25.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:06:25.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T11:06:25.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:06:25.597 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T11:06:25.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:06:25.624 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T11:06:25.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-04-25T11:06:25.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-04-25T11:06:25.674 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-04-25T11:06:25.701 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T11:06:25.709 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T11:06:25.714 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T11:06:25.846 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T11:06:25.860 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T11:06:25.862 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi082.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T11:10:53.977 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-04-25T11:10:53.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-25T11:10:53.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T11:10:54.057 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-25T11:10:54.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-25T11:10:54.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-25T11:10:54.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T11:10:54.216 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-25T11:10:54.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-25T11:10:54.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-25T11:10:54.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T11:10:54.384 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-04-25T11:10:54.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-25T11:10:54.472 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T11:10:54.519 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T11:10:54.520 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T11:10:54.520 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:10:54.523 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T11:10:54.523 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:10:54.526 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T11:10:54.526 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:10:54.549 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T11:10:54.553 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T11:10:54.558 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T11:10:54.562 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T11:10:54.567 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T11:10:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T11:10:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-04-25T11:10:54.589 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-04-25T11:10:54.595 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-04-25T11:10:54.598 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-04-25T11:10:54.600 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-04-25T11:10:54.608 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T11:10:54.609 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-04-25T11:10:54.613 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T11:10:54.621 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T11:10:54.623 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T11:10:54.626 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T11:10:54.636 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T11:10:54.679 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-25T11:10:54.683 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T11:10:54.683 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-25T11:10:54.683 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.683 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.683 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.684 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-25T11:10:54.687 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T11:10:54.687 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-25T11:10:54.687 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.687 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.687 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.687 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.694 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-04-25T11:10:54.697 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T11:10:54.697 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-04-25T11:10:54.697 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.697 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.697 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.698 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:10:54.698 INFO:teuthology.run_tasks:Running task install... 2024-04-25T11:10:54.709 DEBUG:teuthology.task.install:project ceph 2024-04-25T11:10:54.709 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T11:10:54.710 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T11:10:54.710 INFO:teuthology.task.install:Using flavor: default 2024-04-25T11:10:54.719 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T11:10:54.719 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T11:10:54.720 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T11:10:54.720 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:10:54.723 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T11:10:54.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:10:54.724 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T11:10:54.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:10:54.873 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T11:10:54.873 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T11:10:54.876 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T11:10:54.876 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T11:10:54.946 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T11:10:54.946 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T11:10:54.984 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T11:10:54.984 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:10:54.984 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T11:10:54.998 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T11:10:54.999 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:10:54.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T11:10:55.023 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T11:10:55.023 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T11:10:55.041 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T11:10:55.042 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T11:10:55.087 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T11:10:55.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T11:10:55.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T11:10:55.119 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:10:55.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T11:10:55.144 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T11:10:55.145 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T11:10:55.159 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T11:10:55.184 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T11:10:55.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T11:10:55.223 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-04-25T11:10:55.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-04-25T11:10:55.246 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-04-25T11:10:55.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-04-25T11:10:55.283 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T11:10:55.346 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-04-25T11:10:55.347 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-04-25T11:10:55.447 INFO:teuthology.orchestra.run.smithi196.stdout:48 files removed 2024-04-25T11:10:55.472 INFO:teuthology.orchestra.run.smithi080.stdout:48 files removed 2024-04-25T11:10:55.475 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T11:10:55.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T11:10:55.570 INFO:teuthology.orchestra.run.smithi082.stdout:48 files removed 2024-04-25T11:10:55.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T11:10:56.154 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-04-25T11:10:56.224 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 180 kB/s | 84 kB 00:00 2024-04-25T11:10:56.326 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-04-25T11:10:56.538 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-04-25T11:10:56.559 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 40 kB/s | 12 kB 00:00 2024-04-25T11:10:56.668 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 39 kB/s | 12 kB 00:00 2024-04-25T11:10:56.913 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-04-25T11:10:57.009 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-25T11:10:57.119 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-25T11:10:57.505 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-25T11:10:57.692 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T11:10:58.261 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.0 MB 00:01 2024-04-25T11:10:59.299 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-25T11:10:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-25T11:11:01.595 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 19 MB 00:02 2024-04-25T11:11:04.254 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-04-25T11:11:05.645 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T11:11:05.672 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-04-25T11:11:07.090 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T11:11:08.090 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 6.2 MB 00:05 2024-04-25T11:11:09.047 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 7.2 kB/s | 16 kB 00:02 2024-04-25T11:11:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-04-25T11:11:11.098 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 8.7 kB/s | 16 kB 00:01 2024-04-25T11:11:12.198 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T11:11:14.333 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T11:11:14.333 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T11:11:14.344 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T11:11:14.345 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T11:11:14.346 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T11:11:14.347 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T11:11:14.348 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T11:11:14.351 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T11:11:14.351 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T11:11:14.414 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-25T11:11:14.423 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T11:11:14.423 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-04-25T11:11:14.423 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T11:11:14.424 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T11:11:14.425 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T11:11:14.426 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T11:11:14.427 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T11:11:14.428 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T11:11:14.429 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T11:11:14.430 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T11:11:14.431 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T11:11:14.432 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T11:11:14.433 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T11:11:14.434 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T11:11:14.435 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout:Install 148 Packages 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 4 Packages 2024-04-25T11:11:14.436 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:11:14.437 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 214 M 2024-04-25T11:11:14.437 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-25T11:11:15.032 INFO:teuthology.orchestra.run.smithi080.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-04-25T11:11:15.224 INFO:teuthology.orchestra.run.smithi080.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 4.4 MB/s | 863 kB 00:00 2024-04-25T11:11:15.291 INFO:teuthology.orchestra.run.smithi080.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 2.2 MB/s | 147 kB 00:00 2024-04-25T11:11:15.305 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-25T11:11:15.467 INFO:teuthology.orchestra.run.smithi080.stdout:(4/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 8.9 MB/s | 5.4 MB 00:00 2024-04-25T11:11:15.525 INFO:teuthology.orchestra.run.smithi080.stdout:(5/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 9.7 MB/s | 2.3 MB 00:00 2024-04-25T11:11:15.592 INFO:teuthology.orchestra.run.smithi080.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 12 MB/s | 1.5 MB 00:00 2024-04-25T11:11:16.051 INFO:teuthology.orchestra.run.smithi080.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 9.3 MB/s | 4.9 MB 00:00 2024-04-25T11:11:17.001 INFO:teuthology.orchestra.run.smithi080.stdout:(8/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x86 13 MB/s | 18 MB 00:01 2024-04-25T11:11:17.118 INFO:teuthology.orchestra.run.smithi080.stdout:(9/152): ceph-radosgw-19.0.0-3291.g994e2f20.el9 9.5 MB/s | 10 MB 00:01 2024-04-25T11:11:17.134 INFO:teuthology.orchestra.run.smithi080.stdout:(10/152): ceph-selinux-19.0.0-3291.g994e2f20.el 189 kB/s | 25 kB 00:00 2024-04-25T11:11:17.227 INFO:teuthology.orchestra.run.smithi080.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.4 MB/s | 224 kB 00:00 2024-04-25T11:11:17.294 INFO:teuthology.orchestra.run.smithi080.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 405 kB/s | 27 kB 00:00 2024-04-25T11:11:17.360 INFO:teuthology.orchestra.run.smithi080.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 477 kB/s | 32 kB 00:00 2024-04-25T11:11:17.439 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T11:11:17.439 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T11:11:17.450 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T11:11:17.451 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T11:11:17.451 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T11:11:17.452 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T11:11:17.452 INFO:teuthology.orchestra.run.smithi080.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 8.1 MB/s | 756 kB 00:00 2024-04-25T11:11:17.453 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T11:11:17.456 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T11:11:17.456 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T11:11:17.516 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-25T11:11:17.528 INFO:teuthology.orchestra.run.smithi080.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 2.0 MB/s | 158 kB 00:00 2024-04-25T11:11:17.536 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T11:11:17.537 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T11:11:17.538 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T11:11:17.539 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T11:11:17.540 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T11:11:17.541 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T11:11:17.542 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T11:11:17.543 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T11:11:17.544 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T11:11:17.545 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T11:11:17.546 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T11:11:17.547 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-25T11:11:17.548 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-04-25T11:11:17.549 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 4 Packages 2024-04-25T11:11:17.549 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:11:17.549 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 214 M 2024-04-25T11:11:17.549 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-25T11:11:17.595 INFO:teuthology.orchestra.run.smithi080.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.9 MB/s | 127 kB 00:00 2024-04-25T11:11:17.679 INFO:teuthology.orchestra.run.smithi080.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 5.8 MB/s | 497 kB 00:00 2024-04-25T11:11:18.163 INFO:teuthology.orchestra.run.smithi080.stdout:(18/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 11 MB/s | 5.2 MB 00:00 2024-04-25T11:11:18.231 INFO:teuthology.orchestra.run.smithi082.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-04-25T11:11:18.254 INFO:teuthology.orchestra.run.smithi080.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 493 kB/s | 45 kB 00:00 2024-04-25T11:11:18.321 INFO:teuthology.orchestra.run.smithi080.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 2.0 MB/s | 135 kB 00:00 2024-04-25T11:11:18.388 INFO:teuthology.orchestra.run.smithi080.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 2.4 MB/s | 161 kB 00:00 2024-04-25T11:11:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:(22/152): ceph-common-19.0.0-3291.g994e2f20.el9 5.3 MB/s | 20 MB 00:03 2024-04-25T11:11:18.606 INFO:teuthology.orchestra.run.smithi080.stdout:(23/152): python3-rados-19.0.0-3291.g994e2f20.e 1.4 MB/s | 321 kB 00:00 2024-04-25T11:11:18.673 INFO:teuthology.orchestra.run.smithi080.stdout:(24/152): python3-rbd-19.0.0-3291.g994e2f20.el9 3.2 MB/s | 298 kB 00:00 2024-04-25T11:11:18.689 INFO:teuthology.orchestra.run.smithi080.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.2 MB/s | 100 kB 00:00 2024-04-25T11:11:18.756 INFO:teuthology.orchestra.run.smithi080.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.0 MB/s | 86 kB 00:00 2024-04-25T11:11:18.997 INFO:teuthology.orchestra.run.smithi082.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 863 kB 00:00 2024-04-25T11:11:19.040 INFO:teuthology.orchestra.run.smithi080.stdout:(27/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 8.7 MB/s | 3.0 MB 00:00 2024-04-25T11:11:19.099 INFO:teuthology.orchestra.run.smithi080.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 588 kB/s | 34 kB 00:00 2024-04-25T11:11:19.131 INFO:teuthology.orchestra.run.smithi082.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 1.1 MB/s | 147 kB 00:00 2024-04-25T11:11:19.174 INFO:teuthology.orchestra.run.smithi080.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.9 MB/s | 142 kB 00:00 2024-04-25T11:11:19.624 INFO:teuthology.orchestra.run.smithi080.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 7.9 MB/s | 3.5 MB 00:00 2024-04-25T11:11:20.108 INFO:teuthology.orchestra.run.smithi080.stdout:(31/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 125 kB/s | 169 kB 00:01 2024-04-25T11:11:20.364 INFO:teuthology.orchestra.run.smithi082.stdout:(4/152): ceph-common-19.0.0-3291.g994e2f20.el9. 7.8 MB/s | 20 MB 00:02 2024-04-25T11:11:20.406 INFO:teuthology.orchestra.run.smithi082.stdout:(5/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 1.8 MB/s | 2.3 MB 00:01 2024-04-25T11:11:20.467 INFO:teuthology.orchestra.run.smithi080.stdout:(32/152): ceph-mgr-diskprediction-local-19.0.0- 8.8 MB/s | 7.4 MB 00:00 2024-04-25T11:11:20.525 INFO:teuthology.orchestra.run.smithi080.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 847 kB/s | 49 kB 00:00 2024-04-25T11:11:20.531 INFO:teuthology.orchestra.run.smithi082.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 9.0 MB/s | 1.5 MB 00:00 2024-04-25T11:11:20.550 INFO:teuthology.orchestra.run.smithi080.stdout:(34/152): ceph-mgr-modules-core-19.0.0-3291.g99 563 kB/s | 249 kB 00:00 2024-04-25T11:11:20.567 INFO:teuthology.orchestra.run.smithi080.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3291.g9 393 kB/s | 16 kB 00:00 2024-04-25T11:11:20.726 INFO:teuthology.orchestra.run.smithi080.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 4.7 MB/s | 762 kB 00:00 2024-04-25T11:11:20.810 INFO:teuthology.orchestra.run.smithi080.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 219 kB/s | 18 kB 00:00 2024-04-25T11:11:20.968 INFO:teuthology.orchestra.run.smithi080.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 508 kB/s | 80 kB 00:00 2024-04-25T11:11:21.019 INFO:teuthology.orchestra.run.smithi080.stdout:(39/152): ceph-volume-19.0.0-3291.g994e2f20.el9 583 kB/s | 273 kB 00:00 2024-04-25T11:11:21.390 INFO:teuthology.orchestra.run.smithi082.stdout:(7/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-04-25T11:11:21.423 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 2.1 MB/s | 21 MB 00:10 2024-04-25T11:11:21.457 INFO:teuthology.orchestra.run.smithi082.stdout:(8/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 4.6 MB/s | 4.9 MB 00:01 2024-04-25T11:11:21.502 INFO:teuthology.orchestra.run.smithi080.stdout:(40/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 9.9 MB/s | 43 MB 00:04 2024-04-25T11:11:21.524 INFO:teuthology.orchestra.run.smithi082.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 378 kB/s | 25 kB 00:00 2024-04-25T11:11:21.594 INFO:teuthology.orchestra.run.smithi080.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-04-25T11:11:21.619 INFO:teuthology.orchestra.run.smithi080.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 325 kB/s | 195 kB 00:00 2024-04-25T11:11:21.720 INFO:teuthology.orchestra.run.smithi080.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-04-25T11:11:21.778 INFO:teuthology.orchestra.run.smithi080.stdout:(44/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 919 kB/s | 253 kB 00:00 2024-04-25T11:11:21.820 INFO:teuthology.orchestra.run.smithi080.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-04-25T11:11:21.879 INFO:teuthology.orchestra.run.smithi080.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-04-25T11:11:21.954 INFO:teuthology.orchestra.run.smithi080.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-04-25T11:11:21.957 INFO:teuthology.orchestra.run.smithi082.stdout:(10/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 12 MB/s | 18 MB 00:01 2024-04-25T11:11:21.996 INFO:teuthology.orchestra.run.smithi080.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-04-25T11:11:22.049 INFO:teuthology.orchestra.run.smithi082.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.4 MB/s | 224 kB 00:00 2024-04-25T11:11:22.055 INFO:teuthology.orchestra.run.smithi080.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T11:11:22.122 INFO:teuthology.orchestra.run.smithi080.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 322 kB/s | 21 kB 00:00 2024-04-25T11:11:22.124 INFO:teuthology.orchestra.run.smithi082.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 360 kB/s | 27 kB 00:00 2024-04-25T11:11:22.200 INFO:teuthology.orchestra.run.smithi082.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 422 kB/s | 32 kB 00:00 2024-04-25T11:11:22.238 INFO:teuthology.orchestra.run.smithi080.stdout:(51/152): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-04-25T11:11:22.264 INFO:teuthology.orchestra.run.smithi080.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-04-25T11:11:22.316 INFO:teuthology.orchestra.run.smithi082.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 6.3 MB/s | 756 kB 00:00 2024-04-25T11:11:22.331 INFO:teuthology.orchestra.run.smithi080.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-04-25T11:11:22.356 INFO:teuthology.orchestra.run.smithi080.stdout:(54/152): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-04-25T11:11:22.398 INFO:teuthology.orchestra.run.smithi080.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-04-25T11:11:22.408 INFO:teuthology.orchestra.run.smithi082.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.7 MB/s | 158 kB 00:00 2024-04-25T11:11:22.423 INFO:teuthology.orchestra.run.smithi080.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-04-25T11:11:22.457 INFO:teuthology.orchestra.run.smithi080.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-25T11:11:22.490 INFO:teuthology.orchestra.run.smithi080.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-04-25T11:11:22.492 INFO:teuthology.orchestra.run.smithi082.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.5 MB/s | 127 kB 00:00 2024-04-25T11:11:22.601 INFO:teuthology.orchestra.run.smithi082.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 4.5 MB/s | 497 kB 00:00 2024-04-25T11:11:22.649 INFO:teuthology.orchestra.run.smithi080.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-04-25T11:11:22.674 INFO:teuthology.orchestra.run.smithi080.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 3.1 MB/s | 582 kB 00:00 2024-04-25T11:11:22.708 INFO:teuthology.orchestra.run.smithi080.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-04-25T11:11:22.741 INFO:teuthology.orchestra.run.smithi080.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-25T11:11:22.845 INFO:teuthology.orchestra.run.smithi080.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-04-25T11:11:22.867 INFO:teuthology.orchestra.run.smithi080.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-25T11:11:22.909 INFO:teuthology.orchestra.run.smithi080.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 550 kB/s | 35 kB 00:00 2024-04-25T11:11:23.143 INFO:teuthology.orchestra.run.smithi080.stdout:(66/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-04-25T11:11:23.176 INFO:teuthology.orchestra.run.smithi082.stdout:(18/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 9.0 MB/s | 5.2 MB 00:00 2024-04-25T11:11:23.284 INFO:teuthology.orchestra.run.smithi082.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 416 kB/s | 45 kB 00:00 2024-04-25T11:11:23.385 INFO:teuthology.orchestra.run.smithi082.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.3 MB/s | 135 kB 00:00 2024-04-25T11:11:23.476 INFO:teuthology.orchestra.run.smithi080.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 4.8 MB/s | 1.6 MB 00:00 2024-04-25T11:11:23.487 INFO:teuthology.orchestra.run.smithi082.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.5 MB/s | 161 kB 00:00 2024-04-25T11:11:23.630 INFO:teuthology.orchestra.run.smithi082.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 2.2 MB/s | 321 kB 00:00 2024-04-25T11:11:23.660 INFO:teuthology.orchestra.run.smithi080.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 4.9 MB/s | 911 kB 00:00 2024-04-25T11:11:23.719 INFO:teuthology.orchestra.run.smithi080.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-04-25T11:11:23.735 INFO:teuthology.orchestra.run.smithi080.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-25T11:11:23.755 INFO:teuthology.orchestra.run.smithi082.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 2.3 MB/s | 298 kB 00:00 2024-04-25T11:11:23.836 INFO:teuthology.orchestra.run.smithi080.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.9 MB/s | 4.7 MB 00:00 2024-04-25T11:11:23.880 INFO:teuthology.orchestra.run.smithi082.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 798 kB/s | 100 kB 00:00 2024-04-25T11:11:23.911 INFO:teuthology.orchestra.run.smithi080.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-04-25T11:11:23.970 INFO:teuthology.orchestra.run.smithi080.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-04-25T11:11:23.997 INFO:teuthology.orchestra.run.smithi082.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 739 kB/s | 86 kB 00:00 2024-04-25T11:11:24.062 INFO:teuthology.orchestra.run.smithi080.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-25T11:11:24.162 INFO:teuthology.orchestra.run.smithi080.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-25T11:11:24.270 INFO:teuthology.orchestra.run.smithi080.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-04-25T11:11:24.362 INFO:teuthology.orchestra.run.smithi080.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 209 kB/s | 19 kB 00:00 2024-04-25T11:11:24.389 INFO:teuthology.orchestra.run.smithi082.stdout:(26/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 15 MB/s | 43 MB 00:02 2024-04-25T11:11:24.429 INFO:teuthology.orchestra.run.smithi080.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-25T11:11:24.464 INFO:teuthology.orchestra.run.smithi082.stdout:(27/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 6.5 MB/s | 3.0 MB 00:00 2024-04-25T11:11:24.490 INFO:teuthology.orchestra.run.smithi082.stdout:(28/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.7 MB/s | 169 kB 00:00 2024-04-25T11:11:24.496 INFO:teuthology.orchestra.run.smithi080.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 521 kB/s | 35 kB 00:00 2024-04-25T11:11:24.540 INFO:teuthology.orchestra.run.smithi082.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3291.g 455 kB/s | 34 kB 00:00 2024-04-25T11:11:24.565 INFO:teuthology.orchestra.run.smithi082.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.8 MB/s | 142 kB 00:00 2024-04-25T11:11:24.713 INFO:teuthology.orchestra.run.smithi080.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 5.8 MB/s | 5.8 MB 00:00 2024-04-25T11:11:24.797 INFO:teuthology.orchestra.run.smithi080.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-25T11:11:24.872 INFO:teuthology.orchestra.run.smithi080.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-25T11:11:25.014 INFO:teuthology.orchestra.run.smithi080.stdout:(83/152): python3-babel-2.9.1-2.el9.noarch.rpm 5.4 MB/s | 6.0 MB 00:01 2024-04-25T11:11:25.081 INFO:teuthology.orchestra.run.smithi080.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 635 kB/s | 42 kB 00:00 2024-04-25T11:11:25.082 INFO:teuthology.orchestra.run.smithi082.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-04-25T11:11:25.123 INFO:teuthology.orchestra.run.smithi080.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 308 kB/s | 77 kB 00:00 2024-04-25T11:11:25.140 INFO:teuthology.orchestra.run.smithi082.stdout:(32/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 5.9 MB/s | 3.5 MB 00:00 2024-04-25T11:11:25.148 INFO:teuthology.orchestra.run.smithi080.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-25T11:11:25.166 INFO:teuthology.orchestra.run.smithi082.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3291.g99 2.9 MB/s | 249 kB 00:00 2024-04-25T11:11:25.207 INFO:teuthology.orchestra.run.smithi080.stdout:(87/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.2 MB/s | 5.1 MB 00:00 2024-04-25T11:11:25.216 INFO:teuthology.orchestra.run.smithi082.stdout:(34/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 655 kB/s | 49 kB 00:00 2024-04-25T11:11:25.232 INFO:teuthology.orchestra.run.smithi080.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-04-25T11:11:25.241 INFO:teuthology.orchestra.run.smithi082.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3291.g9 219 kB/s | 16 kB 00:00 2024-04-25T11:11:25.266 INFO:teuthology.orchestra.run.smithi080.stdout:(89/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-04-25T11:11:25.283 INFO:teuthology.orchestra.run.smithi082.stdout:(36/152): ceph-volume-19.0.0-3291.g994e2f20.el9 4.0 MB/s | 273 kB 00:00 2024-04-25T11:11:25.291 INFO:teuthology.orchestra.run.smithi080.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-04-25T11:11:25.316 INFO:teuthology.orchestra.run.smithi080.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 641 kB/s | 54 kB 00:00 2024-04-25T11:11:25.342 INFO:teuthology.orchestra.run.smithi082.stdout:(37/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 7.4 MB/s | 762 kB 00:00 2024-04-25T11:11:25.367 INFO:teuthology.orchestra.run.smithi082.stdout:(38/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 218 kB/s | 18 kB 00:00 2024-04-25T11:11:25.375 INFO:teuthology.orchestra.run.smithi080.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 763 kB/s | 44 kB 00:00 2024-04-25T11:11:25.401 INFO:teuthology.orchestra.run.smithi080.stdout:(93/152): python3-toml-0.10.2-6.el9.noarch.rpm 499 kB/s | 42 kB 00:00 2024-04-25T11:11:25.426 INFO:teuthology.orchestra.run.smithi082.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 965 kB/s | 80 kB 00:00 2024-04-25T11:11:25.442 INFO:teuthology.orchestra.run.smithi080.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-25T11:11:25.468 INFO:teuthology.orchestra.run.smithi080.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 535 kB/s | 36 kB 00:00 2024-04-25T11:11:25.484 INFO:teuthology.orchestra.run.smithi082.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-04-25T11:11:25.501 INFO:teuthology.orchestra.run.smithi080.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-04-25T11:11:25.518 INFO:teuthology.orchestra.run.smithi082.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-25T11:11:25.526 INFO:teuthology.orchestra.run.smithi080.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T11:11:25.560 INFO:teuthology.orchestra.run.smithi080.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-04-25T11:11:25.568 INFO:teuthology.orchestra.run.smithi082.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-25T11:11:25.585 INFO:teuthology.orchestra.run.smithi080.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T11:11:25.627 INFO:teuthology.orchestra.run.smithi080.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 955 kB/s | 64 kB 00:00 2024-04-25T11:11:25.635 INFO:teuthology.orchestra.run.smithi082.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T11:11:25.653 INFO:teuthology.orchestra.run.smithi080.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-04-25T11:11:25.677 INFO:teuthology.orchestra.run.smithi082.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-04-25T11:11:25.686 INFO:teuthology.orchestra.run.smithi080.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 379 kB/s | 22 kB 00:00 2024-04-25T11:11:25.736 INFO:teuthology.orchestra.run.smithi082.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-04-25T11:11:25.761 INFO:teuthology.orchestra.run.smithi082.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-25T11:11:25.778 INFO:teuthology.orchestra.run.smithi080.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-04-25T11:11:25.828 INFO:teuthology.orchestra.run.smithi082.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-25T11:11:26.028 INFO:teuthology.orchestra.run.smithi082.stdout:(48/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 2.2 MB/s | 10 MB 00:04 2024-04-25T11:11:26.237 INFO:teuthology.orchestra.run.smithi082.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 513 kB/s | 107 kB 00:00 2024-04-25T11:11:26.287 INFO:teuthology.orchestra.run.smithi082.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 689 kB 00:00 2024-04-25T11:11:26.313 INFO:teuthology.orchestra.run.smithi082.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 285 kB/s | 21 kB 00:00 2024-04-25T11:11:26.337 INFO:teuthology.orchestra.run.smithi080.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 843 kB/s | 548 kB 00:00 2024-04-25T11:11:26.362 INFO:teuthology.orchestra.run.smithi080.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 529 kB/s | 309 kB 00:00 2024-04-25T11:11:26.371 INFO:teuthology.orchestra.run.smithi082.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-04-25T11:11:26.381 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T11:11:26.413 INFO:teuthology.orchestra.run.smithi082.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-04-25T11:11:26.437 INFO:teuthology.orchestra.run.smithi080.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-25T11:11:26.472 INFO:teuthology.orchestra.run.smithi082.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 314 kB/s | 18 kB 00:00 2024-04-25T11:11:26.505 INFO:teuthology.orchestra.run.smithi082.stdout:(55/152): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-04-25T11:11:26.529 INFO:teuthology.orchestra.run.smithi080.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-04-25T11:11:26.530 INFO:teuthology.orchestra.run.smithi082.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-04-25T11:11:26.589 INFO:teuthology.orchestra.run.smithi082.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-04-25T11:11:26.614 INFO:teuthology.orchestra.run.smithi082.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-25T11:11:26.621 INFO:teuthology.orchestra.run.smithi080.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-04-25T11:11:26.730 INFO:teuthology.orchestra.run.smithi080.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 623 kB/s | 67 kB 00:00 2024-04-25T11:11:26.806 INFO:teuthology.orchestra.run.smithi082.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-04-25T11:11:26.813 INFO:teuthology.orchestra.run.smithi080.stdout:(110/152): libarrow-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-04-25T11:11:26.839 INFO:teuthology.orchestra.run.smithi080.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-04-25T11:11:26.839 INFO:teuthology.orchestra.run.smithi082.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 2.5 MB/s | 582 kB 00:00 2024-04-25T11:11:26.865 INFO:teuthology.orchestra.run.smithi082.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-04-25T11:11:26.899 INFO:teuthology.orchestra.run.smithi082.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-04-25T11:11:26.923 INFO:teuthology.orchestra.run.smithi080.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 838 kB 00:00 2024-04-25T11:11:26.957 INFO:teuthology.orchestra.run.smithi082.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-25T11:11:26.989 INFO:teuthology.orchestra.run.smithi080.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-04-25T11:11:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-25T11:11:27.016 INFO:teuthology.orchestra.run.smithi082.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-04-25T11:11:27.023 INFO:teuthology.orchestra.run.smithi080.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-04-25T11:11:27.090 INFO:teuthology.orchestra.run.smithi080.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-04-25T11:11:27.124 INFO:teuthology.orchestra.run.smithi080.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-25T11:11:27.207 INFO:teuthology.orchestra.run.smithi080.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-25T11:11:27.232 INFO:teuthology.orchestra.run.smithi080.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-25T11:11:27.267 INFO:teuthology.orchestra.run.smithi082.stdout:(66/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-04-25T11:11:27.416 INFO:teuthology.orchestra.run.smithi080.stdout:(119/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.6 MB/s | 16 MB 00:02 2024-04-25T11:11:27.467 INFO:teuthology.orchestra.run.smithi080.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 151 kB/s | 35 kB 00:00 2024-04-25T11:11:27.492 INFO:teuthology.orchestra.run.smithi080.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.0 MB/s | 303 kB 00:00 2024-04-25T11:11:27.550 INFO:teuthology.orchestra.run.smithi082.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-04-25T11:11:27.626 INFO:teuthology.orchestra.run.smithi080.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-04-25T11:11:27.651 INFO:teuthology.orchestra.run.smithi080.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 912 kB/s | 144 kB 00:00 2024-04-25T11:11:27.726 INFO:teuthology.orchestra.run.smithi080.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-04-25T11:11:27.751 INFO:teuthology.orchestra.run.smithi080.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-04-25T11:11:27.759 INFO:teuthology.orchestra.run.smithi082.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-04-25T11:11:27.792 INFO:teuthology.orchestra.run.smithi082.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-04-25T11:11:27.827 INFO:teuthology.orchestra.run.smithi080.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-04-25T11:11:27.853 INFO:teuthology.orchestra.run.smithi080.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-04-25T11:11:27.859 INFO:teuthology.orchestra.run.smithi082.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 5.5 MB/s | 4.7 MB 00:00 2024-04-25T11:11:27.901 INFO:teuthology.orchestra.run.smithi082.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 939 kB/s | 133 kB 00:00 2024-04-25T11:11:27.911 INFO:teuthology.orchestra.run.smithi080.stdout:(128/152): python3-google-auth-2.29.0-1.el9.noa 416 kB/s | 206 kB 00:00 2024-04-25T11:11:27.936 INFO:teuthology.orchestra.run.smithi080.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-04-25T11:11:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-25T11:11:28.018 INFO:teuthology.orchestra.run.smithi082.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-04-25T11:11:28.019 INFO:teuthology.orchestra.run.smithi080.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2024-04-25T11:11:28.045 INFO:teuthology.orchestra.run.smithi080.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-04-25T11:11:28.085 INFO:teuthology.orchestra.run.smithi082.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-25T11:11:28.087 INFO:teuthology.orchestra.run.smithi080.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-04-25T11:11:28.137 INFO:teuthology.orchestra.run.smithi080.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 492 kB/s | 58 kB 00:00 2024-04-25T11:11:28.162 INFO:teuthology.orchestra.run.smithi080.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-25T11:11:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-04-25T11:11:28.187 INFO:teuthology.orchestra.run.smithi080.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-04-25T11:11:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 424 kB/s | 26 kB 00:00 2024-04-25T11:11:28.263 INFO:teuthology.orchestra.run.smithi080.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 717 kB/s | 90 kB 00:00 2024-04-25T11:11:28.285 INFO:teuthology.orchestra.run.smithi082.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-04-25T11:11:28.288 INFO:teuthology.orchestra.run.smithi080.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-04-25T11:11:28.313 INFO:teuthology.orchestra.run.smithi080.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 245 kB/s | 31 kB 00:00 2024-04-25T11:11:28.354 INFO:teuthology.orchestra.run.smithi082.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-25T11:11:28.411 INFO:teuthology.orchestra.run.smithi082.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-04-25T11:11:28.413 INFO:teuthology.orchestra.run.smithi080.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 592 kB/s | 59 kB 00:00 2024-04-25T11:11:28.439 INFO:teuthology.orchestra.run.smithi080.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-04-25T11:11:28.456 INFO:teuthology.orchestra.run.smithi080.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 252 kB/s | 36 kB 00:00 2024-04-25T11:11:28.487 INFO:teuthology.orchestra.run.smithi082.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 8.3 MB/s | 5.8 MB 00:00 2024-04-25T11:11:28.514 INFO:teuthology.orchestra.run.smithi080.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-04-25T11:11:28.532 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T11:11:28.533 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T11:11:28.544 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T11:11:28.545 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T11:11:28.545 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T11:11:28.546 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T11:11:28.548 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T11:11:28.548 INFO:teuthology.orchestra.run.smithi080.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 976 kB/s | 90 kB 00:00 2024-04-25T11:11:28.550 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T11:11:28.551 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T11:11:28.590 INFO:teuthology.orchestra.run.smithi080.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-25T11:11:28.610 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-04-25T11:11:28.623 INFO:teuthology.orchestra.run.smithi080.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-25T11:11:28.625 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-25T11:11:28.625 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-04-25T11:11:28.625 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-25T11:11:28.625 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-04-25T11:11:28.625 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T11:11:28.625 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T11:11:28.625 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T11:11:28.626 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T11:11:28.627 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T11:11:28.628 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T11:11:28.629 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T11:11:28.630 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T11:11:28.631 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T11:11:28.632 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T11:11:28.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T11:11:28.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T11:11:28.635 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T11:11:28.636 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout:Install 148 Packages 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 4 Packages 2024-04-25T11:11:28.637 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:11:28.638 INFO:teuthology.orchestra.run.smithi082.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 8.9 MB/s | 6.0 MB 00:00 2024-04-25T11:11:28.638 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 214 M 2024-04-25T11:11:28.638 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-04-25T11:11:28.640 INFO:teuthology.orchestra.run.smithi080.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-25T11:11:28.662 INFO:teuthology.orchestra.run.smithi082.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-04-25T11:11:28.696 INFO:teuthology.orchestra.run.smithi082.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-25T11:11:28.722 INFO:teuthology.orchestra.run.smithi082.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-25T11:11:28.724 INFO:teuthology.orchestra.run.smithi080.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-25T11:11:28.755 INFO:teuthology.orchestra.run.smithi082.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-04-25T11:11:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-04-25T11:11:28.782 INFO:teuthology.orchestra.run.smithi080.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-25T11:11:28.805 INFO:teuthology.orchestra.run.smithi082.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T11:11:28.847 INFO:teuthology.orchestra.run.smithi082.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-25T11:11:28.873 INFO:teuthology.orchestra.run.smithi082.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-04-25T11:11:28.906 INFO:teuthology.orchestra.run.smithi082.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 916 kB/s | 54 kB 00:00 2024-04-25T11:11:28.981 INFO:teuthology.orchestra.run.smithi082.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.9 MB/s | 5.1 MB 00:00 2024-04-25T11:11:29.000 INFO:teuthology.orchestra.run.smithi080.stdout:(149/152): librados2-19.0.0-3291.g994e2f20.el9. 9.3 MB/s | 3.3 MB 00:00 2024-04-25T11:11:29.006 INFO:teuthology.orchestra.run.smithi082.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-04-25T11:11:29.090 INFO:teuthology.orchestra.run.smithi082.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-04-25T11:11:29.100 INFO:teuthology.orchestra.run.smithi080.stdout:(150/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 8.2 MB/s | 3.1 MB 00:00 2024-04-25T11:11:29.157 INFO:teuthology.orchestra.run.smithi082.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-04-25T11:11:29.167 INFO:teuthology.orchestra.run.smithi080.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 3.5 MB/s | 1.3 MB 00:00 2024-04-25T11:11:29.182 INFO:teuthology.orchestra.run.smithi082.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 390 kB/s | 36 kB 00:00 2024-04-25T11:11:29.216 INFO:teuthology.orchestra.run.smithi082.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-04-25T11:11:29.250 INFO:teuthology.orchestra.run.smithi082.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 305 kB 00:00 2024-04-25T11:11:29.275 INFO:teuthology.orchestra.run.smithi082.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-04-25T11:11:29.309 INFO:teuthology.orchestra.run.smithi082.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T11:11:29.334 INFO:teuthology.orchestra.run.smithi082.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T11:11:29.368 INFO:teuthology.orchestra.run.smithi082.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-04-25T11:11:29.393 INFO:teuthology.orchestra.run.smithi082.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-04-25T11:11:29.442 INFO:teuthology.orchestra.run.smithi080.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 2.4 MB 00:00 2024-04-25T11:11:29.445 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-25T11:11:29.445 INFO:teuthology.orchestra.run.smithi080.stdout:Total 14 MB/s | 214 MB 00:15 2024-04-25T11:11:29.468 INFO:teuthology.orchestra.run.smithi082.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-04-25T11:11:29.627 INFO:teuthology.orchestra.run.smithi082.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-04-25T11:11:29.660 INFO:teuthology.orchestra.run.smithi082.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.6 MB/s | 309 kB 00:00 2024-04-25T11:11:29.686 INFO:teuthology.orchestra.run.smithi082.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-04-25T11:11:29.749 INFO:teuthology.orchestra.run.smithi196.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-04-25T11:11:29.844 INFO:teuthology.orchestra.run.smithi082.stdout:(107/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-25T11:11:29.869 INFO:teuthology.orchestra.run.smithi082.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 142 kB/s | 26 kB 00:00 2024-04-25T11:11:29.912 INFO:teuthology.orchestra.run.smithi082.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-04-25T11:11:29.945 INFO:teuthology.orchestra.run.smithi082.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-04-25T11:11:29.971 INFO:teuthology.orchestra.run.smithi082.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-25T11:11:30.057 INFO:teuthology.orchestra.run.smithi196.stdout:(2/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 10 MB/s | 5.4 MB 00:00 2024-04-25T11:11:30.071 INFO:teuthology.orchestra.run.smithi082.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2024-04-25T11:11:30.099 INFO:teuthology.orchestra.run.smithi196.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 3.5 MB/s | 147 kB 00:00 2024-04-25T11:11:30.113 INFO:teuthology.orchestra.run.smithi082.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-04-25T11:11:30.138 INFO:teuthology.orchestra.run.smithi082.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 652 kB/s | 43 kB 00:00 2024-04-25T11:11:30.163 INFO:teuthology.orchestra.run.smithi082.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-04-25T11:11:30.189 INFO:teuthology.orchestra.run.smithi082.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 297 kB/s | 15 kB 00:00 2024-04-25T11:11:30.231 INFO:teuthology.orchestra.run.smithi082.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-25T11:11:30.256 INFO:teuthology.orchestra.run.smithi082.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-04-25T11:11:30.257 INFO:teuthology.orchestra.run.smithi196.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 14 MB/s | 2.3 MB 00:00 2024-04-25T11:11:30.298 INFO:teuthology.orchestra.run.smithi082.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 847 kB/s | 35 kB 00:00 2024-04-25T11:11:30.323 INFO:teuthology.orchestra.run.smithi082.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-25T11:11:30.349 INFO:teuthology.orchestra.run.smithi082.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-04-25T11:11:30.374 INFO:teuthology.orchestra.run.smithi196.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 14 MB/s | 1.5 MB 00:00 2024-04-25T11:11:30.394 INFO:teuthology.orchestra.run.smithi196.stdout:(6/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.3 MB/s | 863 kB 00:00 2024-04-25T11:11:30.407 INFO:teuthology.orchestra.run.smithi082.stdout:(122/152): libarrow-9.0.0-10.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-04-25T11:11:30.432 INFO:teuthology.orchestra.run.smithi082.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-25T11:11:30.449 INFO:teuthology.orchestra.run.smithi082.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-04-25T11:11:30.466 INFO:teuthology.orchestra.run.smithi082.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 529 kB/s | 18 kB 00:00 2024-04-25T11:11:30.483 INFO:teuthology.orchestra.run.smithi082.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 690 kB/s | 23 kB 00:00 2024-04-25T11:11:30.500 INFO:teuthology.orchestra.run.smithi082.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-04-25T11:11:30.517 INFO:teuthology.orchestra.run.smithi082.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-04-25T11:11:30.538 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-25T11:11:30.559 INFO:teuthology.orchestra.run.smithi082.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-04-25T11:11:30.609 INFO:teuthology.orchestra.run.smithi082.stdout:(130/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-25T11:11:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-04-25T11:11:30.668 INFO:teuthology.orchestra.run.smithi082.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-04-25T11:11:30.677 INFO:teuthology.orchestra.run.smithi196.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 16 MB/s | 4.9 MB 00:00 2024-04-25T11:11:30.679 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-25T11:11:30.680 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-25T11:11:30.718 INFO:teuthology.orchestra.run.smithi082.stdout:(133/152): python3-grpcio-1.46.7-10.el9.x86_64. 5.2 MB/s | 2.0 MB 00:00 2024-04-25T11:11:30.744 INFO:teuthology.orchestra.run.smithi082.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-25T11:11:30.769 INFO:teuthology.orchestra.run.smithi082.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-04-25T11:11:30.794 INFO:teuthology.orchestra.run.smithi082.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-04-25T11:11:30.819 INFO:teuthology.orchestra.run.smithi082.stdout:(137/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-25T11:11:30.844 INFO:teuthology.orchestra.run.smithi082.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-04-25T11:11:30.870 INFO:teuthology.orchestra.run.smithi082.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T11:11:30.895 INFO:teuthology.orchestra.run.smithi082.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-04-25T11:11:30.921 INFO:teuthology.orchestra.run.smithi082.stdout:(141/152): python3-rsa-4.9-2.el9.noarch.rpm 781 kB/s | 59 kB 00:00 2024-04-25T11:11:30.938 INFO:teuthology.orchestra.run.smithi082.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 757 kB/s | 51 kB 00:00 2024-04-25T11:11:30.963 INFO:teuthology.orchestra.run.smithi082.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-04-25T11:11:30.988 INFO:teuthology.orchestra.run.smithi082.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-04-25T11:11:31.013 INFO:teuthology.orchestra.run.smithi082.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-25T11:11:31.030 INFO:teuthology.orchestra.run.smithi082.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-04-25T11:11:31.055 INFO:teuthology.orchestra.run.smithi082.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-25T11:11:31.139 INFO:teuthology.orchestra.run.smithi082.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-25T11:11:31.247 INFO:teuthology.orchestra.run.smithi082.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-25T11:11:31.327 INFO:teuthology.orchestra.run.smithi196.stdout:(8/152): ceph-radosgw-19.0.0-3291.g994e2f20.el9 16 MB/s | 10 MB 00:00 2024-04-25T11:11:31.369 INFO:teuthology.orchestra.run.smithi196.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 607 kB/s | 25 kB 00:00 2024-04-25T11:11:31.381 INFO:teuthology.orchestra.run.smithi082.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-04-25T11:11:31.865 INFO:teuthology.orchestra.run.smithi082.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 4.0 MB/s | 3.3 MB 00:00 2024-04-25T11:11:32.278 INFO:teuthology.orchestra.run.smithi196.stdout:(10/152): ceph-common-19.0.0-3291.g994e2f20.el9 7.1 MB/s | 20 MB 00:02 2024-04-25T11:11:32.353 INFO:teuthology.orchestra.run.smithi196.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.9 MB/s | 224 kB 00:00 2024-04-25T11:11:32.397 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-25T11:11:32.397 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-25T11:11:32.420 INFO:teuthology.orchestra.run.smithi196.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 406 kB/s | 27 kB 00:00 2024-04-25T11:11:32.487 INFO:teuthology.orchestra.run.smithi196.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 475 kB/s | 32 kB 00:00 2024-04-25T11:11:32.556 INFO:teuthology.orchestra.run.smithi082.stdout:(152/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 2.1 MB/s | 3.1 MB 00:01 2024-04-25T11:11:32.561 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-25T11:11:32.561 INFO:teuthology.orchestra.run.smithi082.stdout:Total 14 MB/s | 214 MB 00:15 2024-04-25T11:11:32.612 INFO:teuthology.orchestra.run.smithi196.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 5.9 MB/s | 756 kB 00:00 2024-04-25T11:11:32.729 INFO:teuthology.orchestra.run.smithi196.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.3 MB/s | 158 kB 00:00 2024-04-25T11:11:32.813 INFO:teuthology.orchestra.run.smithi196.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.5 MB/s | 127 kB 00:00 2024-04-25T11:11:32.905 INFO:teuthology.orchestra.run.smithi196.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 5.3 MB/s | 497 kB 00:00 2024-04-25T11:11:33.388 INFO:teuthology.orchestra.run.smithi196.stdout:(18/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 11 MB/s | 5.2 MB 00:00 2024-04-25T11:11:33.513 INFO:teuthology.orchestra.run.smithi196.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 362 kB/s | 45 kB 00:00 2024-04-25T11:11:33.589 INFO:teuthology.orchestra.run.smithi196.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.7 MB/s | 135 kB 00:00 2024-04-25T11:11:33.665 INFO:teuthology.orchestra.run.smithi196.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 2.1 MB/s | 161 kB 00:00 2024-04-25T11:11:33.670 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-25T11:11:33.765 INFO:teuthology.orchestra.run.smithi196.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 3.1 MB/s | 321 kB 00:00 2024-04-25T11:11:33.815 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-25T11:11:33.815 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-25T11:11:33.873 INFO:teuthology.orchestra.run.smithi196.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 2.7 MB/s | 298 kB 00:00 2024-04-25T11:11:33.940 INFO:teuthology.orchestra.run.smithi196.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.5 MB/s | 100 kB 00:00 2024-04-25T11:11:34.007 INFO:teuthology.orchestra.run.smithi196.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.3 MB/s | 86 kB 00:00 2024-04-25T11:11:34.341 INFO:teuthology.orchestra.run.smithi196.stdout:(26/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 9.1 MB/s | 3.0 MB 00:00 2024-04-25T11:11:34.442 INFO:teuthology.orchestra.run.smithi196.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.7 MB/s | 169 kB 00:00 2024-04-25T11:11:34.525 INFO:teuthology.orchestra.run.smithi196.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 411 kB/s | 34 kB 00:00 2024-04-25T11:11:34.608 INFO:teuthology.orchestra.run.smithi196.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.7 MB/s | 142 kB 00:00 2024-04-25T11:11:34.959 INFO:teuthology.orchestra.run.smithi196.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 10 MB/s | 3.5 MB 00:00 2024-04-25T11:11:35.342 INFO:teuthology.orchestra.run.smithi196.stdout:(31/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 11 MB/s | 43 MB 00:03 2024-04-25T11:11:35.409 INFO:teuthology.orchestra.run.smithi196.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 3.7 MB/s | 249 kB 00:00 2024-04-25T11:11:35.451 INFO:teuthology.orchestra.run.smithi196.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 1.2 MB/s | 49 kB 00:00 2024-04-25T11:11:35.493 INFO:teuthology.orchestra.run.smithi196.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 395 kB/s | 16 kB 00:00 2024-04-25T11:11:35.540 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-25T11:11:35.540 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-25T11:11:35.543 INFO:teuthology.orchestra.run.smithi196.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 5.3 MB/s | 273 kB 00:00 2024-04-25T11:11:35.660 INFO:teuthology.orchestra.run.smithi196.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 6.4 MB/s | 762 kB 00:00 2024-04-25T11:11:35.702 INFO:teuthology.orchestra.run.smithi196.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 439 kB/s | 18 kB 00:00 2024-04-25T11:11:35.886 INFO:teuthology.orchestra.run.smithi196.stdout:(38/152): ceph-mgr-diskprediction-local-19.0.0- 8.0 MB/s | 7.4 MB 00:00 2024-04-25T11:11:35.911 INFO:teuthology.orchestra.run.smithi196.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 385 kB/s | 80 kB 00:00 2024-04-25T11:11:36.020 INFO:teuthology.orchestra.run.smithi196.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-25T11:11:36.130 INFO:teuthology.orchestra.run.smithi196.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-04-25T11:11:36.412 INFO:teuthology.orchestra.run.smithi196.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-04-25T11:11:36.504 INFO:teuthology.orchestra.run.smithi196.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-04-25T11:11:36.529 INFO:teuthology.orchestra.run.smithi196.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-04-25T11:11:36.555 INFO:teuthology.orchestra.run.smithi196.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T11:11:36.605 INFO:teuthology.orchestra.run.smithi196.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-25T11:11:36.638 INFO:teuthology.orchestra.run.smithi196.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-25T11:11:36.822 INFO:teuthology.orchestra.run.smithi196.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-04-25T11:11:36.947 INFO:teuthology.orchestra.run.smithi196.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 856 kB/s | 107 kB 00:00 2024-04-25T11:11:36.981 INFO:teuthology.orchestra.run.smithi196.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-04-25T11:11:37.015 INFO:teuthology.orchestra.run.smithi196.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 321 kB/s | 21 kB 00:00 2024-04-25T11:11:37.090 INFO:teuthology.orchestra.run.smithi196.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 437 kB/s | 33 kB 00:00 2024-04-25T11:11:37.182 INFO:teuthology.orchestra.run.smithi196.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-04-25T11:11:37.232 INFO:teuthology.orchestra.run.smithi196.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-25T11:11:37.291 INFO:teuthology.orchestra.run.smithi196.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-04-25T11:11:37.383 INFO:teuthology.orchestra.run.smithi196.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-04-25T11:11:37.433 INFO:teuthology.orchestra.run.smithi196.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 910 kB/s | 45 kB 00:00 2024-04-25T11:11:37.491 INFO:teuthology.orchestra.run.smithi196.stdout:(58/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-04-25T11:11:37.659 INFO:teuthology.orchestra.run.smithi196.stdout:(59/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 2.4 MB/s | 18 MB 00:07 2024-04-25T11:11:37.701 INFO:teuthology.orchestra.run.smithi196.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 2.7 MB/s | 582 kB 00:00 2024-04-25T11:11:37.726 INFO:teuthology.orchestra.run.smithi196.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-04-25T11:11:37.760 INFO:teuthology.orchestra.run.smithi196.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-04-25T11:11:37.785 INFO:teuthology.orchestra.run.smithi196.stdout:(63/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 202 kB/s | 25 kB 00:00 2024-04-25T11:11:37.810 INFO:teuthology.orchestra.run.smithi196.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T11:11:37.835 INFO:teuthology.orchestra.run.smithi196.stdout:(65/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-25T11:11:37.861 INFO:teuthology.orchestra.run.smithi196.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-04-25T11:11:38.153 INFO:teuthology.orchestra.run.smithi196.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-04-25T11:11:38.228 INFO:teuthology.orchestra.run.smithi196.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-25T11:11:38.261 INFO:teuthology.orchestra.run.smithi196.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-04-25T11:11:38.287 INFO:teuthology.orchestra.run.smithi196.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T11:11:38.379 INFO:teuthology.orchestra.run.smithi196.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-04-25T11:11:38.437 INFO:teuthology.orchestra.run.smithi196.stdout:(72/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-04-25T11:11:38.463 INFO:teuthology.orchestra.run.smithi196.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-04-25T11:11:38.513 INFO:teuthology.orchestra.run.smithi196.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-04-25T11:11:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-25T11:11:38.563 INFO:teuthology.orchestra.run.smithi196.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T11:11:38.622 INFO:teuthology.orchestra.run.smithi196.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-04-25T11:11:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T11:11:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T11:11:38.672 INFO:teuthology.orchestra.run.smithi196.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 385 kB/s | 19 kB 00:00 2024-04-25T11:11:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T11:11:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T11:11:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T11:11:38.797 INFO:teuthology.orchestra.run.smithi196.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-25T11:11:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T11:11:38.839 INFO:teuthology.orchestra.run.smithi196.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-04-25T11:11:39.039 INFO:teuthology.orchestra.run.smithi196.stdout:(80/152): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-04-25T11:11:39.115 INFO:teuthology.orchestra.run.smithi196.stdout:(81/152): postgresql-server-13.14-1.el9.x86_64. 6.8 MB/s | 5.8 MB 00:00 2024-04-25T11:11:39.140 INFO:teuthology.orchestra.run.smithi196.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-25T11:11:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T11:11:39.166 INFO:teuthology.orchestra.run.smithi196.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-04-25T11:11:39.191 INFO:teuthology.orchestra.run.smithi196.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T11:11:39.216 INFO:teuthology.orchestra.run.smithi196.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-04-25T11:11:39.241 INFO:teuthology.orchestra.run.smithi196.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-25T11:11:39.266 INFO:teuthology.orchestra.run.smithi196.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T11:11:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:11:39.292 INFO:teuthology.orchestra.run.smithi196.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-25T11:11:39.317 INFO:teuthology.orchestra.run.smithi196.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T11:11:39.342 INFO:teuthology.orchestra.run.smithi196.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T11:11:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:11:39.409 INFO:teuthology.orchestra.run.smithi196.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.0 MB/s | 5.1 MB 00:00 2024-04-25T11:11:39.441 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:11:39.443 INFO:teuthology.orchestra.run.smithi196.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 414 kB/s | 42 kB 00:00 2024-04-25T11:11:39.468 INFO:teuthology.orchestra.run.smithi196.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-04-25T11:11:39.493 INFO:teuthology.orchestra.run.smithi196.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-25T11:11:39.518 INFO:teuthology.orchestra.run.smithi196.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-04-25T11:11:39.532 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:11:39.544 INFO:teuthology.orchestra.run.smithi196.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-04-25T11:11:39.569 INFO:teuthology.orchestra.run.smithi196.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-25T11:11:39.578 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T11:11:39.594 INFO:teuthology.orchestra.run.smithi196.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T11:11:39.620 INFO:teuthology.orchestra.run.smithi196.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T11:11:39.645 INFO:teuthology.orchestra.run.smithi196.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T11:11:39.670 INFO:teuthology.orchestra.run.smithi196.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-04-25T11:11:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T11:11:39.775 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T11:11:39.796 INFO:teuthology.orchestra.run.smithi196.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-04-25T11:11:39.803 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:11:39.908 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:11:39.937 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T11:11:40.000 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T11:11:40.022 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T11:11:40.045 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T11:11:40.138 INFO:teuthology.orchestra.run.smithi196.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-04-25T11:11:40.163 INFO:teuthology.orchestra.run.smithi196.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-04-25T11:11:40.239 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T11:11:40.272 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T11:11:40.322 INFO:teuthology.orchestra.run.smithi196.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-04-25T11:11:40.355 INFO:teuthology.orchestra.run.smithi196.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-04-25T11:11:40.372 INFO:teuthology.orchestra.run.smithi196.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 93 kB/s | 19 kB 00:00 2024-04-25T11:11:40.378 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T11:11:40.465 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T11:11:40.504 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T11:11:40.539 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T11:11:40.547 INFO:teuthology.orchestra.run.smithi196.stdout:(108/152): libarrow-9.0.0-10.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-25T11:11:40.572 INFO:teuthology.orchestra.run.smithi196.stdout:(109/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 120 kB/s | 26 kB 00:00 2024-04-25T11:11:40.597 INFO:teuthology.orchestra.run.smithi196.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 216 kB/s | 49 kB 00:00 2024-04-25T11:11:40.603 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T11:11:40.623 INFO:teuthology.orchestra.run.smithi196.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 895 kB/s | 67 kB 00:00 2024-04-25T11:11:40.647 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T11:11:40.665 INFO:teuthology.orchestra.run.smithi196.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-04-25T11:11:40.690 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T11:11:40.706 INFO:teuthology.orchestra.run.smithi196.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 838 kB 00:00 2024-04-25T11:11:40.722 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T11:11:40.732 INFO:teuthology.orchestra.run.smithi196.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-04-25T11:11:40.757 INFO:teuthology.orchestra.run.smithi196.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 482 kB/s | 43 kB 00:00 2024-04-25T11:11:40.759 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T11:11:40.774 INFO:teuthology.orchestra.run.smithi196.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 484 kB/s | 32 kB 00:00 2024-04-25T11:11:40.816 INFO:teuthology.orchestra.run.smithi196.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 257 kB/s | 15 kB 00:00 2024-04-25T11:11:40.828 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T11:11:40.841 INFO:teuthology.orchestra.run.smithi196.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-25T11:11:40.866 INFO:teuthology.orchestra.run.smithi196.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-25T11:11:40.882 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T11:11:40.892 INFO:teuthology.orchestra.run.smithi196.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-25T11:11:40.912 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T11:11:40.917 INFO:teuthology.orchestra.run.smithi196.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 471 kB/s | 35 kB 00:00 2024-04-25T11:11:40.942 INFO:teuthology.orchestra.run.smithi196.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T11:11:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T11:11:41.026 INFO:teuthology.orchestra.run.smithi196.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-04-25T11:11:41.046 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T11:11:41.051 INFO:teuthology.orchestra.run.smithi196.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-25T11:11:41.076 INFO:teuthology.orchestra.run.smithi196.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2024-04-25T11:11:41.083 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T11:11:41.102 INFO:teuthology.orchestra.run.smithi196.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 236 kB/s | 18 kB 00:00 2024-04-25T11:11:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T11:11:41.144 INFO:teuthology.orchestra.run.smithi196.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-04-25T11:11:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T11:11:41.169 INFO:teuthology.orchestra.run.smithi196.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-25T11:11:41.194 INFO:teuthology.orchestra.run.smithi196.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-04-25T11:11:41.216 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T11:11:41.236 INFO:teuthology.orchestra.run.smithi196.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-25T11:11:41.261 INFO:teuthology.orchestra.run.smithi196.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 706 kB/s | 46 kB 00:00 2024-04-25T11:11:41.270 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T11:11:41.287 INFO:teuthology.orchestra.run.smithi196.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 868 kB/s | 79 kB 00:00 2024-04-25T11:11:41.312 INFO:teuthology.orchestra.run.smithi196.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-04-25T11:11:41.337 INFO:teuthology.orchestra.run.smithi196.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T11:11:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T11:11:41.362 INFO:teuthology.orchestra.run.smithi196.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-25T11:11:41.396 INFO:teuthology.orchestra.run.smithi196.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-04-25T11:11:41.421 INFO:teuthology.orchestra.run.smithi196.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-04-25T11:11:41.446 INFO:teuthology.orchestra.run.smithi196.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 368 kB/s | 31 kB 00:00 2024-04-25T11:11:41.472 INFO:teuthology.orchestra.run.smithi196.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T11:11:41.485 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T11:11:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-25T11:11:41.497 INFO:teuthology.orchestra.run.smithi196.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-04-25T11:11:41.522 INFO:teuthology.orchestra.run.smithi196.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 476 kB/s | 36 kB 00:00 2024-04-25T11:11:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T11:11:41.547 INFO:teuthology.orchestra.run.smithi196.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-04-25T11:11:41.573 INFO:teuthology.orchestra.run.smithi196.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T11:11:41.576 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T11:11:41.598 INFO:teuthology.orchestra.run.smithi196.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T11:11:41.614 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T11:11:41.623 INFO:teuthology.orchestra.run.smithi196.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-25T11:11:41.640 INFO:teuthology.orchestra.run.smithi196.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-04-25T11:11:41.674 INFO:teuthology.orchestra.run.smithi196.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-25T11:11:41.709 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T11:11:41.741 INFO:teuthology.orchestra.run.smithi196.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-25T11:11:41.877 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T11:11:41.902 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T11:11:41.916 INFO:teuthology.orchestra.run.smithi196.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 1.3 MB 00:00 2024-04-25T11:11:41.945 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T11:11:42.025 INFO:teuthology.orchestra.run.smithi196.stdout:(150/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 8.8 MB/s | 3.1 MB 00:00 2024-04-25T11:11:42.065 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T11:11:42.075 INFO:teuthology.orchestra.run.smithi196.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-04-25T11:11:42.143 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T11:11:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T11:11:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T11:11:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T11:11:42.280 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T11:11:42.294 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T11:11:42.403 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:11:42.440 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T11:11:42.497 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T11:11:42.528 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:11:42.542 INFO:teuthology.orchestra.run.smithi196.stdout:(152/152): librados2-19.0.0-3291.g994e2f20.el9. 3.7 MB/s | 3.3 MB 00:00 2024-04-25T11:11:42.546 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-04-25T11:11:42.546 INFO:teuthology.orchestra.run.smithi196.stdout:Total 15 MB/s | 214 MB 00:13 2024-04-25T11:11:42.553 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T11:11:42.554 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:11:42.624 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T11:11:42.645 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:11:42.656 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T11:11:42.675 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T11:11:42.684 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T11:11:42.731 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T11:11:42.767 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T11:11:42.810 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T11:11:42.822 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T11:11:42.852 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T11:11:42.880 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T11:11:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:11:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T11:11:42.996 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:11:43.026 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T11:11:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T11:11:43.063 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T11:11:43.071 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T11:11:43.094 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T11:11:43.105 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T11:11:43.117 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T11:11:43.199 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T11:11:43.238 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T11:11:43.260 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T11:11:43.279 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T11:11:43.293 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T11:11:43.304 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T11:11:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T11:11:43.399 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T11:11:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T11:11:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T11:11:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T11:11:43.546 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T11:11:43.578 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T11:11:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T11:11:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T11:11:43.607 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-04-25T11:11:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T11:11:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T11:11:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T11:11:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T11:11:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T11:11:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T11:11:43.749 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-04-25T11:11:43.749 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-04-25T11:11:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T11:11:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T11:11:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T11:11:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T11:11:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T11:11:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T11:11:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T11:11:44.008 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T11:11:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T11:11:44.069 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T11:11:44.102 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T11:11:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T11:11:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T11:11:44.194 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T11:11:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T11:11:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T11:11:44.240 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T11:11:44.272 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T11:11:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T11:11:44.319 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T11:11:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T11:11:44.420 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T11:11:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T11:11:44.465 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T11:11:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T11:11:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T11:11:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T11:11:45.185 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T11:11:45.222 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T11:11:45.228 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T11:11:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T11:11:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T11:11:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T11:11:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T11:11:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T11:11:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T11:11:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T11:11:45.471 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-04-25T11:11:45.471 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-04-25T11:11:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T11:11:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T11:11:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T11:11:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T11:11:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T11:11:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T11:11:45.717 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T11:11:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T11:11:45.746 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T11:11:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T11:11:45.818 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T11:11:45.822 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T11:11:45.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T11:11:45.897 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T11:11:45.939 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T11:11:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T11:11:46.127 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T11:11:46.158 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T11:11:46.199 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T11:11:46.294 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T11:11:46.341 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T11:11:46.381 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T11:11:46.407 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T11:11:46.431 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T11:11:46.460 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T11:11:46.506 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T11:11:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T11:11:46.632 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T11:11:46.664 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T11:11:46.691 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T11:11:46.734 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T11:11:46.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T11:11:46.813 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T11:11:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T11:11:46.877 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T11:11:46.911 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T11:11:46.956 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T11:11:47.219 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T11:11:47.437 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T11:11:47.517 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T11:11:47.548 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T11:11:47.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T11:11:47.704 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T11:11:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T11:11:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T11:11:47.902 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T11:11:47.928 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T11:11:47.961 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T11:11:48.283 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T11:11:48.324 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T11:11:48.415 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T11:11:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T11:11:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T11:11:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T11:11:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T11:11:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T11:11:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T11:11:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T11:11:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T11:11:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T11:11:48.972 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T11:11:49.002 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T11:11:49.024 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T11:11:49.055 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T11:11:49.073 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T11:11:49.095 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T11:11:49.131 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T11:11:49.778 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T11:11:49.885 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T11:11:51.109 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T11:11:51.184 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T11:11:51.211 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T11:11:51.245 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T11:11:51.339 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:11:51.360 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-04-25T11:11:51.369 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:11:51.437 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T11:11:51.475 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T11:11:51.528 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T11:11:51.562 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T11:11:51.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T11:11:51.588 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T11:11:51.607 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T11:11:51.630 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T11:11:51.681 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T11:11:51.712 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T11:11:51.764 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T11:11:51.930 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:11:51.964 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T11:11:51.964 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T11:11:52.054 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T11:11:52.054 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T11:11:52.054 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T11:11:52.054 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:11:52.082 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T11:11:52.089 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:11:52.214 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:11:52.240 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:11:52.249 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T11:11:52.277 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T11:11:52.331 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:11:52.360 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T11:11:52.373 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T11:11:52.395 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T11:11:52.506 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T11:11:52.565 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T11:11:52.594 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:11:52.698 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:11:52.736 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T11:11:52.799 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T11:11:52.821 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T11:11:52.841 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T11:11:53.021 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T11:11:53.062 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T11:11:53.173 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T11:11:53.274 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T11:11:53.303 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T11:11:53.338 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T11:11:53.415 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T11:11:53.453 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T11:11:53.506 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T11:11:53.538 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T11:11:53.566 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T11:11:53.633 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T11:11:53.688 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T11:11:53.718 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T11:11:53.761 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T11:11:53.839 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T11:11:53.881 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T11:11:53.924 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T11:11:53.961 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T11:11:54.029 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T11:11:54.076 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T11:11:54.149 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T11:11:54.284 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T11:11:54.336 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T11:11:54.620 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:11:54.650 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:11:54.868 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T11:11:54.948 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T11:11:54.978 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T11:11:55.029 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T11:11:55.075 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T11:11:55.125 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T11:11:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:11:55.253 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T11:11:55.279 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T11:11:55.336 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T11:11:55.338 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T11:11:55.338 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T11:11:55.339 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T11:11:55.339 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:11:55.371 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T11:11:55.390 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T11:11:55.456 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T11:11:55.486 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T11:11:55.523 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T11:11:55.578 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T11:11:55.632 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T11:11:55.673 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T11:11:55.716 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T11:11:55.851 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T11:11:55.896 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T11:11:55.926 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T11:11:55.968 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T11:11:56.062 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T11:11:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T11:11:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T11:11:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T11:11:56.200 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T11:11:56.274 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T11:11:56.399 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T11:11:56.441 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T11:11:56.468 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T11:11:56.503 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T11:11:56.542 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T11:11:56.581 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T11:11:56.695 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T11:11:56.864 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T11:11:56.897 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T11:11:56.940 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T11:11:56.973 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T11:11:57.063 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T11:11:57.114 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T11:11:57.142 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T11:11:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T11:11:57.297 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T11:11:57.352 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T11:11:58.061 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T11:11:58.107 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T11:11:58.157 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T11:11:58.264 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T11:11:58.323 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T11:11:58.403 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T11:11:58.442 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T11:11:58.619 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T11:11:58.657 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T11:11:58.734 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T11:11:59.372 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T11:11:59.488 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T11:12:00.704 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T11:12:00.777 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T11:12:00.805 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T11:12:00.838 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T11:12:01.159 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T11:12:01.209 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T11:12:01.292 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T11:12:01.330 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T11:12:01.375 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T11:12:01.864 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T11:12:01.895 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T11:12:01.966 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T11:12:01.989 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /root 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-04-25T11:12:03.899 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:04.070 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T11:12:04.085 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T11:12:04.086 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:04.086 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T11:12:04.086 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:04.269 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:12:04.310 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:12:04.867 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T11:12:04.913 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T11:12:05.006 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T11:12:05.006 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T11:12:05.006 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T11:12:05.006 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:05.039 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T11:12:05.674 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T11:12:05.699 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T11:12:05.699 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:05.699 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T11:12:05.699 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T11:12:05.700 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T11:12:05.700 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:05.933 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T11:12:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T11:12:05.955 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:05.955 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T11:12:05.955 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T11:12:05.955 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T11:12:05.955 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:06.425 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T11:12:06.447 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T11:12:06.447 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:06.448 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T11:12:06.448 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T11:12:06.448 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T11:12:06.448 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:06.547 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T11:12:06.595 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T11:12:06.659 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T11:12:06.843 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T11:12:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T11:12:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T11:12:07.067 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T11:12:07.197 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T11:12:07.235 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T11:12:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T11:12:07.260 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-04-25T11:12:07.261 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-04-25T11:12:07.261 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-04-25T11:12:07.261 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-04-25T11:12:07.261 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-04-25T11:12:07.261 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-04-25T11:12:07.261 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-04-25T11:12:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:07.267 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T11:12:07.294 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T11:12:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T11:12:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T11:12:07.448 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:07.448 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T11:12:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:07.722 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T11:12:07.752 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T11:12:07.784 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T11:12:07.845 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T11:12:07.883 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T11:12:08.915 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T11:12:08.952 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T11:12:09.035 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T11:12:09.061 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T11:12:09.061 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:09.061 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T11:12:09.061 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T11:12:09.061 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T11:12:09.061 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:09.286 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T11:12:09.309 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T11:12:09.309 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:09.309 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T11:12:09.309 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T11:12:09.309 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T11:12:09.309 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T11:12:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T11:12:09.793 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:09.793 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T11:12:09.793 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T11:12:09.793 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T11:12:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:09.900 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T11:12:09.918 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T11:12:09.949 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T11:12:09.952 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T11:12:10.012 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T11:12:10.053 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T11:12:10.199 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T11:12:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T11:12:10.246 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T11:12:10.246 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T11:12:10.269 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T11:12:10.269 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:10.269 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T11:12:10.269 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T11:12:10.269 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T11:12:10.269 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:10.313 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T11:12:10.324 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T11:12:10.324 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T11:12:10.411 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T11:12:10.423 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T11:12:10.478 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T11:12:10.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T11:12:10.587 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T11:12:10.619 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T11:12:10.650 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T11:12:11.099 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T11:12:11.120 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T11:12:11.153 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T11:12:11.213 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T11:12:11.243 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T11:12:11.410 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T11:12:11.449 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T11:12:11.472 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T11:12:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T11:12:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T11:12:11.472 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T11:12:11.472 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:11.517 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T11:12:11.538 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T11:12:11.538 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:11.538 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T11:12:11.538 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:11.584 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T11:12:11.605 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T11:12:11.606 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:11.606 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T11:12:11.606 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T11:12:11.606 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T11:12:11.606 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:11.926 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T11:12:11.948 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T11:12:11.948 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:11.948 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T11:12:11.948 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T11:12:11.948 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T11:12:11.948 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:12.271 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T11:12:12.304 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T11:12:13.261 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T11:12:13.287 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T11:12:13.389 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T11:12:13.553 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T11:12:13.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T11:12:13.604 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T11:12:13.604 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:13.604 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T11:12:13.604 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T11:12:13.604 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T11:12:13.605 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:13.648 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T11:12:13.659 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T11:12:13.758 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T11:12:13.813 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T11:12:14.749 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T11:12:14.792 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T11:12:14.815 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T11:12:14.815 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:14.815 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T11:12:14.816 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T11:12:14.816 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T11:12:14.816 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:14.860 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T11:12:14.882 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T11:12:14.882 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:14.882 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T11:12:14.882 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:14.927 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T11:12:14.949 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T11:12:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:14.949 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T11:12:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T11:12:14.950 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T11:12:14.950 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:15.269 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T11:12:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T11:12:15.292 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:15.292 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T11:12:15.292 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T11:12:15.292 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T11:12:15.292 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:16.238 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T11:12:16.280 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T11:12:16.320 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T11:12:16.352 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T11:12:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T11:12:16.564 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T11:12:16.609 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T11:12:16.630 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:16.631 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T11:12:16.833 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T11:12:16.848 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T11:12:16.848 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:16.848 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T11:12:16.848 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:17.236 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:17.279 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:17.298 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:18.124 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T11:12:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T11:12:18.259 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T11:12:18.340 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T11:12:18.388 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T11:12:18.389 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T11:12:18.419 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T11:12:18.444 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T11:12:18.444 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:18.444 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T11:12:18.444 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T11:12:18.444 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T11:12:18.445 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:18.481 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T11:12:18.514 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T11:12:18.514 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T11:12:18.603 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T11:12:18.670 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T11:12:18.670 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:18.692 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T11:12:18.692 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:18.692 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T11:12:18.692 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T11:12:18.692 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T11:12:18.692 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:19.146 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T11:12:19.168 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T11:12:19.168 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:19.168 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T11:12:19.168 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T11:12:19.168 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T11:12:19.168 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:19.275 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T11:12:19.324 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T11:12:19.378 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T11:12:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T11:12:19.555 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T11:12:19.570 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T11:12:19.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T11:12:19.621 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T11:12:19.628 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T11:12:19.664 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T11:12:19.689 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T11:12:19.778 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T11:12:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T11:12:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T11:12:19.916 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T11:12:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T11:12:19.954 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T11:12:19.986 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T11:12:20.014 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T11:12:20.450 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T11:12:20.479 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T11:12:20.511 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T11:12:20.519 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:20.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:20.572 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T11:12:20.582 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:20.602 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T11:12:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T11:12:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T11:12:21.549 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T11:12:21.630 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T11:12:21.634 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T11:12:21.671 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T11:12:21.679 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T11:12:21.679 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T11:12:21.764 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T11:12:21.797 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T11:12:21.797 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T11:12:21.887 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T11:12:21.952 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:22.639 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T11:12:22.663 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T11:12:22.762 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T11:12:22.928 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T11:12:22.956 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T11:12:22.979 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T11:12:22.979 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:22.979 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T11:12:22.979 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T11:12:22.980 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T11:12:22.980 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:23.024 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T11:12:23.035 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T11:12:23.134 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T11:12:23.181 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T11:12:24.116 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T11:12:24.143 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T11:12:24.166 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T11:12:24.166 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:24.166 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T11:12:24.166 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T11:12:24.166 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T11:12:24.166 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:24.218 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T11:12:24.240 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T11:12:24.240 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:24.240 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T11:12:24.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:24.286 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T11:12:24.308 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T11:12:24.308 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:24.308 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T11:12:24.308 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T11:12:24.308 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T11:12:24.308 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:24.620 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T11:12:24.642 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T11:12:24.642 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T11:12:24.642 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T11:12:24.642 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T11:12:24.642 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T11:12:24.642 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:24.689 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T11:12:24.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T11:12:24.691 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T11:12:24.692 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T11:12:24.693 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T11:12:24.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T11:12:24.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T11:12:24.696 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T11:12:24.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T11:12:24.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T11:12:24.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T11:12:24.700 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T11:12:24.701 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T11:12:24.701 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T11:12:26.829 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.830 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.831 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T11:12:26.832 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T11:12:26.833 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T11:12:26.834 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.835 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T11:12:26.836 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T11:12:26.837 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T11:12:26.838 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T11:12:26.839 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T11:12:26.840 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T11:12:26.841 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T11:12:26.841 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T11:12:26.841 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T11:12:26.841 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T11:12:26.841 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:12:26.841 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-25T11:12:27.242 DEBUG:teuthology.parallel:result is None 2024-04-25T11:12:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T11:12:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T11:12:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T11:12:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T11:12:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T11:12:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T11:12:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T11:12:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T11:12:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T11:12:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T11:12:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T11:12:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T11:12:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T11:12:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T11:12:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T11:12:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T11:12:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T11:12:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T11:12:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T11:12:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T11:12:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T11:12:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T11:12:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T11:12:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T11:12:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T11:12:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T11:12:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T11:12:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T11:12:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T11:12:28.907 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T11:12:28.948 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T11:12:28.988 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T11:12:29.021 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T11:12:29.048 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T11:12:29.230 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T11:12:29.268 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T11:12:29.299 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T11:12:29.855 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:29.896 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:29.916 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T11:12:30.013 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:30.013 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:30.013 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.014 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.016 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T11:12:30.017 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.018 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T11:12:30.019 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T11:12:30.020 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T11:12:30.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T11:12:30.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T11:12:30.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T11:12:30.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T11:12:30.025 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T11:12:30.026 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T11:12:30.027 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T11:12:30.028 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T11:12:30.028 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-25T11:12:30.028 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-25T11:12:30.396 DEBUG:teuthology.parallel:result is None 2024-04-25T11:12:30.741 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T11:12:30.827 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T11:12:30.868 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T11:12:30.949 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T11:12:30.981 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T11:12:30.982 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T11:12:31.057 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T11:12:31.090 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T11:12:31.090 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T11:12:31.193 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T11:12:31.262 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:37.345 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:37.345 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T11:12:37.346 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T11:12:37.347 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T11:12:37.348 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T11:12:37.348 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T11:12:37.361 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T11:12:37.362 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T11:12:37.363 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T11:12:37.364 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T11:12:37.365 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T11:12:37.366 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T11:12:37.367 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T11:12:37.368 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T11:12:37.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T11:12:39.493 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T11:12:39.493 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T11:12:39.496 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T11:12:39.497 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T11:12:39.498 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T11:12:39.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T11:12:39.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T11:12:39.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T11:12:39.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T11:12:39.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T11:12:39.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T11:12:39.505 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T11:12:39.506 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T11:12:39.506 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:12:39.506 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-04-25T11:12:39.897 DEBUG:teuthology.parallel:result is None 2024-04-25T11:12:39.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:12:40.114 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T11:12:40.140 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T11:12:40.140 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T11:12:40.141 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T11:12:40.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:12:40.283 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T11:12:40.308 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T11:12:40.309 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T11:12:40.309 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T11:12:40.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:12:40.450 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T11:12:40.471 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T11:12:40.471 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T11:12:40.471 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T11:12:40.473 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T11:12:40.473 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:12:40.473 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T11:12:40.505 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:12:40.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T11:12:40.536 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:12:40.536 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T11:12:40.560 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T11:12:40.561 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:12:40.561 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T11:12:40.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T11:12:40.655 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:12:40.655 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T11:12:40.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T11:12:40.752 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:12:40.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T11:12:40.778 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T11:12:40.842 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T11:12:40.842 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:12:40.842 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T11:12:40.868 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T11:12:40.934 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:12:40.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T11:12:40.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T11:12:41.029 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:12:41.029 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T11:12:41.053 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T11:12:41.116 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T11:12:41.116 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:12:41.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T11:12:41.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T11:12:41.205 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:12:41.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T11:12:41.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T11:12:41.298 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:12:41.298 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T11:12:41.321 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T11:12:41.385 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-25T11:12:41.503 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'subvols': {'create': 2}} 2024-04-25T11:12:41.503 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:12:41.503 INFO:tasks.cephadm:Cluster fsid is bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:12:41.503 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-25T11:12:41.504 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.80', 'mon.b': '172.21.15.82', 'mon.c': '172.21.15.196'} 2024-04-25T11:12:41.504 INFO:tasks.cephadm:First mon is mon.a on smithi080 2024-04-25T11:12:41.504 INFO:tasks.cephadm:First mgr is x 2024-04-25T11:12:41.504 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-25T11:12:41.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2024-04-25T11:12:41.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-04-25T11:12:41.555 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname $(hostname -s) 2024-04-25T11:12:41.579 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-25T11:12:41.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:12:41.718 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78872/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3291-g994e2f20', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3291.g994e2f20'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-25 04:02:18.990013', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240425.015853-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-04-25T11:12:41.856 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240425.015853-debug, sha1 994e2f20102a20fa9a27966c14b625cc01884df8 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:12:41.857 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm 2024-04-25T11:12:41.858 DEBUG:teuthology.orchestra.run.smithi080:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:42.227 INFO:teuthology.orchestra.run.smithi080.stdout:-rw-r--r--. 1 ubuntu ubuntu 781647 Apr 25 11:12 /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:42.227 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:42.777 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 781647 Apr 25 11:12 /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:42.777 DEBUG:teuthology.orchestra.run.smithi196:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:43.201 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r--. 1 ubuntu ubuntu 781647 Apr 25 11:12 /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:43.201 DEBUG:teuthology.orchestra.run.smithi080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:43.219 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:43.238 DEBUG:teuthology.orchestra.run.smithi196:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T11:12:43.274 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 on all hosts... 2024-04-25T11:12:43.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 pull 2024-04-25T11:12:43.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 pull 2024-04-25T11:12:43.280 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 pull 2024-04-25T11:12:44.816 INFO:teuthology.orchestra.run.smithi080.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T11:12:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T11:12:45.176 INFO:teuthology.orchestra.run.smithi196.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T11:13:19.307 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:13:19.308 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T11:13:19.308 INFO:teuthology.orchestra.run.smithi080.stdout: "image_id": "d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4", 2024-04-25T11:13:19.308 INFO:teuthology.orchestra.run.smithi080.stdout: "repo_digests": [ 2024-04-25T11:13:19.308 INFO:teuthology.orchestra.run.smithi080.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385" 2024-04-25T11:13:19.308 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:13:19.308 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:13:37.313 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-25T11:13:37.314 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T11:13:37.314 INFO:teuthology.orchestra.run.smithi196.stdout: "image_id": "d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4", 2024-04-25T11:13:37.314 INFO:teuthology.orchestra.run.smithi196.stdout: "repo_digests": [ 2024-04-25T11:13:37.314 INFO:teuthology.orchestra.run.smithi196.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385" 2024-04-25T11:13:37.314 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-04-25T11:13:37.314 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-25T11:13:43.715 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-25T11:13:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T11:13:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4", 2024-04-25T11:13:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-04-25T11:13:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385" 2024-04-25T11:13:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-25T11:13:43.716 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-25T11:13:43.739 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2024-04-25T11:13:43.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-04-25T11:13:43.796 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph 2024-04-25T11:13:43.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2024-04-25T11:13:43.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-04-25T11:13:43.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /etc/ceph 2024-04-25T11:13:43.908 INFO:tasks.cephadm:Writing seed config... 2024-04-25T11:13:43.910 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-25T11:13:43.910 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-25T11:13:43.910 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-25T11:13:43.910 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-25T11:13:43.910 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-25T11:13:43.911 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-25T11:13:43.911 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-25T11:13:43.911 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-25T11:13:43.911 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-25T11:13:43.911 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-25T11:13:43.911 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-25T11:13:43.912 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-25T11:13:43.912 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-25T11:13:43.912 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-25T11:13:43.912 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-25T11:13:43.912 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-25T11:13:43.912 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-25T11:13:43.912 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-25T11:13:43.913 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-25T11:13:43.913 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-25T11:13:43.913 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-25T11:13:43.913 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-25T11:13:43.913 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-25T11:13:43.913 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-25T11:13:43.914 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-25T11:13:43.914 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-25T11:13:43.914 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-25T11:13:43.914 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-25T11:13:43.914 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-25T11:13:43.914 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-25T11:13:43.914 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-25T11:13:43.915 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-25T11:13:43.916 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-25T11:13:43.916 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-25T11:13:43.916 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-25T11:13:43.916 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-25T11:13:43.916 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-25T11:13:43.916 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-25T11:13:43.916 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-25T11:13:43.918 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:13:43.918 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-25T11:13:43.940 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bba277ec-02f4-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-25T11:13:43.941 DEBUG:teuthology.orchestra.run.smithi080:mon.a> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service 2024-04-25T11:13:43.983 DEBUG:teuthology.orchestra.run.smithi080:mgr.x> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.x.service 2024-04-25T11:13:44.026 INFO:tasks.cephadm:Bootstrapping... 2024-04-25T11:13:44.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 -v bootstrap --fsid bba277ec-02f4-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.80 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:13:44.221 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-25T11:13:44.221 INFO:teuthology.orchestra.run.smithi080.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8', '-v', 'bootstrap', '--fsid', 'bba277ec-02f4-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.80', '--skip-admin-label'] 2024-04-25T11:13:44.221 INFO:teuthology.orchestra.run.smithi080.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-25T11:13:44.222 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying podman|docker is present... 2024-04-25T11:13:44.247 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T11:13:44.247 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying lvm2 is present... 2024-04-25T11:13:44.247 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying time synchronization is in place... 2024-04-25T11:13:44.254 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T11:13:44.255 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T11:13:44.261 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T11:13:44.261 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-25T11:13:44.267 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout enabled 2024-04-25T11:13:44.273 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout active 2024-04-25T11:13:44.273 INFO:teuthology.orchestra.run.smithi080.stdout:Unit chronyd.service is enabled and running 2024-04-25T11:13:44.273 INFO:teuthology.orchestra.run.smithi080.stdout:Repeating the final host check... 2024-04-25T11:13:44.297 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T11:13:44.297 INFO:teuthology.orchestra.run.smithi080.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-25T11:13:44.297 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl is present 2024-04-25T11:13:44.297 INFO:teuthology.orchestra.run.smithi080.stdout:lvcreate is present 2024-04-25T11:13:44.303 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T11:13:44.303 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T11:13:44.309 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T11:13:44.309 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-25T11:13:44.315 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout enabled 2024-04-25T11:13:44.322 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout active 2024-04-25T11:13:44.322 INFO:teuthology.orchestra.run.smithi080.stdout:Unit chronyd.service is enabled and running 2024-04-25T11:13:44.322 INFO:teuthology.orchestra.run.smithi080.stdout:Host looks OK 2024-04-25T11:13:44.322 INFO:teuthology.orchestra.run.smithi080.stdout:Cluster fsid: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:13:44.322 INFO:teuthology.orchestra.run.smithi080.stdout:Acquiring lock 140692712991904 on /run/cephadm/bba277ec-02f4-11ef-bc93-c7b262605968.lock 2024-04-25T11:13:44.322 INFO:teuthology.orchestra.run.smithi080.stdout:Lock 140692712991904 acquired on /run/cephadm/bba277ec-02f4-11ef-bc93-c7b262605968.lock 2024-04-25T11:13:44.323 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying IP 172.21.15.80 port 3300 ... 2024-04-25T11:13:44.323 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying IP 172.21.15.80 port 6789 ... 2024-04-25T11:13:44.323 INFO:teuthology.orchestra.run.smithi080.stdout:Base mon IP(s) is [172.21.15.80:3300, 172.21.15.80:6789], mon addrv is [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-04-25T11:13:44.326 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.80 metric 100 2024-04-25T11:13:44.326 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.80 metric 100 2024-04-25T11:13:44.328 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-25T11:13:44.328 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-25T11:13:44.328 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-25T11:13:44.331 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-25T11:13:44.331 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-25T11:13:44.331 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T11:13:44.331 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-25T11:13:44.331 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout inet6 fe80::dc2d:475a:513b:1454/64 scope link noprefixroute 2024-04-25T11:13:44.331 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T11:13:44.332 INFO:teuthology.orchestra.run.smithi080.stdout:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-04-25T11:13:44.332 INFO:teuthology.orchestra.run.smithi080.stdout:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-04-25T11:13:44.332 INFO:teuthology.orchestra.run.smithi080.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-25T11:13:44.332 INFO:teuthology.orchestra.run.smithi080.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-25T11:13:44.333 INFO:teuthology.orchestra.run.smithi080.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T11:13:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 2024-04-25T11:13:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T11:13:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Getting image source signatures 2024-04-25T11:13:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:665339d96aad80d083ba9988a62422bcef0a42210fb2b28340e33ab98589f7b8 2024-04-25T11:13:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-25T11:13:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying config sha256:d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 2024-04-25T11:13:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-25T11:13:53.312 INFO:teuthology.orchestra.run.smithi080.stdout:ceph: stdout ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T11:13:53.312 INFO:teuthology.orchestra.run.smithi080.stdout:Ceph version: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T11:13:53.312 INFO:teuthology.orchestra.run.smithi080.stdout:Extracting ceph user uid/gid from container image... 2024-04-25T11:13:54.327 INFO:teuthology.orchestra.run.smithi080.stdout:stat: stdout 167 167 2024-04-25T11:13:54.327 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial keys... 2024-04-25T11:13:55.634 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQDyOipmxtswKBAAMDQkOYcygRQ8XvYRJb7BBA== 2024-04-25T11:13:56.509 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQDzOipmcDCSOBAAW16b8zFFpF2591Y3+31KHA== 2024-04-25T11:13:57.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQD0OipmqkybMhAAnqa7VgGJWU31DB7oykcvJA== 2024-04-25T11:13:57.441 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial monmap... 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool for a [v2:172.21.15.80:3300,v1:172.21.15.80:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = quincy 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: set fsid to bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:13:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:Creating mon... 2024-04-25T11:14:00.094 INFO:teuthology.orchestra.run.smithi080.stdout:create mon.a on 2024-04-25T11:14:00.300 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-25T11:14:00.437 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-25T11:14:00.624 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bba277ec-02f4-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-bba277ec-02f4-11ef-bc93-c7b262605968.target. 2024-04-25T11:14:00.624 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bba277ec-02f4-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-bba277ec-02f4-11ef-bc93-c7b262605968.target. 2024-04-25T11:14:00.827 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a 2024-04-25T11:14:00.828 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-25T11:14:00.989 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bba277ec-02f4-11ef-bc93-c7b262605968.target.wants/ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-bba277ec-02f4-11ef-bc93-c7b262605968@.service. 2024-04-25T11:14:01.509 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T11:14:01.509 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-25T11:14:01.516 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T11:14:01.516 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-25T11:14:01.516 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-25T11:14:01.516 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T11:14:01.516 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mon to start... 2024-04-25T11:14:01.517 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mon... 2024-04-25T11:14:01.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:01 smithi080 systemd[1]: Started Ceph mon.a for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: monmap epoch 1 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: last_changed 2024-04-25T11:13:57.766755+0000 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: min_mon_release 19 (squid) 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: election_strategy: 1 2024-04-25T11:14:02.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:14:02.581 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: fsmap 2024-04-25T11:14:02.581 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T11:14:02.581 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: mgrmap e1: no daemons active 2024-04-25T11:14:02.581 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:02 smithi080 ceph-mon[28749]: from='client.? 172.21.15.80:0/2268918495' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout cluster: 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout id: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout services: 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.559316s) 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout data: 2024-04-25T11:14:02.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout pgs: 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.947+0000 7f6577d35700 1 Processor -- start 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.947+0000 7f6577d35700 1 -- start start 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.947+0000 7f6577d35700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657010c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.947+0000 7f6577d35700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f657010cbf0 con 0x7f657007d580 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.947+0000 7f6575ad1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657010c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.947+0000 7f6575ad1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657010c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34402/0 (socket says 172.21.15.80:34402) 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.947+0000 7f6575ad1700 1 -- 172.21.15.80:0/4123662432 learned_addr learned my addr 172.21.15.80:0/4123662432 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.948+0000 7f6575ad1700 1 -- 172.21.15.80:0/4123662432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657010cd70 con 0x7f657007d580 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.948+0000 7f6575ad1700 1 --2- 172.21.15.80:0/4123662432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657010c5e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f656c0098a0 tx=0x7f656c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f41f482c96f6fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.948+0000 7f6574acf700 1 -- 172.21.15.80:0/4123662432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f656c004160 con 0x7f657007d580 2024-04-25T11:14:02.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.948+0000 7f6574acf700 1 -- 172.21.15.80:0/4123662432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656c004300 con 0x7f657007d580 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.948+0000 7f6574acf700 1 -- 172.21.15.80:0/4123662432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f656c0036a0 con 0x7f657007d580 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.949+0000 7f6577d35700 1 -- 172.21.15.80:0/4123662432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 msgr2=0x7f657010c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.949+0000 7f6577d35700 1 --2- 172.21.15.80:0/4123662432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657010c5e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f656c0098a0 tx=0x7f656c009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.949+0000 7f6577d35700 1 -- 172.21.15.80:0/4123662432 shutdown_connections 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.949+0000 7f6577d35700 1 --2- 172.21.15.80:0/4123662432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657010c5e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.949+0000 7f6577d35700 1 -- 172.21.15.80:0/4123662432 >> 172.21.15.80:0/4123662432 conn(0x7f6570104030 msgr2=0x7f65701064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.949+0000 7f6577d35700 1 -- 172.21.15.80:0/4123662432 shutdown_connections 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.949+0000 7f6577d35700 1 -- 172.21.15.80:0/4123662432 wait complete. 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6577d35700 1 Processor -- start 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6577d35700 1 -- start start 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6577d35700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6577d35700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f657010d2a0 con 0x7f657007d580 2024-04-25T11:14:02.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6575ad1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6575ad1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34406/0 (socket says 172.21.15.80:34406) 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6575ad1700 1 -- 172.21.15.80:0/2268918495 learned_addr learned my addr 172.21.15.80:0/2268918495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6575ad1700 1 -- 172.21.15.80:0/2268918495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657019daf0 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.950+0000 7f6575ad1700 1 --2- 172.21.15.80:0/2268918495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657019d5b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f656c000c00 tx=0x7f656c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6566ffd700 1 -- 172.21.15.80:0/2268918495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f656c003db0 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6566ffd700 1 -- 172.21.15.80:0/2268918495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656c011630 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6566ffd700 1 -- 172.21.15.80:0/2268918495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f656c011950 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657019dd80 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65701a0990 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6566ffd700 1 -- 172.21.15.80:0/2268918495 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f656c01a460 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6566ffd700 1 -- 172.21.15.80:0/2268918495 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f656c01b780 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.951+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6570064cf0 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:01.954+0000 7f6566ffd700 1 -- 172.21.15.80:0/2268918495 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f656c01b980 con 0x7f657007d580 2024-04-25T11:14:02.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.023+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f657002e7e0 con 0x7f657007d580 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.023+0000 7f6566ffd700 1 -- 172.21.15.80:0/2268918495 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f656c01bb60 con 0x7f657007d580 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.024+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 msgr2=0x7f657019d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.024+0000 7f6577d35700 1 --2- 172.21.15.80:0/2268918495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657019d5b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f656c000c00 tx=0x7f656c004750 comp rx=0 tx=0).stop 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.024+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 shutdown_connections 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.024+0000 7f6577d35700 1 --2- 172.21.15.80:0/2268918495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f657007d580 0x7f657019d5b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.024+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 >> 172.21.15.80:0/2268918495 conn(0x7f6570104030 msgr2=0x7f6570104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.024+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 shutdown_connections 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.024+0000 7f6577d35700 1 -- 172.21.15.80:0/2268918495 wait complete. 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:mon is available 2024-04-25T11:14:02.594 INFO:teuthology.orchestra.run.smithi080.stdout:Assimilating anything we can from ceph.conf... 2024-04-25T11:14:03.653 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:03 smithi080 ceph-mon[28749]: from='client.? 172.21.15.80:0/3392558609' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T11:14:03.653 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:03 smithi080 ceph-mon[28749]: from='client.? 172.21.15.80:0/3392558609' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout fsid = bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T11:14:03.662 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.966+0000 7f0df13e7700 1 Processor -- start 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.966+0000 7f0df13e7700 1 -- start start 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.967+0000 7f0df13e7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec108d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.967+0000 7f0df13e7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec109330 con 0x7f0dec108930 2024-04-25T11:14:03.663 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.967+0000 7f0deaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec108d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.967+0000 7f0deaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec108d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34418/0 (socket says 172.21.15.80:34418) 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.967+0000 7f0deaffd700 1 -- 172.21.15.80:0/1241070610 learned_addr learned my addr 172.21.15.80:0/1241070610 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.967+0000 7f0deaffd700 1 -- 172.21.15.80:0/1241070610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec109a60 con 0x7f0dec108930 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.967+0000 7f0deaffd700 1 --2- 172.21.15.80:0/1241070610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec108d40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0098a0 tx=0x7f0ddc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91917fd9887da23b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0de9ffb700 1 -- 172.21.15.80:0/1241070610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc004160 con 0x7f0dec108930 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0de9ffb700 1 -- 172.21.15.80:0/1241070610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc004300 con 0x7f0dec108930 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0de9ffb700 1 -- 172.21.15.80:0/1241070610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc0036a0 con 0x7f0dec108930 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0df13e7700 1 -- 172.21.15.80:0/1241070610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 msgr2=0x7f0dec108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0df13e7700 1 --2- 172.21.15.80:0/1241070610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec108d40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0098a0 tx=0x7f0ddc009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0df13e7700 1 -- 172.21.15.80:0/1241070610 shutdown_connections 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0df13e7700 1 --2- 172.21.15.80:0/1241070610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec108d40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0df13e7700 1 -- 172.21.15.80:0/1241070610 >> 172.21.15.80:0/1241070610 conn(0x7f0dec103f90 msgr2=0x7f0dec106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:03.664 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0df13e7700 1 -- 172.21.15.80:0/1241070610 shutdown_connections 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.968+0000 7f0df13e7700 1 -- 172.21.15.80:0/1241070610 wait complete. 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.969+0000 7f0df13e7700 1 Processor -- start 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.969+0000 7f0df13e7700 1 -- start start 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.969+0000 7f0df13e7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec19c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.969+0000 7f0df13e7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec109f90 con 0x7f0dec108930 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.969+0000 7f0deaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec19c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0deaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec19c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34434/0 (socket says 172.21.15.80:34434) 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0deaffd700 1 -- 172.21.15.80:0/3392558609 learned_addr learned my addr 172.21.15.80:0/3392558609 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0deaffd700 1 -- 172.21.15.80:0/3392558609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec19ca20 con 0x7f0dec108930 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0deaffd700 1 --2- 172.21.15.80:0/3392558609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec19c4e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc000c00 tx=0x7f0ddc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0dd3fff700 1 -- 172.21.15.80:0/3392558609 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc003db0 con 0x7f0dec108930 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0dd3fff700 1 -- 172.21.15.80:0/3392558609 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc011630 con 0x7f0dec108930 2024-04-25T11:14:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec19ccb0 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0dd3fff700 1 -- 172.21.15.80:0/3392558609 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ddc011950 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec19f8c0 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0dd3fff700 1 -- 172.21.15.80:0/3392558609 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0ddc01a460 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.970+0000 7f0dd3fff700 1 -- 172.21.15.80:0/3392558609 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ddc01b780 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.971+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec064cf0 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:02.973+0000 7f0dd3fff700 1 -- 172.21.15.80:0/3392558609 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0ddc01b980 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.040+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0dec02e790 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.044+0000 7f0dd3fff700 1 -- 172.21.15.80:0/3392558609 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f0ddc01bb60 con 0x7f0dec108930 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.045+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 msgr2=0x7f0dec19c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.045+0000 7f0df13e7700 1 --2- 172.21.15.80:0/3392558609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec19c4e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc000c00 tx=0x7f0ddc004750 comp rx=0 tx=0).stop 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.045+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 shutdown_connections 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.045+0000 7f0df13e7700 1 --2- 172.21.15.80:0/3392558609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dec108930 0x7f0dec19c4e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:03.666 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.045+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 >> 172.21.15.80:0/3392558609 conn(0x7f0dec103f90 msgr2=0x7f0dec192b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:03.667 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.046+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 shutdown_connections 2024-04-25T11:14:03.667 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:03.046+0000 7f0df13e7700 1 -- 172.21.15.80:0/3392558609 wait complete. 2024-04-25T11:14:03.667 INFO:teuthology.orchestra.run.smithi080.stdout:Generating new minimal ceph.conf... 2024-04-25T11:14:04.729 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:04 smithi080 ceph-mon[28749]: from='client.? 172.21.15.80:0/1801327803' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.056+0000 7fa50bc72700 1 Processor -- start 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.056+0000 7fa50bc72700 1 -- start start 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.056+0000 7fa50bc72700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa5041092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.056+0000 7fa50bc72700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa504109890 con 0x7fa504108e90 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa509a0e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa5041092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa509a0e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa5041092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34446/0 (socket says 172.21.15.80:34446) 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa509a0e700 1 -- 172.21.15.80:0/445491986 learned_addr learned my addr 172.21.15.80:0/445491986 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa509a0e700 1 -- 172.21.15.80:0/445491986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa504109a10 con 0x7fa504108e90 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa509a0e700 1 --2- 172.21.15.80:0/445491986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa5041092a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa5000098a0 tx=0x7fa500009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1903b31f1fbb40eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa508a0c700 1 -- 172.21.15.80:0/445491986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa500004160 con 0x7fa504108e90 2024-04-25T11:14:04.737 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa508a0c700 1 -- 172.21.15.80:0/445491986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa500004300 con 0x7fa504108e90 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.057+0000 7fa508a0c700 1 -- 172.21.15.80:0/445491986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa500011af0 con 0x7fa504108e90 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.058+0000 7fa50bc72700 1 -- 172.21.15.80:0/445491986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 msgr2=0x7fa5041092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.058+0000 7fa50bc72700 1 --2- 172.21.15.80:0/445491986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa5041092a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa5000098a0 tx=0x7fa500009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.058+0000 7fa50bc72700 1 -- 172.21.15.80:0/445491986 shutdown_connections 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.058+0000 7fa50bc72700 1 --2- 172.21.15.80:0/445491986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa5041092a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.058+0000 7fa50bc72700 1 -- 172.21.15.80:0/445491986 >> 172.21.15.80:0/445491986 conn(0x7fa504103740 msgr2=0x7fa504105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.058+0000 7fa50bc72700 1 -- 172.21.15.80:0/445491986 shutdown_connections 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.058+0000 7fa50bc72700 1 -- 172.21.15.80:0/445491986 wait complete. 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa50bc72700 1 Processor -- start 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa50bc72700 1 -- start start 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa50bc72700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa50419df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa50bc72700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa50410a910 con 0x7fa504108e90 2024-04-25T11:14:04.738 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa509a0e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa50419df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa509a0e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa50419df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34450/0 (socket says 172.21.15.80:34450) 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa509a0e700 1 -- 172.21.15.80:0/1801327803 learned_addr learned my addr 172.21.15.80:0/1801327803 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.059+0000 7fa509a0e700 1 -- 172.21.15.80:0/1801327803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50419e490 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa509a0e700 1 --2- 172.21.15.80:0/1801327803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa50419df50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa500011670 tx=0x7fa500004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa4faffd700 1 -- 172.21.15.80:0/1801327803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5000036a0 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa4faffd700 1 -- 172.21.15.80:0/1801327803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa50001a430 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa4faffd700 1 -- 172.21.15.80:0/1801327803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa500019550 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50419e720 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041a1330 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa4faffd700 1 -- 172.21.15.80:0/1801327803 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa500019b50 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.060+0000 7fa4faffd700 1 -- 172.21.15.80:0/1801327803 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa500024730 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.061+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa504064cf0 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.063+0000 7fa4faffd700 1 -- 172.21.15.80:0/1801327803 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa500043e50 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.130+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa50402e810 con 0x7fa504108e90 2024-04-25T11:14:04.739 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.130+0000 7fa4faffd700 1 -- 172.21.15.80:0/1801327803 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fa500032020 con 0x7fa504108e90 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.131+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 msgr2=0x7fa50419df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.131+0000 7fa50bc72700 1 --2- 172.21.15.80:0/1801327803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa50419df50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa500011670 tx=0x7fa500004280 comp rx=0 tx=0).stop 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.131+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 shutdown_connections 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.131+0000 7fa50bc72700 1 --2- 172.21.15.80:0/1801327803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa504108e90 0x7fa50419df50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.131+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 >> 172.21.15.80:0/1801327803 conn(0x7fa504103740 msgr2=0x7fa504104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.131+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 shutdown_connections 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:04.131+0000 7fa50bc72700 1 -- 172.21.15.80:0/1801327803 wait complete. 2024-04-25T11:14:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:Restarting the monitor... 2024-04-25T11:14:05.000 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:04 smithi080 systemd[1]: Stopping Ceph mon.a for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:14:05.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a[28745]: 2024-04-25T11:14:04.999+0000 7f12b61e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:14:05.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a[28745]: 2024-04-25T11:14:04.999+0000 7f12b61e5700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T11:14:05.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 podman[28995]: 2024-04-25 11:14:05.245033598 +0000 UTC m=+0.351540246 container died 46a75723734f7deb23c0aec33924de7750a8fcf1892693dcd2c8f7c1993a9258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T11:14:05.833 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 podman[28995]: 2024-04-25 11:14:05.598822723 +0000 UTC m=+0.705329382 container cleanup 46a75723734f7deb23c0aec33924de7750a8fcf1892693dcd2c8f7c1993a9258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:14:05.833 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 bash[28995]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a 2024-04-25T11:14:06.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 podman[29009]: 2024-04-25 11:14:05.833391956 +0000 UTC m=+0.585124071 container remove 46a75723734f7deb23c0aec33924de7750a8fcf1892693dcd2c8f7c1993a9258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:14:06.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 systemd[1]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-25T11:14:06.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 systemd[1]: Stopped Ceph mon.a for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:14:06.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:05 smithi080 systemd[1]: Starting Ceph mon.a for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:14:06.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 podman[29106]: 2024-04-25 11:14:06.159213132 +0000 UTC m=+0.111188597 container create 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:14:06.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 podman[29106]: 2024-04-25 11:14:06.066061561 +0000 UTC m=+0.018037040 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:14:06.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 podman[29106]: 2024-04-25 11:14:06.353311872 +0000 UTC m=+0.305287341 container init 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-04-25T11:14:06.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 podman[29106]: 2024-04-25 11:14:06.356147576 +0000 UTC m=+0.308123043 container start 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev), process ceph-mon, pid 2 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: pidfile_write: ignore empty --pid-file 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: load: jerasure load: lrc 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: RocksDB version: 7.9.2 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Git sha 0 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Compile date 2024-04-25 02:57:34 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: DB SUMMARY 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: DB Session ID: H7UACIBMD9MVALOMKKFY 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: CURRENT file: CURRENT 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-25T11:14:06.437 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105092 ; 2024-04-25T11:14:06.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.error_if_exists: 0 2024-04-25T11:14:06.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.create_if_missing: 0 2024-04-25T11:14:06.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.paranoid_checks: 1 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.env: 0x5652c831c500 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.info_log: 0x5652c9515fc0 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.statistics: (nil) 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.use_fsync: 0 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_log_file_size: 0 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T11:14:06.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.allow_fallocate: 1 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.use_direct_reads: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.db_log_dir: 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.wal_dir: 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T11:14:06.440 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.write_buffer_manager: 0x5652c94e68c0 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T11:14:06.441 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.unordered_write: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.row_cache: None 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.wal_filter: None 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.two_write_queues: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.wal_compression: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.atomic_flush: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T11:14:06.442 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.log_readahead_size: 0 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_background_jobs: 2 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_background_compactions: -1 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_subcompactions: 1 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T11:14:06.443 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_open_files: -1 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_background_flushes: -1 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Compression algorithms supported: 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T11:14:06.444 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kZSTD supported: 0 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kXpressCompression supported: 0 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kZlibCompression supported: 1 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kSnappyCompression supported: 1 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kLZ4Compression supported: 1 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: kBZip2Compression supported: 0 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.merge_operator: 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_filter: None 2024-04-25T11:14:06.445 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5652c961c1a0) 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: cache_index_and_filter_blocks: 1 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: pin_top_level_index_and_filter: 1 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_type: 0 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: data_block_index_type: 0 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_shortening: 1 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: checksum: 4 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: no_block_cache: 0 2024-04-25T11:14:06.446 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache: 0x5652c95191f0 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_name: BinnedLRUCache 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_options: 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: capacity : 536870912 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: num_shard_bits : 4 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: strict_capacity_limit : 0 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: high_pri_pool_ratio: 0.000 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_compressed: (nil) 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: persistent_cache: (nil) 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_size: 4096 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_size_deviation: 10 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_restart_interval: 16 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_block_restart_interval: 1 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: metadata_block_size: 4096 2024-04-25T11:14:06.447 INFO:journalctl@ceph.mon.a.smithi080.stdout: partition_filters: 0 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: use_delta_encoding: 1 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: filter_policy: bloomfilter 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: whole_key_filtering: 1 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: verify_compression: 0 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: read_amp_bytes_per_bit: 0 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: format_version: 5 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: enable_index_compression: 1 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_align: 0 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: max_auto_readahead_size: 262144 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: prepopulate_block_cache: 0 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: initial_auto_readahead_size: 8192 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T11:14:06.448 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression: NoCompression 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.num_levels: 7 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T11:14:06.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T11:14:06.450 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T11:14:06.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T11:14:06.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T11:14:06.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T11:14:06.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T11:14:06.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T11:14:06.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T11:14:06.451 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T11:14:06.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T11:14:06.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.inplace_update_support: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.bloom_locality: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.max_successive_merges: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.ttl: 2592000 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T11:14:06.454 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.enable_blob_files: false 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.min_blob_size: 0 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 046399c6-7098-4dd1-9861-40850b4b188a 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714043646395616, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-25T11:14:06.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714043646396766, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100251, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 98136, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14161, "raw_average_key_size": 49, "raw_value_size": 90436, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714043646, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "046399c6-7098-4dd1-9861-40850b4b188a", "db_session_id": "H7UACIBMD9MVALOMKKFY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714043646396849, "job": 1, "event": "recovery_finished"} 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5652c94fdc00 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: DB pointer 0x5652ce2f0000 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** DB Stats ** 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T11:14:06.456 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: L0 2/0 99.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: Sum 2/0 99.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 138.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T11:14:06.457 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative compaction: 0.00 GB write, 29.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval compaction: 0.00 GB write, 29.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Block cache BinnedLRUCache@0x5652c95191f0#2 capacity: 512.00 MB usage: 1.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.03 KB,0.000196695%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-25T11:14:06.458 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: starting mon.a rank 0 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???) e1 preinit fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???).mds e1 new map 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???).mds e1 print_map 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout: e1 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout: legacy client fscid: -1 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout: No filesystems configured 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T11:14:06.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-25T11:14:06.460 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 bash[29106]: 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 2024-04-25T11:14:06.460 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 systemd[1]: Started Ceph mon.a for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:14:06.460 INFO:teuthology.orchestra.run.smithi080.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-25T11:14:06.755 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: monmap epoch 1 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: last_changed 2024-04-25T11:13:57.766755+0000 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: min_mon_release 19 (squid) 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: election_strategy: 1 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: fsmap 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T11:14:06.756 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:06 smithi080 ceph-mon[29126]: mgrmap e1: no daemons active 2024-04-25T11:14:07.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.865+0000 7fd290317700 1 Processor -- start 2024-04-25T11:14:07.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.866+0000 7fd290317700 1 -- start start 2024-04-25T11:14:07.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.866+0000 7fd290317700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28810c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:07.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.866+0000 7fd290317700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd28810cc60 con 0x7fd28807d560 2024-04-25T11:14:07.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.866+0000 7fd28e0b3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28810c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:07.466 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.866+0000 7fd28e0b3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28810c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48070/0 (socket says 172.21.15.80:48070) 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.866+0000 7fd28e0b3700 1 -- 172.21.15.80:0/957002413 learned_addr learned my addr 172.21.15.80:0/957002413 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.867+0000 7fd28e0b3700 1 -- 172.21.15.80:0/957002413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28810cde0 con 0x7fd28807d560 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.867+0000 7fd28e0b3700 1 --2- 172.21.15.80:0/957002413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28810c670 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098a0 tx=0x7fd284009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61480a31fc466ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.867+0000 7fd28d0b1700 1 -- 172.21.15.80:0/957002413 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd284004160 con 0x7fd28807d560 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.867+0000 7fd28d0b1700 1 -- 172.21.15.80:0/957002413 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd284004300 con 0x7fd28807d560 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.867+0000 7fd28d0b1700 1 -- 172.21.15.80:0/957002413 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd284011af0 con 0x7fd28807d560 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 -- 172.21.15.80:0/957002413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 msgr2=0x7fd28810c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 --2- 172.21.15.80:0/957002413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28810c670 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098a0 tx=0x7fd284009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 -- 172.21.15.80:0/957002413 shutdown_connections 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 --2- 172.21.15.80:0/957002413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28810c670 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 -- 172.21.15.80:0/957002413 >> 172.21.15.80:0/957002413 conn(0x7fd288104080 msgr2=0x7fd288106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 -- 172.21.15.80:0/957002413 shutdown_connections 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 -- 172.21.15.80:0/957002413 wait complete. 2024-04-25T11:14:07.467 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 Processor -- start 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.868+0000 7fd290317700 1 -- start start 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd290317700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28819de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd290317700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd28810ddf0 con 0x7fd28807d560 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd28e0b3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28819de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd28e0b3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28819de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48082/0 (socket says 172.21.15.80:48082) 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd28e0b3700 1 -- 172.21.15.80:0/2228690198 learned_addr learned my addr 172.21.15.80:0/2228690198 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd28e0b3700 1 -- 172.21.15.80:0/2228690198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28819e3d0 con 0x7fd28807d560 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd28e0b3700 1 --2- 172.21.15.80:0/2228690198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28819de90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd284009fb0 tx=0x7fd284011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:07.468 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd27f7fe700 1 -- 172.21.15.80:0/2228690198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd284011bc0 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd27f7fe700 1 -- 172.21.15.80:0/2228690198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd284024440 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd27f7fe700 1 -- 172.21.15.80:0/2228690198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd28401a5c0 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28819e660 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.869+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2881a1270 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.870+0000 7fd27f7fe700 1 -- 172.21.15.80:0/2228690198 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd28401ac10 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.870+0000 7fd27f7fe700 1 -- 172.21.15.80:0/2228690198 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd284019700 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.870+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd288064cf0 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.873+0000 7fd27f7fe700 1 -- 172.21.15.80:0/2228690198 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd28402dde0 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.941+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fd2881a1560 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.943+0000 7fd27f7fe700 1 -- 172.21.15.80:0/2228690198 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fd2840245f0 con 0x7fd28807d560 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.944+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 msgr2=0x7fd28819de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.944+0000 7fd290317700 1 --2- 172.21.15.80:0/2228690198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28819de90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd284009fb0 tx=0x7fd284011890 comp rx=0 tx=0).stop 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.944+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 shutdown_connections 2024-04-25T11:14:07.469 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.944+0000 7fd290317700 1 --2- 172.21.15.80:0/2228690198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd28807d560 0x7fd28819de90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:07.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.944+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 >> 172.21.15.80:0/2228690198 conn(0x7fd288104080 msgr2=0x7fd288104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:07.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.944+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 shutdown_connections 2024-04-25T11:14:07.470 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:06.944+0000 7fd290317700 1 -- 172.21.15.80:0/2228690198 wait complete. 2024-04-25T11:14:07.470 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-25T11:14:07.491 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:14:07.492 INFO:teuthology.orchestra.run.smithi080.stdout:Creating mgr... 2024-04-25T11:14:07.492 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-25T11:14:07.492 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-25T11:14:07.739 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.x 2024-04-25T11:14:07.740 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-25T11:14:07.880 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bba277ec-02f4-11ef-bc93-c7b262605968.target.wants/ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-bba277ec-02f4-11ef-bc93-c7b262605968@.service. 2024-04-25T11:14:08.103 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:07 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2228690198' entity='client.admin' 2024-04-25T11:14:08.379 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:08 smithi080 podman[29340]: 2024-04-25 11:14:08.315758837 +0000 UTC m=+0.316732498 container start 9991e343a928f6601477e49179d20381d9dac74cb651e8919c1a232b7b6a2861 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T11:14:08.379 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:08 smithi080 bash[29340]: 9991e343a928f6601477e49179d20381d9dac74cb651e8919c1a232b7b6a2861 2024-04-25T11:14:08.392 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T11:14:08.392 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-25T11:14:08.400 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T11:14:08.400 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-25T11:14:08.400 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-25T11:14:08.400 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T11:14:08.408 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T11:14:08.408 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-25T11:14:08.415 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T11:14:08.416 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-25T11:14:08.416 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-25T11:14:08.416 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-25T11:14:08.416 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr to start... 2024-04-25T11:14:08.416 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr... 2024-04-25T11:14:08.634 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:08 smithi080 systemd[1]: Started Ceph mgr.x for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:14:08.635 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:08.493+0000 7f7bf083a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:14:08.982 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:08.680+0000 7f7bf083a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:14:08.982 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:08.783+0000 7f7bf083a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:14:09.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:09 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2960306752' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T11:14:09.385 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:09.108+0000 7f7bf083a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:14:09.385 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:09.193+0000 7f7bf083a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:14:09.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:09.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:09.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-25T11:14:09.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:09.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:09.593 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T11:14:01.467137+0000", 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.901+0000 7f0d909f1700 1 Processor -- start 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.901+0000 7f0d909f1700 1 -- start start 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.901+0000 7f0d909f1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c10c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.901+0000 7f0d909f1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c10cb70 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c10c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c10c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48116/0 (socket says 172.21.15.80:48116) 2024-04-25T11:14:09.594 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8a59c700 1 -- 172.21.15.80:0/2172014612 learned_addr learned my addr 172.21.15.80:0/2172014612 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8a59c700 1 -- 172.21.15.80:0/2172014612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c10ccf0 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8a59c700 1 --2- 172.21.15.80:0/2172014612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c10c560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0098a0 tx=0x7f0d7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740fd73a27b8a40f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8959a700 1 -- 172.21.15.80:0/2172014612 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d7c004160 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8959a700 1 -- 172.21.15.80:0/2172014612 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0d7c004300 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.902+0000 7f0d8959a700 1 -- 172.21.15.80:0/2172014612 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d7c011af0 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.903+0000 7f0d909f1700 1 -- 172.21.15.80:0/2172014612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 msgr2=0x7f0d8c10c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.903+0000 7f0d909f1700 1 --2- 172.21.15.80:0/2172014612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c10c560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0098a0 tx=0x7f0d7c009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.903+0000 7f0d909f1700 1 -- 172.21.15.80:0/2172014612 shutdown_connections 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.903+0000 7f0d909f1700 1 --2- 172.21.15.80:0/2172014612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c10c560 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.903+0000 7f0d909f1700 1 -- 172.21.15.80:0/2172014612 >> 172.21.15.80:0/2172014612 conn(0x7f0d8c103f90 msgr2=0x7f0d8c106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.903+0000 7f0d909f1700 1 -- 172.21.15.80:0/2172014612 shutdown_connections 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.903+0000 7f0d909f1700 1 -- 172.21.15.80:0/2172014612 wait complete. 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.904+0000 7f0d909f1700 1 Processor -- start 2024-04-25T11:14:09.595 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.904+0000 7f0d909f1700 1 -- start start 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.904+0000 7f0d909f1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c19de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.904+0000 7f0d909f1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c10dd70 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d8a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c19de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d8a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c19de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48122/0 (socket says 172.21.15.80:48122) 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d8a59c700 1 -- 172.21.15.80:0/2960306752 learned_addr learned my addr 172.21.15.80:0/2960306752 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d8a59c700 1 -- 172.21.15.80:0/2960306752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c19e3d0 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d8a59c700 1 --2- 172.21.15.80:0/2960306752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c19de90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0117b0 tx=0x7f0d7c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d7b7fe700 1 -- 172.21.15.80:0/2960306752 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d7c0039c0 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c19e660 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c1a1270 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d7b7fe700 1 -- 172.21.15.80:0/2960306752 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0d7c003b60 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.905+0000 7f0d7b7fe700 1 -- 172.21.15.80:0/2960306752 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d7c0042a0 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.906+0000 7f0d7b7fe700 1 -- 172.21.15.80:0/2960306752 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d7c019870 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.596 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.906+0000 7f0d7b7fe700 1 -- 172.21.15.80:0/2960306752 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0d7c024730 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.907+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6c005360 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.909+0000 7f0d7b7fe700 1 -- 172.21.15.80:0/2960306752 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0d7c043e50 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.981+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0d6c005650 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.982+0000 7f0d7b7fe700 1 -- 172.21.15.80:0/2960306752 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0d7c032020 con 0x7f0d8c07ccf0 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.983+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 msgr2=0x7f0d8c19de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.983+0000 7f0d909f1700 1 --2- 172.21.15.80:0/2960306752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c19de90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0117b0 tx=0x7f0d7c011b70 comp rx=0 tx=0).stop 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.983+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 shutdown_connections 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.983+0000 7f0d909f1700 1 --2- 172.21.15.80:0/2960306752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d8c07ccf0 0x7f0d8c19de90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.983+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 >> 172.21.15.80:0/2960306752 conn(0x7f0d8c103f90 msgr2=0x7f0d8c104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.983+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 shutdown_connections 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:08.983+0000 7f0d909f1700 1 -- 172.21.15.80:0/2960306752 wait complete. 2024-04-25T11:14:09.597 INFO:teuthology.orchestra.run.smithi080.stdout:mgr not available, waiting (1/15)... 2024-04-25T11:14:10.737 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:10.399+0000 7f7bf083a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:14:10.737 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:10.568+0000 7f7bf083a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:14:10.737 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:10.736+0000 7f7bf083a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:14:11.315 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:11.021+0000 7f7bf083a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:14:11.315 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:11.113+0000 7f7bf083a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:14:11.316 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:11.314+0000 7f7bf083a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:14:11.634 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:11.505+0000 7f7bf083a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:14:12.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:12 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4004639556' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T11:14:12.385 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:12.116+0000 7f7bf083a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:14:12.801 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:12.542+0000 7f7bf083a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:14:12.801 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:12.636+0000 7f7bf083a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:14:12.815 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:12.816 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:12.816 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:14:12.816 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T11:14:12.816 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T11:14:12.816 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T11:14:12.816 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:12.817 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:12.818 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:12.819 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T11:14:01.467137+0000", 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.034+0000 7efc68be4700 1 Processor -- start 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.034+0000 7efc68be4700 1 -- start start 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc68be4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6410b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc68be4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc6410b9c0 con 0x7efc6410afe0 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc6259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6410b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:12.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc6259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6410b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48126/0 (socket says 172.21.15.80:48126) 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc6259c700 1 -- 172.21.15.80:0/2396445940 learned_addr learned my addr 172.21.15.80:0/2396445940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc6259c700 1 -- 172.21.15.80:0/2396445940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6410bb40 con 0x7efc6410afe0 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc6259c700 1 --2- 172.21.15.80:0/2396445940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6410b3f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efc580098a0 tx=0x7efc58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bc4ffb715f23df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.035+0000 7efc6159a700 1 -- 172.21.15.80:0/2396445940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc58004160 con 0x7efc6410afe0 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.036+0000 7efc6159a700 1 -- 172.21.15.80:0/2396445940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7efc58004300 con 0x7efc6410afe0 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.036+0000 7efc6159a700 1 -- 172.21.15.80:0/2396445940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc58011af0 con 0x7efc6410afe0 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.036+0000 7efc68be4700 1 -- 172.21.15.80:0/2396445940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 msgr2=0x7efc6410b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.036+0000 7efc68be4700 1 --2- 172.21.15.80:0/2396445940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6410b3f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efc580098a0 tx=0x7efc58009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.037+0000 7efc68be4700 1 -- 172.21.15.80:0/2396445940 shutdown_connections 2024-04-25T11:14:12.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.037+0000 7efc68be4700 1 --2- 172.21.15.80:0/2396445940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6410b3f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.037+0000 7efc68be4700 1 -- 172.21.15.80:0/2396445940 >> 172.21.15.80:0/2396445940 conn(0x7efc64103740 msgr2=0x7efc64105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.037+0000 7efc68be4700 1 -- 172.21.15.80:0/2396445940 shutdown_connections 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.037+0000 7efc68be4700 1 -- 172.21.15.80:0/2396445940 wait complete. 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.037+0000 7efc68be4700 1 Processor -- start 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.037+0000 7efc68be4700 1 -- start start 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc68be4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6419df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc68be4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc64108890 con 0x7efc6410afe0 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc6259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6419df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc6259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6419df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48128/0 (socket says 172.21.15.80:48128) 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc6259c700 1 -- 172.21.15.80:0/4004639556 learned_addr learned my addr 172.21.15.80:0/4004639556 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc6259c700 1 -- 172.21.15.80:0/4004639556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6419e490 con 0x7efc6410afe0 2024-04-25T11:14:12.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc6259c700 1 --2- 172.21.15.80:0/4004639556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6419df50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc580117b0 tx=0x7efc58011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc537fe700 1 -- 172.21.15.80:0/4004639556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc580039c0 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc537fe700 1 -- 172.21.15.80:0/4004639556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7efc58003b60 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.038+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6419e720 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.039+0000 7efc537fe700 1 -- 172.21.15.80:0/4004639556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc58019550 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.039+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc641a1330 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.039+0000 7efc537fe700 1 -- 172.21.15.80:0/4004639556 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc58019ba0 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.039+0000 7efc537fe700 1 -- 172.21.15.80:0/4004639556 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efc58024730 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.040+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc64064cf0 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.042+0000 7efc537fe700 1 -- 172.21.15.80:0/4004639556 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7efc580042c0 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.112+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7efc6402e810 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.113+0000 7efc537fe700 1 -- 172.21.15.80:0/4004639556 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7efc5801a950 con 0x7efc6410afe0 2024-04-25T11:14:12.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.114+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 msgr2=0x7efc6419df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.114+0000 7efc68be4700 1 --2- 172.21.15.80:0/4004639556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6419df50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc580117b0 tx=0x7efc58011b70 comp rx=0 tx=0).stop 2024-04-25T11:14:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.114+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 shutdown_connections 2024-04-25T11:14:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.114+0000 7efc68be4700 1 --2- 172.21.15.80:0/4004639556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6410afe0 0x7efc6419df50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.114+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 >> 172.21.15.80:0/4004639556 conn(0x7efc64103740 msgr2=0x7efc64104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.114+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 shutdown_connections 2024-04-25T11:14:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:12.114+0000 7efc68be4700 1 -- 172.21.15.80:0/4004639556 wait complete. 2024-04-25T11:14:12.825 INFO:teuthology.orchestra.run.smithi080.stdout:mgr not available, waiting (2/15)... 2024-04-25T11:14:13.135 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:12.839+0000 7f7bf083a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:14:13.634 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:13.375+0000 7f7bf083a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:14:13.635 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:13.466+0000 7f7bf083a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:14:14.040 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:13.705+0000 7f7bf083a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:14:14.040 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:13.836+0000 7f7bf083a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:14:14.040 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:13.928+0000 7f7bf083a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:14:14.041 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:14.040+0000 7f7bf083a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:14:14.635 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:14.337+0000 7f7bf083a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:14:15.211 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:14.939+0000 7f7bf083a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:14:15.211 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:15.156+0000 7f7bf083a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: Activating manager daemon x 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: mgrmap e2: x(active, starting, since 0.0036174s) 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: Manager daemon x is now available 2024-04-25T11:14:15.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T11:14:15.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T11:14:15.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' 2024-04-25T11:14:15.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' 2024-04-25T11:14:15.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:15 smithi080 ceph-mon[29126]: from='mgr.14100 172.21.15.80:0/1234317698' entity='mgr.x' 2024-04-25T11:14:15.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:15.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:15.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:14:15.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T11:14:15.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T11:14:15.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T11:14:15.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T11:14:15.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T11:14:15.981 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T11:14:01.467137+0000", 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.275+0000 7f00863a5700 1 Processor -- start 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.275+0000 7f00863a5700 1 -- start start 2024-04-25T11:14:15.982 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f00863a5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008010c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f00863a5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f008010cbf0 con 0x7f008007d580 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008010c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008010c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48200/0 (socket says 172.21.15.80:48200) 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007ffff700 1 -- 172.21.15.80:0/298075015 learned_addr learned my addr 172.21.15.80:0/298075015 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007ffff700 1 -- 172.21.15.80:0/298075015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008010cd70 con 0x7f008007d580 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007ffff700 1 --2- 172.21.15.80:0/298075015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008010c5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00700098a0 tx=0x7f0070009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9c4461f22c557d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007effd700 1 -- 172.21.15.80:0/298075015 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0070004160 con 0x7f008007d580 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007effd700 1 -- 172.21.15.80:0/298075015 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0070004300 con 0x7f008007d580 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.276+0000 7f007effd700 1 -- 172.21.15.80:0/298075015 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0070011af0 con 0x7f008007d580 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.277+0000 7f00863a5700 1 -- 172.21.15.80:0/298075015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 msgr2=0x7f008010c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.277+0000 7f00863a5700 1 --2- 172.21.15.80:0/298075015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008010c5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00700098a0 tx=0x7f0070009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.277+0000 7f00863a5700 1 -- 172.21.15.80:0/298075015 shutdown_connections 2024-04-25T11:14:15.983 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.277+0000 7f00863a5700 1 --2- 172.21.15.80:0/298075015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008010c5e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.277+0000 7f00863a5700 1 -- 172.21.15.80:0/298075015 >> 172.21.15.80:0/298075015 conn(0x7f0080104030 msgr2=0x7f00801064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.277+0000 7f00863a5700 1 -- 172.21.15.80:0/298075015 shutdown_connections 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.277+0000 7f00863a5700 1 -- 172.21.15.80:0/298075015 wait complete. 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.278+0000 7f00863a5700 1 Processor -- start 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.278+0000 7f00863a5700 1 -- start start 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.278+0000 7f00863a5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008019de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.278+0000 7f00863a5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f008010ddf0 con 0x7f008007d580 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.278+0000 7f007ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008019de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.278+0000 7f007ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008019de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48214/0 (socket says 172.21.15.80:48214) 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.278+0000 7f007ffff700 1 -- 172.21.15.80:0/2558321194 learned_addr learned my addr 172.21.15.80:0/2558321194 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.279+0000 7f007ffff700 1 -- 172.21.15.80:0/2558321194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008019e3b0 con 0x7f008007d580 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.279+0000 7f007ffff700 1 --2- 172.21.15.80:0/2558321194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008019de70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00700117b0 tx=0x7f0070011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.279+0000 7f007d7fa700 1 -- 172.21.15.80:0/2558321194 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00700039c0 con 0x7f008007d580 2024-04-25T11:14:15.984 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.279+0000 7f007d7fa700 1 -- 172.21.15.80:0/2558321194 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0070003b60 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.279+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008019e640 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.279+0000 7f007d7fa700 1 -- 172.21.15.80:0/2558321194 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00700196a0 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.279+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00801a1250 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.280+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0080064cf0 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.280+0000 7f007d7fa700 1 -- 172.21.15.80:0/2558321194 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 2) ==== 49272+0+0 (secure 0 0 0) 0x7f0070019910 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.280+0000 7f007d7fa700 1 -- 172.21.15.80:0/2558321194 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f00700525e0 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.282+0000 7f007d7fa700 1 -- 172.21.15.80:0/2558321194 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0070020e20 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.353+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f00801a1470 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.353+0000 7f007d7fa700 1 -- 172.21.15.80:0/2558321194 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0070019cb0 con 0x7f008007d580 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.354+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 msgr2=0x7f008019de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.354+0000 7f00863a5700 1 --2- 172.21.15.80:0/2558321194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008019de70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00700117b0 tx=0x7f0070011b70 comp rx=0 tx=0).stop 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.354+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 shutdown_connections 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.354+0000 7f00863a5700 1 --2- 172.21.15.80:0/2558321194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f008007d580 0x7f008019de70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:15.985 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.354+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 >> 172.21.15.80:0/2558321194 conn(0x7f0080104030 msgr2=0x7f0080104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:15.986 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.354+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 shutdown_connections 2024-04-25T11:14:15.986 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:15.354+0000 7f00863a5700 1 -- 172.21.15.80:0/2558321194 wait complete. 2024-04-25T11:14:15.986 INFO:teuthology.orchestra.run.smithi080.stdout:mgr not available, waiting (3/15)... 2024-04-25T11:14:16.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:16 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2558321194' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T11:14:16.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:16 smithi080 ceph-mon[29126]: mgrmap e3: x(active, since 1.00773s) 2024-04-25T11:14:18.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:18 smithi080 ceph-mon[29126]: mgrmap e4: x(active, since 2s) 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2024-04-25T11:14:19.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T11:14:19.336 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T11:14:19.337 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T11:14:19.338 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T11:14:01.467137+0000", 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.425+0000 7f66b0de0700 1 Processor -- start 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.425+0000 7f66b0de0700 1 -- start start 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.425+0000 7f66b0de0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac109f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.425+0000 7f66b0de0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac10a4f0 con 0x7f66ac109af0 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.425+0000 7f66aa59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.425+0000 7f66aa59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac109f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39782/0 (socket says 172.21.15.80:39782) 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.425+0000 7f66aa59c700 1 -- 172.21.15.80:0/65616536 learned_addr learned my addr 172.21.15.80:0/65616536 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.426+0000 7f66aa59c700 1 -- 172.21.15.80:0/65616536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac10ac20 con 0x7f66ac109af0 2024-04-25T11:14:19.339 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.426+0000 7f66aa59c700 1 --2- 172.21.15.80:0/65616536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac109f00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f669c0098a0 tx=0x7f669c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34436b1a1b4bfc6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.426+0000 7f66a959a700 1 -- 172.21.15.80:0/65616536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f669c004160 con 0x7f66ac109af0 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.426+0000 7f66a959a700 1 -- 172.21.15.80:0/65616536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f669c004300 con 0x7f66ac109af0 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.426+0000 7f66a959a700 1 -- 172.21.15.80:0/65616536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f669c011af0 con 0x7f66ac109af0 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.427+0000 7f66b0de0700 1 -- 172.21.15.80:0/65616536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 msgr2=0x7f66ac109f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.427+0000 7f66b0de0700 1 --2- 172.21.15.80:0/65616536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac109f00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f669c0098a0 tx=0x7f669c009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.427+0000 7f66b0de0700 1 -- 172.21.15.80:0/65616536 shutdown_connections 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.427+0000 7f66b0de0700 1 --2- 172.21.15.80:0/65616536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac109f00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.427+0000 7f66b0de0700 1 -- 172.21.15.80:0/65616536 >> 172.21.15.80:0/65616536 conn(0x7f66ac105110 msgr2=0x7f66ac1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.427+0000 7f66b0de0700 1 -- 172.21.15.80:0/65616536 shutdown_connections 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.427+0000 7f66b0de0700 1 -- 172.21.15.80:0/65616536 wait complete. 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66b0de0700 1 Processor -- start 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66b0de0700 1 -- start start 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66b0de0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac19df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:19.340 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66b0de0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac10dfd0 con 0x7f66ac109af0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66aa59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac19df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66aa59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac19df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39786/0 (socket says 172.21.15.80:39786) 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66aa59c700 1 -- 172.21.15.80:0/613329437 learned_addr learned my addr 172.21.15.80:0/613329437 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.428+0000 7f66aa59c700 1 -- 172.21.15.80:0/613329437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac19e480 con 0x7f66ac109af0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.429+0000 7f66aa59c700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac19df40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f669c009fb0 tx=0x7f669c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.429+0000 7f669b7fe700 1 -- 172.21.15.80:0/613329437 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f669c0036a0 con 0x7f66ac109af0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.429+0000 7f669b7fe700 1 -- 172.21.15.80:0/613329437 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f669c003cd0 con 0x7f66ac109af0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.429+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac19e710 con 0x7f66ac109af0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.429+0000 7f669b7fe700 1 -- 172.21.15.80:0/613329437 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f669c01a430 con 0x7f66ac109af0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.429+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac1a1320 con 0x7f66ac109af0 2024-04-25T11:14:19.341 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.430+0000 7f669b7fe700 1 -- 172.21.15.80:0/613329437 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) ==== 49505+0+0 (secure 0 0 0) 0x7f669c01a6f0 con 0x7f66ac109af0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.430+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac064cf0 con 0x7f66ac109af0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.430+0000 7f669b7fe700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f669403d4d0 0x7f669403f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.430+0000 7f669b7fe700 1 -- 172.21.15.80:0/613329437 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f669c052490 con 0x7f66ac109af0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.430+0000 7f66a9d9b700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f669403d4d0 0x7f669403f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.431+0000 7f66a9d9b700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f669403d4d0 0x7f669403f9e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66a0006fd0 tx=0x7f66a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.436+0000 7f669b7fe700 1 -- 172.21.15.80:0/613329437 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f669c017e90 con 0x7f66ac109af0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.724+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f66ac1a19a0 con 0x7f66ac109af0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.724+0000 7f669b7fe700 1 -- 172.21.15.80:0/613329437 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f669c02c350 con 0x7f66ac109af0 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.726+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f669403d4d0 msgr2=0x7f669403f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.726+0000 7f66b0de0700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f669403d4d0 0x7f669403f9e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66a0006fd0 tx=0x7f66a0006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.726+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 msgr2=0x7f66ac19df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.726+0000 7f66b0de0700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac19df40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f669c009fb0 tx=0x7f669c011890 comp rx=0 tx=0).stop 2024-04-25T11:14:19.342 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.726+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 shutdown_connections 2024-04-25T11:14:19.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.726+0000 7f66b0de0700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f669403d4d0 0x7f669403f9e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:19.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.726+0000 7f66b0de0700 1 --2- 172.21.15.80:0/613329437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66ac109af0 0x7f66ac19df40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:19.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.727+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 >> 172.21.15.80:0/613329437 conn(0x7f66ac105110 msgr2=0x7f66ac105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:19.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.727+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 shutdown_connections 2024-04-25T11:14:19.343 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:18.727+0000 7f66b0de0700 1 -- 172.21.15.80:0/613329437 wait complete. 2024-04-25T11:14:19.343 INFO:teuthology.orchestra.run.smithi080.stdout:mgr is available 2024-04-25T11:14:19.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/613329437' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T11:14:20.553 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/765600358' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T11:14:20.555 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout fsid = bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T11:14:20.562 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.775+0000 7f0992745700 1 Processor -- start 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.775+0000 7f0992745700 1 -- start start 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.775+0000 7f0992745700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c10ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.775+0000 7f0992745700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f098c10ef60 con 0x7f098c07d540 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c10ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c10ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39800/0 (socket says 172.21.15.80:39800) 2024-04-25T11:14:20.563 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098bfff700 1 -- 172.21.15.80:0/2165284608 learned_addr learned my addr 172.21.15.80:0/2165284608 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098bfff700 1 -- 172.21.15.80:0/2165284608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c10f0e0 con 0x7f098c07d540 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098bfff700 1 --2- 172.21.15.80:0/2165284608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c10ea20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f097c0098a0 tx=0x7f097c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce5cbda91bf749b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098affd700 1 -- 172.21.15.80:0/2165284608 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f097c004160 con 0x7f098c07d540 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098affd700 1 -- 172.21.15.80:0/2165284608 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f097c004300 con 0x7f098c07d540 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.776+0000 7f098affd700 1 -- 172.21.15.80:0/2165284608 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f097c011af0 con 0x7f098c07d540 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.777+0000 7f0992745700 1 -- 172.21.15.80:0/2165284608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 msgr2=0x7f098c10ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.777+0000 7f0992745700 1 --2- 172.21.15.80:0/2165284608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c10ea20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f097c0098a0 tx=0x7f097c009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.777+0000 7f0992745700 1 -- 172.21.15.80:0/2165284608 shutdown_connections 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.777+0000 7f0992745700 1 --2- 172.21.15.80:0/2165284608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c10ea20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.777+0000 7f0992745700 1 -- 172.21.15.80:0/2165284608 >> 172.21.15.80:0/2165284608 conn(0x7f098c104030 msgr2=0x7f098c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.777+0000 7f0992745700 1 -- 172.21.15.80:0/2165284608 shutdown_connections 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.777+0000 7f0992745700 1 -- 172.21.15.80:0/2165284608 wait complete. 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f0992745700 1 Processor -- start 2024-04-25T11:14:20.564 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f0992745700 1 -- start start 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f0992745700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c1a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f0992745700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f098c10fff0 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f098bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c1a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f098bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c1a0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39806/0 (socket says 172.21.15.80:39806) 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f098bfff700 1 -- 172.21.15.80:0/765600358 learned_addr learned my addr 172.21.15.80:0/765600358 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.778+0000 7f098bfff700 1 -- 172.21.15.80:0/765600358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c1a05b0 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.779+0000 7f098bfff700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c1a0070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f097c009fb0 tx=0x7f097c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.779+0000 7f09897fa700 1 -- 172.21.15.80:0/765600358 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f097c011bc0 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.779+0000 7f09897fa700 1 -- 172.21.15.80:0/765600358 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f097c024440 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.779+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f098c1a0840 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.779+0000 7f09897fa700 1 -- 172.21.15.80:0/765600358 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f097c01a5c0 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.779+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098c1a3450 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.780+0000 7f09897fa700 1 -- 172.21.15.80:0/765600358 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) ==== 49505+0+0 (secure 0 0 0) 0x7f097c01a830 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.780+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f098c064cf0 con 0x7f098c07d540 2024-04-25T11:14:20.565 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.780+0000 7f09897fa700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f097403d520 0x7f097403fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.780+0000 7f09897fa700 1 -- 172.21.15.80:0/765600358 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f097c052620 con 0x7f098c07d540 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.780+0000 7f098b7fe700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f097403d520 0x7f097403fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.780+0000 7f098b7fe700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f097403d520 0x7f097403fa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0980006fd0 tx=0x7f0980006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.785+0000 7f09897fa700 1 -- 172.21.15.80:0/765600358 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f097c017e90 con 0x7f098c07d540 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.978+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f098c1a4c50 con 0x7f098c07d540 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.980+0000 7f09897fa700 1 -- 172.21.15.80:0/765600358 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f097c04ceb0 con 0x7f098c07d540 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f097403d520 msgr2=0x7f097403fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f097403d520 0x7f097403fa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0980006fd0 tx=0x7f0980006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 msgr2=0x7f098c1a0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c1a0070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f097c009fb0 tx=0x7f097c011890 comp rx=0 tx=0).stop 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 shutdown_connections 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f097403d520 0x7f097403fa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 --2- 172.21.15.80:0/765600358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f098c07d540 0x7f098c1a0070 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:20.566 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 >> 172.21.15.80:0/765600358 conn(0x7f098c104030 msgr2=0x7f098c104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:20.567 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 shutdown_connections 2024-04-25T11:14:20.567 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:19.982+0000 7f0992745700 1 -- 172.21.15.80:0/765600358 wait complete. 2024-04-25T11:14:20.567 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling cephadm module... 2024-04-25T11:14:21.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:21 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2097637136' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-25T11:14:21.625 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: ignoring --setuser ceph since I am not root 2024-04-25T11:14:21.626 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: ignoring --setgroup ceph since I am not root 2024-04-25T11:14:21.626 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:21.498+0000 7f51fb02a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:14:21.884 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:21.685+0000 7f51fb02a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:14:21.885 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:21.789+0000 7f51fb02a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.983+0000 7ff3416be700 1 Processor -- start 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.983+0000 7ff3416be700 1 -- start start 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.983+0000 7ff3416be700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c108dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.983+0000 7ff3416be700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1093b0 con 0x7ff33c1089b0 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.983+0000 7ff33affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c108dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.983+0000 7ff33affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c108dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39812/0 (socket says 172.21.15.80:39812) 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.983+0000 7ff33affd700 1 -- 172.21.15.80:0/4172733755 learned_addr learned my addr 172.21.15.80:0/4172733755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.984+0000 7ff33affd700 1 -- 172.21.15.80:0/4172733755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c109ae0 con 0x7ff33c1089b0 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.984+0000 7ff33affd700 1 --2- 172.21.15.80:0/4172733755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c108dc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3340098a0 tx=0x7ff334009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c5eec73e6a36e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.984+0000 7ff339ffb700 1 -- 172.21.15.80:0/4172733755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff334004160 con 0x7ff33c1089b0 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.984+0000 7ff339ffb700 1 -- 172.21.15.80:0/4172733755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff334004300 con 0x7ff33c1089b0 2024-04-25T11:14:21.900 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.984+0000 7ff339ffb700 1 -- 172.21.15.80:0/4172733755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff334011af0 con 0x7ff33c1089b0 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 -- 172.21.15.80:0/4172733755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 msgr2=0x7ff33c108dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 --2- 172.21.15.80:0/4172733755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c108dc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3340098a0 tx=0x7ff334009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 -- 172.21.15.80:0/4172733755 shutdown_connections 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 --2- 172.21.15.80:0/4172733755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c108dc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 -- 172.21.15.80:0/4172733755 >> 172.21.15.80:0/4172733755 conn(0x7ff33c104030 msgr2=0x7ff33c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 -- 172.21.15.80:0/4172733755 shutdown_connections 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 -- 172.21.15.80:0/4172733755 wait complete. 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.985+0000 7ff3416be700 1 Processor -- start 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff3416be700 1 -- start start 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff3416be700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c1a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff3416be700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c07ca00 con 0x7ff33c1089b0 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff33affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c1a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff33affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c1a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39828/0 (socket says 172.21.15.80:39828) 2024-04-25T11:14:21.901 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff33affd700 1 -- 172.21.15.80:0/2097637136 learned_addr learned my addr 172.21.15.80:0/2097637136 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:21.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff33affd700 1 -- 172.21.15.80:0/2097637136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c1a0600 con 0x7ff33c1089b0 2024-04-25T11:14:21.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff33affd700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c1a00c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff334011670 tx=0x7ff334004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:21.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3340036a0 con 0x7ff33c1089b0 2024-04-25T11:14:21.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.986+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c1a0890 con 0x7ff33c1089b0 2024-04-25T11:14:21.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.987+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c1a34a0 con 0x7ff33c1089b0 2024-04-25T11:14:21.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.987+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff33401a430 con 0x7ff33c1089b0 2024-04-25T11:14:21.902 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.987+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff334019550 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.987+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) ==== 49505+0+0 (secure 0 0 0) 0x7ff334019810 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.987+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff328005360 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.988+0000 7ff323fff700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7ff32403d4d0 0x7ff32403f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.988+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff334052550 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.988+0000 7ff33a7fc700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7ff32403d4d0 0x7ff32403f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.988+0000 7ff33a7fc700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7ff32403d4d0 0x7ff32403f9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff330006fd0 tx=0x7ff330006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:20.993+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff334017e90 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.250+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff328005650 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.302+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff334023390 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.304+0000 7ff323fff700 1 -- 172.21.15.80:0/2097637136 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mgrmap(e 5) ==== 49516+0+0 (secure 0 0 0) 0x7ff33402d960 con 0x7ff33c1089b0 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7ff32403d4d0 msgr2=0x7ff32403f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7ff32403d4d0 0x7ff32403f9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff330006fd0 tx=0x7ff330006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:21.903 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 msgr2=0x7ff33c1a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:21.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c1a00c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff334011670 tx=0x7ff334004280 comp rx=0 tx=0).stop 2024-04-25T11:14:21.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 shutdown_connections 2024-04-25T11:14:21.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7ff32403d4d0 0x7ff32403f9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:21.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 --2- 172.21.15.80:0/2097637136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33c1089b0 0x7ff33c1a00c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:21.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 >> 172.21.15.80:0/2097637136 conn(0x7ff33c104030 msgr2=0x7ff33c191f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:21.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 shutdown_connections 2024-04-25T11:14:21.904 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:21.305+0000 7ff3416be700 1 -- 172.21.15.80:0/2097637136 wait complete. 2024-04-25T11:14:22.196 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:22 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:22.108+0000 7f51fb02a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:14:22.196 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:22 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:22.196+0000 7f51fb02a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:14:22.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:22 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2097637136' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-25T11:14:22.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:22 smithi080 ceph-mon[29126]: mgrmap e5: x(active, since 6s) 2024-04-25T11:14:23.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:23.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-25T11:14:23.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T11:14:23.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T11:14:23.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T11:14:23.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:23.187 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.313+0000 7f2c7fe93700 1 Processor -- start 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.313+0000 7f2c7fe93700 1 -- start start 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7fe93700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7810c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7fe93700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7810cbb0 con 0x7f2c7807cc70 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7dc2f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7810c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7dc2f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7810c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39854/0 (socket says 172.21.15.80:39854) 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7dc2f700 1 -- 172.21.15.80:0/2839404099 learned_addr learned my addr 172.21.15.80:0/2839404099 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7dc2f700 1 -- 172.21.15.80:0/2839404099 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7810cd30 con 0x7f2c7807cc70 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7dc2f700 1 --2- 172.21.15.80:0/2839404099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7810c5e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c740098a0 tx=0x7f2c74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ab73c47fcf695e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7cc2d700 1 -- 172.21.15.80:0/2839404099 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c74004160 con 0x7f2c7807cc70 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7cc2d700 1 -- 172.21.15.80:0/2839404099 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2c74004300 con 0x7f2c7807cc70 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.314+0000 7f2c7cc2d700 1 -- 172.21.15.80:0/2839404099 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c74011af0 con 0x7f2c7807cc70 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.315+0000 7f2c7fe93700 1 -- 172.21.15.80:0/2839404099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 msgr2=0x7f2c7810c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.315+0000 7f2c7fe93700 1 --2- 172.21.15.80:0/2839404099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7810c5e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c740098a0 tx=0x7f2c74009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.315+0000 7f2c7fe93700 1 -- 172.21.15.80:0/2839404099 shutdown_connections 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.315+0000 7f2c7fe93700 1 --2- 172.21.15.80:0/2839404099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7810c5e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.315+0000 7f2c7fe93700 1 -- 172.21.15.80:0/2839404099 >> 172.21.15.80:0/2839404099 conn(0x7f2c78103f90 msgr2=0x7f2c78106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.315+0000 7f2c7fe93700 1 -- 172.21.15.80:0/2839404099 shutdown_connections 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.315+0000 7f2c7fe93700 1 -- 172.21.15.80:0/2839404099 wait complete. 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.316+0000 7f2c7fe93700 1 Processor -- start 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.316+0000 7f2c7fe93700 1 -- start start 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.316+0000 7f2c7fe93700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7819de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.316+0000 7f2c7fe93700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7810ddb0 con 0x7f2c7807cc70 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.316+0000 7f2c7dc2f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7819de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.316+0000 7f2c7dc2f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7819de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39870/0 (socket says 172.21.15.80:39870) 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.316+0000 7f2c7dc2f700 1 -- 172.21.15.80:0/4293956172 learned_addr learned my addr 172.21.15.80:0/4293956172 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.317+0000 7f2c7dc2f700 1 -- 172.21.15.80:0/4293956172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7819e3d0 con 0x7f2c7807cc70 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.317+0000 7f2c7dc2f700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7819de90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009fb0 tx=0x7f2c74011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.317+0000 7f2c6effd700 1 -- 172.21.15.80:0/4293956172 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c74011bc0 con 0x7f2c7807cc70 2024-04-25T11:14:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.317+0000 7f2c6effd700 1 -- 172.21.15.80:0/4293956172 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2c74024440 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.317+0000 7f2c6effd700 1 -- 172.21.15.80:0/4293956172 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c7401a5c0 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.317+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7819e660 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.317+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c781a1270 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.318+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c78064cf0 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.318+0000 7f2c6effd700 1 -- 172.21.15.80:0/4293956172 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 49516+0+0 (secure 0 0 0) 0x7f2c740245f0 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.318+0000 7f2c6effd700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 0x7f2c6403fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.319+0000 7f2c6effd700 1 -- 172.21.15.80:0/4293956172 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2c74052660 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.319+0000 7f2c7d42e700 1 -- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 msgr2=0x7f2c6403fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1021361872 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.319+0000 7f2c7d42e700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 0x7f2c6403fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.324+0000 7f2c6effd700 1 -- 172.21.15.80:0/4293956172 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2c74052080 con 0x7f2c7807cc70 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.520+0000 7f2c7d42e700 1 -- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 msgr2=0x7f2c6403fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1021361872 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.520+0000 7f2c7d42e700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 0x7f2c6403fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T11:14:23.190 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.600+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2c7802e850 con 0x7f2c7807cc70 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.600+0000 7f2c6effd700 1 -- 172.21.15.80:0/4293956172 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f2c740249e0 con 0x7f2c7807cc70 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.603+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 msgr2=0x7f2c6403fa30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.603+0000 7f2c7fe93700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 0x7f2c6403fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.603+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 msgr2=0x7f2c7819de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.603+0000 7f2c7fe93700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7819de90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009fb0 tx=0x7f2c74011890 comp rx=0 tx=0).stop 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.604+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 shutdown_connections 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.604+0000 7f2c7fe93700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f2c6403d520 0x7f2c6403fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.604+0000 7f2c7fe93700 1 --2- 172.21.15.80:0/4293956172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c7807cc70 0x7f2c7819de90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.604+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 >> 172.21.15.80:0/4293956172 conn(0x7f2c78103f90 msgr2=0x7f2c78104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.604+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 shutdown_connections 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:22.604+0000 7f2c7fe93700 1 -- 172.21.15.80:0/4293956172 wait complete. 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for the mgr to restart... 2024-04-25T11:14:23.191 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr epoch 5... 2024-04-25T11:14:23.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:23 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4293956172' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T11:14:23.597 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:23.420+0000 7f51fb02a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:14:23.597 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:23.597+0000 7f51fb02a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:14:23.862 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:23.777+0000 7f51fb02a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:14:24.134 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:24.070+0000 7f51fb02a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:14:24.565 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:24.164+0000 7f51fb02a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:14:24.566 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:24.369+0000 7f51fb02a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:14:24.884 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:24.564+0000 7f51fb02a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:14:25.384 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:25.168+0000 7f51fb02a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:14:25.884 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:25.596+0000 7f51fb02a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:14:25.885 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:25.693+0000 7f51fb02a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:14:26.384 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:25.898+0000 7f51fb02a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:14:26.758 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:26.421+0000 7f51fb02a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:14:26.758 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:26.514+0000 7f51fb02a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:14:27.108 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:26.757+0000 7f51fb02a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:14:27.108 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:26.892+0000 7f51fb02a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:14:27.108 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:26.989+0000 7f51fb02a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:14:27.108 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:27 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:27.107+0000 7f51fb02a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:14:27.884 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:27 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:27.433+0000 7f51fb02a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:14:28.304 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:28.032+0000 7f51fb02a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:14:28.305 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:28.251+0000 7f51fb02a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: Active manager daemon x restarted 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: Activating manager daemon x 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: osdmap e2: 0 total, 0 up, 0 in 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: mgrmap e6: x(active, starting, since 0.00375835s) 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: Manager daemon x is now available 2024-04-25T11:14:28.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:28.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:28.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:14:28.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:14:28.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:28 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T11:14:29.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:29 smithi080 ceph-mon[29126]: Found migration_current of "None". Setting to last migration. 2024-04-25T11:14:29.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:29 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T11:14:29.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:29 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:29.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:29 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:29.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:29 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:14:29.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:29 smithi080 ceph-mon[29126]: mgrmap e7: x(active, since 1.00645s) 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.656+0000 7f653be9f700 1 Processor -- start 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f653be9f700 1 -- start start 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f653be9f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653410b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f653be9f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f653410b9c0 con 0x7f653410afe0 2024-04-25T11:14:29.865 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f6539c3b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653410b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f6539c3b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653410b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39872/0 (socket says 172.21.15.80:39872) 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f6539c3b700 1 -- 172.21.15.80:0/3293289275 learned_addr learned my addr 172.21.15.80:0/3293289275 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f6539c3b700 1 -- 172.21.15.80:0/3293289275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653410bb40 con 0x7f653410afe0 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.657+0000 7f6539c3b700 1 --2- 172.21.15.80:0/3293289275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653410b3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65240098a0 tx=0x7f6524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932ec8307bf91209 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.658+0000 7f6538c39700 1 -- 172.21.15.80:0/3293289275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6524004160 con 0x7f653410afe0 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.658+0000 7f6538c39700 1 -- 172.21.15.80:0/3293289275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6524004300 con 0x7f653410afe0 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.658+0000 7f6538c39700 1 -- 172.21.15.80:0/3293289275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6524011af0 con 0x7f653410afe0 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 -- 172.21.15.80:0/3293289275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 msgr2=0x7f653410b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 --2- 172.21.15.80:0/3293289275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653410b3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65240098a0 tx=0x7f6524009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 -- 172.21.15.80:0/3293289275 shutdown_connections 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 --2- 172.21.15.80:0/3293289275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653410b3f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 -- 172.21.15.80:0/3293289275 >> 172.21.15.80:0/3293289275 conn(0x7f6534103740 msgr2=0x7f6534105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:29.866 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 -- 172.21.15.80:0/3293289275 shutdown_connections 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 -- 172.21.15.80:0/3293289275 wait complete. 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.659+0000 7f653be9f700 1 Processor -- start 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f653be9f700 1 -- start start 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f653be9f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653419df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f653be9f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6534108890 con 0x7f653410afe0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f6539c3b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653419df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f6539c3b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653419df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39880/0 (socket says 172.21.15.80:39880) 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f6539c3b700 1 -- 172.21.15.80:0/3116012571 learned_addr learned my addr 172.21.15.80:0/3116012571 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f6539c3b700 1 -- 172.21.15.80:0/3116012571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653419e490 con 0x7f653410afe0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f6539c3b700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653419df50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6524009fb0 tx=0x7f6524011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6524011bc0 con 0x7f653410afe0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6524024440 con 0x7f653410afe0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653419e720 con 0x7f653410afe0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.661+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65341a1330 con 0x7f653410afe0 2024-04-25T11:14:29.867 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.660+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f652401a430 con 0x7f653410afe0 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.661+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 49516+0+0 (secure 0 0 0) 0x7f652401a710 con 0x7f653410afe0 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.662+0000 7f652affd700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.662+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 --> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6520040140 con 0x7f652003d520 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.662+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6524053530 con 0x7f653410afe0 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.662+0000 7f653943a700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 msgr2=0x7f652003fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1021361872 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.662+0000 7f653943a700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.863+0000 7f653943a700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 msgr2=0x7f652003fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1021361872 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:23.863+0000 7f653943a700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:24.263+0000 7f653943a700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 msgr2=0x7f652003fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1021361872 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:24.263+0000 7f653943a700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:25.064+0000 7f653943a700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 msgr2=0x7f652003fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1021361872 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:25.064+0000 7f653943a700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:26.665+0000 7f653943a700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 msgr2=0x7f652003fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1021361872 2024-04-25T11:14:29.868 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:26.665+0000 7f653943a700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:28.255+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 6) ==== 49283+0+0 (secure 0 0 0) 0x7f65240245f0 con 0x7f653410afe0 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:28.255+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 msgr2=0x7f652003fa30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:28.255+0000 7f652affd700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.256+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 7) ==== 49410+0+0 (secure 0 0 0) 0x7f6524019ca0 con 0x7f653410afe0 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.256+0000 7f652affd700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6520040e60 0x7f6520043280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.256+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f652401eec0 con 0x7f6520040e60 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.257+0000 7f653943a700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6520040e60 0x7f6520043280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.257+0000 7f653943a700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6520040e60 0x7f6520043280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6530003a10 tx=0x7f6530009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.258+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f652401eec0 con 0x7f6520040e60 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.266+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6534064cf0 con 0x7f6520040e60 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f652affd700 1 -- 172.21.15.80:0/3116012571 <== mgr.14120 v2:172.21.15.80:6800/2554689632 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f6534064cf0 con 0x7f6520040e60 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6520040e60 msgr2=0x7f6520043280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6520040e60 0x7f6520043280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6530003a10 tx=0x7f6530009290 comp rx=0 tx=0).stop 2024-04-25T11:14:29.869 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 msgr2=0x7f653419df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653419df50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6524009fb0 tx=0x7f6524011890 comp rx=0 tx=0).stop 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 shutdown_connections 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6520040e60 0x7f6520043280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f653410afe0 0x7f653419df50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 --2- 172.21.15.80:0/3116012571 >> [v2:172.21.15.80:6800/1021361872,v1:172.21.15.80:6801/1021361872] conn(0x7f652003d520 0x7f652003fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 >> 172.21.15.80:0/3116012571 conn(0x7f6534103740 msgr2=0x7f6534104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 shutdown_connections 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:29.267+0000 7f653be9f700 1 -- 172.21.15.80:0/3116012571 wait complete. 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:mgr epoch 5 is available 2024-04-25T11:14:29.870 INFO:teuthology.orchestra.run.smithi080.stdout:Setting orchestrator backend to cephadm... 2024-04-25T11:14:30.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:30 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:28] ENGINE Bus STARTING 2024-04-25T11:14:30.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:30 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:28] ENGINE Serving on http://172.21.15.80:8765 2024-04-25T11:14:30.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:30 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:29] ENGINE Serving on https://172.21.15.80:7150 2024-04-25T11:14:30.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:30 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:29] ENGINE Bus STARTED 2024-04-25T11:14:30.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:30 smithi080 ceph-mon[29126]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T11:14:30.532 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:30 smithi080 ceph-mon[29126]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T11:14:31.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.302+0000 7fbea0c8f700 1 Processor -- start 2024-04-25T11:14:31.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.302+0000 7fbea0c8f700 1 -- start start 2024-04-25T11:14:31.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.302+0000 7fbea0c8f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c10a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:31.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.302+0000 7fbea0c8f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c10a900 con 0x7fbe9c109f00 2024-04-25T11:14:31.119 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c10a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c10a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43700/0 (socket says 172.21.15.80:43700) 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9a59c700 1 -- 172.21.15.80:0/2144139613 learned_addr learned my addr 172.21.15.80:0/2144139613 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9a59c700 1 -- 172.21.15.80:0/2144139613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c108c20 con 0x7fbe9c109f00 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9a59c700 1 --2- 172.21.15.80:0/2144139613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c10a310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0098a0 tx=0x7fbe8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9899bf33494b0776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9959a700 1 -- 172.21.15.80:0/2144139613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8c004160 con 0x7fbe9c109f00 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9959a700 1 -- 172.21.15.80:0/2144139613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbe8c004300 con 0x7fbe9c109f00 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.303+0000 7fbe9959a700 1 -- 172.21.15.80:0/2144139613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8c011af0 con 0x7fbe9c109f00 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.304+0000 7fbea0c8f700 1 -- 172.21.15.80:0/2144139613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 msgr2=0x7fbe9c10a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.304+0000 7fbea0c8f700 1 --2- 172.21.15.80:0/2144139613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c10a310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0098a0 tx=0x7fbe8c009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.304+0000 7fbea0c8f700 1 -- 172.21.15.80:0/2144139613 shutdown_connections 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.304+0000 7fbea0c8f700 1 --2- 172.21.15.80:0/2144139613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c10a310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.304+0000 7fbea0c8f700 1 -- 172.21.15.80:0/2144139613 >> 172.21.15.80:0/2144139613 conn(0x7fbe9c103800 msgr2=0x7fbe9c105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:31.120 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.304+0000 7fbea0c8f700 1 -- 172.21.15.80:0/2144139613 shutdown_connections 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.304+0000 7fbea0c8f700 1 -- 172.21.15.80:0/2144139613 wait complete. 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.305+0000 7fbea0c8f700 1 Processor -- start 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.305+0000 7fbea0c8f700 1 -- start start 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.305+0000 7fbea0c8f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c1084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.305+0000 7fbea0c8f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c10ce60 con 0x7fbe9c109f00 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.305+0000 7fbe9a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c1084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.305+0000 7fbe9a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c1084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43706/0 (socket says 172.21.15.80:43706) 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.305+0000 7fbe9a59c700 1 -- 172.21.15.80:0/3437666513 learned_addr learned my addr 172.21.15.80:0/3437666513 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.306+0000 7fbe9a59c700 1 -- 172.21.15.80:0/3437666513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c1089f0 con 0x7fbe9c109f00 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.306+0000 7fbe9a59c700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c1084b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0090e0 tx=0x7fbe8c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.308+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8c0039e0 con 0x7fbe9c109f00 2024-04-25T11:14:31.121 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.308+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbe8c003b80 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.308+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8c0246e0 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.308+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c1a0cc0 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.308+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c1a1140 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.309+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 7) ==== 49410+0+0 (secure 0 0 0) 0x7fbe8c022020 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.309+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c064cf0 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.309+0000 7fbe8b7fe700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fbe8403d4a0 0x7fbe8403f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.309+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbe8c01a840 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.309+0000 7fbe99d9b700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fbe8403d4a0 0x7fbe8403f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.310+0000 7fbe99d9b700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fbe8403d4a0 0x7fbe8403f9b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.310+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7fbe8c01aae0 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.317+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbe8c00b3e0 con 0x7fbe9c109f00 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.530+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fbe9c1a1480 con 0x7fbe8403d4a0 2024-04-25T11:14:31.122 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.536+0000 7fbe8b7fe700 1 -- 172.21.15.80:0/3437666513 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbe9c1a1480 con 0x7fbe8403d4a0 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fbe8403d4a0 msgr2=0x7fbe8403f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fbe8403d4a0 0x7fbe8403f9b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 msgr2=0x7fbe9c1084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c1084b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0090e0 tx=0x7fbe8c011940 comp rx=0 tx=0).stop 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 shutdown_connections 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fbe8403d4a0 0x7fbe8403f9b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 --2- 172.21.15.80:0/3437666513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9c109f00 0x7fbe9c1084b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.538+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 >> 172.21.15.80:0/3437666513 conn(0x7fbe9c103800 msgr2=0x7fbe9c105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.539+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 shutdown_connections 2024-04-25T11:14:31.123 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:30.539+0000 7fbea0c8f700 1 -- 172.21.15.80:0/3437666513 wait complete. 2024-04-25T11:14:31.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:31 smithi080 ceph-mon[29126]: mgrmap e8: x(active, since 2s) 2024-04-25T11:14:31.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:31 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:31.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:31 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:14:32.358 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:32 smithi080 ceph-mon[29126]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a8d1fe700 1 Processor -- start 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a8d1fe700 1 -- start start 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a8d1fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a8810ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a8d1fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8810ef60 con 0x7f5a8807d540 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a86d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a8810ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a86d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a8810ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43720/0 (socket says 172.21.15.80:43720) 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a86d9d700 1 -- 172.21.15.80:0/2413781752 learned_addr learned my addr 172.21.15.80:0/2413781752 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:32.366 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.544+0000 7f5a86d9d700 1 -- 172.21.15.80:0/2413781752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8810f0e0 con 0x7f5a8807d540 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.545+0000 7f5a86d9d700 1 --2- 172.21.15.80:0/2413781752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a8810ea20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098a0 tx=0x7f5a78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21edb52472a67d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.545+0000 7f5a85d9b700 1 -- 172.21.15.80:0/2413781752 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a78004160 con 0x7f5a8807d540 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.545+0000 7f5a85d9b700 1 -- 172.21.15.80:0/2413781752 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5a78004300 con 0x7f5a8807d540 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.545+0000 7f5a85d9b700 1 -- 172.21.15.80:0/2413781752 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a78011af0 con 0x7f5a8807d540 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/2413781752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 msgr2=0x7f5a8810ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 --2- 172.21.15.80:0/2413781752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a8810ea20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098a0 tx=0x7f5a78009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/2413781752 shutdown_connections 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 --2- 172.21.15.80:0/2413781752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a8810ea20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/2413781752 >> 172.21.15.80:0/2413781752 conn(0x7f5a88104030 msgr2=0x7f5a881064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/2413781752 shutdown_connections 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/2413781752 wait complete. 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.546+0000 7f5a8d1fe700 1 Processor -- start 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a8d1fe700 1 -- start start 2024-04-25T11:14:32.367 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a8d1fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a881a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a8d1fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8810fff0 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a86d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a881a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a86d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a881a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43730/0 (socket says 172.21.15.80:43730) 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a86d9d700 1 -- 172.21.15.80:0/250811585 learned_addr learned my addr 172.21.15.80:0/250811585 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a86d9d700 1 -- 172.21.15.80:0/250811585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a881a05a0 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.547+0000 7f5a86d9d700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a881a0060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009fb0 tx=0x7f5a78011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.548+0000 7f5a6ffff700 1 -- 172.21.15.80:0/250811585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a780036a0 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.548+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a881a0830 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.548+0000 7f5a6ffff700 1 -- 172.21.15.80:0/250811585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5a7801a430 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.548+0000 7f5a6ffff700 1 -- 172.21.15.80:0/250811585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a78019550 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.548+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a881a3440 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.549+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a88064cf0 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.549+0000 7f5a6ffff700 1 -- 172.21.15.80:0/250811585 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f5a78019800 con 0x7f5a8807d540 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.549+0000 7f5a6ffff700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5a7003d570 0x7f5a7003fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:32.368 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.549+0000 7f5a6ffff700 1 -- 172.21.15.80:0/250811585 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5a78052690 con 0x7f5a8807d540 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.549+0000 7f5a8659c700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5a7003d570 0x7f5a7003fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.550+0000 7f5a8659c700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5a7003d570 0x7f5a7003fa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c006fd0 tx=0x7f5a7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.554+0000 7f5a6ffff700 1 -- 172.21.15.80:0/250811585 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5a78017e90 con 0x7f5a8807d540 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.749+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5a881050b0 con 0x7f5a7003d570 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.750+0000 7f5a6ffff700 1 -- 172.21.15.80:0/250811585 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5a881050b0 con 0x7f5a7003d570 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5a7003d570 msgr2=0x7f5a7003fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5a7003d570 0x7f5a7003fa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c006fd0 tx=0x7f5a7c006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 msgr2=0x7f5a881a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a881a0060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009fb0 tx=0x7f5a78011940 comp rx=0 tx=0).stop 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 shutdown_connections 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5a7003d570 0x7f5a7003fa80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 --2- 172.21.15.80:0/250811585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8807d540 0x7f5a881a0060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 >> 172.21.15.80:0/250811585 conn(0x7f5a88104030 msgr2=0x7f5a88104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 shutdown_connections 2024-04-25T11:14:32.369 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:31.753+0000 7f5a8d1fe700 1 -- 172.21.15.80:0/250811585 wait complete. 2024-04-25T11:14:32.370 INFO:teuthology.orchestra.run.smithi080.stdout:Generating ssh key... 2024-04-25T11:14:33.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-mon[29126]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: Generating public/private rsa key pair. 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: Your identification has been saved in /tmp/tmpf_8fc3ym/key. 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: Your public key has been saved in /tmp/tmpf_8fc3ym/key.pub. 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: The key fingerprint is: 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: SHA256:/I+tHs+mxCXx4B0C7xRXX9sttppHGRfWZ/GyiQFlM1Y ceph-bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: The key's randomart image is: 2024-04-25T11:14:33.523 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: +---[RSA 3072]----+ 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | . o.BoE++| 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | o * o..@| 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | * o =oB| 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | . + * = X | 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | S + = * | 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | o o + | 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | = o . | 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | . B.. | 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: | .=+= | 2024-04-25T11:14:33.524 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: +----[SHA256]-----+ 2024-04-25T11:14:33.850 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.744+0000 7f5ec608d700 1 Processor -- start 2024-04-25T11:14:33.850 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.744+0000 7f5ec608d700 1 -- start start 2024-04-25T11:14:33.850 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.744+0000 7f5ec608d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec0108dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.744+0000 7f5ec608d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01093b0 con 0x7f5ec01089b0 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.744+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec0108dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.745+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec0108dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43738/0 (socket says 172.21.15.80:43738) 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.745+0000 7f5ebf7fe700 1 -- 172.21.15.80:0/3501968389 learned_addr learned my addr 172.21.15.80:0/3501968389 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.745+0000 7f5ebf7fe700 1 -- 172.21.15.80:0/3501968389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec0109ae0 con 0x7f5ec01089b0 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.745+0000 7f5ebf7fe700 1 --2- 172.21.15.80:0/3501968389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec0108dc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00098a0 tx=0x7f5eb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67e3a7098692ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.745+0000 7f5ebeffd700 1 -- 172.21.15.80:0/3501968389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb0004160 con 0x7f5ec01089b0 2024-04-25T11:14:33.851 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.745+0000 7f5ebeffd700 1 -- 172.21.15.80:0/3501968389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5eb0004300 con 0x7f5ec01089b0 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.745+0000 7f5ebeffd700 1 -- 172.21.15.80:0/3501968389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb0011af0 con 0x7f5ec01089b0 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.746+0000 7f5ec608d700 1 -- 172.21.15.80:0/3501968389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 msgr2=0x7f5ec0108dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.746+0000 7f5ec608d700 1 --2- 172.21.15.80:0/3501968389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec0108dc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00098a0 tx=0x7f5eb0009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.746+0000 7f5ec608d700 1 -- 172.21.15.80:0/3501968389 shutdown_connections 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.746+0000 7f5ec608d700 1 --2- 172.21.15.80:0/3501968389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec0108dc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.746+0000 7f5ec608d700 1 -- 172.21.15.80:0/3501968389 >> 172.21.15.80:0/3501968389 conn(0x7f5ec0104030 msgr2=0x7f5ec01064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.746+0000 7f5ec608d700 1 -- 172.21.15.80:0/3501968389 shutdown_connections 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.746+0000 7f5ec608d700 1 -- 172.21.15.80:0/3501968389 wait complete. 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ec608d700 1 Processor -- start 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ec608d700 1 -- start start 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ec608d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec019df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ec608d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec010ce90 con 0x7f5ec01089b0 2024-04-25T11:14:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec019df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec019df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43740/0 (socket says 172.21.15.80:43740) 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ebf7fe700 1 -- 172.21.15.80:0/807358959 learned_addr learned my addr 172.21.15.80:0/807358959 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.747+0000 7f5ebf7fe700 1 -- 172.21.15.80:0/807358959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec019e490 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.748+0000 7f5ebf7fe700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec019df50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00090e0 tx=0x7f5eb0011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.748+0000 7f5ebd7fa700 1 -- 172.21.15.80:0/807358959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb00039e0 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.748+0000 7f5ebd7fa700 1 -- 172.21.15.80:0/807358959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5eb0003b80 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.748+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec019e720 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.748+0000 7f5ebd7fa700 1 -- 172.21.15.80:0/807358959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb0024690 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.748+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01a1330 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.749+0000 7f5ebd7fa700 1 -- 172.21.15.80:0/807358959 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f5eb0022020 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.749+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec0064cf0 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.749+0000 7f5ebd7fa700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5eac03d5c0 0x7f5eac03fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.749+0000 7f5ebd7fa700 1 -- 172.21.15.80:0/807358959 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5eb0052570 con 0x7f5ec01089b0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.749+0000 7f5eb6ffd700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5eac03d5c0 0x7f5eac03fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:33.853 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.749+0000 7f5eb6ffd700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5eac03d5c0 0x7f5eac03fad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006fd0 tx=0x7f5ea8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.754+0000 7f5ebd7fa700 1 -- 172.21.15.80:0/807358959 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5eb00172b0 con 0x7f5ec01089b0 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:32.951+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f5ec002e880 con 0x7f5eac03d5c0 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.231+0000 7f5ebd7fa700 1 -- 172.21.15.80:0/807358959 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5ec002e880 con 0x7f5eac03d5c0 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5eac03d5c0 msgr2=0x7f5eac03fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5eac03d5c0 0x7f5eac03fad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006fd0 tx=0x7f5ea8006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 msgr2=0x7f5ec019df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec019df50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00090e0 tx=0x7f5eb0011940 comp rx=0 tx=0).stop 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 shutdown_connections 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5eac03d5c0 0x7f5eac03fad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 --2- 172.21.15.80:0/807358959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec01089b0 0x7f5ec019df50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 >> 172.21.15.80:0/807358959 conn(0x7f5ec0104030 msgr2=0x7f5ec01944b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 shutdown_connections 2024-04-25T11:14:33.854 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:33.233+0000 7f5ec608d700 1 -- 172.21.15.80:0/807358959 wait complete. 2024-04-25T11:14:34.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:34 smithi080 ceph-mon[29126]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:34.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:34 smithi080 ceph-mon[29126]: Generating ssh key... 2024-04-25T11:14:35.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbByBFxhzOO75f2v+R0xtcRMBH5uaorbdlBwG9TSI+N9m6GWpp6uJUI12oib0bM4Yr2US2erZU8o7/6cIqG9SkJdOjkBFy2knqopci3Z2yhnAtGNtKXNPixsECRZumMQY8KAtsrjK7/bPB+DtLCHG+OdHZavSMRAhHSv7PzN/BfXLfofoVsPBXjqIUgRQBdUecM2KMvg00LzmGTNgsbwNnB3aJyytt+eyhu3uKHa4frkeOyNU/QUH0ReHoKxShjI/Suc/Ah+Jw1AU3sO/vJCtL+Vt8tDoZYf3xrb9HDWD48u14uGLU6q9gS20lqLjRqssgI2pna2ypqXDFeLY4UJpGfcZz1qo8iVXu5v9gLpzx25WtvC7s/Sb3WCS+GoPBPrImiUR+Q1fzpH9iMALIuCyBUwHF7JzX4J448UHl3O/hTjRdx7sZDbxRP3jq2RK47RnHGL8tlgpk9iT9OYheKlBd1IDD7DeWJWXDkVjPVhh074yC745GgGVWOvp5eLyVDus= ceph-bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:14:35.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.276+0000 7f6c70f70700 1 Processor -- start 2024-04-25T11:14:35.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.276+0000 7f6c70f70700 1 -- start start 2024-04-25T11:14:35.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.277+0000 7f6c70f70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c10c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:35.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.277+0000 7f6c70f70700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c10cbd0 con 0x7f6c6c07d560 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.277+0000 7f6c6a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c10c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.277+0000 7f6c6a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c10c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43744/0 (socket says 172.21.15.80:43744) 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.277+0000 7f6c6a59c700 1 -- 172.21.15.80:0/3198103917 learned_addr learned my addr 172.21.15.80:0/3198103917 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.277+0000 7f6c6a59c700 1 -- 172.21.15.80:0/3198103917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c10cd50 con 0x7f6c6c07d560 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.278+0000 7f6c6a59c700 1 --2- 172.21.15.80:0/3198103917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c10c5e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0098a0 tx=0x7f6c5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ae12c935f1f97f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.278+0000 7f6c6959a700 1 -- 172.21.15.80:0/3198103917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c004160 con 0x7f6c6c07d560 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.278+0000 7f6c6959a700 1 -- 172.21.15.80:0/3198103917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6c5c004300 con 0x7f6c6c07d560 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.278+0000 7f6c6959a700 1 -- 172.21.15.80:0/3198103917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c011af0 con 0x7f6c6c07d560 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.278+0000 7f6c70f70700 1 -- 172.21.15.80:0/3198103917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 msgr2=0x7f6c6c10c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.278+0000 7f6c70f70700 1 --2- 172.21.15.80:0/3198103917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c10c5e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0098a0 tx=0x7f6c5c009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.279+0000 7f6c70f70700 1 -- 172.21.15.80:0/3198103917 shutdown_connections 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.279+0000 7f6c70f70700 1 --2- 172.21.15.80:0/3198103917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c10c5e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:35.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.279+0000 7f6c70f70700 1 -- 172.21.15.80:0/3198103917 >> 172.21.15.80:0/3198103917 conn(0x7f6c6c103fb0 msgr2=0x7f6c6c106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.279+0000 7f6c70f70700 1 -- 172.21.15.80:0/3198103917 shutdown_connections 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.279+0000 7f6c70f70700 1 -- 172.21.15.80:0/3198103917 wait complete. 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.279+0000 7f6c70f70700 1 Processor -- start 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c70f70700 1 -- start start 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c70f70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c19de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c70f70700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c10ddd0 con 0x7f6c6c07d560 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c6a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c19de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c6a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c19de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43746/0 (socket says 172.21.15.80:43746) 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c6a59c700 1 -- 172.21.15.80:0/609676993 learned_addr learned my addr 172.21.15.80:0/609676993 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c6a59c700 1 -- 172.21.15.80:0/609676993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c19e380 con 0x7f6c6c07d560 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c6a59c700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c19de40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009fb0 tx=0x7f6c5c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c5b7fe700 1 -- 172.21.15.80:0/609676993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c0036a0 con 0x7f6c6c07d560 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c5b7fe700 1 -- 172.21.15.80:0/609676993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6c5c01a430 con 0x7f6c6c07d560 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.280+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c19e610 con 0x7f6c6c07d560 2024-04-25T11:14:35.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.281+0000 7f6c5b7fe700 1 -- 172.21.15.80:0/609676993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c019550 con 0x7f6c6c07d560 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.281+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c1a1220 con 0x7f6c6c07d560 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.281+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c064cf0 con 0x7f6c6c07d560 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.281+0000 7f6c5b7fe700 1 -- 172.21.15.80:0/609676993 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f6c5c019850 con 0x7f6c6c07d560 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.282+0000 7f6c5b7fe700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6c5403d520 0x7f6c5403fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.282+0000 7f6c5b7fe700 1 -- 172.21.15.80:0/609676993 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6c5c0526e0 con 0x7f6c6c07d560 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.282+0000 7f6c69d9b700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6c5403d520 0x7f6c5403fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.282+0000 7f6c69d9b700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6c5403d520 0x7f6c5403fa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c60006fd0 tx=0x7f6c60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.287+0000 7f6c5b7fe700 1 -- 172.21.15.80:0/609676993 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6c5c017e90 con 0x7f6c6c07d560 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.487+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6c6c1050c0 con 0x7f6c5403d520 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.488+0000 7f6c5b7fe700 1 -- 172.21.15.80:0/609676993 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f6c6c1050c0 con 0x7f6c5403d520 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6c5403d520 msgr2=0x7f6c5403fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6c5403d520 0x7f6c5403fa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c60006fd0 tx=0x7f6c60006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 msgr2=0x7f6c6c19de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c19de40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009fb0 tx=0x7f6c5c011940 comp rx=0 tx=0).stop 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 shutdown_connections 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f6c5403d520 0x7f6c5403fa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 --2- 172.21.15.80:0/609676993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c07d560 0x7f6c6c19de40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 >> 172.21.15.80:0/609676993 conn(0x7f6c6c103fb0 msgr2=0x7f6c6c104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 shutdown_connections 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:34.490+0000 7f6c70f70700 1 -- 172.21.15.80:0/609676993 wait complete. 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:Adding key to root@localhost authorized_keys... 2024-04-25T11:14:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:Adding host smithi080... 2024-04-25T11:14:35.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:35 smithi080 ceph-mon[29126]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:36.539 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:36 smithi080 ceph-mon[29126]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:36.539 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:36 smithi080 ceph-mon[29126]: Deploying cephadm binary to smithi080 2024-04-25T11:14:40.353 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Added host 'smithi080' with addr '172.21.15.80' 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.473+0000 7f204799d700 1 Processor -- start 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.473+0000 7f204799d700 1 -- start start 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.473+0000 7f204799d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f2040108160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.473+0000 7f204799d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2040108770 con 0x7f2040107d50 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.473+0000 7f2045739700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f2040108160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.473+0000 7f2045739700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f2040108160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43748/0 (socket says 172.21.15.80:43748) 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.473+0000 7f2045739700 1 -- 172.21.15.80:0/1572693727 learned_addr learned my addr 172.21.15.80:0/1572693727 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.474+0000 7f2045739700 1 -- 172.21.15.80:0/1572693727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20401088f0 con 0x7f2040107d50 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.474+0000 7f2045739700 1 --2- 172.21.15.80:0/1572693727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f2040108160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098a0 tx=0x7f203c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5196f1e1d39e3bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.474+0000 7f2037fff700 1 -- 172.21.15.80:0/1572693727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203c004160 con 0x7f2040107d50 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.474+0000 7f2037fff700 1 -- 172.21.15.80:0/1572693727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f203c004300 con 0x7f2040107d50 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.474+0000 7f2037fff700 1 -- 172.21.15.80:0/1572693727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203c011af0 con 0x7f2040107d50 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 -- 172.21.15.80:0/1572693727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 msgr2=0x7f2040108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 --2- 172.21.15.80:0/1572693727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f2040108160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f203c0098a0 tx=0x7f203c009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 -- 172.21.15.80:0/1572693727 shutdown_connections 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 --2- 172.21.15.80:0/1572693727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f2040108160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 -- 172.21.15.80:0/1572693727 >> 172.21.15.80:0/1572693727 conn(0x7f2040103710 msgr2=0x7f2040105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 -- 172.21.15.80:0/1572693727 shutdown_connections 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 -- 172.21.15.80:0/1572693727 wait complete. 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.475+0000 7f204799d700 1 Processor -- start 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f204799d700 1 -- start start 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f204799d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f204010a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f204799d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f204010dd80 con 0x7f2040107d50 2024-04-25T11:14:40.355 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f2045739700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f204010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:40.356 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f2045739700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f204010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43760/0 (socket says 172.21.15.80:43760) 2024-04-25T11:14:40.356 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f2045739700 1 -- 172.21.15.80:0/4278397495 learned_addr learned my addr 172.21.15.80:0/4278397495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:40.356 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f2045739700 1 -- 172.21.15.80:0/4278397495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204010aaa0 con 0x7f2040107d50 2024-04-25T11:14:40.356 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f2045739700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f204010a560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f203c009fb0 tx=0x7f203c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:40.356 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f20367fc700 1 -- 172.21.15.80:0/4278397495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203c011bc0 con 0x7f2040107d50 2024-04-25T11:14:40.356 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f20367fc700 1 -- 172.21.15.80:0/4278397495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f203c024440 con 0x7f2040107d50 2024-04-25T11:14:40.356 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f20367fc700 1 -- 172.21.15.80:0/4278397495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203c01a5c0 con 0x7f2040107d50 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.476+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2040108cf0 con 0x7f2040107d50 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.477+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20401091d0 con 0x7f2040107d50 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.478+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040064cf0 con 0x7f2040107d50 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.478+0000 7f20367fc700 1 -- 172.21.15.80:0/4278397495 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f203c01a830 con 0x7f2040107d50 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.478+0000 7f20367fc700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f202c03d570 0x7f202c03fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.478+0000 7f20367fc700 1 -- 172.21.15.80:0/4278397495 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f203c052740 con 0x7f2040107d50 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.478+0000 7f2044f38700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f202c03d570 0x7f202c03fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.478+0000 7f2044f38700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f202c03d570 0x7f202c03fa80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2030006fd0 tx=0x7f2030006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.483+0000 7f20367fc700 1 -- 172.21.15.80:0/4278397495 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f20401088f0 con 0x7f2040107d50 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:35.683+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}) -- 0x7f2040197690 con 0x7f202c03d570 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.718+0000 7f20367fc700 1 -- 172.21.15.80:0/4278397495 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f2040197690 con 0x7f202c03d570 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f202c03d570 msgr2=0x7f202c03fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:40.357 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f202c03d570 0x7f202c03fa80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2030006fd0 tx=0x7f2030006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 msgr2=0x7f204010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f204010a560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f203c009fb0 tx=0x7f203c011890 comp rx=0 tx=0).stop 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 shutdown_connections 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f202c03d570 0x7f202c03fa80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 --2- 172.21.15.80:0/4278397495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2040107d50 0x7f204010a560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 >> 172.21.15.80:0/4278397495 conn(0x7f2040103710 msgr2=0x7f2040104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 shutdown_connections 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:39.720+0000 7f204799d700 1 -- 172.21.15.80:0/4278397495 wait complete. 2024-04-25T11:14:40.358 INFO:teuthology.orchestra.run.smithi080.stdout:Deploying unmanaged mon service... 2024-04-25T11:14:41.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:40 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:41.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:40 smithi080 ceph-mon[29126]: Added host smithi080 2024-04-25T11:14:41.035 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:40 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:14:42.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:42 smithi080 ceph-mon[29126]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:42.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:42 smithi080 ceph-mon[29126]: Saving service mon spec with placement count:5 2024-04-25T11:14:42.325 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:42 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:42.608 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.801+0000 7fc2cc795700 1 Processor -- start 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.801+0000 7fc2cc795700 1 -- start start 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2cc795700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c4108d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2cc795700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4109360 con 0x7fc2c4108960 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2ca531700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c4108d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2ca531700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c4108d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43076/0 (socket says 172.21.15.80:43076) 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2ca531700 1 -- 172.21.15.80:0/2802344495 learned_addr learned my addr 172.21.15.80:0/2802344495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2ca531700 1 -- 172.21.15.80:0/2802344495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c4109a90 con 0x7fc2c4108960 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2ca531700 1 --2- 172.21.15.80:0/2802344495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c4108d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00098a0 tx=0x7fc2c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc3f361b4325239 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2c952f700 1 -- 172.21.15.80:0/2802344495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0004160 con 0x7fc2c4108960 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2c952f700 1 -- 172.21.15.80:0/2802344495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc2c0004300 con 0x7fc2c4108960 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.802+0000 7fc2c952f700 1 -- 172.21.15.80:0/2802344495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0011af0 con 0x7fc2c4108960 2024-04-25T11:14:42.609 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.803+0000 7fc2cc795700 1 -- 172.21.15.80:0/2802344495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 msgr2=0x7fc2c4108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.803+0000 7fc2cc795700 1 --2- 172.21.15.80:0/2802344495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c4108d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00098a0 tx=0x7fc2c0009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.803+0000 7fc2cc795700 1 -- 172.21.15.80:0/2802344495 shutdown_connections 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.803+0000 7fc2cc795700 1 --2- 172.21.15.80:0/2802344495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c4108d70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.803+0000 7fc2cc795700 1 -- 172.21.15.80:0/2802344495 >> 172.21.15.80:0/2802344495 conn(0x7fc2c4103fc0 msgr2=0x7fc2c4106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.803+0000 7fc2cc795700 1 -- 172.21.15.80:0/2802344495 shutdown_connections 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.803+0000 7fc2cc795700 1 -- 172.21.15.80:0/2802344495 wait complete. 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2cc795700 1 Processor -- start 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2cc795700 1 -- start start 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2cc795700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c407c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2cc795700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c410ce40 con 0x7fc2c4108960 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2ca531700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c407c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2ca531700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c407c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43080/0 (socket says 172.21.15.80:43080) 2024-04-25T11:14:42.610 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2ca531700 1 -- 172.21.15.80:0/4201052536 learned_addr learned my addr 172.21.15.80:0/4201052536 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.804+0000 7fc2ca531700 1 -- 172.21.15.80:0/4201052536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c407ced0 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.805+0000 7fc2ca531700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c407c990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0011670 tx=0x7fc2c0004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.805+0000 7fc2bb7fe700 1 -- 172.21.15.80:0/4201052536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c00036a0 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.805+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c41a0cb0 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.805+0000 7fc2bb7fe700 1 -- 172.21.15.80:0/4201052536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc2c0003cd0 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.805+0000 7fc2bb7fe700 1 -- 172.21.15.80:0/4201052536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c00193c0 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.805+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c41a1130 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.806+0000 7fc2bb7fe700 1 -- 172.21.15.80:0/4201052536 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7fc2c0019680 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.806+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c4064cf0 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.806+0000 7fc2bb7fe700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc2b003d520 0x7fc2b003fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.806+0000 7fc2bb7fe700 1 -- 172.21.15.80:0/4201052536 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc2c0052520 con 0x7fc2c4108960 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.806+0000 7fc2c9d30700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc2b003d520 0x7fc2b003fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.806+0000 7fc2c9d30700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc2b003d520 0x7fc2b003fa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4006fd0 tx=0x7fc2b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:42.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:40.811+0000 7fc2bb7fe700 1 -- 172.21.15.80:0/4201052536 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc2c0017e90 con 0x7fc2c4108960 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.034+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc2c41051b0 con 0x7fc2b003d520 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.042+0000 7fc2bb7fe700 1 -- 172.21.15.80:0/4201052536 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc2c41051b0 con 0x7fc2b003d520 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc2b003d520 msgr2=0x7fc2b003fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc2b003d520 0x7fc2b003fa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4006fd0 tx=0x7fc2b4006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 msgr2=0x7fc2c407c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c407c990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0011670 tx=0x7fc2c0004280 comp rx=0 tx=0).stop 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 shutdown_connections 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc2b003d520 0x7fc2b003fa30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 --2- 172.21.15.80:0/4201052536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2c4108960 0x7fc2c407c990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.044+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 >> 172.21.15.80:0/4201052536 conn(0x7fc2c4103fc0 msgr2=0x7fc2c4104a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.045+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 shutdown_connections 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:41.045+0000 7fc2cc795700 1 -- 172.21.15.80:0/4201052536 wait complete. 2024-04-25T11:14:42.612 INFO:teuthology.orchestra.run.smithi080.stdout:Deploying unmanaged mgr service... 2024-04-25T11:14:43.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:43 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:43.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:43 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:43.872 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.032+0000 7feb1e8ef700 1 Processor -- start 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.032+0000 7feb1e8ef700 1 -- start start 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.032+0000 7feb1e8ef700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb1810e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.032+0000 7feb1e8ef700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810eea0 con 0x7feb1807ccf0 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb17fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb1810e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb17fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb1810e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43086/0 (socket says 172.21.15.80:43086) 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb17fff700 1 -- 172.21.15.80:0/3618233073 learned_addr learned my addr 172.21.15.80:0/3618233073 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb17fff700 1 -- 172.21.15.80:0/3618233073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1810f020 con 0x7feb1807ccf0 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb17fff700 1 --2- 172.21.15.80:0/3618233073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb1810e960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feb080098a0 tx=0x7feb08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e89590d1c6e089 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb16ffd700 1 -- 172.21.15.80:0/3618233073 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb08004160 con 0x7feb1807ccf0 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb16ffd700 1 -- 172.21.15.80:0/3618233073 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb08004300 con 0x7feb1807ccf0 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.033+0000 7feb16ffd700 1 -- 172.21.15.80:0/3618233073 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb08011a20 con 0x7feb1807ccf0 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.034+0000 7feb1e8ef700 1 -- 172.21.15.80:0/3618233073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 msgr2=0x7feb1810e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:43.873 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.034+0000 7feb1e8ef700 1 --2- 172.21.15.80:0/3618233073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb1810e960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feb080098a0 tx=0x7feb08009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.034+0000 7feb1e8ef700 1 -- 172.21.15.80:0/3618233073 shutdown_connections 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.034+0000 7feb1e8ef700 1 --2- 172.21.15.80:0/3618233073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb1810e960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.034+0000 7feb1e8ef700 1 -- 172.21.15.80:0/3618233073 >> 172.21.15.80:0/3618233073 conn(0x7feb18103f90 msgr2=0x7feb18106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.034+0000 7feb1e8ef700 1 -- 172.21.15.80:0/3618233073 shutdown_connections 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.034+0000 7feb1e8ef700 1 -- 172.21.15.80:0/3618233073 wait complete. 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb1e8ef700 1 Processor -- start 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb1e8ef700 1 -- start start 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb1e8ef700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb181a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb1e8ef700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810ffc0 con 0x7feb1807ccf0 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb17fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb181a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb17fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb181a0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43092/0 (socket says 172.21.15.80:43092) 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb17fff700 1 -- 172.21.15.80:0/836830437 learned_addr learned my addr 172.21.15.80:0/836830437 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:43.874 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.035+0000 7feb17fff700 1 -- 172.21.15.80:0/836830437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb181a0580 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.036+0000 7feb17fff700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb181a0040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb08004660 tx=0x7feb08011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.036+0000 7feb157fa700 1 -- 172.21.15.80:0/836830437 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb08003a60 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.036+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb181a0810 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.036+0000 7feb157fa700 1 -- 172.21.15.80:0/836830437 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb0801b8f0 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.036+0000 7feb157fa700 1 -- 172.21.15.80:0/836830437 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb08023890 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.036+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb181a3420 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.037+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb18064cf0 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.037+0000 7feb157fa700 1 -- 172.21.15.80:0/836830437 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7feb0802c3f0 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.037+0000 7feb157fa700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7feb0003d520 0x7feb0003fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.037+0000 7feb157fa700 1 -- 172.21.15.80:0/836830437 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7feb08053050 con 0x7feb1807ccf0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.037+0000 7feb177fe700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7feb0003d520 0x7feb0003fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:43.875 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.038+0000 7feb177fe700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7feb0003d520 0x7feb0003fa30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb0c006fd0 tx=0x7feb0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.042+0000 7feb157fa700 1 -- 172.21.15.80:0/836830437 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feb0801f030 con 0x7feb1807ccf0 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.266+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7feb181a36b0 con 0x7feb0003d520 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.271+0000 7feb157fa700 1 -- 172.21.15.80:0/836830437 <== mgr.14120 v2:172.21.15.80:6800/2554689632 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7feb181a36b0 con 0x7feb0003d520 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7feb0003d520 msgr2=0x7feb0003fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7feb0003d520 0x7feb0003fa30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb0c006fd0 tx=0x7feb0c006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 msgr2=0x7feb181a0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb181a0040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb08004660 tx=0x7feb08011aa0 comp rx=0 tx=0).stop 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 shutdown_connections 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7feb0003d520 0x7feb0003fa30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 --2- 172.21.15.80:0/836830437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb1807ccf0 0x7feb181a0040 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 >> 172.21.15.80:0/836830437 conn(0x7feb18103f90 msgr2=0x7feb18104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 shutdown_connections 2024-04-25T11:14:43.876 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:43.273+0000 7feb1e8ef700 1 -- 172.21.15.80:0/836830437 wait complete. 2024-04-25T11:14:44.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:44 smithi080 ceph-mon[29126]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:44.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:44 smithi080 ceph-mon[29126]: Saving service mgr spec with placement count:2 2024-04-25T11:14:44.499 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:44 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:45.604 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:45 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2258412330' entity='client.admin' 2024-04-25T11:14:45.604 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:45 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:45.611 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7e1179700 1 Processor -- start 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7e1179700 1 -- start start 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7e1179700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc1092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7e1179700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc109880 con 0x7ff7dc108ea0 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7dad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc1092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7dad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc1092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43094/0 (socket says 172.21.15.80:43094) 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7dad9d700 1 -- 172.21.15.80:0/1610886940 learned_addr learned my addr 172.21.15.80:0/1610886940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7dad9d700 1 -- 172.21.15.80:0/1610886940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc109a00 con 0x7ff7dc108ea0 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.272+0000 7ff7dad9d700 1 --2- 172.21.15.80:0/1610886940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc1092b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0098a0 tx=0x7ff7cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5bc78cfda69f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7d9d9b700 1 -- 172.21.15.80:0/1610886940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7cc004160 con 0x7ff7dc108ea0 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7d9d9b700 1 -- 172.21.15.80:0/1610886940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7cc004300 con 0x7ff7dc108ea0 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7d9d9b700 1 -- 172.21.15.80:0/1610886940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7cc011a20 con 0x7ff7dc108ea0 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7e1179700 1 -- 172.21.15.80:0/1610886940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 msgr2=0x7ff7dc1092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7e1179700 1 --2- 172.21.15.80:0/1610886940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc1092b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0098a0 tx=0x7ff7cc009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7e1179700 1 -- 172.21.15.80:0/1610886940 shutdown_connections 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7e1179700 1 --2- 172.21.15.80:0/1610886940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc1092b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.273+0000 7ff7e1179700 1 -- 172.21.15.80:0/1610886940 >> 172.21.15.80:0/1610886940 conn(0x7ff7dc103710 msgr2=0x7ff7dc105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.274+0000 7ff7e1179700 1 -- 172.21.15.80:0/1610886940 shutdown_connections 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.274+0000 7ff7e1179700 1 -- 172.21.15.80:0/1610886940 wait complete. 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.274+0000 7ff7e1179700 1 Processor -- start 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.274+0000 7ff7e1179700 1 -- start start 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7e1179700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:45.613 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7e1179700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc10ce50 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7dad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7dad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43100/0 (socket says 172.21.15.80:43100) 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7dad9d700 1 -- 172.21.15.80:0/2258412330 learned_addr learned my addr 172.21.15.80:0/2258412330 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7dad9d700 1 -- 172.21.15.80:0/2258412330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc19d290 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7dad9d700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc19cd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc004660 tx=0x7ff7cc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7c3fff700 1 -- 172.21.15.80:0/2258412330 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7cc003a60 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7c3fff700 1 -- 172.21.15.80:0/2258412330 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7cc01b8f0 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7dc19d520 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7c3fff700 1 -- 172.21.15.80:0/2258412330 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7cc023890 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.275+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7dc1a0120 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.276+0000 7ff7c3fff700 1 -- 172.21.15.80:0/2258412330 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7ff7cc02c3f0 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.277+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7dc064cf0 con 0x7ff7dc108ea0 2024-04-25T11:14:45.614 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.277+0000 7ff7c3fff700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7ff7c403d520 0x7ff7c403fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.277+0000 7ff7c3fff700 1 -- 172.21.15.80:0/2258412330 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff7cc052d60 con 0x7ff7dc108ea0 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.277+0000 7ff7da59c700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7ff7c403d520 0x7ff7c403fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.277+0000 7ff7da59c700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7ff7c403d520 0x7ff7c403fa30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0006fd0 tx=0x7ff7d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.282+0000 7ff7c3fff700 1 -- 172.21.15.80:0/2258412330 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff7cc01f030 con 0x7ff7dc108ea0 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.498+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7ff7dc1a0720 con 0x7ff7dc108ea0 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.503+0000 7ff7c3fff700 1 -- 172.21.15.80:0/2258412330 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7ff7cc0172b0 con 0x7ff7dc108ea0 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7ff7c403d520 msgr2=0x7ff7c403fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7ff7c403d520 0x7ff7c403fa30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0006fd0 tx=0x7ff7d0006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 msgr2=0x7ff7dc19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc19cd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc004660 tx=0x7ff7cc011aa0 comp rx=0 tx=0).stop 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 shutdown_connections 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7ff7c403d520 0x7ff7c403fa30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 --2- 172.21.15.80:0/2258412330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7dc108ea0 0x7ff7dc19cd50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.505+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 >> 172.21.15.80:0/2258412330 conn(0x7ff7dc103710 msgr2=0x7ff7dc104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:45.616 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.506+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 shutdown_connections 2024-04-25T11:14:45.616 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:44.506+0000 7ff7e1179700 1 -- 172.21.15.80:0/2258412330 wait complete. 2024-04-25T11:14:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.002+0000 7fa5f8ec6700 1 Processor -- start 2024-04-25T11:14:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.002+0000 7fa5f8ec6700 1 -- start start 2024-04-25T11:14:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.003+0000 7fa5f8ec6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f410c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.003+0000 7fa5f8ec6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f410cba0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.003+0000 7fa5f259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f410c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.003+0000 7fa5f259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f410c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43104/0 (socket says 172.21.15.80:43104) 2024-04-25T11:14:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.003+0000 7fa5f259c700 1 -- 172.21.15.80:0/972914118 learned_addr learned my addr 172.21.15.80:0/972914118 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.004+0000 7fa5f259c700 1 -- 172.21.15.80:0/972914118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f410cd20 con 0x7fa5f407ccf0 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.004+0000 7fa5f259c700 1 --2- 172.21.15.80:0/972914118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f410c590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80098a0 tx=0x7fa5e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dceecb948f378b2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.004+0000 7fa5f159a700 1 -- 172.21.15.80:0/972914118 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5e8004160 con 0x7fa5f407ccf0 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.004+0000 7fa5f159a700 1 -- 172.21.15.80:0/972914118 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5e8004300 con 0x7fa5f407ccf0 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.004+0000 7fa5f159a700 1 -- 172.21.15.80:0/972914118 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5e8011a20 con 0x7fa5f407ccf0 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.005+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/972914118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 msgr2=0x7fa5f410c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.005+0000 7fa5f8ec6700 1 --2- 172.21.15.80:0/972914118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f410c590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80098a0 tx=0x7fa5e8009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.005+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/972914118 shutdown_connections 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.005+0000 7fa5f8ec6700 1 --2- 172.21.15.80:0/972914118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f410c590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.005+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/972914118 >> 172.21.15.80:0/972914118 conn(0x7fa5f4103fc0 msgr2=0x7fa5f4106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.005+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/972914118 shutdown_connections 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.005+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/972914118 wait complete. 2024-04-25T11:14:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.006+0000 7fa5f8ec6700 1 Processor -- start 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.006+0000 7fa5f8ec6700 1 -- start start 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.006+0000 7fa5f8ec6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f419de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.006+0000 7fa5f8ec6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f410dde0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.006+0000 7fa5f259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f419de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.006+0000 7fa5f259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f419de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43120/0 (socket says 172.21.15.80:43120) 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.006+0000 7fa5f259c700 1 -- 172.21.15.80:0/141421774 learned_addr learned my addr 172.21.15.80:0/141421774 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.007+0000 7fa5f259c700 1 -- 172.21.15.80:0/141421774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f419e3a0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.007+0000 7fa5f259c700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f419de60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009520 tx=0x7fa5e8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.007+0000 7fa5e37fe700 1 -- 172.21.15.80:0/141421774 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5e80039e0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.007+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f419e630 con 0x7fa5f407ccf0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.007+0000 7fa5e37fe700 1 -- 172.21.15.80:0/141421774 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5e801b8f0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.007+0000 7fa5e37fe700 1 -- 172.21.15.80:0/141421774 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5e80197d0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.007+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f41a1240 con 0x7fa5f407ccf0 2024-04-25T11:14:46.840 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.008+0000 7fa5e37fe700 1 -- 172.21.15.80:0/141421774 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7fa5e8019a90 con 0x7fa5f407ccf0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.008+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f4064cf0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.008+0000 7fa5e37fe700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fa5dc03d570 0x7fa5dc03fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.008+0000 7fa5e37fe700 1 -- 172.21.15.80:0/141421774 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa5e8052da0 con 0x7fa5f407ccf0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.009+0000 7fa5f1d9b700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fa5dc03d570 0x7fa5dc03fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.009+0000 7fa5f1d9b700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fa5dc03d570 0x7fa5dc03fa80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4006fd0 tx=0x7fa5e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.014+0000 7fa5e37fe700 1 -- 172.21.15.80:0/141421774 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa5e801f030 con 0x7fa5f407ccf0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.217+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa5f41a1410 con 0x7fa5f407ccf0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.220+0000 7fa5e37fe700 1 -- 172.21.15.80:0/141421774 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa5e802a350 con 0x7fa5f407ccf0 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fa5dc03d570 msgr2=0x7fa5dc03fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fa5dc03d570 0x7fa5dc03fa80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4006fd0 tx=0x7fa5e4006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 msgr2=0x7fa5f419de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f419de60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009520 tx=0x7fa5e8011aa0 comp rx=0 tx=0).stop 2024-04-25T11:14:46.841 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 shutdown_connections 2024-04-25T11:14:46.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fa5dc03d570 0x7fa5dc03fa80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:46.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 --2- 172.21.15.80:0/141421774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5f407ccf0 0x7fa5f419de60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:46.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 >> 172.21.15.80:0/141421774 conn(0x7fa5f4103fc0 msgr2=0x7fa5f41049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:46.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 shutdown_connections 2024-04-25T11:14:46.842 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:46.223+0000 7fa5f8ec6700 1 -- 172.21.15.80:0/141421774 wait complete. 2024-04-25T11:14:46.842 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling the dashboard module... 2024-04-25T11:14:47.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:47 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/141421774' entity='client.admin' 2024-04-25T11:14:47.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:47 smithi080 ceph-mon[29126]: from='mgr.14120 172.21.15.80:0/3195303374' entity='mgr.x' 2024-04-25T11:14:48.426 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:48 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1311501849' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-25T11:14:48.427 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:48 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: ignoring --setuser ceph since I am not root 2024-04-25T11:14:48.427 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:48 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: ignoring --setgroup ceph since I am not root 2024-04-25T11:14:48.427 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:48 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:48.425+0000 7fee01f3b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:14:48.718 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:48 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:48.617+0000 7fee01f3b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:14:48.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:48 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:48.725+0000 7fee01f3b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:14:49.000 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.278+0000 7fd6e5e0a700 1 Processor -- start 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.278+0000 7fd6e5e0a700 1 -- start start 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.278+0000 7fd6e5e0a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e0108da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.278+0000 7fd6e5e0a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0109390 con 0x7fd6e0108990 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6df7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e0108da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6df7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e0108da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53270/0 (socket says 172.21.15.80:53270) 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6df7fe700 1 -- 172.21.15.80:0/3222941028 learned_addr learned my addr 172.21.15.80:0/3222941028 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6df7fe700 1 -- 172.21.15.80:0/3222941028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e0109ac0 con 0x7fd6e0108990 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6df7fe700 1 --2- 172.21.15.80:0/3222941028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e0108da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009e80 tx=0x7fd6d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc26403c95f0e8e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6de7fc700 1 -- 172.21.15.80:0/3222941028 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d8017070 con 0x7fd6e0108990 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6de7fc700 1 -- 172.21.15.80:0/3222941028 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6d800b8c0 con 0x7fd6e0108990 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.279+0000 7fd6de7fc700 1 -- 172.21.15.80:0/3222941028 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d8004490 con 0x7fd6e0108990 2024-04-25T11:14:49.001 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.280+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/3222941028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 msgr2=0x7fd6e0108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.280+0000 7fd6e5e0a700 1 --2- 172.21.15.80:0/3222941028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e0108da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009e80 tx=0x7fd6d800b330 comp rx=0 tx=0).stop 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.280+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/3222941028 shutdown_connections 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.280+0000 7fd6e5e0a700 1 --2- 172.21.15.80:0/3222941028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e0108da0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.280+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/3222941028 >> 172.21.15.80:0/3222941028 conn(0x7fd6e0103fd0 msgr2=0x7fd6e0106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.280+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/3222941028 shutdown_connections 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.280+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/3222941028 wait complete. 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.281+0000 7fd6e5e0a700 1 Processor -- start 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.281+0000 7fd6e5e0a700 1 -- start start 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6e5e0a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6e5e0a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e010ce70 con 0x7fd6e0108990 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6df7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6df7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53276/0 (socket says 172.21.15.80:53276) 2024-04-25T11:14:49.002 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6df7fe700 1 -- 172.21.15.80:0/1311501849 learned_addr learned my addr 172.21.15.80:0/1311501849 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6df7fe700 1 -- 172.21.15.80:0/1311501849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e019d2d0 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6df7fe700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e019cd90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009fd0 tx=0x7fd6d800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.282+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d8020020 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.283+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6d8003b50 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.283+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d8017040 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.283+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e019d560 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.283+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e01a0170 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.284+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e0064cf0 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.284+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7fd6d8023020 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.284+0000 7fd6dcff9700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fd6cc03d520 0x7fd6cc03fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.284+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd6d800f050 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.284+0000 7fd6deffd700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fd6cc03d520 0x7fd6cc03fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.285+0000 7fd6deffd700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fd6cc03d520 0x7fd6cc03fa30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8006fd0 tx=0x7fd6c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.290+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd6d802a020 con 0x7fd6e0108990 2024-04-25T11:14:49.003 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:47.563+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fd6e01a0340 con 0x7fd6e0108990 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.223+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fd6d802dd60 con 0x7fd6e0108990 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.224+0000 7fd6dcff9700 1 -- 172.21.15.80:0/1311501849 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mgrmap(e 9) ==== 49529+0+0 (secure 0 0 0) 0x7fd6d8025400 con 0x7fd6e0108990 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.225+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fd6cc03d520 msgr2=0x7fd6cc03fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.225+0000 7fd6e5e0a700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fd6cc03d520 0x7fd6cc03fa30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8006fd0 tx=0x7fd6c8006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.225+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 msgr2=0x7fd6e019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.225+0000 7fd6e5e0a700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e019cd90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009fd0 tx=0x7fd6d800bd30 comp rx=0 tx=0).stop 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.225+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 shutdown_connections 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.225+0000 7fd6e5e0a700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fd6cc03d520 0x7fd6cc03fa30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.225+0000 7fd6e5e0a700 1 --2- 172.21.15.80:0/1311501849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6e0108990 0x7fd6e019cd90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.226+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 >> 172.21.15.80:0/1311501849 conn(0x7fd6e0103fd0 msgr2=0x7fd6e0104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.226+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 shutdown_connections 2024-04-25T11:14:49.004 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:48.226+0000 7fd6e5e0a700 1 -- 172.21.15.80:0/1311501849 wait complete. 2024-04-25T11:14:49.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:49 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1311501849' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-25T11:14:49.254 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:49 smithi080 ceph-mon[29126]: mgrmap e9: x(active, since 19s) 2024-04-25T11:14:49.254 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:49 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:49.043+0000 7fee01f3b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:14:49.254 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:49 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:49.130+0000 7fee01f3b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-25T11:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T11:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T11:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T11:14:50.393 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.473+0000 7fc898fc6700 1 Processor -- start 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.473+0000 7fc898fc6700 1 -- start start 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc898fc6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89410c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc898fc6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc89410cba0 con 0x7fc89407ccf0 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc89259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89410c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc89259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89410c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53288/0 (socket says 172.21.15.80:53288) 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc89259c700 1 -- 172.21.15.80:0/1485183062 learned_addr learned my addr 172.21.15.80:0/1485183062 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc89259c700 1 -- 172.21.15.80:0/1485183062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89410cd20 con 0x7fc89407ccf0 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc89259c700 1 --2- 172.21.15.80:0/1485183062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89410c590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc8840098a0 tx=0x7fc884009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f31d841462d770 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.474+0000 7fc89159a700 1 -- 172.21.15.80:0/1485183062 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884004160 con 0x7fc89407ccf0 2024-04-25T11:14:50.394 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.475+0000 7fc89159a700 1 -- 172.21.15.80:0/1485183062 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc884004300 con 0x7fc89407ccf0 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.475+0000 7fc89159a700 1 -- 172.21.15.80:0/1485183062 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884011a20 con 0x7fc89407ccf0 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.475+0000 7fc898fc6700 1 -- 172.21.15.80:0/1485183062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 msgr2=0x7fc89410c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.475+0000 7fc898fc6700 1 --2- 172.21.15.80:0/1485183062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89410c590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc8840098a0 tx=0x7fc884009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.475+0000 7fc898fc6700 1 -- 172.21.15.80:0/1485183062 shutdown_connections 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.475+0000 7fc898fc6700 1 --2- 172.21.15.80:0/1485183062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89410c590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.475+0000 7fc898fc6700 1 -- 172.21.15.80:0/1485183062 >> 172.21.15.80:0/1485183062 conn(0x7fc894103fc0 msgr2=0x7fc894106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.476+0000 7fc898fc6700 1 -- 172.21.15.80:0/1485183062 shutdown_connections 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.476+0000 7fc898fc6700 1 -- 172.21.15.80:0/1485183062 wait complete. 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.476+0000 7fc898fc6700 1 Processor -- start 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.476+0000 7fc898fc6700 1 -- start start 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc898fc6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89419de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:50.395 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc898fc6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc89410dde0 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc89259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89419de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc89259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89419de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53292/0 (socket says 172.21.15.80:53292) 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc89259c700 1 -- 172.21.15.80:0/1223862453 learned_addr learned my addr 172.21.15.80:0/1223862453 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc89259c700 1 -- 172.21.15.80:0/1223862453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89419e3a0 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc89259c700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89419de60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc884004660 tx=0x7fc884011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc8837fe700 1 -- 172.21.15.80:0/1223862453 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884003a60 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.477+0000 7fc8837fe700 1 -- 172.21.15.80:0/1223862453 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc88401b8f0 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.478+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89419e630 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.478+0000 7fc8837fe700 1 -- 172.21.15.80:0/1223862453 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884023890 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.478+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8941a1240 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.479+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc894064cf0 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.479+0000 7fc8837fe700 1 -- 172.21.15.80:0/1223862453 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) ==== 49529+0+0 (secure 0 0 0) 0x7fc88402c3f0 con 0x7fc89407ccf0 2024-04-25T11:14:50.396 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.479+0000 7fc8837fe700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 0x7fc87c03fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.479+0000 7fc8837fe700 1 -- 172.21.15.80:0/1223862453 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc884052df0 con 0x7fc89407ccf0 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.479+0000 7fc891d9b700 1 -- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 msgr2=0x7fc87c03fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2554689632 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.479+0000 7fc891d9b700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 0x7fc87c03fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.485+0000 7fc8837fe700 1 -- 172.21.15.80:0/1223862453 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc88401f030 con 0x7fc89407ccf0 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.680+0000 7fc891d9b700 1 -- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 msgr2=0x7fc87c03fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2554689632 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.680+0000 7fc891d9b700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 0x7fc87c03fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.780+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fc8941a1410 con 0x7fc89407ccf0 2024-04-25T11:14:50.397 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.781+0000 7fc8837fe700 1 -- 172.21.15.80:0/1223862453 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fc884016df0 con 0x7fc89407ccf0 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 msgr2=0x7fc87c03fa80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 0x7fc87c03fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 msgr2=0x7fc89419de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89419de60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc884004660 tx=0x7fc884011aa0 comp rx=0 tx=0).stop 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 shutdown_connections 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7fc87c03d570 0x7fc87c03fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 --2- 172.21.15.80:0/1223862453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc89407ccf0 0x7fc89419de60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 >> 172.21.15.80:0/1223862453 conn(0x7fc894103fc0 msgr2=0x7fc8941049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 shutdown_connections 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:49.783+0000 7fc898fc6700 1 -- 172.21.15.80:0/1223862453 wait complete. 2024-04-25T11:14:50.398 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for the mgr to restart... 2024-04-25T11:14:50.399 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr epoch 9... 2024-04-25T11:14:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:50 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1223862453' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T11:14:50.509 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:50 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:50.346+0000 7fee01f3b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:14:50.787 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:50 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:50.526+0000 7fee01f3b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:14:50.787 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:50 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:50.705+0000 7fee01f3b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:14:51.120 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:51 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:51.019+0000 7fee01f3b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:14:51.385 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:51 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:51.118+0000 7fee01f3b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:14:51.385 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:51 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:51.327+0000 7fee01f3b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:14:51.802 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:51 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:51.525+0000 7fee01f3b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:14:52.384 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:52 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:52.127+0000 7fee01f3b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:14:52.856 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:52 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:52.554+0000 7fee01f3b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:14:52.856 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:52 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:52.652+0000 7fee01f3b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:14:52.856 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:52 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:52.855+0000 7fee01f3b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:14:53.634 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:53 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:53.377+0000 7fee01f3b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:14:53.635 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:53 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:53.471+0000 7fee01f3b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:14:54.063 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:53 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:53.717+0000 7fee01f3b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:14:54.063 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:53 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:53.851+0000 7fee01f3b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:14:54.064 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:53 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:53.946+0000 7fee01f3b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:14:54.064 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:54 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:54.063+0000 7fee01f3b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:14:54.635 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:54 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:54.365+0000 7fee01f3b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:14:55.237 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:54 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:54.964+0000 7fee01f3b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:14:55.237 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:14:55.182+0000 7fee01f3b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: Active manager daemon x restarted 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: Activating manager daemon x 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: osdmap e3: 0 total, 0 up, 0 in 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: mgrmap e10: x(active, starting, since 0.00433819s) 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: Manager daemon x is now available 2024-04-25T11:14:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:14:55.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T11:14:56.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T11:14:56.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:56 smithi080 ceph-mon[29126]: mgrmap e11: x(active, since 1.00665s) 2024-04-25T11:14:57.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-25T11:14:57.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-25T11:14:57.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T11:14:57.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-25T11:14:57.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.798+0000 7f5b04923700 1 Processor -- start 2024-04-25T11:14:57.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.798+0000 7f5b04923700 1 -- start start 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.798+0000 7f5b04923700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b00108d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.798+0000 7f5b04923700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00109330 con 0x7f5b00108930 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.798+0000 7f5afe59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b00108d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.799+0000 7f5afe59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b00108d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53304/0 (socket says 172.21.15.80:53304) 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.799+0000 7f5afe59c700 1 -- 172.21.15.80:0/3926252230 learned_addr learned my addr 172.21.15.80:0/3926252230 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.799+0000 7f5afe59c700 1 -- 172.21.15.80:0/3926252230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b00109a60 con 0x7f5b00108930 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.799+0000 7f5afe59c700 1 --2- 172.21.15.80:0/3926252230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b00108d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5af00098a0 tx=0x7f5af0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e576960803b7a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.799+0000 7f5afd59a700 1 -- 172.21.15.80:0/3926252230 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af0004160 con 0x7f5b00108930 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.799+0000 7f5afd59a700 1 -- 172.21.15.80:0/3926252230 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af0004300 con 0x7f5b00108930 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.799+0000 7f5afd59a700 1 -- 172.21.15.80:0/3926252230 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af0011a20 con 0x7f5b00108930 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.800+0000 7f5b04923700 1 -- 172.21.15.80:0/3926252230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 msgr2=0x7f5b00108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.800+0000 7f5b04923700 1 --2- 172.21.15.80:0/3926252230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b00108d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5af00098a0 tx=0x7f5af0009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:57.045 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.801+0000 7f5b04923700 1 -- 172.21.15.80:0/3926252230 shutdown_connections 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.801+0000 7f5b04923700 1 --2- 172.21.15.80:0/3926252230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b00108d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.801+0000 7f5b04923700 1 -- 172.21.15.80:0/3926252230 >> 172.21.15.80:0/3926252230 conn(0x7f5b00103f90 msgr2=0x7f5b00106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.801+0000 7f5b04923700 1 -- 172.21.15.80:0/3926252230 shutdown_connections 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.801+0000 7f5b04923700 1 -- 172.21.15.80:0/3926252230 wait complete. 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5b04923700 1 Processor -- start 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5b04923700 1 -- start start 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5b04923700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b0019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5b04923700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0010ce10 con 0x7f5b00108930 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5afe59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b0019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5afe59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b0019dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53308/0 (socket says 172.21.15.80:53308) 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5afe59c700 1 -- 172.21.15.80:0/4249613409 learned_addr learned my addr 172.21.15.80:0/4249613409 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5afe59c700 1 -- 172.21.15.80:0/4249613409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0019e3e0 con 0x7f5b00108930 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.802+0000 7f5afe59c700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b0019dea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5af0011a20 tx=0x7f5af0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:57.046 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.803+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af00039c0 con 0x7f5b00108930 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.803+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0019e670 con 0x7f5b00108930 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.803+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af0003b60 con 0x7f5b00108930 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.803+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af0019700 con 0x7f5b00108930 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.803+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b001a1280 con 0x7f5b00108930 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.804+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) ==== 49529+0+0 (secure 0 0 0) 0x7f5af0019a00 con 0x7f5b00108930 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.804+0000 7f5aef7fe700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.804+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 --> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5ae8040190 con 0x7f5ae803d570 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.804+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5af0052820 con 0x7f5b00108930 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.804+0000 7f5afdd9b700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 msgr2=0x7f5ae803fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2554689632 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:50.804+0000 7f5afdd9b700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:51.005+0000 7f5afdd9b700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 msgr2=0x7f5ae803fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2554689632 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:51.005+0000 7f5afdd9b700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T11:14:57.047 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:51.406+0000 7f5afdd9b700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 msgr2=0x7f5ae803fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2554689632 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:51.406+0000 7f5afdd9b700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:52.207+0000 7f5afdd9b700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 msgr2=0x7f5ae803fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2554689632 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:52.207+0000 7f5afdd9b700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:53.808+0000 7f5afdd9b700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 msgr2=0x7f5ae803fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/2554689632 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:53.808+0000 7f5afdd9b700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:55.187+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 10) ==== 49296+0+0 (secure 0 0 0) 0x7f5af002d430 con 0x7f5b00108930 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:55.187+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 msgr2=0x7f5ae803fa80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:55.187+0000 7f5aef7fe700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.188+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 11) ==== 49423+0+0 (secure 0 0 0) 0x7f5af00238d0 con 0x7f5b00108930 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.188+0000 7f5aef7fe700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f5af002d020 0x7f5ae8043000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.188+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5ae8040190 con 0x7f5af002d020 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.189+0000 7f5afdd9b700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f5af002d020 0x7f5ae8043000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.190+0000 7f5afdd9b700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f5af002d020 0x7f5ae8043000 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5af4003a10 tx=0x7f5af40092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.190+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f5ae8040190 con 0x7f5af002d020 2024-04-25T11:14:57.048 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.198+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f5b0010cc60 con 0x7f5af002d020 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5aef7fe700 1 -- 172.21.15.80:0/4249613409 <== mgr.14152 v2:172.21.15.80:6800/3135257773 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f5b0010cc60 con 0x7f5af002d020 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f5af002d020 msgr2=0x7f5ae8043000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f5af002d020 0x7f5ae8043000 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5af4003a10 tx=0x7f5af40092b0 comp rx=0 tx=0).stop 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 msgr2=0x7f5b0019dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b0019dea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5af0011a20 tx=0x7f5af0011b00 comp rx=0 tx=0).stop 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 shutdown_connections 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f5af002d020 0x7f5ae8043000 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b00108930 0x7f5b0019dea0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 --2- 172.21.15.80:0/4249613409 >> [v2:172.21.15.80:6800/2554689632,v1:172.21.15.80:6801/2554689632] conn(0x7f5ae803d570 0x7f5ae803fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 >> 172.21.15.80:0/4249613409 conn(0x7f5b00103f90 msgr2=0x7f5b00194430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 shutdown_connections 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:56.199+0000 7f5b04923700 1 -- 172.21.15.80:0/4249613409 wait complete. 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:mgr epoch 9 is available 2024-04-25T11:14:57.049 INFO:teuthology.orchestra.run.smithi080.stdout:Generating a dashboard self-signed certificate... 2024-04-25T11:14:57.301 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:57 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:55] ENGINE Bus STARTING 2024-04-25T11:14:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:57 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:55] ENGINE Serving on https://172.21.15.80:7150 2024-04-25T11:14:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:57 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:55] ENGINE Serving on http://172.21.15.80:8765 2024-04-25T11:14:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:57 smithi080 ceph-mon[29126]: [25/Apr/2024:11:14:55] ENGINE Bus STARTED 2024-04-25T11:14:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:57 smithi080 ceph-mon[29126]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T11:14:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:57 smithi080 ceph-mon[29126]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T11:14:57.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:14:58.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-25T11:14:58.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.523+0000 7f4ae47e1700 1 Processor -- start 2024-04-25T11:14:58.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.523+0000 7f4ae47e1700 1 -- start start 2024-04-25T11:14:58.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.524+0000 7f4ae47e1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc10a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:58.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.524+0000 7f4ae47e1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc10a870 con 0x7f4adc109e90 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.524+0000 7f4ae257d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc10a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.524+0000 7f4ae257d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc10a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57288/0 (socket says 172.21.15.80:57288) 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.524+0000 7f4ae257d700 1 -- 172.21.15.80:0/1623330617 learned_addr learned my addr 172.21.15.80:0/1623330617 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.525+0000 7f4ae257d700 1 -- 172.21.15.80:0/1623330617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc108b10 con 0x7f4adc109e90 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.525+0000 7f4ae257d700 1 --2- 172.21.15.80:0/1623330617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc10a2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80098a0 tx=0x7f4ad8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db0983cd2f59584 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.525+0000 7f4ae157b700 1 -- 172.21.15.80:0/1623330617 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad8004160 con 0x7f4adc109e90 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.525+0000 7f4ae157b700 1 -- 172.21.15.80:0/1623330617 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad8004300 con 0x7f4adc109e90 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.525+0000 7f4ae157b700 1 -- 172.21.15.80:0/1623330617 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad8011a20 con 0x7f4adc109e90 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.526+0000 7f4ae47e1700 1 -- 172.21.15.80:0/1623330617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 msgr2=0x7f4adc10a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.526+0000 7f4ae47e1700 1 --2- 172.21.15.80:0/1623330617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc10a2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80098a0 tx=0x7f4ad8009bb0 comp rx=0 tx=0).stop 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.526+0000 7f4ae47e1700 1 -- 172.21.15.80:0/1623330617 shutdown_connections 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.526+0000 7f4ae47e1700 1 --2- 172.21.15.80:0/1623330617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc10a2a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:58.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.526+0000 7f4ae47e1700 1 -- 172.21.15.80:0/1623330617 >> 172.21.15.80:0/1623330617 conn(0x7f4adc103710 msgr2=0x7f4adc105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.526+0000 7f4ae47e1700 1 -- 172.21.15.80:0/1623330617 shutdown_connections 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.526+0000 7f4ae47e1700 1 -- 172.21.15.80:0/1623330617 wait complete. 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.527+0000 7f4ae47e1700 1 Processor -- start 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.527+0000 7f4ae47e1700 1 -- start start 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.527+0000 7f4ae47e1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc19de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.527+0000 7f4ae47e1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc10ced0 con 0x7f4adc109e90 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ae257d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc19de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ae257d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc19de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57292/0 (socket says 172.21.15.80:57292) 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ae257d700 1 -- 172.21.15.80:0/2810782447 learned_addr learned my addr 172.21.15.80:0/2810782447 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ae257d700 1 -- 172.21.15.80:0/2810782447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc19e360 con 0x7f4adc109e90 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ae257d700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc19de20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8011a20 tx=0x7f4ad8011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ad37fe700 1 -- 172.21.15.80:0/2810782447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad80039e0 con 0x7f4adc109e90 2024-04-25T11:14:58.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ad37fe700 1 -- 172.21.15.80:0/2810782447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad801b8f0 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc19e5f0 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ad37fe700 1 -- 172.21.15.80:0/2810782447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad8023770 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.528+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc1a1200 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.529+0000 7f4ad37fe700 1 -- 172.21.15.80:0/2810782447 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 11) ==== 49423+0+0 (secure 0 0 0) 0x7f4ad802c3f0 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.530+0000 7f4ad37fe700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4ac803d4b0 0x7f4ac803f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.530+0000 7f4ad37fe700 1 -- 172.21.15.80:0/2810782447 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4ad8053b90 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.530+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc064cf0 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.530+0000 7f4ae1d7c700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4ac803d4b0 0x7f4ac803f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.530+0000 7f4ae1d7c700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4ac803d4b0 0x7f4ac803f9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006fd0 tx=0x7f4acc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.537+0000 7f4ad37fe700 1 -- 172.21.15.80:0/2810782447 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4ad801f030 con 0x7f4adc109e90 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.747+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f4adc02e810 con 0x7f4ac803d4b0 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.859+0000 7f4ad37fe700 1 -- 172.21.15.80:0/2810782447 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f4adc02e810 con 0x7f4ac803d4b0 2024-04-25T11:14:58.442 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4ac803d4b0 msgr2=0x7f4ac803f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4ac803d4b0 0x7f4ac803f9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006fd0 tx=0x7f4acc006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 msgr2=0x7f4adc19de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc19de20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8011a20 tx=0x7f4ad8011b00 comp rx=0 tx=0).stop 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 shutdown_connections 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4ac803d4b0 0x7f4ac803f9c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 --2- 172.21.15.80:0/2810782447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4adc109e90 0x7f4adc19de20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 >> 172.21.15.80:0/2810782447 conn(0x7f4adc103710 msgr2=0x7f4adc1943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 shutdown_connections 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:57.861+0000 7f4ae47e1700 1 -- 172.21.15.80:0/2810782447 wait complete. 2024-04-25T11:14:58.443 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial admin user... 2024-04-25T11:14:59.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:58 smithi080 ceph-mon[29126]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:14:59.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:14:59.109 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:14:59.110 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:58 smithi080 ceph-mon[29126]: mgrmap e12: x(active, since 2s) 2024-04-25T11:14:59.923 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$RE69touQ8355hZONAIw4z.sACojAbYMLKzrwUon8.mpje/geU/w3m", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714043699, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.865+0000 7fcefd893700 1 Processor -- start 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.865+0000 7fcefd893700 1 -- start start 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.865+0000 7fcefd893700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef8108da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.865+0000 7fcefd893700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcef8109390 con 0x7fcef8108990 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.865+0000 7fcef6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef8108da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.865+0000 7fcef6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef8108da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57302/0 (socket says 172.21.15.80:57302) 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.865+0000 7fcef6ffd700 1 -- 172.21.15.80:0/2247731417 learned_addr learned my addr 172.21.15.80:0/2247731417 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.866+0000 7fcef6ffd700 1 -- 172.21.15.80:0/2247731417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef8109ac0 con 0x7fcef8108990 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.866+0000 7fcef6ffd700 1 --2- 172.21.15.80:0/2247731417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef8108da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcee800bb40 tx=0x7fcee800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b143e4927b99ccde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.866+0000 7fcef5ffb700 1 -- 172.21.15.80:0/2247731417 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee800dbe0 con 0x7fcef8108990 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.866+0000 7fcef5ffb700 1 -- 172.21.15.80:0/2247731417 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee80044e0 con 0x7fcef8108990 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.866+0000 7fcef5ffb700 1 -- 172.21.15.80:0/2247731417 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee8010470 con 0x7fcef8108990 2024-04-25T11:14:59.924 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 -- 172.21.15.80:0/2247731417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 msgr2=0x7fcef8108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:59.925 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 --2- 172.21.15.80:0/2247731417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef8108da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcee800bb40 tx=0x7fcee800be50 comp rx=0 tx=0).stop 2024-04-25T11:14:59.925 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 -- 172.21.15.80:0/2247731417 shutdown_connections 2024-04-25T11:14:59.925 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 --2- 172.21.15.80:0/2247731417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef8108da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:59.925 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 -- 172.21.15.80:0/2247731417 >> 172.21.15.80:0/2247731417 conn(0x7fcef8103fd0 msgr2=0x7fcef8106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:59.925 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 -- 172.21.15.80:0/2247731417 shutdown_connections 2024-04-25T11:14:59.925 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 -- 172.21.15.80:0/2247731417 wait complete. 2024-04-25T11:14:59.925 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.867+0000 7fcefd893700 1 Processor -- start 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcefd893700 1 -- start start 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcefd893700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcefd893700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcef807ca00 con 0x7fcef8108990 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcef6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcef6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef819bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57308/0 (socket says 172.21.15.80:57308) 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcef6ffd700 1 -- 172.21.15.80:0/464079290 learned_addr learned my addr 172.21.15.80:0/464079290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcef6ffd700 1 -- 172.21.15.80:0/464079290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef819c130 con 0x7fcef8108990 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcef6ffd700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef819bbf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcee8003c30 tx=0x7fcee8003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:59.926 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcefc891700 1 -- 172.21.15.80:0/464079290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee8027070 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef819c3c0 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcefc891700 1 -- 172.21.15.80:0/464079290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee80042d0 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.868+0000 7fcefc891700 1 -- 172.21.15.80:0/464079290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee80229b0 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.869+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef819efd0 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.869+0000 7fcefc891700 1 -- 172.21.15.80:0/464079290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) ==== 49529+0+0 (secure 0 0 0) 0x7fcee802a070 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.870+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef8064cf0 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.870+0000 7fcefc891700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcee003d5c0 0x7fcee003fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.870+0000 7fcefc891700 1 -- 172.21.15.80:0/464079290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcee801f070 con 0x7fcef8108990 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.870+0000 7fcef67fc700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcee003d5c0 0x7fcee003fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.870+0000 7fcef67fc700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcee003d5c0 0x7fcee003fad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fceec006fd0 tx=0x7fceec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:14:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:58.876+0000 7fcefc891700 1 -- 172.21.15.80:0/464079290 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcee8015070 con 0x7fcef8108990 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.108+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fcef819f260 con 0x7fcee003d5c0 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.338+0000 7fcefc891700 1 -- 172.21.15.80:0/464079290 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fcef819f260 con 0x7fcee003d5c0 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcee003d5c0 msgr2=0x7fcee003fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcee003d5c0 0x7fcee003fad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fceec006fd0 tx=0x7fceec006e40 comp rx=0 tx=0).stop 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 msgr2=0x7fcef819bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef819bbf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcee8003c30 tx=0x7fcee8003980 comp rx=0 tx=0).stop 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 shutdown_connections 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcee003d5c0 0x7fcee003fad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 --2- 172.21.15.80:0/464079290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcef8108990 0x7fcef819bbf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 >> 172.21.15.80:0/464079290 conn(0x7fcef8103fd0 msgr2=0x7fcef8191ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 shutdown_connections 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:14:59.341+0000 7fcefd893700 1 -- 172.21.15.80:0/464079290 wait complete. 2024-04-25T11:14:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:Fetching dashboard port number... 2024-04-25T11:15:00.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:00.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:59 smithi080 ceph-mon[29126]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:15:00.033 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:14:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:01.198 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:00 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1784025969' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 8443 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.340+0000 7ff3e1cc8700 1 Processor -- start 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.340+0000 7ff3e1cc8700 1 -- start start 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.340+0000 7ff3e1cc8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc10c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.340+0000 7ff3e1cc8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc07ce00 con 0x7ff3dc10a510 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.340+0000 7ff3db7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.340+0000 7ff3db7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc10c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57318/0 (socket says 172.21.15.80:57318) 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.340+0000 7ff3db7fe700 1 -- 172.21.15.80:0/3794054491 learned_addr learned my addr 172.21.15.80:0/3794054491 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.341+0000 7ff3db7fe700 1 -- 172.21.15.80:0/3794054491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc10ce70 con 0x7ff3dc10a510 2024-04-25T11:15:01.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.341+0000 7ff3db7fe700 1 --2- 172.21.15.80:0/3794054491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc10c930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0098a0 tx=0x7ff3cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e9692b5e4b662a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.341+0000 7ff3da7fc700 1 -- 172.21.15.80:0/3794054491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3cc004160 con 0x7ff3dc10a510 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.341+0000 7ff3da7fc700 1 -- 172.21.15.80:0/3794054491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc004300 con 0x7ff3dc10a510 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.341+0000 7ff3da7fc700 1 -- 172.21.15.80:0/3794054491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3cc011a20 con 0x7ff3dc10a510 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/3794054491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 msgr2=0x7ff3dc10c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 --2- 172.21.15.80:0/3794054491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc10c930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0098a0 tx=0x7ff3cc009bb0 comp rx=0 tx=0).stop 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/3794054491 shutdown_connections 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 --2- 172.21.15.80:0/3794054491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc10c930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/3794054491 >> 172.21.15.80:0/3794054491 conn(0x7ff3dc103f90 msgr2=0x7ff3dc106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/3794054491 shutdown_connections 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/3794054491 wait complete. 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.342+0000 7ff3e1cc8700 1 Processor -- start 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3e1cc8700 1 -- start start 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3e1cc8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc19de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:01.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3e1cc8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc10ddb0 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3db7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc19de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3db7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc19de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57326/0 (socket says 172.21.15.80:57326) 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3db7fe700 1 -- 172.21.15.80:0/1784025969 learned_addr learned my addr 172.21.15.80:0/1784025969 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3db7fe700 1 -- 172.21.15.80:0/1784025969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc19e370 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.343+0000 7ff3db7fe700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc19de30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009520 tx=0x7ff3cc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.344+0000 7ff3d8ff9700 1 -- 172.21.15.80:0/1784025969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3cc0039e0 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.344+0000 7ff3d8ff9700 1 -- 172.21.15.80:0/1784025969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc01b8f0 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.344+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc19e600 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.344+0000 7ff3d8ff9700 1 -- 172.21.15.80:0/1784025969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3cc0197d0 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.344+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc1a1210 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.345+0000 7ff3d8ff9700 1 -- 172.21.15.80:0/1784025969 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) ==== 49529+0+0 (secure 0 0 0) 0x7ff3cc019aa0 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.345+0000 7ff3d8ff9700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff3c403d620 0x7ff3c403fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.345+0000 7ff3d8ff9700 1 -- 172.21.15.80:0/1784025969 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff3cc052ea0 con 0x7ff3dc10a510 2024-04-25T11:15:01.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.345+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3dc064cf0 con 0x7ff3dc10a510 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.345+0000 7ff3daffd700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff3c403d620 0x7ff3c403fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.345+0000 7ff3daffd700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff3c403d620 0x7ff3c403fb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0006fd0 tx=0x7ff3d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.355+0000 7ff3d8ff9700 1 -- 172.21.15.80:0/1784025969 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff3cc01f030 con 0x7ff3dc10a510 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.567+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7ff3dc1a13e0 con 0x7ff3dc10a510 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.568+0000 7ff3d8ff9700 1 -- 172.21.15.80:0/1784025969 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7ff3cc02a350 con 0x7ff3dc10a510 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff3c403d620 msgr2=0x7ff3c403fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff3c403d620 0x7ff3c403fb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0006fd0 tx=0x7ff3d0006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 msgr2=0x7ff3dc19de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc19de30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009520 tx=0x7ff3cc011aa0 comp rx=0 tx=0).stop 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 shutdown_connections 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff3c403d620 0x7ff3c403fb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 --2- 172.21.15.80:0/1784025969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3dc10a510 0x7ff3dc19de30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 >> 172.21.15.80:0/1784025969 conn(0x7ff3dc103f90 msgr2=0x7ff3dc104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 shutdown_connections 2024-04-25T11:15:01.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:00.570+0000 7ff3e1cc8700 1 -- 172.21.15.80:0/1784025969 wait complete. 2024-04-25T11:15:01.239 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T11:15:01.239 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-25T11:15:01.247 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T11:15:01.247 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-25T11:15:01.247 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-25T11:15:01.247 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-25T11:15:01.248 INFO:teuthology.orchestra.run.smithi080.stdout:Ceph Dashboard is now available at: 2024-04-25T11:15:01.248 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:01.249 INFO:teuthology.orchestra.run.smithi080.stdout: URL: https://smithi080:8443/ 2024-04-25T11:15:01.249 INFO:teuthology.orchestra.run.smithi080.stdout: User: admin 2024-04-25T11:15:01.249 INFO:teuthology.orchestra.run.smithi080.stdout: Password: 4i6z53r5l5 2024-04-25T11:15:01.249 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:01.249 INFO:teuthology.orchestra.run.smithi080.stdout:Saving cluster configuration to /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config directory 2024-04-25T11:15:01.249 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling autotune for osd_memory_target 2024-04-25T11:15:03.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:02 smithi080 ceph-mon[29126]: mgrmap e13: x(active, since 6s) 2024-04-25T11:15:03.327 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.489+0000 7f5409347700 1 Processor -- start 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.489+0000 7f5409347700 1 -- start start 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.489+0000 7f5409347700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f5404108d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.489+0000 7f5409347700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5404109360 con 0x7f5404108960 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.489+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f5404108d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.490+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f5404108d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57336/0 (socket says 172.21.15.80:57336) 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.490+0000 7f5402ffd700 1 -- 172.21.15.80:0/2081565449 learned_addr learned my addr 172.21.15.80:0/2081565449 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.490+0000 7f5402ffd700 1 -- 172.21.15.80:0/2081565449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5404109a90 con 0x7f5404108960 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.490+0000 7f5402ffd700 1 --2- 172.21.15.80:0/2081565449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f5404108d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009e80 tx=0x7f53f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b8ed671ef0abae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.490+0000 7f5401ffb700 1 -- 172.21.15.80:0/2081565449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f4017070 con 0x7f5404108960 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.490+0000 7f5401ffb700 1 -- 172.21.15.80:0/2081565449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53f400b8c0 con 0x7f5404108960 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.490+0000 7f5401ffb700 1 -- 172.21.15.80:0/2081565449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f4004490 con 0x7f5404108960 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.491+0000 7f5409347700 1 -- 172.21.15.80:0/2081565449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 msgr2=0x7f5404108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:03.328 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.491+0000 7f5409347700 1 --2- 172.21.15.80:0/2081565449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f5404108d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009e80 tx=0x7f53f400b330 comp rx=0 tx=0).stop 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.491+0000 7f5409347700 1 -- 172.21.15.80:0/2081565449 shutdown_connections 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.491+0000 7f5409347700 1 --2- 172.21.15.80:0/2081565449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f5404108d70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.491+0000 7f5409347700 1 -- 172.21.15.80:0/2081565449 >> 172.21.15.80:0/2081565449 conn(0x7f5404103fc0 msgr2=0x7f5404106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.491+0000 7f5409347700 1 -- 172.21.15.80:0/2081565449 shutdown_connections 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.491+0000 7f5409347700 1 -- 172.21.15.80:0/2081565449 wait complete. 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5409347700 1 Processor -- start 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5409347700 1 -- start start 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5409347700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f540419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5409347700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f540410ce40 con 0x7f5404108960 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f540419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f540419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57342/0 (socket says 172.21.15.80:57342) 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5402ffd700 1 -- 172.21.15.80:0/3065778103 learned_addr learned my addr 172.21.15.80:0/3065778103 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5402ffd700 1 -- 172.21.15.80:0/3065778103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540419d320 con 0x7f5404108960 2024-04-25T11:15:03.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.492+0000 7f5402ffd700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f540419cde0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009fd0 tx=0x7f53f400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.493+0000 7f53fbfff700 1 -- 172.21.15.80:0/3065778103 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f4020020 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.493+0000 7f53fbfff700 1 -- 172.21.15.80:0/3065778103 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53f4012430 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.493+0000 7f53fbfff700 1 -- 172.21.15.80:0/3065778103 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f4017040 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.493+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540419d5b0 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.493+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54041a01c0 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.494+0000 7f53fbfff700 1 -- 172.21.15.80:0/3065778103 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f53f4023020 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.494+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5404064cf0 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.494+0000 7f53fbfff700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53f003d6b0 0x7f53f003fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.494+0000 7f53fbfff700 1 -- 172.21.15.80:0/3065778103 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f53f400f050 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.494+0000 7f54027fc700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53f003d6b0 0x7f53f003fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.494+0000 7f54027fc700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53f003d6b0 0x7f53f003fbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53ec006fd0 tx=0x7f53ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.499+0000 7f53fbfff700 1 -- 172.21.15.80:0/3065778103 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f53f402a020 con 0x7f5404108960 2024-04-25T11:15:03.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.696+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f54041a0390 con 0x7f5404108960 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.697+0000 7f53fbfff700 1 -- 172.21.15.80:0/3065778103 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f53f402dd60 con 0x7f5404108960 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.698+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53f003d6b0 msgr2=0x7f53f003fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53f003d6b0 0x7f53f003fbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53ec006fd0 tx=0x7f53ec006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 msgr2=0x7f540419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f540419cde0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009fd0 tx=0x7f53f400bd50 comp rx=0 tx=0).stop 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 shutdown_connections 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53f003d6b0 0x7f53f003fbc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 --2- 172.21.15.80:0/3065778103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5404108960 0x7f540419cde0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 >> 172.21.15.80:0/3065778103 conn(0x7f5404103fc0 msgr2=0x7f5404104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 shutdown_connections 2024-04-25T11:15:03.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:02.699+0000 7f5409347700 1 -- 172.21.15.80:0/3065778103 wait complete. 2024-04-25T11:15:04.651 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfea5b0700 1 Processor -- start 2024-04-25T11:15:04.651 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfea5b0700 1 -- start start 2024-04-25T11:15:04.651 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfea5b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe410c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:04.651 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfea5b0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe410cc20 con 0x7fbfe407d560 2024-04-25T11:15:04.651 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfe3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe410c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:04.651 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfe3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe410c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57344/0 (socket says 172.21.15.80:57344) 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfe3fff700 1 -- 172.21.15.80:0/2183021235 learned_addr learned my addr 172.21.15.80:0/2183021235 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.742+0000 7fbfe3fff700 1 -- 172.21.15.80:0/2183021235 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe410cda0 con 0x7fbfe407d560 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.743+0000 7fbfe3fff700 1 --2- 172.21.15.80:0/2183021235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe410c630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40098a0 tx=0x7fbfd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f66c2b8895cdd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.743+0000 7fbfe2ffd700 1 -- 172.21.15.80:0/2183021235 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4004160 con 0x7fbfe407d560 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.743+0000 7fbfe2ffd700 1 -- 172.21.15.80:0/2183021235 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfd4004300 con 0x7fbfe407d560 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.743+0000 7fbfe2ffd700 1 -- 172.21.15.80:0/2183021235 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4011a20 con 0x7fbfe407d560 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.743+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2183021235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 msgr2=0x7fbfe410c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.743+0000 7fbfea5b0700 1 --2- 172.21.15.80:0/2183021235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe410c630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40098a0 tx=0x7fbfd4009bb0 comp rx=0 tx=0).stop 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.743+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2183021235 shutdown_connections 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.744+0000 7fbfea5b0700 1 --2- 172.21.15.80:0/2183021235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe410c630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.744+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2183021235 >> 172.21.15.80:0/2183021235 conn(0x7fbfe4104080 msgr2=0x7fbfe41064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.744+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2183021235 shutdown_connections 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.744+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2183021235 wait complete. 2024-04-25T11:15:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.744+0000 7fbfea5b0700 1 Processor -- start 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.744+0000 7fbfea5b0700 1 -- start start 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfea5b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe419de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfea5b0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe410de60 con 0x7fbfe407d560 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe419de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe419de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57346/0 (socket says 172.21.15.80:57346) 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe3fff700 1 -- 172.21.15.80:0/2356095401 learned_addr learned my addr 172.21.15.80:0/2356095401 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe3fff700 1 -- 172.21.15.80:0/2356095401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe419e360 con 0x7fbfe407d560 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe3fff700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe419de20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4004660 tx=0x7fbfd4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe17fa700 1 -- 172.21.15.80:0/2356095401 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4003a60 con 0x7fbfe407d560 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe17fa700 1 -- 172.21.15.80:0/2356095401 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfd401b8f0 con 0x7fbfe407d560 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe419e5f0 con 0x7fbfe407d560 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfe17fa700 1 -- 172.21.15.80:0/2356095401 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4023890 con 0x7fbfe407d560 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.745+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41a1200 con 0x7fbfe407d560 2024-04-25T11:15:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.746+0000 7fbfe17fa700 1 -- 172.21.15.80:0/2356095401 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7fbfd402c3f0 con 0x7fbfe407d560 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.746+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe4064cf0 con 0x7fbfe407d560 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.747+0000 7fbfe17fa700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbfcc03d670 0x7fbfcc03fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.747+0000 7fbfe17fa700 1 -- 172.21.15.80:0/2356095401 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbfd4052f80 con 0x7fbfe407d560 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.747+0000 7fbfe37fe700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbfcc03d670 0x7fbfcc03fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.747+0000 7fbfe37fe700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbfcc03d670 0x7fbfcc03fb80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8006fd0 tx=0x7fbfd8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:03.752+0000 7fbfe17fa700 1 -- 172.21.15.80:0/2356095401 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbfd401f030 con 0x7fbfe407d560 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.058+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fbfe41a13d0 con 0x7fbfe407d560 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.061+0000 7fbfe17fa700 1 -- 172.21.15.80:0/2356095401 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fbfd40172b0 con 0x7fbfe407d560 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbfcc03d670 msgr2=0x7fbfcc03fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbfcc03d670 0x7fbfcc03fb80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8006fd0 tx=0x7fbfd8006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 msgr2=0x7fbfe419de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe419de20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4004660 tx=0x7fbfd4011aa0 comp rx=0 tx=0).stop 2024-04-25T11:15:04.654 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 shutdown_connections 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbfcc03d670 0x7fbfcc03fb80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 --2- 172.21.15.80:0/2356095401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe407d560 0x7fbfe419de20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 >> 172.21.15.80:0/2356095401 conn(0x7fbfe4104080 msgr2=0x7fbfe4104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 shutdown_connections 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-25T11:15:04.063+0000 7fbfea5b0700 1 -- 172.21.15.80:0/2356095401 wait complete. 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout:Or, if you are only running a single cluster on this host: 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-25T11:15:04.655 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout: ceph telemetry on 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout:For more information see: 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:04.656 INFO:teuthology.orchestra.run.smithi080.stdout:Bootstrap complete. 2024-04-25T11:15:04.687 INFO:tasks.cephadm:Fetching config... 2024-04-25T11:15:04.687 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:15:04.687 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-25T11:15:04.703 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-25T11:15:04.703 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:15:04.703 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-25T11:15:04.758 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-25T11:15:04.759 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:15:04.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-25T11:15:04.822 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-25T11:15:04.822 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:15:04.822 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-25T11:15:04.877 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-25T11:15:04.878 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbByBFxhzOO75f2v+R0xtcRMBH5uaorbdlBwG9TSI+N9m6GWpp6uJUI12oib0bM4Yr2US2erZU8o7/6cIqG9SkJdOjkBFy2knqopci3Z2yhnAtGNtKXNPixsECRZumMQY8KAtsrjK7/bPB+DtLCHG+OdHZavSMRAhHSv7PzN/BfXLfofoVsPBXjqIUgRQBdUecM2KMvg00LzmGTNgsbwNnB3aJyytt+eyhu3uKHa4frkeOyNU/QUH0ReHoKxShjI/Suc/Ah+Jw1AU3sO/vJCtL+Vt8tDoZYf3xrb9HDWD48u14uGLU6q9gS20lqLjRqssgI2pna2ypqXDFeLY4UJpGfcZz1qo8iVXu5v9gLpzx25WtvC7s/Sb3WCS+GoPBPrImiUR+Q1fzpH9iMALIuCyBUwHF7JzX4J448UHl3O/hTjRdx7sZDbxRP3jq2RK47RnHGL8tlgpk9iT9OYheKlBd1IDD7DeWJWXDkVjPVhh074yC745GgGVWOvp5eLyVDus= ceph-bba277ec-02f4-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T11:15:04.949 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbByBFxhzOO75f2v+R0xtcRMBH5uaorbdlBwG9TSI+N9m6GWpp6uJUI12oib0bM4Yr2US2erZU8o7/6cIqG9SkJdOjkBFy2knqopci3Z2yhnAtGNtKXNPixsECRZumMQY8KAtsrjK7/bPB+DtLCHG+OdHZavSMRAhHSv7PzN/BfXLfofoVsPBXjqIUgRQBdUecM2KMvg00LzmGTNgsbwNnB3aJyytt+eyhu3uKHa4frkeOyNU/QUH0ReHoKxShjI/Suc/Ah+Jw1AU3sO/vJCtL+Vt8tDoZYf3xrb9HDWD48u14uGLU6q9gS20lqLjRqssgI2pna2ypqXDFeLY4UJpGfcZz1qo8iVXu5v9gLpzx25WtvC7s/Sb3WCS+GoPBPrImiUR+Q1fzpH9iMALIuCyBUwHF7JzX4J448UHl3O/hTjRdx7sZDbxRP3jq2RK47RnHGL8tlgpk9iT9OYheKlBd1IDD7DeWJWXDkVjPVhh074yC745GgGVWOvp5eLyVDus= ceph-bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:04.969 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbByBFxhzOO75f2v+R0xtcRMBH5uaorbdlBwG9TSI+N9m6GWpp6uJUI12oib0bM4Yr2US2erZU8o7/6cIqG9SkJdOjkBFy2knqopci3Z2yhnAtGNtKXNPixsECRZumMQY8KAtsrjK7/bPB+DtLCHG+OdHZavSMRAhHSv7PzN/BfXLfofoVsPBXjqIUgRQBdUecM2KMvg00LzmGTNgsbwNnB3aJyytt+eyhu3uKHa4frkeOyNU/QUH0ReHoKxShjI/Suc/Ah+Jw1AU3sO/vJCtL+Vt8tDoZYf3xrb9HDWD48u14uGLU6q9gS20lqLjRqssgI2pna2ypqXDFeLY4UJpGfcZz1qo8iVXu5v9gLpzx25WtvC7s/Sb3WCS+GoPBPrImiUR+Q1fzpH9iMALIuCyBUwHF7JzX4J448UHl3O/hTjRdx7sZDbxRP3jq2RK47RnHGL8tlgpk9iT9OYheKlBd1IDD7DeWJWXDkVjPVhh074yC745GgGVWOvp5eLyVDus= ceph-bba277ec-02f4-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T11:15:05.007 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbByBFxhzOO75f2v+R0xtcRMBH5uaorbdlBwG9TSI+N9m6GWpp6uJUI12oib0bM4Yr2US2erZU8o7/6cIqG9SkJdOjkBFy2knqopci3Z2yhnAtGNtKXNPixsECRZumMQY8KAtsrjK7/bPB+DtLCHG+OdHZavSMRAhHSv7PzN/BfXLfofoVsPBXjqIUgRQBdUecM2KMvg00LzmGTNgsbwNnB3aJyytt+eyhu3uKHa4frkeOyNU/QUH0ReHoKxShjI/Suc/Ah+Jw1AU3sO/vJCtL+Vt8tDoZYf3xrb9HDWD48u14uGLU6q9gS20lqLjRqssgI2pna2ypqXDFeLY4UJpGfcZz1qo8iVXu5v9gLpzx25WtvC7s/Sb3WCS+GoPBPrImiUR+Q1fzpH9iMALIuCyBUwHF7JzX4J448UHl3O/hTjRdx7sZDbxRP3jq2RK47RnHGL8tlgpk9iT9OYheKlBd1IDD7DeWJWXDkVjPVhh074yC745GgGVWOvp5eLyVDus= ceph-bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:05.019 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbByBFxhzOO75f2v+R0xtcRMBH5uaorbdlBwG9TSI+N9m6GWpp6uJUI12oib0bM4Yr2US2erZU8o7/6cIqG9SkJdOjkBFy2knqopci3Z2yhnAtGNtKXNPixsECRZumMQY8KAtsrjK7/bPB+DtLCHG+OdHZavSMRAhHSv7PzN/BfXLfofoVsPBXjqIUgRQBdUecM2KMvg00LzmGTNgsbwNnB3aJyytt+eyhu3uKHa4frkeOyNU/QUH0ReHoKxShjI/Suc/Ah+Jw1AU3sO/vJCtL+Vt8tDoZYf3xrb9HDWD48u14uGLU6q9gS20lqLjRqssgI2pna2ypqXDFeLY4UJpGfcZz1qo8iVXu5v9gLpzx25WtvC7s/Sb3WCS+GoPBPrImiUR+Q1fzpH9iMALIuCyBUwHF7JzX4J448UHl3O/hTjRdx7sZDbxRP3jq2RK47RnHGL8tlgpk9iT9OYheKlBd1IDD7DeWJWXDkVjPVhh074yC745GgGVWOvp5eLyVDus= ceph-bba277ec-02f4-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T11:15:05.058 INFO:teuthology.orchestra.run.smithi196.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbByBFxhzOO75f2v+R0xtcRMBH5uaorbdlBwG9TSI+N9m6GWpp6uJUI12oib0bM4Yr2US2erZU8o7/6cIqG9SkJdOjkBFy2knqopci3Z2yhnAtGNtKXNPixsECRZumMQY8KAtsrjK7/bPB+DtLCHG+OdHZavSMRAhHSv7PzN/BfXLfofoVsPBXjqIUgRQBdUecM2KMvg00LzmGTNgsbwNnB3aJyytt+eyhu3uKHa4frkeOyNU/QUH0ReHoKxShjI/Suc/Ah+Jw1AU3sO/vJCtL+Vt8tDoZYf3xrb9HDWD48u14uGLU6q9gS20lqLjRqssgI2pna2ypqXDFeLY4UJpGfcZz1qo8iVXu5v9gLpzx25WtvC7s/Sb3WCS+GoPBPrImiUR+Q1fzpH9iMALIuCyBUwHF7JzX4J448UHl3O/hTjRdx7sZDbxRP3jq2RK47RnHGL8tlgpk9iT9OYheKlBd1IDD7DeWJWXDkVjPVhh074yC745GgGVWOvp5eLyVDus= ceph-bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:05.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-25T11:15:05.089 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:05 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2356095401' entity='client.admin' 2024-04-25T11:15:05.303 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:07.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 -- 172.21.15.80:0/1273509044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 msgr2=0x7f627c102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 --2- 172.21.15.80:0/1273509044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c102dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f627400b0a0 tx=0x7f627400b3b0 comp rx=0 tx=0).stop 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 -- 172.21.15.80:0/1273509044 shutdown_connections 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 --2- 172.21.15.80:0/1273509044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c102dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 -- 172.21.15.80:0/1273509044 >> 172.21.15.80:0/1273509044 conn(0x7f627c0fdfe0 msgr2=0x7f627c1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 -- 172.21.15.80:0/1273509044 shutdown_connections 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 -- 172.21.15.80:0/1273509044 wait complete. 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 Processor -- start 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.615+0000 7f628462a700 1 -- start start 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f628462a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c06b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:07.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f628462a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f627c108980 con 0x7f627c1029c0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62823c6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c06b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62823c6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c06b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43562/0 (socket says 172.21.15.80:43562) 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62823c6700 1 -- 172.21.15.80:0/2048389144 learned_addr learned my addr 172.21.15.80:0/2048389144 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62823c6700 1 -- 172.21.15.80:0/2048389144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c06bb80 con 0x7f627c1029c0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62823c6700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c06b640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6274015040 tx=0x7f6274003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62737fe700 1 -- 172.21.15.80:0/2048389144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6274021020 con 0x7f627c1029c0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c19c300 con 0x7f627c1029c0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62737fe700 1 -- 172.21.15.80:0/2048389144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f627400bdd0 con 0x7f627c1029c0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.616+0000 7f62737fe700 1 -- 172.21.15.80:0/2048389144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6274017040 con 0x7f627c1029c0 2024-04-25T11:15:07.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.617+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c19c760 con 0x7f627c1029c0 2024-04-25T11:15:07.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.618+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c109100 con 0x7f627c1029c0 2024-04-25T11:15:07.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.618+0000 7f62737fe700 1 -- 172.21.15.80:0/2048389144 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f6274024020 con 0x7f627c1029c0 2024-04-25T11:15:07.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.618+0000 7f62737fe700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f626803d610 0x7f626803fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:07.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.618+0000 7f62737fe700 1 -- 172.21.15.80:0/2048389144 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f627400f050 con 0x7f627c1029c0 2024-04-25T11:15:07.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.618+0000 7f6281bc5700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f626803d610 0x7f626803fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:07.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.618+0000 7f6281bc5700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f626803d610 0x7f626803fb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f626c006fd0 tx=0x7f626c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:07.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.623+0000 7f62737fe700 1 -- 172.21.15.80:0/2048389144 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f627402b020 con 0x7f627c1029c0 2024-04-25T11:15:07.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.828+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f627c02e740 con 0x7f627c1029c0 2024-04-25T11:15:07.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.831+0000 7f62737fe700 1 -- 172.21.15.80:0/2048389144 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f627402e9e0 con 0x7f627c1029c0 2024-04-25T11:15:07.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f626803d610 msgr2=0x7f626803fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:07.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f626803d610 0x7f626803fb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f626c006fd0 tx=0x7f626c006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:07.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 msgr2=0x7f627c06b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:07.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c06b640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6274015040 tx=0x7f6274003ce0 comp rx=0 tx=0).stop 2024-04-25T11:15:07.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 shutdown_connections 2024-04-25T11:15:07.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f626803d610 0x7f626803fb20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:07.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 --2- 172.21.15.80:0/2048389144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f627c1029c0 0x7f627c06b640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:07.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.834+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 >> 172.21.15.80:0/2048389144 conn(0x7f627c0fdfe0 msgr2=0x7f627c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:07.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.835+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 shutdown_connections 2024-04-25T11:15:07.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:07.835+0000 7f628462a700 1 -- 172.21.15.80:0/2048389144 wait complete. 2024-04-25T11:15:08.501 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-25T11:15:08.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-25T11:15:09.124 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:09.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:08 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2048389144' entity='client.admin' 2024-04-25T11:15:10.356 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:10.357 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:10.357 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:15:10.357 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:10.357 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:10.357 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:10.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.682+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/352366446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 msgr2=0x7f6fb8104390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:10.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.682+0000 7f6fbfcfa700 1 --2- 172.21.15.80:0/352366446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb8104390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009910 tx=0x7f6fb4009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:10.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.682+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/352366446 shutdown_connections 2024-04-25T11:15:10.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.682+0000 7f6fbfcfa700 1 --2- 172.21.15.80:0/352366446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb8104390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.682+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/352366446 >> 172.21.15.80:0/352366446 conn(0x7f6fb80fd760 msgr2=0x7f6fb80ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.683+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/352366446 shutdown_connections 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.683+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/352366446 wait complete. 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.683+0000 7f6fbfcfa700 1 Processor -- start 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.683+0000 7f6fbfcfa700 1 -- start start 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.683+0000 7f6fbfcfa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.683+0000 7f6fbfcfa700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8108960 con 0x7f6fb8103f80 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6fbda96700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6fbda96700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43582/0 (socket says 172.21.15.80:43582) 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6fbda96700 1 -- 172.21.15.80:0/820498240 learned_addr learned my addr 172.21.15.80:0/820498240 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6fbda96700 1 -- 172.21.15.80:0/820498240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb8198a20 con 0x7f6fb8103f80 2024-04-25T11:15:10.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6fbda96700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb81984e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40057d0 tx=0x7f6fb4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6faeffd700 1 -- 172.21.15.80:0/820498240 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb4027070 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb8198cb0 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6faeffd700 1 -- 172.21.15.80:0/820498240 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb400be10 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6faeffd700 1 -- 172.21.15.80:0/820498240 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb4022dd0 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.684+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb819b8c0 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.685+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb81090e0 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.685+0000 7f6faeffd700 1 -- 172.21.15.80:0/820498240 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f6fb402a070 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.685+0000 7f6faeffd700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6fa403d5c0 0x7f6fa403fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.685+0000 7f6faeffd700 1 -- 172.21.15.80:0/820498240 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6fb401e030 con 0x7f6fb8103f80 2024-04-25T11:15:10.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.686+0000 7f6fbd295700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6fa403d5c0 0x7f6fa403fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:10.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.686+0000 7f6fbd295700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6fa403d5c0 0x7f6fa403fad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8006fd0 tx=0x7f6fa8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:10.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.691+0000 7f6faeffd700 1 -- 172.21.15.80:0/820498240 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6fb4013070 con 0x7f6fb8103f80 2024-04-25T11:15:10.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.891+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f6fb802e620 con 0x7f6fa403d5c0 2024-04-25T11:15:10.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.895+0000 7f6faeffd700 1 -- 172.21.15.80:0/820498240 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6fb802e620 con 0x7f6fa403d5c0 2024-04-25T11:15:10.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6fa403d5c0 msgr2=0x7f6fa403fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:10.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6fa403d5c0 0x7f6fa403fad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8006fd0 tx=0x7f6fa8006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:10.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 msgr2=0x7f6fb81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:10.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb81984e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40057d0 tx=0x7f6fb4005800 comp rx=0 tx=0).stop 2024-04-25T11:15:10.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 shutdown_connections 2024-04-25T11:15:10.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6fa403d5c0 0x7f6fa403fad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:10.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 --2- 172.21.15.80:0/820498240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fb8103f80 0x7f6fb81984e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:10.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 >> 172.21.15.80:0/820498240 conn(0x7f6fb80fd760 msgr2=0x7f6fb80fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:10.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 shutdown_connections 2024-04-25T11:15:10.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:10.897+0000 7f6fbfcfa700 1 -- 172.21.15.80:0/820498240 wait complete. 2024-04-25T11:15:11.588 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi082 2024-04-25T11:15:11.588 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:15:11.588 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.conf 2024-04-25T11:15:11.607 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:15:11.607 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:11.664 INFO:tasks.cephadm:Adding host smithi082 to orchestrator... 2024-04-25T11:15:11.665 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch host add smithi082 2024-04-25T11:15:11.914 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:12.220 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:12.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:11 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:13.148 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:12 smithi080 ceph-mon[29126]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:13.148 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:12 smithi080 ceph-mon[29126]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.549+0000 7f3a19382700 1 -- 172.21.15.80:0/3962312074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 msgr2=0x7f3a14108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.549+0000 7f3a19382700 1 --2- 172.21.15.80:0/3962312074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14108e40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009910 tx=0x7f3a04009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.549+0000 7f3a19382700 1 -- 172.21.15.80:0/3962312074 shutdown_connections 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.549+0000 7f3a19382700 1 --2- 172.21.15.80:0/3962312074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14108e40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.549+0000 7f3a19382700 1 -- 172.21.15.80:0/3962312074 >> 172.21.15.80:0/3962312074 conn(0x7f3a140fdd00 msgr2=0x7f3a14100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.549+0000 7f3a19382700 1 -- 172.21.15.80:0/3962312074 shutdown_connections 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.549+0000 7f3a19382700 1 -- 172.21.15.80:0/3962312074 wait complete. 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a19382700 1 Processor -- start 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a19382700 1 -- start start 2024-04-25T11:15:13.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a19382700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14103110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a19382700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410e0d0 con 0x7f3a14108a30 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a12ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14103110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a12ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14103110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43600/0 (socket says 172.21.15.80:43600) 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a12ffd700 1 -- 172.21.15.80:0/2673137130 learned_addr learned my addr 172.21.15.80:0/2673137130 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.550+0000 7f3a12ffd700 1 -- 172.21.15.80:0/2673137130 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a14104f60 con 0x7f3a14108a30 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.551+0000 7f3a12ffd700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14103110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a040056d0 tx=0x7f3a040057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.551+0000 7f3a10ff9700 1 -- 172.21.15.80:0/2673137130 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a04027070 con 0x7f3a14108a30 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.551+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a14103650 con 0x7f3a14108a30 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.551+0000 7f3a10ff9700 1 -- 172.21.15.80:0/2673137130 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a0400be10 con 0x7f3a14108a30 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.551+0000 7f3a10ff9700 1 -- 172.21.15.80:0/2673137130 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a04022d20 con 0x7f3a14108a30 2024-04-25T11:15:13.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.551+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a14103a50 con 0x7f3a14108a30 2024-04-25T11:15:13.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.552+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a14064cf0 con 0x7f3a14108a30 2024-04-25T11:15:13.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.552+0000 7f3a10ff9700 1 -- 172.21.15.80:0/2673137130 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f3a0402a070 con 0x7f3a14108a30 2024-04-25T11:15:13.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.552+0000 7f3a10ff9700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3a0003d610 0x7f3a0003fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:13.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.552+0000 7f3a10ff9700 1 -- 172.21.15.80:0/2673137130 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3a0401e030 con 0x7f3a14108a30 2024-04-25T11:15:13.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.552+0000 7f3a0a7fc700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3a0003d610 0x7f3a0003fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:13.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.553+0000 7f3a0a7fc700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3a0003d610 0x7f3a0003fb20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39fc006fd0 tx=0x7f39fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:13.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.557+0000 7f3a10ff9700 1 -- 172.21.15.80:0/2673137130 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3a04013070 con 0x7f3a14108a30 2024-04-25T11:15:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:13.757+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}) -- 0x7f3a14103cd0 con 0x7f3a0003d610 2024-04-25T11:15:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:14 smithi080 ceph-mon[29126]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:15:16.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:16 smithi080 ceph-mon[29126]: Deploying cephadm binary to smithi082 2024-04-25T11:15:16.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:16 smithi080 ceph-mon[29126]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:17.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.982+0000 7f3a10ff9700 1 -- 172.21.15.80:0/2673137130 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3a14103cd0 con 0x7f3a0003d610 2024-04-25T11:15:17.983 INFO:teuthology.orchestra.run.smithi080.stdout:Added host 'smithi082' with addr '172.21.15.82' 2024-04-25T11:15:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3a0003d610 msgr2=0x7f3a0003fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3a0003d610 0x7f3a0003fb20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39fc006fd0 tx=0x7f39fc006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 msgr2=0x7f3a14103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14103110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a040056d0 tx=0x7f3a040057b0 comp rx=0 tx=0).stop 2024-04-25T11:15:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 shutdown_connections 2024-04-25T11:15:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3a0003d610 0x7f3a0003fb20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 --2- 172.21.15.80:0/2673137130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a14108a30 0x7f3a14103110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 >> 172.21.15.80:0/2673137130 conn(0x7f3a140fdd00 msgr2=0x7f3a14105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 shutdown_connections 2024-04-25T11:15:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:17.984+0000 7f3a19382700 1 -- 172.21.15.80:0/2673137130 wait complete. 2024-04-25T11:15:18.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:18 smithi080 ceph-mon[29126]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:18.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:18 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:18.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:18 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:18.745 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T11:15:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:19.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:19 smithi080 ceph-mon[29126]: Added host smithi082 2024-04-25T11:15:19.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:19.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:20.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:20 smithi080 ceph-mon[29126]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.520+0000 7f1bda7fe700 1 -- 172.21.15.80:0/386014252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 msgr2=0x7f1bd4108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.520+0000 7f1bda7fe700 1 --2- 172.21.15.80:0/386014252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd4108d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009910 tx=0x7f1bc8009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.520+0000 7f1bda7fe700 1 -- 172.21.15.80:0/386014252 shutdown_connections 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.520+0000 7f1bda7fe700 1 --2- 172.21.15.80:0/386014252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd4108d70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.520+0000 7f1bda7fe700 1 -- 172.21.15.80:0/386014252 >> 172.21.15.80:0/386014252 conn(0x7f1bd4078480 msgr2=0x7f1bd40788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.520+0000 7f1bda7fe700 1 -- 172.21.15.80:0/386014252 shutdown_connections 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.520+0000 7f1bda7fe700 1 -- 172.21.15.80:0/386014252 wait complete. 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.521+0000 7f1bda7fe700 1 Processor -- start 2024-04-25T11:15:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.521+0000 7f1bda7fe700 1 -- start start 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bda7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bda7fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd410ceb0 con 0x7f1bd4108960 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37340/0 (socket says 172.21.15.80:37340) 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd3fff700 1 -- 172.21.15.80:0/1451398824 learned_addr learned my addr 172.21.15.80:0/1451398824 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd3fff700 1 -- 172.21.15.80:0/1451398824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd406bb80 con 0x7f1bd4108960 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd3fff700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd419a700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80056d0 tx=0x7f1bc80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd17fa700 1 -- 172.21.15.80:0/1451398824 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc8027070 con 0x7f1bd4108960 2024-04-25T11:15:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd17fa700 1 -- 172.21.15.80:0/1451398824 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc800be10 con 0x7f1bd4108960 2024-04-25T11:15:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bd17fa700 1 -- 172.21.15.80:0/1451398824 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc8022d20 con 0x7f1bd4108960 2024-04-25T11:15:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd419aca0 con 0x7f1bd4108960 2024-04-25T11:15:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.522+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd419b160 con 0x7f1bd4108960 2024-04-25T11:15:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.524+0000 7f1bd17fa700 1 -- 172.21.15.80:0/1451398824 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f1bc802a070 con 0x7f1bd4108960 2024-04-25T11:15:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.524+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd4104070 con 0x7f1bd4108960 2024-04-25T11:15:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.524+0000 7f1bd17fa700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1bbc03d610 0x7f1bbc03fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:20.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.524+0000 7f1bd17fa700 1 -- 172.21.15.80:0/1451398824 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1bc801e030 con 0x7f1bd4108960 2024-04-25T11:15:20.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.524+0000 7f1bd37fe700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1bbc03d610 0x7f1bbc03fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:20.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.524+0000 7f1bd37fe700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1bbc03d610 0x7f1bbc03fb20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4006fd0 tx=0x7f1bc4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:20.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.529+0000 7f1bd17fa700 1 -- 172.21.15.80:0/1451398824 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1bc8013070 con 0x7f1bd4108960 2024-04-25T11:15:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.741+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bd4064d50 con 0x7f1bbc03d610 2024-04-25T11:15:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.742+0000 7f1bd17fa700 1 -- 172.21.15.80:0/1451398824 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f1bd4064d50 con 0x7f1bbc03d610 2024-04-25T11:15:20.743 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:20.743 INFO:teuthology.orchestra.run.smithi080.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}] 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1bbc03d610 msgr2=0x7f1bbc03fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1bbc03d610 0x7f1bbc03fb20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4006fd0 tx=0x7f1bc4006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 msgr2=0x7f1bd419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd419a700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80056d0 tx=0x7f1bc80057b0 comp rx=0 tx=0).stop 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 shutdown_connections 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1bbc03d610 0x7f1bbc03fb20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 --2- 172.21.15.80:0/1451398824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd4108960 0x7f1bd419a700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 >> 172.21.15.80:0/1451398824 conn(0x7f1bd4078480 msgr2=0x7f1bd40ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 shutdown_connections 2024-04-25T11:15:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:20.745+0000 7f1bda7fe700 1 -- 172.21.15.80:0/1451398824 wait complete. 2024-04-25T11:15:21.331 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi196 2024-04-25T11:15:21.332 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:15:21.332 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.conf 2024-04-25T11:15:21.351 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:15:21.351 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:21.408 INFO:tasks.cephadm:Adding host smithi196 to orchestrator... 2024-04-25T11:15:21.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch host add smithi196 2024-04-25T11:15:21.644 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:21.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:21.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:21 smithi080 ceph-mon[29126]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:15:21.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:21 smithi080 ceph-mon[29126]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 -- 172.21.15.80:0/2802234041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 msgr2=0x7f9280109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 --2- 172.21.15.80:0/2802234041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f9280109e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9270009910 tx=0x7f9270009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 -- 172.21.15.80:0/2802234041 shutdown_connections 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 --2- 172.21.15.80:0/2802234041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f9280109e00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 -- 172.21.15.80:0/2802234041 >> 172.21.15.80:0/2802234041 conn(0x7f92800ff540 msgr2=0x7f9280101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 -- 172.21.15.80:0/2802234041 shutdown_connections 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 -- 172.21.15.80:0/2802234041 wait complete. 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.199+0000 7f92862c7700 1 Processor -- start 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.200+0000 7f92862c7700 1 -- start start 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.200+0000 7f92862c7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f928019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.200+0000 7f92862c7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f928010df40 con 0x7f92801099f0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.200+0000 7f927ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f928019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.200+0000 7f927ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f928019f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37356/0 (socket says 172.21.15.80:37356) 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.200+0000 7f927ffff700 1 -- 172.21.15.80:0/1019711973 learned_addr learned my addr 172.21.15.80:0/1019711973 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.200+0000 7f927ffff700 1 -- 172.21.15.80:0/1019711973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928019fa50 con 0x7f92801099f0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.201+0000 7f927ffff700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f928019f510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92700056d0 tx=0x7f92700057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.201+0000 7f927d7fa700 1 -- 172.21.15.80:0/1019711973 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9270027070 con 0x7f92801099f0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.201+0000 7f927d7fa700 1 -- 172.21.15.80:0/1019711973 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f927000be10 con 0x7f92801099f0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.201+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928019fd40 con 0x7f92801099f0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.201+0000 7f927d7fa700 1 -- 172.21.15.80:0/1019711973 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9270022d20 con 0x7f92801099f0 2024-04-25T11:15:23.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.201+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9280199870 con 0x7f92801099f0 2024-04-25T11:15:23.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.202+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9280105100 con 0x7f92801099f0 2024-04-25T11:15:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.202+0000 7f927d7fa700 1 -- 172.21.15.80:0/1019711973 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f927002a070 con 0x7f92801099f0 2024-04-25T11:15:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.202+0000 7f927d7fa700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f926803d610 0x7f926803fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.202+0000 7f927d7fa700 1 -- 172.21.15.80:0/1019711973 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f927001e030 con 0x7f92801099f0 2024-04-25T11:15:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.202+0000 7f927f7fe700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f926803d610 0x7f926803fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:23.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.203+0000 7f927f7fe700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f926803d610 0x7f926803fb20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9274006fd0 tx=0x7f9274006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:23.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.207+0000 7f927d7fa700 1 -- 172.21.15.80:0/1019711973 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9270013070 con 0x7f92801099f0 2024-04-25T11:15:23.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:23.412+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}) -- 0x7f928019ac40 con 0x7f926803d610 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:24.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:25.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:25 smithi080 ceph-mon[29126]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:15:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:25 smithi080 ceph-mon[29126]: Deploying cephadm binary to smithi196 2024-04-25T11:15:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:25 smithi080 ceph-mon[29126]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:15:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:25 smithi080 ceph-mon[29126]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:26.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:26 smithi080 ceph-mon[29126]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:26.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:26 smithi080 ceph-mon[29126]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:27.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.604+0000 7f927d7fa700 1 -- 172.21.15.80:0/1019711973 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f928019ac40 con 0x7f926803d610 2024-04-25T11:15:27.605 INFO:teuthology.orchestra.run.smithi080.stdout:Added host 'smithi196' with addr '172.21.15.196' 2024-04-25T11:15:27.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f926803d610 msgr2=0x7f926803fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:27.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f926803d610 0x7f926803fb20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9274006fd0 tx=0x7f9274006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:27.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 msgr2=0x7f928019f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:27.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f928019f510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92700056d0 tx=0x7f92700057b0 comp rx=0 tx=0).stop 2024-04-25T11:15:27.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 shutdown_connections 2024-04-25T11:15:27.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f926803d610 0x7f926803fb20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:27.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 --2- 172.21.15.80:0/1019711973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92801099f0 0x7f928019f510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:27.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.606+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 >> 172.21.15.80:0/1019711973 conn(0x7f92800ff540 msgr2=0x7f92801004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:27.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.607+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 shutdown_connections 2024-04-25T11:15:27.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:27.607+0000 7f92862c7700 1 -- 172.21.15.80:0/1019711973 wait complete. 2024-04-25T11:15:28.226 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T11:15:28.458 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:29.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:29 smithi080 ceph-mon[29126]: Added host smithi196 2024-04-25T11:15:29.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.102+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/4263306445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 msgr2=0x7f4e04108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.102+0000 7f4e0b5ac700 1 --2- 172.21.15.80:0/4263306445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e04108d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009910 tx=0x7f4df4009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.102+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/4263306445 shutdown_connections 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.102+0000 7f4e0b5ac700 1 --2- 172.21.15.80:0/4263306445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e04108d70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.102+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/4263306445 >> 172.21.15.80:0/4263306445 conn(0x7f4e04078480 msgr2=0x7f4e040788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.103+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/4263306445 shutdown_connections 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.103+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/4263306445 wait complete. 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.103+0000 7f4e0b5ac700 1 Processor -- start 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.103+0000 7f4e0b5ac700 1 -- start start 2024-04-25T11:15:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.103+0000 7f4e0b5ac700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e0419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.103+0000 7f4e0b5ac700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0410ceb0 con 0x7f4e04108960 2024-04-25T11:15:30.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4e09348700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e0419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:30.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4e09348700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e0419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46832/0 (socket says 172.21.15.80:46832) 2024-04-25T11:15:30.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4e09348700 1 -- 172.21.15.80:0/1982391209 learned_addr learned my addr 172.21.15.80:0/1982391209 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4e09348700 1 -- 172.21.15.80:0/1982391209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0406bb80 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4e09348700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e0419a700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4df40056d0 tx=0x7f4df40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4dfa7fc700 1 -- 172.21.15.80:0/1982391209 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4027070 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4dfa7fc700 1 -- 172.21.15.80:0/1982391209 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4df400be10 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0419aca0 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4dfa7fc700 1 -- 172.21.15.80:0/1982391209 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4022d20 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.104+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0419b160 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.105+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e04104070 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.105+0000 7f4dfa7fc700 1 -- 172.21.15.80:0/1982391209 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f4df402a070 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.105+0000 7f4dfa7fc700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4df003d610 0x7f4df003fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.106+0000 7f4dfa7fc700 1 -- 172.21.15.80:0/1982391209 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4df401e030 con 0x7f4e04108960 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.106+0000 7f4e08b47700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4df003d610 0x7f4df003fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:30.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.106+0000 7f4e08b47700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4df003d610 0x7f4df003fb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4e00006fd0 tx=0x7f4e00006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:30.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.111+0000 7f4dfa7fc700 1 -- 172.21.15.80:0/1982391209 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4df4013070 con 0x7f4e04108960 2024-04-25T11:15:30.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.317+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e0419b4a0 con 0x7f4df003d610 2024-04-25T11:15:30.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.319+0000 7f4dfa7fc700 1 -- 172.21.15.80:0/1982391209 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f4e0419b4a0 con 0x7f4df003d610 2024-04-25T11:15:30.319 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:15:30.319 INFO:teuthology.orchestra.run.smithi080.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.196", "hostname": "smithi196", "labels": [], "status": ""}] 2024-04-25T11:15:30.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4df003d610 msgr2=0x7f4df003fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:30.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4df003d610 0x7f4df003fb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4e00006fd0 tx=0x7f4e00006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 msgr2=0x7f4e0419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e0419a700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4df40056d0 tx=0x7f4df40057b0 comp rx=0 tx=0).stop 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 shutdown_connections 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4df003d610 0x7f4df003fb20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 --2- 172.21.15.80:0/1982391209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e04108960 0x7f4e0419a700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 >> 172.21.15.80:0/1982391209 conn(0x7f4e04078480 msgr2=0x7f4e040ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 shutdown_connections 2024-04-25T11:15:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:30.321+0000 7f4e0b5ac700 1 -- 172.21.15.80:0/1982391209 wait complete. 2024-04-25T11:15:30.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:30 smithi080 ceph-mon[29126]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:30.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:30 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:30.933 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-25T11:15:30.933 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-25T11:15:31.182 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:32.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:32 smithi080 ceph-mon[29126]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:15:32.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:32 smithi080 ceph-mon[29126]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.683+0000 7fa8aceef700 1 -- 172.21.15.80:0/3794502299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 msgr2=0x7fa8a8108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.683+0000 7fa8aceef700 1 --2- 172.21.15.80:0/3794502299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8108d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa898009910 tx=0x7fa898009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.683+0000 7fa8aceef700 1 -- 172.21.15.80:0/3794502299 shutdown_connections 2024-04-25T11:15:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.683+0000 7fa8aceef700 1 --2- 172.21.15.80:0/3794502299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8108d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:32.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.683+0000 7fa8aceef700 1 -- 172.21.15.80:0/3794502299 >> 172.21.15.80:0/3794502299 conn(0x7fa8a80fe440 msgr2=0x7fa8a8100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:32.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.683+0000 7fa8aceef700 1 -- 172.21.15.80:0/3794502299 shutdown_connections 2024-04-25T11:15:32.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.683+0000 7fa8aceef700 1 -- 172.21.15.80:0/3794502299 wait complete. 2024-04-25T11:15:32.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.684+0000 7fa8aceef700 1 Processor -- start 2024-04-25T11:15:32.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.684+0000 7fa8aceef700 1 -- start start 2024-04-25T11:15:32.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.684+0000 7fa8aceef700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:32.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.684+0000 7fa8aceef700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a810ce80 con 0x7fa8a8108930 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.684+0000 7fa8a659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.684+0000 7fa8a659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46842/0 (socket says 172.21.15.80:46842) 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.684+0000 7fa8a659c700 1 -- 172.21.15.80:0/1968065805 learned_addr learned my addr 172.21.15.80:0/1968065805 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.685+0000 7fa8a659c700 1 -- 172.21.15.80:0/1968065805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a8198c50 con 0x7fa8a8108930 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.685+0000 7fa8a659c700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8198710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa8980056d0 tx=0x7fa8980057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.685+0000 7fa89f7fe700 1 -- 172.21.15.80:0/1968065805 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa898027070 con 0x7fa8a8108930 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.685+0000 7fa89f7fe700 1 -- 172.21.15.80:0/1968065805 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa89800be10 con 0x7fa8a8108930 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.685+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a8198f40 con 0x7fa8a8108930 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.685+0000 7fa89f7fe700 1 -- 172.21.15.80:0/1968065805 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa898022d20 con 0x7fa8a8108930 2024-04-25T11:15:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.685+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a819cf40 con 0x7fa8a8108930 2024-04-25T11:15:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.686+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a8104040 con 0x7fa8a8108930 2024-04-25T11:15:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.686+0000 7fa89f7fe700 1 -- 172.21.15.80:0/1968065805 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7fa89802a070 con 0x7fa8a8108930 2024-04-25T11:15:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.686+0000 7fa89f7fe700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa89403d610 0x7fa89403fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.686+0000 7fa89f7fe700 1 -- 172.21.15.80:0/1968065805 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa89801e030 con 0x7fa8a8108930 2024-04-25T11:15:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.686+0000 7fa89ffff700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa89403d610 0x7fa89403fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.687+0000 7fa89ffff700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa89403d610 0x7fa89403fb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa890006fd0 tx=0x7fa890006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.691+0000 7fa89f7fe700 1 -- 172.21.15.80:0/1968065805 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa898013070 con 0x7fa8a8108930 2024-04-25T11:15:32.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:32.893+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa8a8199a70 con 0x7fa8a8108930 2024-04-25T11:15:33.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.278+0000 7fa89f7fe700 1 -- 172.21.15.80:0/1968065805 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fa89800d340 con 0x7fa8a8108930 2024-04-25T11:15:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa89403d610 msgr2=0x7fa89403fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa89403d610 0x7fa89403fb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa890006fd0 tx=0x7fa890006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 msgr2=0x7fa8a8198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8198710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa8980056d0 tx=0x7fa8980057b0 comp rx=0 tx=0).stop 2024-04-25T11:15:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 shutdown_connections 2024-04-25T11:15:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa89403d610 0x7fa89403fb20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:33.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 --2- 172.21.15.80:0/1968065805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8a8108930 0x7fa8a8198710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:33.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 >> 172.21.15.80:0/1968065805 conn(0x7fa8a80fe440 msgr2=0x7fa8a80ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:33.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 shutdown_connections 2024-04-25T11:15:33.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:33.280+0000 7fa8aceef700 1 -- 172.21.15.80:0/1968065805 wait complete. 2024-04-25T11:15:33.282 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-04-25T11:15:33.591 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:33 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1968065805' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T11:15:33.927 INFO:tasks.cephadm:Adding mon.a on smithi080 2024-04-25T11:15:33.927 INFO:tasks.cephadm:Adding mon.b on smithi082 2024-04-25T11:15:33.927 INFO:tasks.cephadm:Adding mon.c on smithi196 2024-04-25T11:15:33.927 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi196:172.21.15.196=c' 2024-04-25T11:15:34.164 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1968065805' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:34.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:35 smithi080 ceph-mon[29126]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:15:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:35 smithi080 ceph-mon[29126]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:35 smithi080 ceph-mon[29126]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:35 smithi080 ceph-mon[29126]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:15:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:35.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.690+0000 7f70a4bd4700 1 -- 172.21.15.196:0/1785484031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 msgr2=0x7f70a0108d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:35.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.690+0000 7f70a4bd4700 1 --2- 172.21.15.196:0/1785484031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0108d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7090009910 tx=0x7f7090009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:35.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.690+0000 7f70a4bd4700 1 -- 172.21.15.196:0/1785484031 shutdown_connections 2024-04-25T11:15:35.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.690+0000 7f70a4bd4700 1 --2- 172.21.15.196:0/1785484031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0108d20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:35.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.690+0000 7f70a4bd4700 1 -- 172.21.15.196:0/1785484031 >> 172.21.15.196:0/1785484031 conn(0x7f70a00fe420 msgr2=0x7f70a0100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:35.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.690+0000 7f70a4bd4700 1 -- 172.21.15.196:0/1785484031 shutdown_connections 2024-04-25T11:15:35.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.690+0000 7f70a4bd4700 1 -- 172.21.15.196:0/1785484031 wait complete. 2024-04-25T11:15:35.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.691+0000 7f70a4bd4700 1 Processor -- start 2024-04-25T11:15:35.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.691+0000 7f70a4bd4700 1 -- start start 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.691+0000 7f70a4bd4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.691+0000 7f70a4bd4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70a010ce60 con 0x7f70a0108910 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f709e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f709e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.196:53618/0 (socket says 172.21.15.196:53618) 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f709e59c700 1 -- 172.21.15.196:0/442774949 learned_addr learned my addr 172.21.15.196:0/442774949 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f709e59c700 1 -- 172.21.15.196:0/442774949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a0198c60 con 0x7f70a0108910 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f709e59c700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0198720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70900056d0 tx=0x7f70900057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f708f7fe700 1 -- 172.21.15.196:0/442774949 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7090027070 con 0x7f70a0108910 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a0198f50 con 0x7f70a0108910 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f708f7fe700 1 -- 172.21.15.196:0/442774949 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f709000be10 con 0x7f70a0108910 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f708f7fe700 1 -- 172.21.15.196:0/442774949 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7090022d20 con 0x7f70a0108910 2024-04-25T11:15:35.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.692+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a019cf50 con 0x7f70a0108910 2024-04-25T11:15:35.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.693+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a0104020 con 0x7f70a0108910 2024-04-25T11:15:35.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.693+0000 7f708f7fe700 1 -- 172.21.15.196:0/442774949 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f709002a070 con 0x7f70a0108910 2024-04-25T11:15:35.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.694+0000 7f708f7fe700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f708803d610 0x7f708803fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:35.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.694+0000 7f708f7fe700 1 -- 172.21.15.196:0/442774949 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f709001e030 con 0x7f70a0108910 2024-04-25T11:15:35.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.694+0000 7f709dd9b700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f708803d610 0x7f708803fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:35.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.694+0000 7f709dd9b700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f708803d610 0x7f708803fb20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7094006fd0 tx=0x7f7094006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:35.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.699+0000 7f708f7fe700 1 -- 172.21.15.196:0/442774949 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7090013070 con 0x7f70a0108910 2024-04-25T11:15:35.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.907+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}) -- 0x7f70a0199a80 con 0x7f708803d610 2024-04-25T11:15:35.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.914+0000 7f708f7fe700 1 -- 172.21.15.196:0/442774949 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f70a0199a80 con 0x7f708803d610 2024-04-25T11:15:35.916 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mon update... 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f708803d610 msgr2=0x7f708803fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f708803d610 0x7f708803fb20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7094006fd0 tx=0x7f7094006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 msgr2=0x7f70a0198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0198720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70900056d0 tx=0x7f70900057b0 comp rx=0 tx=0).stop 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 shutdown_connections 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f708803d610 0x7f708803fb20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 --2- 172.21.15.196:0/442774949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108910 0x7f70a0198720 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.916+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 >> 172.21.15.196:0/442774949 conn(0x7f70a00fe420 msgr2=0x7f70a00ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.917+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 shutdown_connections 2024-04-25T11:15:35.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:35.917+0000 7f70a4bd4700 1 -- 172.21.15.196:0/442774949 wait complete. 2024-04-25T11:15:36.477 DEBUG:teuthology.orchestra.run.smithi082:mon.b> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.b.service 2024-04-25T11:15:36.480 DEBUG:teuthology.orchestra.run.smithi196:mon.c> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.c.service 2024-04-25T11:15:36.482 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T11:15:36.482 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:37.539 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:37.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:37 smithi080 ceph-mon[29126]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:15:37.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:37 smithi080 ceph-mon[29126]: Saving service mon spec with placement smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi196:172.21.15.196=c;count:3 2024-04-25T11:15:37.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:37 smithi080 ceph-mon[29126]: Deploying daemon mon.c on smithi196 2024-04-25T11:15:38.638 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:38 smithi080 ceph-mon[29126]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.111+0000 7fb9901be700 1 -- 172.21.15.196:0/3488534853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 msgr2=0x7fb988109e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.111+0000 7fb9901be700 1 --2- 172.21.15.196:0/3488534853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb988109e40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb984009910 tx=0x7fb984009c20 comp rx=0 tx=0).stop 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.111+0000 7fb9901be700 1 -- 172.21.15.196:0/3488534853 shutdown_connections 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.111+0000 7fb9901be700 1 --2- 172.21.15.196:0/3488534853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb988109e40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.111+0000 7fb9901be700 1 -- 172.21.15.196:0/3488534853 >> 172.21.15.196:0/3488534853 conn(0x7fb9880ff580 msgr2=0x7fb9881019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.111+0000 7fb9901be700 1 -- 172.21.15.196:0/3488534853 shutdown_connections 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.111+0000 7fb9901be700 1 -- 172.21.15.196:0/3488534853 wait complete. 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.112+0000 7fb9901be700 1 Processor -- start 2024-04-25T11:15:40.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.112+0000 7fb9901be700 1 -- start start 2024-04-25T11:15:40.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.112+0000 7fb9901be700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb98819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:40.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.112+0000 7fb9901be700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810df80 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.113+0000 7fb98df5a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb98819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.113+0000 7fb98df5a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb98819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.196:53634/0 (socket says 172.21.15.196:53634) 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.113+0000 7fb98df5a700 1 -- 172.21.15.196:0/3365636425 learned_addr learned my addr 172.21.15.196:0/3365636425 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.113+0000 7fb98df5a700 1 -- 172.21.15.196:0/3365636425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98819fa20 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.113+0000 7fb98df5a700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb98819f4e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9840056d0 tx=0x7fb9840057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.114+0000 7fb97effd700 1 -- 172.21.15.196:0/3365636425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb984027070 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.114+0000 7fb97effd700 1 -- 172.21.15.196:0/3365636425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98400be10 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.114+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98819fd10 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.114+0000 7fb97effd700 1 -- 172.21.15.196:0/3365636425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb984022d20 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.114+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb988199840 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.115+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb988105140 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.115+0000 7fb97effd700 1 -- 172.21.15.196:0/3365636425 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7fb98402a070 con 0x7fb988109a30 2024-04-25T11:15:40.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.115+0000 7fb97effd700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb97403d610 0x7fb97403fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:40.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.115+0000 7fb97effd700 1 -- 172.21.15.196:0/3365636425 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb98401e030 con 0x7fb988109a30 2024-04-25T11:15:40.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.115+0000 7fb98d759700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb97403d610 0x7fb97403fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:40.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.116+0000 7fb98d759700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb97403d610 0x7fb97403fb20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb978006fd0 tx=0x7fb978006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:40.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.121+0000 7fb97effd700 1 -- 172.21.15.196:0/3365636425 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb984013070 con 0x7fb988109a30 2024-04-25T11:15:40.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.409+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb98819ff40 con 0x7fb988109a30 2024-04-25T11:15:40.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.410+0000 7fb97effd700 1 -- 172.21.15.196:0/3365636425 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fb984031090 con 0x7fb988109a30 2024-04-25T11:15:40.411 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:15:40.411 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":1,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","modified":"2024-04-25T11:13:57.766755Z","created":"2024-04-25T11:13:57.766755Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb97403d610 msgr2=0x7fb97403fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb97403d610 0x7fb97403fb20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb978006fd0 tx=0x7fb978006e40 comp rx=0 tx=0).stop 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 msgr2=0x7fb98819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb98819f4e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9840056d0 tx=0x7fb9840057b0 comp rx=0 tx=0).stop 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 shutdown_connections 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb97403d610 0x7fb97403fb20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 --2- 172.21.15.196:0/3365636425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988109a30 0x7fb98819f4e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 >> 172.21.15.196:0/3365636425 conn(0x7fb9880ff580 msgr2=0x7fb988100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 shutdown_connections 2024-04-25T11:15:40.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:40.412+0000 7fb9901be700 1 -- 172.21.15.196:0/3365636425 wait complete. 2024-04-25T11:15:40.414 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 1 2024-04-25T11:15:40.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:40 smithi080 ceph-mon[29126]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:40.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:40 smithi196 ceph-mon[32659]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-25T11:15:41.148 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:40 smithi196 bash[32607]: 37ca34ca85f63c38f4cc0b8ea6d175a35433dea7940c1715cb9dd835cc6327b4 2024-04-25T11:15:41.149 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:40 smithi196 systemd[1]: Started Ceph mon.c for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:15:42.176 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T11:15:42.176 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T11:15:42.419 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:15:45.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:15:45.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: mon.a calling monitor election 2024-04-25T11:15:45.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:45.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: mon.c calling monitor election 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: monmap epoch 2 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: last_changed 2024-04-25T11:15:40.557088+0000 2024-04-25T11:15:45.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: min_mon_release 19 (squid) 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: election_strategy: 1 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: fsmap 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: mgrmap e13: x(active, since 50s) 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: overall HEALTH_OK 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:45.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: mon.a calling monitor election 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: mon.c calling monitor election 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: monmap epoch 2 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: last_changed 2024-04-25T11:15:40.557088+0000 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: min_mon_release 19 (squid) 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: election_strategy: 1 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: fsmap 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: mgrmap e13: x(active, since 50s) 2024-04-25T11:15:45.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: overall HEALTH_OK 2024-04-25T11:15:45.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:45.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:46.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:46.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:46.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:46.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:46 smithi080 ceph-mon[29126]: Deploying daemon mon.b on smithi082 2024-04-25T11:15:46.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:46.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:46.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:46.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:46.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:46 smithi196 ceph-mon[32659]: Deploying daemon mon.b on smithi082 2024-04-25T11:15:46.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:46.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.971+0000 7f22b9855700 1 -- 172.21.15.196:0/1968248932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 msgr2=0x7f22a0005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:46.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.971+0000 7f22b9855700 1 --2- 172.21.15.196:0/1968248932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 0x7f22a0005aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f22b4102940 tx=0x7f229c00feb0 comp rx=0 tx=0).stop 2024-04-25T11:15:46.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.971+0000 7f22b9855700 1 -- 172.21.15.196:0/1968248932 shutdown_connections 2024-04-25T11:15:46.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.971+0000 7f22b9855700 1 --2- 172.21.15.196:0/1968248932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 0x7f22a0005aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:46.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.971+0000 7f22b9855700 1 -- 172.21.15.196:0/1968248932 >> 172.21.15.196:0/1968248932 conn(0x7f22b40fe510 msgr2=0x7f22b4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:46.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.971+0000 7f22b9855700 1 -- 172.21.15.196:0/1968248932 shutdown_connections 2024-04-25T11:15:46.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.971+0000 7f22b9855700 1 -- 172.21.15.196:0/1968248932 wait complete. 2024-04-25T11:15:46.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.972+0000 7f22b9855700 1 Processor -- start 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b9855700 1 -- start start 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b9855700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 0x7f22b419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b9855700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 0x7f22b41986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b9855700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f22b410a9f0 con 0x7f22a00035c0 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b9855700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f22b410a870 con 0x7f22b419ea50 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b27fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 0x7f22b41986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b27fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 0x7f22b41986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38346/0 (socket says 172.21.15.196:38346) 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b27fc700 1 -- 172.21.15.196:0/3961010165 learned_addr learned my addr 172.21.15.196:0/3961010165 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b2ffd700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 0x7f22b419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:46.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b27fc700 1 -- 172.21.15.196:0/3961010165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 msgr2=0x7f22b41986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b27fc700 1 -- 172.21.15.196:0/3961010165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 msgr2=0x7f22b41986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b27fc700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 0x7f22b41986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.973+0000 7f22b27fc700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 0x7f22b41986a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b2ffd700 1 -- 172.21.15.196:0/3961010165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 msgr2=0x7f22b41986a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b2ffd700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 0x7f22b41986a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b2ffd700 1 -- 172.21.15.196:0/3961010165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b419eff0 con 0x7f22a00035c0 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b2ffd700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 0x7f22b419e510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f229c000c00 tx=0x7f229c0046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b8853700 1 -- 172.21.15.196:0/3961010165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f229c013b00 con 0x7f22a00035c0 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b8853700 1 -- 172.21.15.196:0/3961010165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f229c0044e0 con 0x7f22a00035c0 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b4198ca0 con 0x7f22a00035c0 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b8853700 1 -- 172.21.15.196:0/3961010165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f229c011470 con 0x7f22a00035c0 2024-04-25T11:15:46.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.974+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b4199230 con 0x7f22a00035c0 2024-04-25T11:15:46.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.975+0000 7f22b8853700 1 -- 172.21.15.196:0/3961010165 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f229c023070 con 0x7f22a00035c0 2024-04-25T11:15:46.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.976+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b4104150 con 0x7f22a00035c0 2024-04-25T11:15:46.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.976+0000 7f22b8853700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f229403d400 0x7f229403f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:46.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.976+0000 7f22b8853700 1 -- 172.21.15.196:0/3961010165 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f229c020050 con 0x7f22a00035c0 2024-04-25T11:15:46.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.976+0000 7f22b27fc700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f229403d400 0x7f229403f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:46.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.976+0000 7f22b27fc700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f229403d400 0x7f229403f910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22a4006b20 tx=0x7f22a4006ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:46.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:46.982+0000 7f22b8853700 1 -- 172.21.15.196:0/3961010165 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f229c028020 con 0x7f22a00035c0 2024-04-25T11:15:47.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.267+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f22b41994e0 con 0x7f22a00035c0 2024-04-25T11:15:47.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.268+0000 7f22b8853700 1 -- 172.21.15.196:0/3961010165 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f229c034350 con 0x7f22a00035c0 2024-04-25T11:15:47.269 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:15:47.269 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":2,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","modified":"2024-04-25T11:15:40.557088Z","created":"2024-04-25T11:13:57.766755Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-25T11:15:47.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f229403d400 msgr2=0x7f229403f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:47.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f229403d400 0x7f229403f910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22a4006b20 tx=0x7f22a4006ab0 comp rx=0 tx=0).stop 2024-04-25T11:15:47.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 msgr2=0x7f22b419e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:47.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 0x7f22b419e510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f229c000c00 tx=0x7f229c0046f0 comp rx=0 tx=0).stop 2024-04-25T11:15:47.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 shutdown_connections 2024-04-25T11:15:47.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f229403d400 0x7f229403f910 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:47.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a00035c0 0x7f22b419e510 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:47.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 --2- 172.21.15.196:0/3961010165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b419ea50 0x7f22b41986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:47.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 >> 172.21.15.196:0/3961010165 conn(0x7f22b40fe510 msgr2=0x7f22b41016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:47.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 shutdown_connections 2024-04-25T11:15:47.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:47.271+0000 7f22b9855700 1 -- 172.21.15.196:0/3961010165 wait complete. 2024-04-25T11:15:47.274 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 2 2024-04-25T11:15:47.838 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:47 smithi196 ceph-mon[32659]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:47.838 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:47 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/3961010165' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T11:15:47.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:47 smithi080 ceph-mon[29126]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:47.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:47 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/3961010165' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T11:15:48.865 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T11:15:48.866 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T11:15:49.110 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:15:49.514 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 podman[32421]: 2024-04-25 11:15:49.481361526 +0000 UTC m=+0.338813404 container start cbf4f3ec1a581f8bf84eecfa8b4472514db49ba52b70743ac05d0d8b6dae7637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-25T11:15:49.515 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T11:15:49.515 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev), process ceph-mon, pid 2 2024-04-25T11:15:49.515 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pidfile_write: ignore empty --pid-file 2024-04-25T11:15:50.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: load: jerasure load: lrc 2024-04-25T11:15:50.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: RocksDB version: 7.9.2 2024-04-25T11:15:50.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Git sha 0 2024-04-25T11:15:50.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Compile date 2024-04-25 02:57:34 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: DB SUMMARY 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: DB Session ID: LYQILUME5S9U4XM8HBOT 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: CURRENT file: CURRENT 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.error_if_exists: 0 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.create_if_missing: 0 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.paranoid_checks: 1 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T11:15:50.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.env: 0x5614bb268500 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.info_log: 0x5614bd3a1fc0 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.statistics: (nil) 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.use_fsync: 0 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_log_file_size: 0 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.allow_fallocate: 1 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T11:15:50.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.use_direct_reads: 0 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.db_log_dir: 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.wal_dir: 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T11:15:50.004 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.write_buffer_manager: 0x5614bd3728c0 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T11:15:50.006 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.unordered_write: 0 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.row_cache: None 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.wal_filter: None 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.two_write_queues: 0 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T11:15:50.007 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.wal_compression: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.atomic_flush: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.log_readahead_size: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_background_jobs: 2 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_background_compactions: -1 2024-04-25T11:15:50.008 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_subcompactions: 1 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_open_files: -1 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_background_flushes: -1 2024-04-25T11:15:50.009 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Compression algorithms supported: 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kZSTD supported: 0 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kXpressCompression supported: 0 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kZlibCompression supported: 1 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kSnappyCompression supported: 1 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kLZ4Compression supported: 1 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: kBZip2Compression supported: 0 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T11:15:50.010 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.merge_operator: 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_filter: None 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5614bd4a81a0) 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: index_type: 0 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: data_block_index_type: 0 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: index_shortening: 1 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T11:15:50.011 INFO:journalctl@ceph.mon.b.smithi082.stdout: checksum: 4 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: no_block_cache: 0 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache: 0x5614bd3a51f0 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache_options: 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: capacity : 536870912 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: num_shard_bits : 4 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: strict_capacity_limit : 0 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache_compressed: (nil) 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: persistent_cache: (nil) 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_size: 4096 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_size_deviation: 10 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_restart_interval: 16 2024-04-25T11:15:50.012 INFO:journalctl@ceph.mon.b.smithi082.stdout: index_block_restart_interval: 1 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: metadata_block_size: 4096 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: partition_filters: 0 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: use_delta_encoding: 1 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: filter_policy: bloomfilter 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: whole_key_filtering: 1 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: verify_compression: 0 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: format_version: 5 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: enable_index_compression: 1 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_align: 0 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: max_auto_readahead_size: 262144 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: prepopulate_block_cache: 0 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: initial_auto_readahead_size: 8192 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T11:15:50.013 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression: NoCompression 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.num_levels: 7 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T11:15:50.014 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T11:15:50.015 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T11:15:50.016 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T11:15:50.017 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.inplace_update_support: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.bloom_locality: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.max_successive_merges: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T11:15:50.018 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.ttl: 2592000 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.enable_blob_files: false 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.min_blob_size: 0 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T11:15:50.019 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bbd130e5-063b-4619-aa63-62ef5c898bd3 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714043749521520, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714043749521944, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714043749, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bbd130e5-063b-4619-aa63-62ef5c898bd3", "db_session_id": "LYQILUME5S9U4XM8HBOT", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714043749522032, "job": 1, "event": "recovery_finished"} 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5614bd389c00 2024-04-25T11:15:50.020 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: DB pointer 0x5614c217c000 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** DB Stats ** 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T11:15:50.021 INFO:journalctl@ceph.mon.b.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T11:15:50.022 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: Block cache BinnedLRUCache@0x5614bd3a51f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: using public_addr v2:172.21.15.82:0/0 -> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-04-25T11:15:50.023 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: starting mon.b rank -1 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(???) e0 preinit fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).mds e1 new map 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout: e1 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout: legacy client fscid: -1 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout: No filesystems configured 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-25T11:15:50.024 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.025 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Deploying cephadm binary to smithi196 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.026 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:15:50.027 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.027 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.027 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.027 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.027 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Added host smithi196 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1968065805' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1968065805' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.028 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Saving service mon spec with placement smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi196:172.21.15.196=c;count:3 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Deploying daemon mon.c on smithi196 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.a calling monitor election 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:50.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.c calling monitor election 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: monmap epoch 2 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: last_changed 2024-04-25T11:15:40.557088+0000 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: min_mon_release 19 (squid) 2024-04-25T11:15:50.031 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: election_strategy: 1 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: fsmap 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mgrmap e13: x(active, since 50s) 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: overall HEALTH_OK 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.032 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:50.033 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:50.033 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:50.033 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: Deploying daemon mon.b on smithi082 2024-04-25T11:15:50.033 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:50.033 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:50.033 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/3961010165' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T11:15:50.033 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 ceph-mon[32440]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-25T11:15:50.034 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 bash[32421]: cbf4f3ec1a581f8bf84eecfa8b4472514db49ba52b70743ac05d0d8b6dae7637 2024-04-25T11:15:50.034 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:49 smithi082 systemd[1]: Started Ceph mon.b for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:15:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:15:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: mon.a calling monitor election 2024-04-25T11:15:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: mon.c calling monitor election 2024-04-25T11:15:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: mon.b calling monitor election 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: monmap epoch 3 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: last_changed 2024-04-25T11:15:49.547442+0000 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: min_mon_release 19 (squid) 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: election_strategy: 1 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:15:54.887 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-25T11:15:54.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-25T11:15:54.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: fsmap 2024-04-25T11:15:54.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:54.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: mgrmap e13: x(active, since 59s) 2024-04-25T11:15:54.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: overall HEALTH_OK 2024-04-25T11:15:54.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:54.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:54.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:15:54.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: mon.a calling monitor election 2024-04-25T11:15:54.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:54.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: mon.c calling monitor election 2024-04-25T11:15:54.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:54.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.948 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: mon.b calling monitor election 2024-04-25T11:15:54.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:54.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:54.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T11:15:54.949 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: monmap epoch 3 2024-04-25T11:15:54.950 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:54.950 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: last_changed 2024-04-25T11:15:49.547442+0000 2024-04-25T11:15:54.950 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:15:54.950 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: min_mon_release 19 (squid) 2024-04-25T11:15:54.950 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: election_strategy: 1 2024-04-25T11:15:54.951 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:15:54.951 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-25T11:15:54.951 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-25T11:15:54.951 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: fsmap 2024-04-25T11:15:54.951 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:54.951 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: mgrmap e13: x(active, since 59s) 2024-04-25T11:15:54.951 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: overall HEALTH_OK 2024-04-25T11:15:54.952 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:54.952 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:54.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.971+0000 7fe837eb0700 1 -- 172.21.15.196:0/2274619648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe81c0035c0 msgr2=0x7fe81c005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:54.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.971+0000 7fe837eb0700 1 --2- 172.21.15.196:0/2274619648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe81c0035c0 0x7fe81c005aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe830075960 tx=0x7fe82c00fe60 comp rx=0 tx=0).stop 2024-04-25T11:15:54.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.971+0000 7fe837eb0700 1 -- 172.21.15.196:0/2274619648 shutdown_connections 2024-04-25T11:15:54.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.971+0000 7fe837eb0700 1 --2- 172.21.15.196:0/2274619648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe81c0035c0 0x7fe81c005aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:54.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.971+0000 7fe837eb0700 1 -- 172.21.15.196:0/2274619648 >> 172.21.15.196:0/2274619648 conn(0x7fe8300ff620 msgr2=0x7fe830101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:54.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.971+0000 7fe837eb0700 1 -- 172.21.15.196:0/2274619648 shutdown_connections 2024-04-25T11:15:54.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.971+0000 7fe837eb0700 1 -- 172.21.15.196:0/2274619648 wait complete. 2024-04-25T11:15:54.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 Processor -- start 2024-04-25T11:15:54.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 -- start start 2024-04-25T11:15:54.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 0x7fe8301a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:54.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8301a06f0 0x7fe8301a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:54.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8301a4ed0 0x7fe8301a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe830112080 con 0x7fe8301a4ed0 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe830111f00 con 0x7fe8301a06f0 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.972+0000 7fe837eb0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe830112200 con 0x7fe81c0035c0 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe835c4c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 0x7fe8301a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe835c4c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 0x7fe8301a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:52208/0 (socket says 172.21.15.196:52208) 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe835c4c700 1 -- 172.21.15.196:0/1045786802 learned_addr learned my addr 172.21.15.196:0/1045786802 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe835c4c700 1 -- 172.21.15.196:0/1045786802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 msgr2=0x7fe8301a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe835c4c700 1 -- 172.21.15.196:0/1045786802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 msgr2=0x7fe8301a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe835c4c700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 0x7fe8301a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe835c4c700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 0x7fe8301a01b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83644d700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8301a4ed0 0x7fe8301a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83544b700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8301a06f0 0x7fe8301a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:54.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83644d700 1 -- 172.21.15.196:0/1045786802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 msgr2=0x7fe8301a01b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83644d700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 0x7fe8301a01b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83644d700 1 -- 172.21.15.196:0/1045786802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8301a06f0 msgr2=0x7fe8301a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83644d700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8301a06f0 0x7fe8301a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83644d700 1 -- 172.21.15.196:0/1045786802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8301acc40 con 0x7fe8301a4ed0 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe83644d700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8301a4ed0 0x7fe8301a52e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe82800bd50 tx=0x7fe82800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.973+0000 7fe826ffd700 1 -- 172.21.15.196:0/1045786802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe828019070 con 0x7fe8301a4ed0 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.974+0000 7fe826ffd700 1 -- 172.21.15.196:0/1045786802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe82800cd10 con 0x7fe8301a4ed0 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.974+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8301ace70 con 0x7fe8301a4ed0 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.974+0000 7fe826ffd700 1 -- 172.21.15.196:0/1045786802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe828012700 con 0x7fe8301a4ed0 2024-04-25T11:15:54.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.974+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8301ad2c0 con 0x7fe8301a4ed0 2024-04-25T11:15:54.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.975+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe830064cf0 con 0x7fe8301a4ed0 2024-04-25T11:15:54.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.975+0000 7fe826ffd700 1 -- 172.21.15.196:0/1045786802 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7fe82801c070 con 0x7fe8301a4ed0 2024-04-25T11:15:54.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.975+0000 7fe826ffd700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe81403daa0 0x7fe81403ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:54.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.975+0000 7fe826ffd700 1 -- 172.21.15.196:0/1045786802 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe828050fe0 con 0x7fe8301a4ed0 2024-04-25T11:15:54.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.975+0000 7fe835c4c700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe81403daa0 0x7fe81403ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:54.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.976+0000 7fe835c4c700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe81403daa0 0x7fe81403ffb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00f540 tx=0x7fe82c00f890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:54.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:54.981+0000 7fe826ffd700 1 -- 172.21.15.196:0/1045786802 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe82800f160 con 0x7fe8301a4ed0 2024-04-25T11:15:55.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:15:55.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: mon.a calling monitor election 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: mon.c calling monitor election 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: mon.b calling monitor election 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: monmap epoch 3 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:55.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: last_changed 2024-04-25T11:15:49.547442+0000 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: created 2024-04-25T11:13:57.766755+0000 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: min_mon_release 19 (squid) 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: election_strategy: 1 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: fsmap 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: mgrmap e13: x(active, since 59s) 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: overall HEALTH_OK 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.003 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.279+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe8301ad710 con 0x7fe8301a4ed0 2024-04-25T11:15:55.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.279+0000 7fe826ffd700 1 -- 172.21.15.196:0/1045786802 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7fe82803de20 con 0x7fe8301a4ed0 2024-04-25T11:15:55.280 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-25T11:15:55.280 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":3,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","modified":"2024-04-25T11:15:49.547442Z","created":"2024-04-25T11:13:57.766755Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-25T11:15:55.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.282+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe81403daa0 msgr2=0x7fe81403ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:55.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.282+0000 7fe837eb0700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe81403daa0 0x7fe81403ffb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00f540 tx=0x7fe82c00f890 comp rx=0 tx=0).stop 2024-04-25T11:15:55.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8301a4ed0 msgr2=0x7fe8301a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:55.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8301a4ed0 0x7fe8301a52e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe82800bd50 tx=0x7fe82800be30 comp rx=0 tx=0).stop 2024-04-25T11:15:55.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 shutdown_connections 2024-04-25T11:15:55.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe81403daa0 0x7fe81403ffb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:55.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8301a4ed0 0x7fe8301a52e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:55.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe81c0035c0 0x7fe8301a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:55.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 --2- 172.21.15.196:0/1045786802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8301a06f0 0x7fe8301a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:55.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 >> 172.21.15.196:0/1045786802 conn(0x7fe8300ff620 msgr2=0x7fe830102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:55.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 shutdown_connections 2024-04-25T11:15:55.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:15:55.283+0000 7fe837eb0700 1 -- 172.21.15.196:0/1045786802 wait complete. 2024-04-25T11:15:55.284 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 3 2024-04-25T11:15:55.850 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.850 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.850 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:55.850 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:55 smithi196 ceph-mon[32659]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:55.850 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.850 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:55 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/1045786802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T11:15:55.850 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:55.876 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-25T11:15:55.876 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-25T11:15:55.884 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:55.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:55 smithi080 ceph-mon[29126]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:55.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:55.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:55 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/1045786802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T11:15:55.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:56.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:56.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:56.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:15:56.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:55 smithi082 ceph-mon[32440]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:56.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:56.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:55 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/1045786802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T11:15:56.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:15:56.116 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:15:57.240 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.240 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.240 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.241 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.241 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:57.241 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:57.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:57.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:57.450 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.450 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.450 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.450 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:57.450 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:57.450 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:15:57.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.751+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/137717709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a4108960 msgr2=0x7ff0a4108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.751+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/137717709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a4108960 0x7ff0a4108d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00b0a0 tx=0x7ff09c00b3b0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.751+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/137717709 shutdown_connections 2024-04-25T11:15:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.751+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/137717709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a4108960 0x7ff0a4108d70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.751+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/137717709 >> 172.21.15.80:0/137717709 conn(0x7ff0a4078480 msgr2=0x7ff0a40788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.751+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/137717709 shutdown_connections 2024-04-25T11:15:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.751+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/137717709 wait complete. 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 Processor -- start 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 -- start start 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a4108960 0x7ff0a419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0a419ae90 0x7ff0a419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a41a39c0 0x7ff0a41a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a410ce70 con 0x7ff0a41a39c0 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a410ccf0 con 0x7ff0a4108960 2024-04-25T11:15:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.752+0000 7ff0ac5a9700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a410cff0 con 0x7ff0a419ae90 2024-04-25T11:15:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.753+0000 7ff0aa345700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a4108960 0x7ff0a419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.753+0000 7ff0a9b44700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0a419ae90 0x7ff0a419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.753+0000 7ff0aab46700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a41a39c0 0x7ff0a41a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.753+0000 7ff0aab46700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a41a39c0 0x7ff0a41a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36640/0 (socket says 172.21.15.80:36640) 2024-04-25T11:15:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.753+0000 7ff0aab46700 1 -- 172.21.15.80:0/124634894 learned_addr learned my addr 172.21.15.80:0/124634894 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:15:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0aab46700 1 -- 172.21.15.80:0/124634894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0a419ae90 msgr2=0x7ff0a419b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0aab46700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0a419ae90 0x7ff0a419b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0aab46700 1 -- 172.21.15.80:0/124634894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a4108960 msgr2=0x7ff0a419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0aab46700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a4108960 0x7ff0a419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0aab46700 1 -- 172.21.15.80:0/124634894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a4198840 con 0x7ff0a41a39c0 2024-04-25T11:15:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0aa345700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a4108960 0x7ff0a419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:15:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0aab46700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a41a39c0 0x7ff0a41a5de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff09400b550 tx=0x7ff09400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0a37fe700 1 -- 172.21.15.80:0/124634894 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094015020 con 0x7ff0a41a39c0 2024-04-25T11:15:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0a37fe700 1 -- 172.21.15.80:0/124634894 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff094011ce0 con 0x7ff0a41a39c0 2024-04-25T11:15:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a4198b30 con 0x7ff0a41a39c0 2024-04-25T11:15:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.754+0000 7ff0a37fe700 1 -- 172.21.15.80:0/124634894 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094010ca0 con 0x7ff0a41a39c0 2024-04-25T11:15:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.755+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a4199070 con 0x7ff0a41a39c0 2024-04-25T11:15:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.756+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a4104070 con 0x7ff0a41a39c0 2024-04-25T11:15:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.756+0000 7ff0a37fe700 1 -- 172.21.15.80:0/124634894 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7ff094018020 con 0x7ff0a41a39c0 2024-04-25T11:15:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.756+0000 7ff0a37fe700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff08c03daa0 0x7ff08c03ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:15:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.756+0000 7ff0a37fe700 1 -- 172.21.15.80:0/124634894 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff094050de0 con 0x7ff0a41a39c0 2024-04-25T11:15:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.756+0000 7ff0aa345700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff08c03daa0 0x7ff08c03ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:15:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.757+0000 7ff0aa345700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff08c03daa0 0x7ff08c03ffb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff09c015040 tx=0x7ff09c005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:15:57.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.762+0000 7ff0a37fe700 1 -- 172.21.15.80:0/124634894 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff09401f020 con 0x7ff0a41a39c0 2024-04-25T11:15:57.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.968+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff0a4199470 con 0x7ff0a41a39c0 2024-04-25T11:15:57.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.969+0000 7ff0a37fe700 1 -- 172.21.15.80:0/124634894 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7ff0940187b0 con 0x7ff0a41a39c0 2024-04-25T11:15:57.969 INFO:teuthology.orchestra.run.smithi080.stdout:# minimal ceph.conf for bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:57.969 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-04-25T11:15:57.970 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:15:57.970 INFO:teuthology.orchestra.run.smithi080.stdout: mon_host = [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-04-25T11:15:57.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff08c03daa0 msgr2=0x7ff08c03ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:57.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff08c03daa0 0x7ff08c03ffb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff09c015040 tx=0x7ff09c005040 comp rx=0 tx=0).stop 2024-04-25T11:15:57.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a41a39c0 msgr2=0x7ff0a41a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a41a39c0 0x7ff0a41a5de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff09400b550 tx=0x7ff09400b860 comp rx=0 tx=0).stop 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 shutdown_connections 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff08c03daa0 0x7ff08c03ffb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a41a39c0 0x7ff0a41a5de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a4108960 0x7ff0a419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 --2- 172.21.15.80:0/124634894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0a419ae90 0x7ff0a419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 >> 172.21.15.80:0/124634894 conn(0x7ff0a4078480 msgr2=0x7ff0a40ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 shutdown_connections 2024-04-25T11:15:57.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:15:57.971+0000 7ff0ac5a9700 1 -- 172.21.15.80:0/124634894 wait complete. 2024-04-25T11:15:58.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-25T11:15:58.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:15:58.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:15:58.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.284 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.284 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.284 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.284 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.284 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.284 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:58.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T11:15:58.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:58.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:15:58.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:58.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: Reconfiguring daemon mon.a on smithi080 2024-04-25T11:15:58.287 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:15:58 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/124634894' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: Reconfiguring daemon mon.a on smithi080 2024-04-25T11:15:58.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:15:58 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/124634894' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:58.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: Reconfiguring daemon mon.a on smithi080 2024-04-25T11:15:58.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:15:58 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/124634894' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:15:58.957 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-25T11:15:58.957 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:15:58.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T11:15:59.024 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:15:59.025 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:59.090 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:15:59.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T11:15:59.118 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:15:59.118 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:59.182 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:15:59.182 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T11:15:59.213 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:15:59.214 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:15:59.281 INFO:tasks.cephadm:Adding mgr.x on smithi080 2024-04-25T11:15:59.281 INFO:tasks.cephadm:Adding mgr.y on smithi082 2024-04-25T11:15:59.281 INFO:tasks.cephadm:Adding mgr.z on smithi196 2024-04-25T11:15:59.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi080=x;smithi082=y;smithi196=z' 2024-04-25T11:15:59.562 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:16:00.620 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:00 smithi082 ceph-mon[32440]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:00.620 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:00.620 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:00.620 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:16:00.620 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:16:00.620 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:00.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:00 smithi080 ceph-mon[29126]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:16:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:16:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:00.660 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:00 smithi196 ceph-mon[32659]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:00.660 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:00.660 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:00.660 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:16:00.660 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:16:00.660 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:01.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 -- 172.21.15.196:0/3346406852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 msgr2=0x7f99ac102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:01.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 --2- 172.21.15.196:0/3346406852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 0x7f99ac102eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009910 tx=0x7f99a0009c20 comp rx=0 tx=0).stop 2024-04-25T11:16:01.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 -- 172.21.15.196:0/3346406852 shutdown_connections 2024-04-25T11:16:01.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 --2- 172.21.15.196:0/3346406852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 0x7f99ac102eb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:01.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 -- 172.21.15.196:0/3346406852 >> 172.21.15.196:0/3346406852 conn(0x7f99ac0fe0c0 msgr2=0x7f99ac100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:16:01.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 -- 172.21.15.196:0/3346406852 shutdown_connections 2024-04-25T11:16:01.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 -- 172.21.15.196:0/3346406852 wait complete. 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 Processor -- start 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.179+0000 7f99b2e75700 1 -- start start 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b2e75700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 0x7f99ac198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b2e75700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99ac198c70 0x7f99ac19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b2e75700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac19e140 0x7f99ac1a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b2e75700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac108a60 con 0x7f99ac102aa0 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b2e75700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac1088e0 con 0x7f99ac19e140 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b2e75700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac108be0 con 0x7f99ac198c70 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99ac198c70 0x7f99ac19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99ac198c70 0x7f99ac19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:52216/0 (socket says 172.21.15.196:52216) 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b0c11700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 0x7f99ac198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:01.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 -- 172.21.15.196:0/145649151 learned_addr learned my addr 172.21.15.196:0/145649151 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99b1412700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac19e140 0x7f99ac1a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 -- 172.21.15.196:0/145649151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac19e140 msgr2=0x7f99ac1a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac19e140 0x7f99ac1a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 -- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 msgr2=0x7f99ac198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 0x7f99ac198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 -- 172.21.15.196:0/145649151 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac06b1b0 con 0x7f99ac198c70 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.180+0000 7f99abfff700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99ac198c70 0x7f99ac19dc00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f999800b780 tx=0x7f999800ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.181+0000 7f99a9ffb700 1 -- 172.21.15.196:0/145649151 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998016070 con 0x7f99ac198c70 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.181+0000 7f99a9ffb700 1 -- 172.21.15.196:0/145649151 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99980036a0 con 0x7f99ac198c70 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.181+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac06b4a0 con 0x7f99ac198c70 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.181+0000 7f99a9ffb700 1 -- 172.21.15.196:0/145649151 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99980119c0 con 0x7f99ac198c70 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.181+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac06bab0 con 0x7f99ac198c70 2024-04-25T11:16:01.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.182+0000 7f99a9ffb700 1 -- 172.21.15.196:0/145649151 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f9998019070 con 0x7f99ac198c70 2024-04-25T11:16:01.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.182+0000 7f99a9ffb700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f999c03daa0 0x7f999c03ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:01.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.182+0000 7f99a9ffb700 1 -- 172.21.15.196:0/145649151 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9998050fe0 con 0x7f99ac198c70 2024-04-25T11:16:01.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.182+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ac064cf0 con 0x7f99ac198c70 2024-04-25T11:16:01.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.182+0000 7f99b0c11700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f999c03daa0 0x7f999c03ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:01.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.183+0000 7f99b0c11700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f999c03daa0 0x7f999c03ffb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99a0006010 tx=0x7f99a001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:01.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.188+0000 7f99a9ffb700 1 -- 172.21.15.196:0/145649151 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9998010e30 con 0x7f99ac198c70 2024-04-25T11:16:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.416+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi196=z", "target": ["mon-mgr", ""]}) -- 0x7f99ac0fff00 con 0x7f999c03daa0 2024-04-25T11:16:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.422+0000 7f99a9ffb700 1 -- 172.21.15.196:0/145649151 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f99ac0fff00 con 0x7f999c03daa0 2024-04-25T11:16:01.424 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mgr update... 2024-04-25T11:16:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f999c03daa0 msgr2=0x7f999c03ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f999c03daa0 0x7f999c03ffb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99a0006010 tx=0x7f99a001a040 comp rx=0 tx=0).stop 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99ac198c70 msgr2=0x7f99ac19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99ac198c70 0x7f99ac19dc00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f999800b780 tx=0x7f999800ba90 comp rx=0 tx=0).stop 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 shutdown_connections 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f999c03daa0 0x7f999c03ffb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac19e140 0x7f99ac1a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99ac102aa0 0x7f99ac198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 --2- 172.21.15.196:0/145649151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99ac198c70 0x7f99ac19dc00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 >> 172.21.15.196:0/145649151 conn(0x7f99ac0fe0c0 msgr2=0x7f99ac0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 shutdown_connections 2024-04-25T11:16:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:01.425+0000 7f99b2e75700 1 -- 172.21.15.196:0/145649151 wait complete. 2024-04-25T11:16:01.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:01 smithi196 ceph-mon[32659]: Reconfiguring mon.b (monmap changed)... 2024-04-25T11:16:01.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:01 smithi196 ceph-mon[32659]: Reconfiguring daemon mon.b on smithi082 2024-04-25T11:16:01.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:01.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:01.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:16:01.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:16:01.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:01 smithi080 ceph-mon[29126]: Reconfiguring mon.b (monmap changed)... 2024-04-25T11:16:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:01 smithi080 ceph-mon[29126]: Reconfiguring daemon mon.b on smithi082 2024-04-25T11:16:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:16:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:16:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:01.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:01 smithi082 ceph-mon[32440]: Reconfiguring mon.b (monmap changed)... 2024-04-25T11:16:01.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:01 smithi082 ceph-mon[32440]: Reconfiguring daemon mon.b on smithi082 2024-04-25T11:16:01.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:01.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:01.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T11:16:01.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T11:16:01.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:02.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:02 smithi196 ceph-mon[32659]: Reconfiguring mon.c (monmap changed)... 2024-04-25T11:16:02.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:02 smithi196 ceph-mon[32659]: Reconfiguring daemon mon.c on smithi196 2024-04-25T11:16:02.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:02 smithi196 ceph-mon[32659]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:02.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:02 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:02.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:02 smithi080 ceph-mon[29126]: Reconfiguring mon.c (monmap changed)... 2024-04-25T11:16:02.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:02 smithi080 ceph-mon[29126]: Reconfiguring daemon mon.c on smithi196 2024-04-25T11:16:02.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:02 smithi080 ceph-mon[29126]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:02.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:02 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:02.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:02 smithi082 ceph-mon[32440]: Reconfiguring mon.c (monmap changed)... 2024-04-25T11:16:02.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:02 smithi082 ceph-mon[32440]: Reconfiguring daemon mon.c on smithi196 2024-04-25T11:16:02.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:02 smithi082 ceph-mon[32440]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:02.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:02 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:02.975 DEBUG:teuthology.orchestra.run.smithi082:mgr.y> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.y.service 2024-04-25T11:16:02.978 DEBUG:teuthology.orchestra.run.smithi196:mgr.z> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.z.service 2024-04-25T11:16:02.980 INFO:tasks.cephadm:Deploying OSDs... 2024-04-25T11:16:02.980 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:16:02.980 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T11:16:02.996 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T11:16:02.996 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-04-25T11:16:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T11:16:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:03.051 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T11:16:03.052 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:03.052 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:03.052 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 11:15:08.169035553 +0000 2024-04-25T11:16:03.052 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 11:10:22.940995452 +0000 2024-04-25T11:16:03.052 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 11:10:22.940995452 +0000 2024-04-25T11:16:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 11:10:22.940995452 +0000 2024-04-25T11:16:03.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T11:16:03.115 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T11:16:03.115 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T11:16:03.115 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000253382 s, 2.0 MB/s 2024-04-25T11:16:03.116 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T11:16:03.175 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-04-25T11:16:03.230 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T11:16:03.230 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:03.230 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T11:16:03.230 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:03.230 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:03.231 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 11:15:08.195034985 +0000 2024-04-25T11:16:03.231 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 11:10:23.288987556 +0000 2024-04-25T11:16:03.231 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 11:10:23.288987556 +0000 2024-04-25T11:16:03.231 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 11:10:23.288987556 +0000 2024-04-25T11:16:03.231 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T11:16:03.293 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T11:16:03.293 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T11:16:03.293 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000213715 s, 2.4 MB/s 2024-04-25T11:16:03.294 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T11:16:03.350 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-04-25T11:16:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:03 smithi080 ceph-mon[29126]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:03 smithi080 ceph-mon[29126]: Saving service mgr spec with placement smithi080=x;smithi082=y;smithi196=z;count:3 2024-04-25T11:16:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:03.399 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T11:16:03.399 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:03.399 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T11:16:03.399 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:03.399 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:03.399 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 11:15:08.220034438 +0000 2024-04-25T11:16:03.400 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 11:10:23.637979637 +0000 2024-04-25T11:16:03.400 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 11:10:23.637979637 +0000 2024-04-25T11:16:03.400 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 11:10:23.637979637 +0000 2024-04-25T11:16:03.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T11:16:03.461 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T11:16:03.461 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T11:16:03.461 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000169979 s, 3.0 MB/s 2024-04-25T11:16:03.462 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T11:16:03.518 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 11:15:08.245033892 +0000 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 11:10:23.984971764 +0000 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 11:10:23.984971764 +0000 2024-04-25T11:16:03.573 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 11:10:23.984971764 +0000 2024-04-25T11:16:03.574 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T11:16:03.635 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-25T11:16:03.636 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-25T11:16:03.636 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000182787 s, 2.8 MB/s 2024-04-25T11:16:03.637 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T11:16:03.693 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-25T11:16:03.693 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T11:16:03.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:03 smithi196 ceph-mon[32659]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:03.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:03 smithi196 ceph-mon[32659]: Saving service mgr spec with placement smithi080=x;smithi082=y;smithi196=z;count:3 2024-04-25T11:16:03.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:03.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:03.712 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T11:16:03.712 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-04-25T11:16:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:03 smithi082 ceph-mon[32440]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:03 smithi082 ceph-mon[32440]: Saving service mgr spec with placement smithi080=x;smithi082=y;smithi196=z;count:3 2024-04-25T11:16:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:03.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:03.767 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T11:16:03.767 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:03.767 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T11:16:03.767 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:03.768 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:03.768 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-25 11:15:48.957232066 +0000 2024-04-25T11:16:03.768 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-25 11:09:51.251892972 +0000 2024-04-25T11:16:03.768 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-25 11:09:51.251892972 +0000 2024-04-25T11:16:03.768 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-25 11:09:51.251892972 +0000 2024-04-25T11:16:03.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T11:16:03.833 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-25T11:16:03.833 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-25T11:16:03.833 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000209461 s, 2.4 MB/s 2024-04-25T11:16:03.834 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T11:16:03.893 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-04-25T11:16:03.949 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T11:16:03.949 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:03.949 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T11:16:03.949 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:03.949 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:03.949 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-25 11:15:48.957232066 +0000 2024-04-25T11:16:03.950 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-25 11:09:51.575886447 +0000 2024-04-25T11:16:03.950 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-25 11:09:51.575886447 +0000 2024-04-25T11:16:03.950 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-25 11:09:51.575886447 +0000 2024-04-25T11:16:03.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T11:16:04.013 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-25T11:16:04.013 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-25T11:16:04.013 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000190062 s, 2.7 MB/s 2024-04-25T11:16:04.014 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T11:16:04.070 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-25 11:15:48.958232047 +0000 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-25 11:09:51.912879660 +0000 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-25 11:09:51.912879660 +0000 2024-04-25T11:16:04.126 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-25 11:09:51.912879660 +0000 2024-04-25T11:16:04.127 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T11:16:04.188 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-25T11:16:04.189 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-25T11:16:04.189 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000220879 s, 2.3 MB/s 2024-04-25T11:16:04.190 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T11:16:04.246 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-04-25T11:16:04.301 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T11:16:04.301 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:04.301 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T11:16:04.301 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:04.301 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:04.301 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-25 11:15:48.958232047 +0000 2024-04-25T11:16:04.302 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-25 11:09:52.255872752 +0000 2024-04-25T11:16:04.302 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-25 11:09:52.255872752 +0000 2024-04-25T11:16:04.302 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-25 11:09:52.255872752 +0000 2024-04-25T11:16:04.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T11:16:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-25T11:16:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-25T11:16:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000196199 s, 2.6 MB/s 2024-04-25T11:16:04.364 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T11:16:04.420 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-25T11:16:04.421 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T11:16:04.437 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T11:16:04.438 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-04-25T11:16:04.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:04.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:04.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:04.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:04.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:04.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T11:16:04.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:04.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:04.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:04 smithi196 ceph-mon[32659]: Deploying daemon mgr.z on smithi196 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-25 11:15:39.614413803 +0000 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-25 11:10:35.826548934 +0000 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-25 11:10:35.826548934 +0000 2024-04-25T11:16:04.461 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-25 11:10:35.826548934 +0000 2024-04-25T11:16:04.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T11:16:04.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:04.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:04.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:04.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:04.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:04.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T11:16:04.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:04.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:04.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:04 smithi082 ceph-mon[32440]: Deploying daemon mgr.z on smithi196 2024-04-25T11:16:04.523 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-25T11:16:04.523 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-25T11:16:04.523 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000266137 s, 1.9 MB/s 2024-04-25T11:16:04.525 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T11:16:04.580 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-04-25T11:16:04.634 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-25 11:15:39.615413782 +0000 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-25 11:10:36.172541289 +0000 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-25 11:10:36.172541289 +0000 2024-04-25T11:16:04.635 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-25 11:10:36.172541289 +0000 2024-04-25T11:16:04.635 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:04.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:04 smithi080 ceph-mon[29126]: Deploying daemon mgr.z on smithi196 2024-04-25T11:16:04.697 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-25T11:16:04.697 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-25T11:16:04.697 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.00021146 s, 2.4 MB/s 2024-04-25T11:16:04.698 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T11:16:04.754 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-04-25T11:16:04.809 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-25 11:15:39.616413761 +0000 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-25 11:10:36.515533711 +0000 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-25 11:10:36.515533711 +0000 2024-04-25T11:16:04.810 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-25 11:10:36.515533711 +0000 2024-04-25T11:16:04.810 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T11:16:04.872 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-25T11:16:04.872 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-25T11:16:04.872 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000209515 s, 2.4 MB/s 2024-04-25T11:16:04.873 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T11:16:04.930 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-04-25T11:16:04.986 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-25 11:15:39.616413761 +0000 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-25 11:10:36.847526375 +0000 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-25 11:10:36.847526375 +0000 2024-04-25T11:16:04.987 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-25 11:10:36.847526375 +0000 2024-04-25T11:16:04.987 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T11:16:05.105 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-25T11:16:05.105 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-25T11:16:05.105 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000222827 s, 2.3 MB/s 2024-04-25T11:16:05.107 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T11:16:05.122 INFO:tasks.cephadm:Deploying osd.0 on smithi080 with /dev/vg_nvme/lv_4... 2024-04-25T11:16:05.122 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T11:16:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:16:05.446 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 systemd[1]: Starting Ceph mgr.z for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:16:05.817 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 podman[34498]: 2024-04-25 11:16:05.416251393 +0000 UTC m=+0.017875073 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:16:05.818 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 podman[34498]: 2024-04-25 11:16:05.557556456 +0000 UTC m=+0.159180123 container create 4844d3feb8f5ba8a9ac5f197314ee503bbe969dbcfe92a6d04c9a93c29385fa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-25T11:16:05.818 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 podman[34498]: 2024-04-25 11:16:05.81832812 +0000 UTC m=+0.419951787 container init 4844d3feb8f5ba8a9ac5f197314ee503bbe969dbcfe92a6d04c9a93c29385fa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-25T11:16:06.178 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 podman[34498]: 2024-04-25 11:16:05.821244093 +0000 UTC m=+0.422867761 container start 4844d3feb8f5ba8a9ac5f197314ee503bbe969dbcfe92a6d04c9a93c29385fa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-25T11:16:06.179 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 ceph-mgr[34517]: -- 172.21.15.196:0/4145090663 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559cea7265a0 con 0x559cef4b0000 2024-04-25T11:16:06.179 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 bash[34498]: 4844d3feb8f5ba8a9ac5f197314ee503bbe969dbcfe92a6d04c9a93c29385fa0 2024-04-25T11:16:06.179 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 systemd[1]: Started Ceph mgr.z for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:16:06.179 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:05 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:05.995+0000 7f9719ef5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:16:06.179 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:06.178+0000 7f9719ef5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:06.279+0000 7f9719ef5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:06.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:06.583 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:06.583 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.583 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.583 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:06.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T11:16:06.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:06.584 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:06.659 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:06.659 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.660 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.660 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:06.660 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:06.660 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T11:16:06.660 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:06.660 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:06.946 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:06.589+0000 7f9719ef5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:16:06.946 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:06.673+0000 7f9719ef5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:16:07.257 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T11:16:07.257 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T11:16:07.257 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-25T11:16:07.257 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-25T11:16:07.258 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0139088 s, 754 MB/s 2024-04-25T11:16:07.258 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-25T11:16:07.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:07 smithi080 ceph-mon[29126]: Deploying daemon mgr.y on smithi082 2024-04-25T11:16:07.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:07 smithi082 ceph-mon[32440]: Deploying daemon mgr.y on smithi082 2024-04-25T11:16:07.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:07 smithi196 ceph-mon[32659]: Deploying daemon mgr.y on smithi082 2024-04-25T11:16:07.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2024-04-25T11:16:08.059 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:16:08.196 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:07.871+0000 7f9719ef5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:16:08.196 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:08.041+0000 7f9719ef5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:16:08.243 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 systemd[1]: Starting Ceph mgr.y for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:16:08.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:08 smithi080 ceph-mon[29126]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:08.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:08 smithi082 ceph-mon[32440]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:08.501 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 podman[33808]: 2024-04-25 11:16:08.14652822 +0000 UTC m=+0.024233882 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:16:08.501 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 podman[33808]: 2024-04-25 11:16:08.245382892 +0000 UTC m=+0.123088573 container create 2994882f2731864f4932e208b12b039bfcf4ac8480e817cd03388dd20aea11a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T11:16:08.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:08 smithi196 ceph-mon[32659]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:08.525 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:08.220+0000 7f9719ef5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:16:08.525 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:08.524+0000 7f9719ef5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:16:08.795 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 podman[33808]: 2024-04-25 11:16:08.50661671 +0000 UTC m=+0.384322371 container init 2994882f2731864f4932e208b12b039bfcf4ac8480e817cd03388dd20aea11a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-25T11:16:08.795 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 podman[33808]: 2024-04-25 11:16:08.509604547 +0000 UTC m=+0.387310188 container start 2994882f2731864f4932e208b12b039bfcf4ac8480e817cd03388dd20aea11a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-25T11:16:08.795 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 ceph-mgr[33828]: -- 172.21.15.82:0/2418508358 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac8f4ac5a0 con 0x55ac94236000 2024-04-25T11:16:08.795 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 bash[33808]: 2994882f2731864f4932e208b12b039bfcf4ac8480e817cd03388dd20aea11a4 2024-04-25T11:16:08.796 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 systemd[1]: Started Ceph mgr.y for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:16:08.796 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:08.675+0000 7f82454f2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:16:08.832 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:08.621+0000 7f9719ef5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:16:08.832 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:08.832+0000 7f9719ef5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:16:09.196 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:09.036+0000 7f9719ef5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:16:09.250 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:08.874+0000 7f82454f2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:16:09.250 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:08.985+0000 7f82454f2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:16:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 -- 172.21.15.80:0/294546482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c107640 msgr2=0x7f557c109a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 --2- 172.21.15.80:0/294546482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c107640 0x7f557c109a60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5570009990 tx=0x7f5570009ca0 comp rx=0 tx=0).stop 2024-04-25T11:16:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 -- 172.21.15.80:0/294546482 shutdown_connections 2024-04-25T11:16:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 --2- 172.21.15.80:0/294546482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c109fa0 0x7f557c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 --2- 172.21.15.80:0/294546482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f557c104ce0 0x7f557c107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 --2- 172.21.15.80:0/294546482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c107640 0x7f557c109a60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 -- 172.21.15.80:0/294546482 >> 172.21.15.80:0/294546482 conn(0x7f557c0fe740 msgr2=0x7f557c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 -- 172.21.15.80:0/294546482 shutdown_connections 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.573+0000 7f5582381700 1 -- 172.21.15.80:0/294546482 wait complete. 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 Processor -- start 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 -- start start 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c104ce0 0x7f557c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f557c107640 0x7f557c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c109fa0 0x7f557c1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f557c10fc50 con 0x7f557c109fa0 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f557c10fad0 con 0x7f557c104ce0 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f5582381700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f557c10fdd0 con 0x7f557c107640 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f557bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c104ce0 0x7f557c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f557bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c104ce0 0x7f557c19a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:43226/0 (socket says 172.21.15.80:43226) 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f557bfff700 1 -- 172.21.15.80:0/212480031 learned_addr learned my addr 172.21.15.80:0/212480031 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f558091e700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c109fa0 0x7f557c1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.574+0000 7f557b7fe700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f557c107640 0x7f557c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f557bfff700 1 -- 172.21.15.80:0/212480031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f557c107640 msgr2=0x7f557c19ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f557bfff700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f557c107640 0x7f557c19ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f557bfff700 1 -- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c109fa0 msgr2=0x7f557c1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f557bfff700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c109fa0 0x7f557c1a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f557bfff700 1 -- 172.21.15.80:0/212480031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c1a2330 con 0x7f557c104ce0 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f557bfff700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c104ce0 0x7f557c19a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f556c00d980 tx=0x7f556c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c017070 con 0x7f557c104ce0 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557c102b30 con 0x7f557c104ce0 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f556c00fd40 con 0x7f557c104ce0 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c00e3b0 con 0x7f557c104ce0 2024-04-25T11:16:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.575+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557c1030c0 con 0x7f557c104ce0 2024-04-25T11:16:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.576+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f556c00e550 con 0x7f557c104ce0 2024-04-25T11:16:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.576+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f557c051190 con 0x7f557c104ce0 2024-04-25T11:16:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.576+0000 7f55797fa700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f556403d850 0x7f556403fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.576+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f556c0512d0 con 0x7f557c104ce0 2024-04-25T11:16:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.576+0000 7f557b7fe700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f556403d850 0x7f556403fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:09.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.577+0000 7f557b7fe700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f556403d850 0x7f556403fd60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f557c19b880 tx=0x7f557000b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:09.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.582+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f556c00e940 con 0x7f557c104ce0 2024-04-25T11:16:09.607 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:09.329+0000 7f82454f2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:16:09.607 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:09.430+0000 7f82454f2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:16:09.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:09.790+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f557c063ad0 con 0x7f556403d850 2024-04-25T11:16:09.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:09.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:09 smithi080 ceph-mon[29126]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:09.947 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:09.680+0000 7f9719ef5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:16:09.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:09.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:09.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:09 smithi196 ceph-mon[32659]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:10.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:10.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:10.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:10.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:10.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:10.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:09 smithi082 ceph-mon[32440]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:10.424 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:10.116+0000 7f9719ef5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:16:10.424 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:10.219+0000 7f9719ef5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:16:10.424 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:10.423+0000 7f9719ef5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:16:11.000 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:10.672+0000 7f82454f2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:16:11.000 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:10.838+0000 7f82454f2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:11.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:11.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.044 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:10.952+0000 7f9719ef5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:11.044+0000 7f9719ef5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.045 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.046 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:11.046 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.046 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.046 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:11.046 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:11.046 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:11.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:11.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T11:16:11.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T11:16:11.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:11.283 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:11.004+0000 7f82454f2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:16:11.284 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:11.283+0000 7f82454f2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:16:11.419 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:11.286+0000 7f9719ef5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:16:11.419 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:11.419+0000 7f9719ef5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:16:11.571 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:11.372+0000 7f82454f2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:16:11.571 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:11.570+0000 7f82454f2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:16:11.696 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:11.513+0000 7f9719ef5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:16:11.696 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:11.630+0000 7f9719ef5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:16:11.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:11 smithi080 ceph-mon[29126]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T11:16:11.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:11 smithi080 ceph-mon[29126]: Reconfiguring daemon mgr.x on smithi080 2024-04-25T11:16:11.997 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:11 smithi080 ceph-mon[29126]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:12.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-mon[32440]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T11:16:12.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-mon[32440]: Reconfiguring daemon mgr.x on smithi080 2024-04-25T11:16:12.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-mon[32440]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:12.000 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:11.759+0000 7f82454f2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:16:12.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-mon[32659]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T11:16:12.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-mon[32659]: Reconfiguring daemon mgr.x on smithi080 2024-04-25T11:16:12.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-mon[32659]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:12.197 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:11.934+0000 7f9719ef5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:16:12.750 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:12.344+0000 7f82454f2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:16:12.946 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:12.529+0000 7f9719ef5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:16:12.947 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:16:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:16:12.750+0000 7f9719ef5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:16:13.054 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:12.760+0000 7f82454f2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:16:13.054 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:12.855+0000 7f82454f2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:16:13.055 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:13.054+0000 7f82454f2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:16:13.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:13.603+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 14) ==== 98518+0+0 (secure 0 0 0) 0x7f556c01ad70 con 0x7f557c104ce0 2024-04-25T11:16:13.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:13.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:13.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:13.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: Standby manager daemon z started 2024-04-25T11:16:13.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T11:16:13.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:16:13.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T11:16:13.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:16:13.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:13 smithi080 ceph-mon[29126]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:13.921 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:13.587+0000 7f82454f2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:13.681+0000 7f82454f2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: Standby manager daemon z started 2024-04-25T11:16:13.922 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T11:16:13.923 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:16:13.923 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T11:16:13.923 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:16:13.923 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-mon[32440]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:13.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:13.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: Standby manager daemon z started 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/3919611041' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:16:13.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:13 smithi196 ceph-mon[32659]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:14.250 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:13.921+0000 7f82454f2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:16:14.250 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:14.052+0000 7f82454f2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:16:14.250 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:14.146+0000 7f82454f2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:16:14.560 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:14.261+0000 7f82454f2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:16:14.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:14 smithi080 ceph-mon[29126]: mgrmap e14: x(active, since 78s), standbys: z 2024-04-25T11:16:14.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T11:16:14.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3192640432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43065203-899a-4a95-b206-10e80ad20d37"}]: dispatch 2024-04-25T11:16:14.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3192640432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43065203-899a-4a95-b206-10e80ad20d37"}]': finished 2024-04-25T11:16:14.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:14 smithi080 ceph-mon[29126]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T11:16:14.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:14.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/622138335' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:16:14.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:14 smithi196 ceph-mon[32659]: mgrmap e14: x(active, since 78s), standbys: z 2024-04-25T11:16:14.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T11:16:14.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3192640432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43065203-899a-4a95-b206-10e80ad20d37"}]: dispatch 2024-04-25T11:16:14.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3192640432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43065203-899a-4a95-b206-10e80ad20d37"}]': finished 2024-04-25T11:16:14.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:14 smithi196 ceph-mon[32659]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T11:16:14.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:14.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/622138335' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:16:15.000 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:14.560+0000 7f82454f2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:16:15.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-mon[32440]: mgrmap e14: x(active, since 78s), standbys: z 2024-04-25T11:16:15.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T11:16:15.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3192640432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43065203-899a-4a95-b206-10e80ad20d37"}]: dispatch 2024-04-25T11:16:15.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3192640432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43065203-899a-4a95-b206-10e80ad20d37"}]': finished 2024-04-25T11:16:15.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-mon[32440]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T11:16:15.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:15.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/622138335' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:16:15.500 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:15.155+0000 7f82454f2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:16:15.500 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:16:15.368+0000 7f82454f2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:16:15.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:15.615+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mon.2 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7f556c022300 con 0x7f557c104ce0 2024-04-25T11:16:15.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:15 smithi080 ceph-mon[29126]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:15.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:15 smithi080 ceph-mon[29126]: Standby manager daemon y started 2024-04-25T11:16:15.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:15 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T11:16:15.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:15 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:16:15.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:15 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T11:16:15.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:15 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:16:15.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:15 smithi196 ceph-mon[32659]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:15.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:15 smithi196 ceph-mon[32659]: Standby manager daemon y started 2024-04-25T11:16:15.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:15 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T11:16:15.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:15 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:16:15.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:15 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T11:16:15.947 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:15 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:16:16.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-mon[32440]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:16.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-mon[32440]: Standby manager daemon y started 2024-04-25T11:16:16.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T11:16:16.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:16:16.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T11:16:16.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:15 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/1645642971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:16:16.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:16 smithi080 ceph-mon[29126]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T11:16:16.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T11:16:16.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:16 smithi196 ceph-mon[32659]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T11:16:16.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T11:16:17.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:16 smithi082 ceph-mon[32440]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T11:16:17.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T11:16:17.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:17 smithi080 ceph-mon[29126]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:17.946 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:17 smithi196 ceph-mon[32659]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:18.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:17 smithi082 ceph-mon[32440]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:20.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:20 smithi080 ceph-mon[29126]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:20.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:20 smithi196 ceph-mon[32659]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:20.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:20 smithi082 ceph-mon[32440]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:21.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T11:16:21.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:21.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T11:16:21.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:21.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T11:16:21.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:22.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:22 smithi080 ceph-mon[29126]: Deploying daemon osd.0 on smithi080 2024-04-25T11:16:22.542 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:22 smithi080 ceph-mon[29126]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:22.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:22 smithi196 ceph-mon[32659]: Deploying daemon osd.0 on smithi080 2024-04-25T11:16:22.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:22 smithi196 ceph-mon[32659]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:22.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:22 smithi082 ceph-mon[32440]: Deploying daemon osd.0 on smithi080 2024-04-25T11:16:22.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:22 smithi082 ceph-mon[32440]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:24.419 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:24 smithi080 ceph-mon[29126]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:24.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:24 smithi196 ceph-mon[32659]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:24.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:24 smithi082 ceph-mon[32440]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:26.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:26 smithi080 ceph-mon[29126]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:26.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:26.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:26.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:26.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:26 smithi196 ceph-mon[32659]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:26.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:26.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:26.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:26.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:26 smithi082 ceph-mon[32440]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:26.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:26.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:26.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:28.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:28 smithi080 ceph-mon[29126]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:28.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:28 smithi196 ceph-mon[32659]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:28.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:28 smithi082 ceph-mon[32440]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:29.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.945+0000 7f55797fa700 1 -- 172.21.15.80:0/212480031 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f557c063ad0 con 0x7f556403d850 2024-04-25T11:16:29.946 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 0 on host 'smithi080' 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f556403d850 msgr2=0x7f556403fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f556403d850 0x7f556403fd60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f557c19b880 tx=0x7f557000b720 comp rx=0 tx=0).stop 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c104ce0 msgr2=0x7f557c19a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c104ce0 0x7f557c19a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f556c00d980 tx=0x7f556c00dc90 comp rx=0 tx=0).stop 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 shutdown_connections 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f556403d850 0x7f556403fd60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f557c109fa0 0x7f557c1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:29.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c104ce0 0x7f557c19a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 --2- 172.21.15.80:0/212480031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f557c107640 0x7f557c19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 >> 172.21.15.80:0/212480031 conn(0x7f557c0fe740 msgr2=0x7f557c1057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:16:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 shutdown_connections 2024-04-25T11:16:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:16:29.947+0000 7f5582381700 1 -- 172.21.15.80:0/212480031 wait complete. 2024-04-25T11:16:30.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:30.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:30.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:30.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:30.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:30.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:30.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:30.642 DEBUG:teuthology.orchestra.run.smithi080:osd.0> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.0.service 2024-04-25T11:16:30.644 INFO:tasks.cephadm:Deploying osd.1 on smithi082 with /dev/vg_nvme/lv_4... 2024-04-25T11:16:30.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T11:16:30.889 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:16:31.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:30 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:30 smithi082 ceph-mon[32440]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T11:16:31.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:30 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:31.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:30 smithi080 ceph-mon[29126]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T11:16:31.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:30 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:31.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:30 smithi196 ceph-mon[32659]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T11:16:32.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-mon[29126]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T11:16:32.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-mon[29126]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T11:16:32.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-mon[29126]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:16:32.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:32.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-mon[29126]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:32.068 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-mon[29126]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:16:32.069 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0[43897]: 2024-04-25T11:16:31.968+0000 7f6ab7b98700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T11:16:32.069 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:16:31 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0[43897]: 2024-04-25T11:16:31.975+0000 7f6ab394d700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:16:32.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:31 smithi082 ceph-mon[32440]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T11:16:32.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:31 smithi082 ceph-mon[32440]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T11:16:32.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:31 smithi082 ceph-mon[32440]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:16:32.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:31 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:32.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:31 smithi082 ceph-mon[32440]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:32.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:31 smithi082 ceph-mon[32440]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:16:32.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:31 smithi196 ceph-mon[32659]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T11:16:32.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:31 smithi196 ceph-mon[32659]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T11:16:32.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:31 smithi196 ceph-mon[32659]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:16:32.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:31 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:32.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:31 smithi196 ceph-mon[32659]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:32.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:31 smithi196 ceph-mon[32659]: from='osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:16:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T11:16:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T11:16:32.785 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-25T11:16:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-25T11:16:32.785 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123499 s, 849 MB/s 2024-04-25T11:16:32.785 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-25T11:16:33.099 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:32 smithi082 ceph-mon[32440]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T11:16:33.099 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:32 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:33.099 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:32 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:33.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:32 smithi080 ceph-mon[29126]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T11:16:33.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:32 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:33.221 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:32 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:33.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-04-25T11:16:33.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:32 smithi196 ceph-mon[32659]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T11:16:33.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:32 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:33.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:32 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:16:34.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:16:34.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] boot 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:34.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] boot 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:16:34.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:34.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:34.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: osd.0 [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] boot 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:34.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:35.200 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:34 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi080 2024-04-25T11:16:35.200 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:34 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-25T11:16:35.200 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:34 smithi082 ceph-mon[32440]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T11:16:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 -- 172.21.15.82:0/1979574015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104230 msgr2=0x7f8090104640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 --2- 172.21.15.82:0/1979574015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104230 0x7f8090104640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8084009990 tx=0x7f8084009ca0 comp rx=0 tx=0).stop 2024-04-25T11:16:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 -- 172.21.15.82:0/1979574015 shutdown_connections 2024-04-25T11:16:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 --2- 172.21.15.82:0/1979574015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8090104bd0 0x7f809010b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 --2- 172.21.15.82:0/1979574015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090103100 0x7f8090103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 --2- 172.21.15.82:0/1979574015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104230 0x7f8090104640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 -- 172.21.15.82:0/1979574015 >> 172.21.15.82:0/1979574015 conn(0x7f80900fe740 msgr2=0x7f8090100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:16:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 -- 172.21.15.82:0/1979574015 shutdown_connections 2024-04-25T11:16:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.238+0000 7f8096760700 1 -- 172.21.15.82:0/1979574015 wait complete. 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 Processor -- start 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 -- start start 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090103100 0x7f8090076320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8090104230 0x7f80901a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104bd0 0x7f80901a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f809010eb70 con 0x7f8090103100 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f809010e9f0 con 0x7f8090104bd0 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8096760700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f809010ecf0 con 0x7f8090104230 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8094cfd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104bd0 0x7f80901a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8094cfd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104bd0 0x7f80901a3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39148/0 (socket says 172.21.15.82:39148) 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f8094cfd700 1 -- 172.21.15.82:0/341302933 learned_addr learned my addr 172.21.15.82:0/341302933 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-25T11:16:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f808f7fe700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8090104230 0x7f80901a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.239+0000 7f808ffff700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090103100 0x7f8090076320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8094cfd700 1 -- 172.21.15.82:0/341302933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8090104230 msgr2=0x7f80901a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8094cfd700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8090104230 0x7f80901a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8094cfd700 1 -- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090103100 msgr2=0x7f8090076320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8094cfd700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090103100 0x7f8090076320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8094cfd700 1 -- 172.21.15.82:0/341302933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80901a44e0 con 0x7f8090104bd0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8094cfd700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104bd0 0x7f80901a3e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f808800ef30 tx=0x7f808800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f808d7fa700 1 -- 172.21.15.82:0/341302933 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880092e0 con 0x7f8090104bd0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f808d7fa700 1 -- 172.21.15.82:0/341302933 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8088004bb0 con 0x7f8090104bd0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80901a4770 con 0x7f8090104bd0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f808d7fa700 1 -- 172.21.15.82:0/341302933 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088004280 con 0x7f8090104bd0 2024-04-25T11:16:35.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.240+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80901a4cb0 con 0x7f8090104bd0 2024-04-25T11:16:35.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.241+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8090051190 con 0x7f8090104bd0 2024-04-25T11:16:35.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.242+0000 7f808d7fa700 1 -- 172.21.15.82:0/341302933 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7f808801b030 con 0x7f8090104bd0 2024-04-25T11:16:35.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.243+0000 7f808d7fa700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80780afb70 0x7f80780b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.243+0000 7f808d7fa700 1 -- 172.21.15.82:0/341302933 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f80880dccd0 con 0x7f8090104bd0 2024-04-25T11:16:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.243+0000 7f808ffff700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80780afb70 0x7f80780b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.243+0000 7f808ffff700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80780afb70 0x7f80780b2080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8080005fd0 tx=0x7f8080005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:35.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.248+0000 7f808d7fa700 1 -- 172.21.15.82:0/341302933 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8088022020 con 0x7f8090104bd0 2024-04-25T11:16:35.348 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:34 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi080 2024-04-25T11:16:35.348 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:34 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-25T11:16:35.348 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:34 smithi196 ceph-mon[32659]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T11:16:35.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:34 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi080 2024-04-25T11:16:35.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:34 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-25T11:16:35.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:34 smithi080 ceph-mon[29126]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T11:16:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:35.452+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8090063ad0 con 0x7f80780afb70 2024-04-25T11:16:36.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:35 smithi082 ceph-mon[32440]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:36.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:35 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:16:36.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:35 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:16:36.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:35 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:36.362 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:35 smithi196 ceph-mon[32659]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:36.362 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:35 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:16:36.363 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:35 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:16:36.363 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:35 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:36.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:35 smithi080 ceph-mon[29126]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:36.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:16:36.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:16:36.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:37.202 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:36 smithi082 ceph-mon[32440]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:37.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:36 smithi080 ceph-mon[29126]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:37.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:36 smithi196 ceph-mon[32659]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:16:38.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:37 smithi082 ceph-mon[32440]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:38.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:37 smithi080 ceph-mon[29126]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:38.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:37 smithi196 ceph-mon[32659]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:39.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/2902370322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]: dispatch 2024-04-25T11:16:39.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:38 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]: dispatch 2024-04-25T11:16:39.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:38 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]': finished 2024-04-25T11:16:39.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:38 smithi082 ceph-mon[32440]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T11:16:39.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:38 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:39.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/1190246339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:16:39.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/2902370322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]: dispatch 2024-04-25T11:16:39.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:38 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]: dispatch 2024-04-25T11:16:39.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:38 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]': finished 2024-04-25T11:16:39.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:38 smithi080 ceph-mon[29126]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T11:16:39.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:38 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:39.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/1190246339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:16:39.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/2902370322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]: dispatch 2024-04-25T11:16:39.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:38 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]: dispatch 2024-04-25T11:16:39.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:38 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e75fb74a-e338-408d-b098-edd1c4aeff77"}]': finished 2024-04-25T11:16:39.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:38 smithi196 ceph-mon[32659]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T11:16:39.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:38 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:39.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/1190246339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:16:40.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:40 smithi080 ceph-mon[29126]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:40.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:40 smithi196 ceph-mon[32659]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:40.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:40 smithi082 ceph-mon[32440]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:42.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:42 smithi082 ceph-mon[32440]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:42.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:42 smithi080 ceph-mon[29126]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:42.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:42 smithi196 ceph-mon[32659]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:44.359 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:44 smithi082 ceph-mon[32440]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:44.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:44 smithi080 ceph-mon[29126]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:44.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:44 smithi196 ceph-mon[32659]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:46.341 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:46 smithi082 ceph-mon[32440]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:46.341 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T11:16:46.341 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:46.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:46 smithi080 ceph-mon[29126]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:46.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T11:16:46.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:46.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:46 smithi196 ceph-mon[32659]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:46.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T11:16:46.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:47.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:47 smithi196 ceph-mon[32659]: Deploying daemon osd.1 on smithi082 2024-04-25T11:16:47.589 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:47 smithi082 ceph-mon[32440]: Deploying daemon osd.1 on smithi082 2024-04-25T11:16:47.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:47 smithi080 ceph-mon[29126]: Deploying daemon osd.1 on smithi082 2024-04-25T11:16:48.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:48 smithi082 ceph-mon[32440]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:48.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:48 smithi080 ceph-mon[29126]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:48.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:48 smithi196 ceph-mon[32659]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:50.339 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:50 smithi082 ceph-mon[32440]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:50.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:50 smithi080 ceph-mon[29126]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:50.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:50 smithi196 ceph-mon[32659]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:52.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:52.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:52.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:52.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:51 smithi080 ceph-mon[29126]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:52.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:52.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:52.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:52.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:51 smithi196 ceph-mon[32659]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:52.206 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:52.206 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:52.206 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:52.206 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:51 smithi082 ceph-mon[32440]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:54.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.166+0000 7f808d7fa700 1 -- 172.21.15.82:0/341302933 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8090063ad0 con 0x7f80780afb70 2024-04-25T11:16:54.168 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 1 on host 'smithi082' 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.168+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80780afb70 msgr2=0x7f80780b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.168+0000 7f8096760700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80780afb70 0x7f80780b2080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8080005fd0 tx=0x7f8080005dd0 comp rx=0 tx=0).stop 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.168+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104bd0 msgr2=0x7f80901a3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.168+0000 7f8096760700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104bd0 0x7f80901a3e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f808800ef30 tx=0x7f808800c3a0 comp rx=0 tx=0).stop 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 shutdown_connections 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80780afb70 0x7f80780b2080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8090104bd0 0x7f80901a3e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090103100 0x7f8090076320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 --2- 172.21.15.82:0/341302933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8090104230 0x7f80901a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 >> 172.21.15.82:0/341302933 conn(0x7f80900fe740 msgr2=0x7f8090107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:16:54.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 shutdown_connections 2024-04-25T11:16:54.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:16:54.169+0000 7f8096760700 1 -- 172.21.15.82:0/341302933 wait complete. 2024-04-25T11:16:54.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:54 smithi082 ceph-mon[32440]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:54.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:54 smithi080 ceph-mon[29126]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:54 smithi196 ceph-mon[32659]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:54.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:54.846 DEBUG:teuthology.orchestra.run.smithi082:osd.1> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.1.service 2024-04-25T11:16:54.849 INFO:tasks.cephadm:Deploying osd.2 on smithi196 with /dev/vg_nvme/lv_4... 2024-04-25T11:16:54.849 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T11:16:55.104 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:16:55.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:55 smithi082 ceph-mon[32440]: from='osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T11:16:55.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:55 smithi082 ceph-mon[32440]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T11:16:55.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:55 smithi196 ceph-mon[32659]: from='osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T11:16:55.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:55 smithi196 ceph-mon[32659]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T11:16:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:55 smithi080 ceph-mon[29126]: from='osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T11:16:55.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:55 smithi080 ceph-mon[29126]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T11:16:56.400 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:56 smithi196 ceph-mon[32659]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:56.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:56 smithi196 ceph-mon[32659]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T11:16:56.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:56 smithi196 ceph-mon[32659]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T11:16:56.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:56 smithi196 ceph-mon[32659]: from='osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:16:56.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:56.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:56 smithi196 ceph-mon[32659]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:16:56.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:56 smithi080 ceph-mon[29126]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:56.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:56 smithi080 ceph-mon[29126]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T11:16:56.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:56 smithi080 ceph-mon[29126]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T11:16:56.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:56 smithi080 ceph-mon[29126]: from='osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:16:56.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:56.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:56 smithi080 ceph-mon[29126]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:16:56.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-mon[32440]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:56.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-mon[32440]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T11:16:56.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-mon[32440]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T11:16:56.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-mon[32440]: from='osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:16:56.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:56.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-mon[32440]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:16:56.751 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1[37034]: 2024-04-25T11:16:56.306+0000 7f0a4904c700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T11:16:56.751 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:16:56 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1[37034]: 2024-04-25T11:16:56.308+0000 7f0a44e01700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:16:56.990 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T11:16:56.991 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T11:16:56.991 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-25T11:16:56.991 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-25T11:16:56.991 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112886 s, 929 MB/s 2024-04-25T11:16:56.991 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-25T11:16:57.580 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:57 smithi196 ceph-mon[32659]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:16:57.580 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:57 smithi196 ceph-mon[32659]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T11:16:57.580 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:57.580 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:57.606 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_4 2024-04-25T11:16:57.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:57 smithi080 ceph-mon[29126]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:16:57.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:57 smithi080 ceph-mon[29126]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T11:16:57.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:57.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:57.693 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:57 smithi082 ceph-mon[32440]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:16:57.693 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:57 smithi082 ceph-mon[32440]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T11:16:57.693 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:57.693 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:57.853 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:16:58.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:16:58.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:16:58.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:58.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] boot 2024-04-25T11:16:58.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T11:16:58.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:58.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:58.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:16:58.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:16:58.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:58.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] boot 2024-04-25T11:16:58.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:58.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:16:58.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: osd.1 [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] boot 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:16:58.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:16:58.752 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:16:59.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.543+0000 7fb971f16700 1 -- 172.21.15.196:0/2580854712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 msgr2=0x7fb96c1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:59.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.543+0000 7fb971f16700 1 --2- 172.21.15.196:0/2580854712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c1034f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009990 tx=0x7fb95c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:16:59.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.543+0000 7fb971f16700 1 -- 172.21.15.196:0/2580854712 shutdown_connections 2024-04-25T11:16:59.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.543+0000 7fb971f16700 1 --2- 172.21.15.196:0/2580854712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c104bb0 0x7fb96c10b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:59.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.543+0000 7fb971f16700 1 --2- 172.21.15.196:0/2580854712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c1034f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.543+0000 7fb971f16700 1 --2- 172.21.15.196:0/2580854712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c104210 0x7fb96c104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.543+0000 7fb971f16700 1 -- 172.21.15.196:0/2580854712 >> 172.21.15.196:0/2580854712 conn(0x7fb96c0fe740 msgr2=0x7fb96c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.544+0000 7fb971f16700 1 -- 172.21.15.196:0/2580854712 shutdown_connections 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.544+0000 7fb971f16700 1 -- 172.21.15.196:0/2580854712 wait complete. 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.544+0000 7fb971f16700 1 Processor -- start 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.544+0000 7fb971f16700 1 -- start start 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.544+0000 7fb971f16700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.544+0000 7fb971f16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c104210 0x7fb96c19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb971f16700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c104bb0 0x7fb96c1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb971f16700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c10fd10 con 0x7fb96c104bb0 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb971f16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c10fb90 con 0x7fb96c104210 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb971f16700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c10fe90 con 0x7fb96c1030e0 2024-04-25T11:16:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c19a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:51970/0 (socket says 172.21.15.196:51970) 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 -- 172.21.15.196:0/3577058691 learned_addr learned my addr 172.21.15.196:0/3577058691 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96bfff700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c104bb0 0x7fb96c1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb962ffd700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c104210 0x7fb96c19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 -- 172.21.15.196:0/3577058691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c104210 msgr2=0x7fb96c19ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c104210 0x7fb96c19ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 -- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c104bb0 msgr2=0x7fb96c1a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c104bb0 0x7fb96c1a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 -- 172.21.15.196:0/3577058691 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c1a2290 con 0x7fb96c1030e0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb96b7fe700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c19a7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000c00 tx=0x7fb95c0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb9697fa700 1 -- 172.21.15.196:0/3577058691 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c026070 con 0x7fb96c1030e0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb9697fa700 1 -- 172.21.15.196:0/3577058691 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb95c004000 con 0x7fb96c1030e0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96c1a2520 con 0x7fb96c1030e0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb9697fa700 1 -- 172.21.15.196:0/3577058691 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00fd50 con 0x7fb96c1030e0 2024-04-25T11:16:59.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.545+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96c1a29d0 con 0x7fb96c1030e0 2024-04-25T11:16:59.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.547+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96c051190 con 0x7fb96c1030e0 2024-04-25T11:16:59.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.549+0000 7fb9697fa700 1 -- 172.21.15.196:0/3577058691 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7fb95c029070 con 0x7fb96c1030e0 2024-04-25T11:16:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.549+0000 7fb9697fa700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9580afb70 0x7fb9580b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:16:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.550+0000 7fb9697fa700 1 -- 172.21.15.196:0/3577058691 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fb95c0de510 con 0x7fb96c1030e0 2024-04-25T11:16:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.550+0000 7fb962ffd700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9580afb70 0x7fb9580b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:16:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.550+0000 7fb962ffd700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9580afb70 0x7fb9580b2080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb954005ea0 tx=0x7fb954005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:16:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.553+0000 7fb9697fa700 1 -- 172.21.15.196:0/3577058691 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb95c013070 con 0x7fb96c1030e0 2024-04-25T11:16:59.554 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:59 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi082 2024-04-25T11:16:59.554 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:59 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi082 to 17088M 2024-04-25T11:16:59.554 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:16:59 smithi196 ceph-mon[32659]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:59 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi082 2024-04-25T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:59 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi082 to 17088M 2024-04-25T11:16:59.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:16:59 smithi080 ceph-mon[29126]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T11:16:59.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:59 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi082 2024-04-25T11:16:59.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:59 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi082 to 17088M 2024-04-25T11:16:59.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:16:59 smithi082 ceph-mon[32440]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T11:16:59.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:16:59.757+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb96c063ad0 con 0x7fb9580afb70 2024-04-25T11:17:00.592 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:00 smithi196 ceph-mon[32659]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:00.593 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:00.593 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:00.593 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:00 smithi080 ceph-mon[29126]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:00.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:00.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:00 smithi082 ceph-mon[32440]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:00.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:00.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:00.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:01.583 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:01 smithi196 ceph-mon[32659]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:01 smithi080 ceph-mon[29126]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:01.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:01 smithi082 ceph-mon[32440]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:02.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:02 smithi080 ceph-mon[29126]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:02.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:02 smithi196 ceph-mon[32659]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:02.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:02 smithi082 ceph-mon[32440]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:03.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:03 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/1188264465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]: dispatch 2024-04-25T11:17:03.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:03 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]: dispatch 2024-04-25T11:17:03.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:03 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]': finished 2024-04-25T11:17:03.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:03 smithi080 ceph-mon[29126]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T11:17:03.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:03.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:03 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/682718475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:03.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:03 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/1188264465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]: dispatch 2024-04-25T11:17:03.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:03 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]: dispatch 2024-04-25T11:17:03.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:03 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]': finished 2024-04-25T11:17:03.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:03 smithi196 ceph-mon[32659]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T11:17:03.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:03.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:03 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/682718475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:03 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/1188264465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]: dispatch 2024-04-25T11:17:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:03 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]: dispatch 2024-04-25T11:17:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:03 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1352c87b-d8f4-4f62-b4d9-d256d66bbe0a"}]': finished 2024-04-25T11:17:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:03 smithi082 ceph-mon[32440]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T11:17:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:03.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:03 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/682718475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:04.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:04 smithi080 ceph-mon[29126]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:04.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:04 smithi196 ceph-mon[32659]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:04.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:04 smithi082 ceph-mon[32440]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:06.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:06 smithi196 ceph-mon[32659]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:06.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:06 smithi080 ceph-mon[29126]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:06.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:06 smithi082 ceph-mon[32440]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:08.594 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:08 smithi196 ceph-mon[32659]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:08.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:08 smithi080 ceph-mon[29126]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:08.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:08 smithi082 ceph-mon[32440]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:10.623 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:10 smithi196 ceph-mon[32659]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:10.623 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T11:17:10.623 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:10.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:10 smithi080 ceph-mon[29126]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T11:17:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:10.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:10 smithi082 ceph-mon[32440]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:10.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T11:17:10.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:11.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:11 smithi196 ceph-mon[32659]: Deploying daemon osd.2 on smithi196 2024-04-25T11:17:11.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:11 smithi080 ceph-mon[29126]: Deploying daemon osd.2 on smithi196 2024-04-25T11:17:11.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:11 smithi082 ceph-mon[32440]: Deploying daemon osd.2 on smithi196 2024-04-25T11:17:12.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:12 smithi080 ceph-mon[29126]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:12.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:12 smithi196 ceph-mon[32659]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:12.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:12 smithi082 ceph-mon[32440]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:13.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:13 smithi196 ceph-mon[32659]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:13.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:13 smithi080 ceph-mon[29126]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:13.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:13 smithi082 ceph-mon[32440]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:16.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:16 smithi080 ceph-mon[29126]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:16.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:16.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:16.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:16.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:16 smithi196 ceph-mon[32659]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:16.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:16.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:16.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:16.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:16 smithi082 ceph-mon[32440]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:16.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:16.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:16.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:18.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:18 smithi080 ceph-mon[29126]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:18.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:18 smithi196 ceph-mon[32659]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:18.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:18 smithi082 ceph-mon[32440]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:19.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.025+0000 7fb9697fa700 1 -- 172.21.15.196:0/3577058691 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb96c063ad0 con 0x7fb9580afb70 2024-04-25T11:17:19.027 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 2 on host 'smithi196' 2024-04-25T11:17:19.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9580afb70 msgr2=0x7fb9580b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:19.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9580afb70 0x7fb9580b2080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb954005ea0 tx=0x7fb954005e30 comp rx=0 tx=0).stop 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 msgr2=0x7fb96c19a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c19a7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000c00 tx=0x7fb95c0057c0 comp rx=0 tx=0).stop 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 shutdown_connections 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9580afb70 0x7fb9580b2080 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb96c104bb0 0x7fb96c1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c1030e0 0x7fb96c19a7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 --2- 172.21.15.196:0/3577058691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb96c104210 0x7fb96c19ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 >> 172.21.15.196:0/3577058691 conn(0x7fb96c0fe740 msgr2=0x7fb96c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 shutdown_connections 2024-04-25T11:17:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:17:19.028+0000 7fb971f16700 1 -- 172.21.15.196:0/3577058691 wait complete. 2024-04-25T11:17:19.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:19.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:19.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.625 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.625 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:19.625 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:19.625 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T11:17:19.625 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:19 smithi196 ceph-mon[32659]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T11:17:19.672 DEBUG:teuthology.orchestra.run.smithi196:osd.2> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.2.service 2024-04-25T11:17:19.675 INFO:tasks.cephadm:Deploying osd.3 on smithi080 with /dev/vg_nvme/lv_3... 2024-04-25T11:17:19.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T11:17:19.810 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T11:17:19.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:19 smithi082 ceph-mon[32440]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T11:17:19.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:19.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:19.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:19.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:19.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:19.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T11:17:19.886 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:19 smithi080 ceph-mon[29126]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T11:17:19.935 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:17:21.180 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:21 smithi196 ceph-mon[32659]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T11:17:21.180 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:21 smithi196 ceph-mon[32659]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T11:17:21.181 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:21.181 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:21 smithi196 ceph-mon[32659]: from='osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:17:21.181 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:21 smithi196 ceph-mon[32659]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:17:21.181 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2[37836]: 2024-04-25T11:17:21.016+0000 7fcc17cd0700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T11:17:21.182 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2[37836]: 2024-04-25T11:17:21.021+0000 7fcc13a85700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:17:21.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:21 smithi080 ceph-mon[29126]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T11:17:21.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:21 smithi080 ceph-mon[29126]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T11:17:21.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:21.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:21 smithi080 ceph-mon[29126]: from='osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:17:21.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:21 smithi080 ceph-mon[29126]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:17:21.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:21 smithi082 ceph-mon[32440]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T11:17:21.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:21 smithi082 ceph-mon[32440]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T11:17:21.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:21.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:21 smithi082 ceph-mon[32440]: from='osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:17:21.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:21 smithi082 ceph-mon[32440]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:17:21.975 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T11:17:21.976 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T11:17:21.976 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-25T11:17:21.976 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-25T11:17:21.976 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0147053 s, 713 MB/s 2024-04-25T11:17:21.976 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-25T11:17:22.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:22 smithi080 ceph-mon[29126]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:17:22.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:22 smithi080 ceph-mon[29126]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T11:17:22.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:22 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:22.283 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:22 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:22.284 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:22 smithi080 ceph-mon[29126]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:22.427 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:22 smithi196 ceph-mon[32659]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:17:22.427 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:22 smithi196 ceph-mon[32659]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T11:17:22.427 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:22 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:22.427 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:22 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:22.427 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:22 smithi196 ceph-mon[32659]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:22.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:22 smithi082 ceph-mon[32440]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:17:22.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:22 smithi082 ceph-mon[32440]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T11:17:22.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:22 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:22.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:22 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:22.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:22 smithi082 ceph-mon[32440]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-25T11:17:22.689 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2024-04-25T11:17:22.943 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:17:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:17:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:17:23.346 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] boot 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:23.347 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:17:23.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] boot 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:23.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:17:23.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:17:23.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: osd.2 [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] boot 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:23.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:24.303 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:24 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi196 2024-04-25T11:17:24.303 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:24 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi196 to 17088M 2024-04-25T11:17:24.303 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:24 smithi080 ceph-mon[29126]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T11:17:24.303 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:24 smithi080 ceph-mon[29126]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:24.303 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:17:24.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:24 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi196 2024-04-25T11:17:24.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:24 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi196 to 17088M 2024-04-25T11:17:24.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:24 smithi196 ceph-mon[32659]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T11:17:24.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:24 smithi196 ceph-mon[32659]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:24.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:24 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:17:24.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:24 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi196 2024-04-25T11:17:24.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:24 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi196 to 17088M 2024-04-25T11:17:24.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:24 smithi082 ceph-mon[32440]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T11:17:24.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:24 smithi082 ceph-mon[32440]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:24.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:24 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 -- 172.21.15.80:0/355867647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128104be0 msgr2=0x7fc12810b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/355867647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128104be0 0x7fc12810b490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc12000b0a0 tx=0x7fc12000b3b0 comp rx=0 tx=0).stop 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 -- 172.21.15.80:0/355867647 shutdown_connections 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/355867647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128104be0 0x7fc12810b490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/355867647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc128103110 0x7fc128103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/355867647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc128104240 0x7fc128104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 -- 172.21.15.80:0/355867647 >> 172.21.15.80:0/355867647 conn(0x7fc1280fe750 msgr2=0x7fc128100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 -- 172.21.15.80:0/355867647 shutdown_connections 2024-04-25T11:17:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.541+0000 7fc12d3a1700 1 -- 172.21.15.80:0/355867647 wait complete. 2024-04-25T11:17:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.542+0000 7fc12d3a1700 1 Processor -- start 2024-04-25T11:17:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.542+0000 7fc12d3a1700 1 -- start start 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc12d3a1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128103110 0x7fc128199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc12d3a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc128104240 0x7fc128199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc12d3a1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc128104be0 0x7fc1281a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc12d3a1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc12810ec00 con 0x7fc128103110 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc12d3a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc12810ea80 con 0x7fc128104240 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc12d3a1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc12810ed80 con 0x7fc128104be0 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128103110 0x7fc128199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128103110 0x7fc128199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53886/0 (socket says 172.21.15.80:53886) 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 -- 172.21.15.80:0/3251655595 learned_addr learned my addr 172.21.15.80:0/3251655595 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:17:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc1267fc700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc128104240 0x7fc128199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc1277fe700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc128104be0 0x7fc1281a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 -- 172.21.15.80:0/3251655595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc128104be0 msgr2=0x7fc1281a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc128104be0 0x7fc1281a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 -- 172.21.15.80:0/3251655595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc128104240 msgr2=0x7fc128199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc128104240 0x7fc128199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 -- 172.21.15.80:0/3251655595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1281a1270 con 0x7fc128103110 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc1277fe700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc128104be0 0x7fc1281a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc126ffd700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128103110 0x7fc128199710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc11800d950 tx=0x7fc11800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118016070 con 0x7fc128103110 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1281a1560 con 0x7fc128103110 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc11800be00 con 0x7fc128103110 2024-04-25T11:17:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.543+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11800f3c0 con 0x7fc128103110 2024-04-25T11:17:24.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.544+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1281a1af0 con 0x7fc128103110 2024-04-25T11:17:24.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.544+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc128051190 con 0x7fc128103110 2024-04-25T11:17:24.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.546+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7fc118019070 con 0x7fc128103110 2024-04-25T11:17:24.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.546+0000 7fc10ffff700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc1100afaf0 0x7fc1100b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:24.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.547+0000 7fc1267fc700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc1100afaf0 0x7fc1100b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:17:24.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.547+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3226+0+0 (secure 0 0 0) 0x7fc1180ddb80 con 0x7fc128103110 2024-04-25T11:17:24.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.547+0000 7fc1267fc700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc1100afaf0 0x7fc1100b2000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc12819a7c0 tx=0x7fc11c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:17:24.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.550+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc118020020 con 0x7fc128103110 2024-04-25T11:17:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:24.759+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc128063ad0 con 0x7fc1100afaf0 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48498]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48498]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48498]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48498]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48501]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48501]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48501]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.297 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48501]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T11:17:25.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 ceph-mon[29126]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T11:17:25.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:17:25.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:25.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:25.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:25.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48558]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T11:17:25.335 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T11:17:25.335 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 ceph-mon[32659]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T11:17:25.335 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:17:25.336 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:25.336 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:25.336 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41888]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41888]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41888]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41888]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41891]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41891]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41891]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.336 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41891]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.374 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40993]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T11:17:25.374 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40993]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.374 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40993]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.374 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40993]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.374 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40996]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T11:17:25.375 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40996]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.375 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40996]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.375 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40996]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T11:17:25.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 ceph-mon[32440]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T11:17:25.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:17:25.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:25.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:25.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:25.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40999]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T11:17:25.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48558]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48558]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48558]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48563]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T11:17:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48563]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48563]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:25 smithi080 sudo[48563]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41894]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T11:17:25.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41894]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41894]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41894]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41897]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T11:17:25.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41897]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41897]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:25 smithi196 sudo[41897]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40999]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40999]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[40999]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:25.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[41002]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T11:17:25.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[41002]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T11:17:25.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[41002]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T11:17:25.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:25 smithi082 sudo[41002]: pam_unix(sudo:session): session closed for user root 2024-04-25T11:17:26.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:26.231+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fc1180a37b0 con 0x7fc128103110 2024-04-25T11:17:26.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:26.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T11:17:26.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T11:17:26.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:26.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.386 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.387 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.387 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:26 smithi080 ceph-mon[29126]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.448 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:26 smithi196 ceph-mon[32659]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:26.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T11:17:26.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T11:17:26.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:26.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T11:17:26.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:17:26.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:17:26.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:17:26.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:26 smithi082 ceph-mon[32440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T11:17:27.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:27 smithi080 ceph-mon[29126]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T11:17:27.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:27 smithi080 ceph-mon[29126]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T11:17:27.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:27 smithi196 ceph-mon[32659]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T11:17:27.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:27 smithi196 ceph-mon[32659]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T11:17:27.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:27 smithi082 ceph-mon[32440]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T11:17:27.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:27 smithi082 ceph-mon[32440]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T11:17:28.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:28 smithi080 ceph-mon[29126]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:28.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:28 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/326818967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "870b8e57-a5a4-48b9-8973-413bd846a860"}]: dispatch 2024-04-25T11:17:28.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:28 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/326818967' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "870b8e57-a5a4-48b9-8973-413bd846a860"}]': finished 2024-04-25T11:17:28.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:28 smithi080 ceph-mon[29126]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T11:17:28.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:28 smithi196 ceph-mon[32659]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:28 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/326818967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "870b8e57-a5a4-48b9-8973-413bd846a860"}]: dispatch 2024-04-25T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:28 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/326818967' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "870b8e57-a5a4-48b9-8973-413bd846a860"}]': finished 2024-04-25T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:28 smithi196 ceph-mon[32659]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:28.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:28 smithi082 ceph-mon[32440]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:28.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:28 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/326818967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "870b8e57-a5a4-48b9-8973-413bd846a860"}]: dispatch 2024-04-25T11:17:28.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:28 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/326818967' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "870b8e57-a5a4-48b9-8973-413bd846a860"}]': finished 2024-04-25T11:17:28.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:28 smithi082 ceph-mon[32440]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T11:17:28.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:29.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:29 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1470271478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:29.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:29 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1470271478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:29.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:29 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1470271478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:30.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:30 smithi080 ceph-mon[29126]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:30.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:30 smithi196 ceph-mon[32659]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:30.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:30 smithi082 ceph-mon[32440]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:32.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:32 smithi080 ceph-mon[29126]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:32.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:32 smithi196 ceph-mon[32659]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:32.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:32 smithi082 ceph-mon[32440]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:34.357 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:34 smithi080 ceph-mon[29126]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:34.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:34 smithi196 ceph-mon[32659]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:34.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:34 smithi082 ceph-mon[32440]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:35.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T11:17:35.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:35 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:35.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:35 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T11:17:35.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:35 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:35.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:35 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T11:17:35.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:35 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:36.598 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:36 smithi196 ceph-mon[32659]: Deploying daemon osd.3 on smithi080 2024-04-25T11:17:36.598 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:36 smithi196 ceph-mon[32659]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:36 smithi080 ceph-mon[29126]: Deploying daemon osd.3 on smithi080 2024-04-25T11:17:36.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:36 smithi080 ceph-mon[29126]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:36 smithi082 ceph-mon[32440]: Deploying daemon osd.3 on smithi080 2024-04-25T11:17:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:36 smithi082 ceph-mon[32440]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:38.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:38 smithi080 ceph-mon[29126]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:38.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:38 smithi196 ceph-mon[32659]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:38.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:38 smithi082 ceph-mon[32440]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:40.553 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:40 smithi080 ceph-mon[29126]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:40.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:40 smithi196 ceph-mon[32659]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:40.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:40 smithi082 ceph-mon[32440]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:42.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:41 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:42.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:41 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:42.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:41 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:42.251 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:41 smithi082 ceph-mon[32440]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:42.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:41 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:42.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:41 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:42.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:41 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:42.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:41 smithi080 ceph-mon[29126]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:42.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:41 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:42.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:41 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:42.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:41 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:42.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:41 smithi196 ceph-mon[32659]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:44.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:44 smithi080 ceph-mon[29126]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:44.464 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 3 on host 'smithi080' 2024-04-25T11:17:44.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.462+0000 7fc10ffff700 1 -- 172.21.15.80:0/3251655595 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc128063ad0 con 0x7fc1100afaf0 2024-04-25T11:17:44.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc1100afaf0 msgr2=0x7fc1100b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc1100afaf0 0x7fc1100b2000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc12819a7c0 tx=0x7fc11c009190 comp rx=0 tx=0).stop 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128103110 msgr2=0x7fc128199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128103110 0x7fc128199710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc11800d950 tx=0x7fc11800dc60 comp rx=0 tx=0).stop 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 shutdown_connections 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc1100afaf0 0x7fc1100b2000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc128104be0 0x7fc1281a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128103110 0x7fc128199710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 --2- 172.21.15.80:0/3251655595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc128104240 0x7fc128199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 >> 172.21.15.80:0/3251655595 conn(0x7fc1280fe750 msgr2=0x7fc128107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 shutdown_connections 2024-04-25T11:17:44.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:17:44.466+0000 7fc12d3a1700 1 -- 172.21.15.80:0/3251655595 wait complete. 2024-04-25T11:17:44.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:44 smithi196 ceph-mon[32659]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:44.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:44 smithi082 ceph-mon[32440]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:45.165 DEBUG:teuthology.orchestra.run.smithi080:osd.3> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.3.service 2024-04-25T11:17:45.167 INFO:tasks.cephadm:Deploying osd.4 on smithi082 with /dev/vg_nvme/lv_3... 2024-04-25T11:17:45.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T11:17:45.411 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:17:45.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:45 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:45 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:45 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:45 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:45 smithi082 ceph-mon[32440]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T11:17:45.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:45 smithi082 ceph-mon[32440]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:45.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:45 smithi080 ceph-mon[29126]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T11:17:45.674 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:45 smithi080 ceph-mon[29126]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:45.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:45.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:45 smithi196 ceph-mon[32659]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T11:17:45.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:45 smithi196 ceph-mon[32659]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:47.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:46 smithi080 ceph-mon[29126]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T11:17:47.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:46 smithi080 ceph-mon[29126]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T11:17:47.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:46 smithi080 ceph-mon[29126]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:17:47.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:47.136 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:17:46 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3[50701]: 2024-04-25T11:17:46.810+0000 7fcee9158700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T11:17:47.136 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:17:46 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3[50701]: 2024-04-25T11:17:46.820+0000 7fcee4f0d700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:17:47.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:46 smithi196 ceph-mon[32659]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T11:17:47.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:46 smithi196 ceph-mon[32659]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T11:17:47.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:46 smithi196 ceph-mon[32659]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:17:47.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:47.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:46 smithi082 ceph-mon[32440]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T11:17:47.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:46 smithi082 ceph-mon[32440]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T11:17:47.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:46 smithi082 ceph-mon[32440]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:17:47.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:47.338 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T11:17:47.339 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T11:17:47.339 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-25T11:17:47.339 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-25T11:17:47.339 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114191 s, 918 MB/s 2024-04-25T11:17:47.339 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-25T11:17:47.992 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-04-25T11:17:48.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:47 smithi080 ceph-mon[29126]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:17:48.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:47 smithi080 ceph-mon[29126]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T11:17:48.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:47 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:48.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:47 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:48.052 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:47 smithi080 ceph-mon[29126]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:48.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:47 smithi196 ceph-mon[32659]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:17:48.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:47 smithi196 ceph-mon[32659]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T11:17:48.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:47 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:48.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:47 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:48.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:47 smithi196 ceph-mon[32659]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:48.236 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:17:48.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:47 smithi082 ceph-mon[32440]: from='osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:17:48.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:47 smithi082 ceph-mon[32440]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T11:17:48.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:47 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:48.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:47 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:48.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:47 smithi082 ceph-mon[32440]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-25T11:17:49.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] boot 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi080 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:49.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:49.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:49.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:49.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.002 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:48 smithi082 ceph-mon[32440]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T11:17:49.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:17:49.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:17:49.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] boot 2024-04-25T11:17:49.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T11:17:49.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:49.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi080 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.136 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:48 smithi080 ceph-mon[29126]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: osd.3 [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] boot 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi080 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:17:49.198 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:48 smithi196 ceph-mon[32659]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 -- 172.21.15.82:0/2987417791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 msgr2=0x7fa82c107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 --2- 172.21.15.82:0/2987417791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c107100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009990 tx=0x7fa81c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 -- 172.21.15.82:0/2987417791 shutdown_connections 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 --2- 172.21.15.82:0/2987417791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa82c109fa0 0x7fa82c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 --2- 172.21.15.82:0/2987417791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c107100 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 --2- 172.21.15.82:0/2987417791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa82c107640 0x7fa82c109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 -- 172.21.15.82:0/2987417791 >> 172.21.15.82:0/2987417791 conn(0x7fa82c0fe740 msgr2=0x7fa82c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 -- 172.21.15.82:0/2987417791 shutdown_connections 2024-04-25T11:17:49.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.918+0000 7fa8319f1700 1 -- 172.21.15.82:0/2987417791 wait complete. 2024-04-25T11:17:49.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 Processor -- start 2024-04-25T11:17:49.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 -- start start 2024-04-25T11:17:49.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:49.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa82c107640 0x7fa82c19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa82c109fa0 0x7fa82c1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10fca0 con 0x7fa82c109fa0 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10fb20 con 0x7fa82c104ce0 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa8319f1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10fe20 con 0x7fa82c107640 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa82affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa82affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c19a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46020/0 (socket says 172.21.15.82:46020) 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.919+0000 7fa82affd700 1 -- 172.21.15.82:0/4125863547 learned_addr learned my addr 172.21.15.82:0/4125863547 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82b7fe700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa82c109fa0 0x7fa82c1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82affd700 1 -- 172.21.15.82:0/4125863547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa82c107640 msgr2=0x7fa82c19ad00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82affd700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa82c107640 0x7fa82c19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82affd700 1 -- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa82c109fa0 msgr2=0x7fa82c1a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82affd700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa82c109fa0 0x7fa82c1a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:17:49.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82affd700 1 -- 172.21.15.82:0/4125863547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c1a2320 con 0x7fa82c104ce0 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82b7fe700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa82c109fa0 0x7fa82c1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa82affd700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c19a7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa81c006010 tx=0x7fa81c009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa8309ef700 1 -- 172.21.15.82:0/4125863547 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c027070 con 0x7fa82c104ce0 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa8309ef700 1 -- 172.21.15.82:0/4125863547 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa81c004140 con 0x7fa82c104ce0 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c1a25b0 con 0x7fa82c104ce0 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa8309ef700 1 -- 172.21.15.82:0/4125863547 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c022df0 con 0x7fa82c104ce0 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.920+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c1a2a80 con 0x7fa82c104ce0 2024-04-25T11:17:49.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.921+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c051190 con 0x7fa82c104ce0 2024-04-25T11:17:49.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.923+0000 7fa8309ef700 1 -- 172.21.15.82:0/4125863547 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fa81c02a070 con 0x7fa82c104ce0 2024-04-25T11:17:49.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.923+0000 7fa8309ef700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa8180afb80 0x7fa8180b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:17:49.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.924+0000 7fa8227fc700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa8180afb80 0x7fa8180b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:17:49.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.924+0000 7fa8309ef700 1 -- 172.21.15.82:0/4125863547 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7fa81c0df1d0 con 0x7fa82c104ce0 2024-04-25T11:17:49.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.924+0000 7fa8227fc700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa8180afb80 0x7fa8180b2090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa814005950 tx=0x7fa8140058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:17:49.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:49.928+0000 7fa8309ef700 1 -- 172.21.15.82:0/4125863547 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa81c031080 con 0x7fa82c104ce0 2024-04-25T11:17:50.005 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:49 smithi082 ceph-mon[32440]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:50.005 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:49 smithi082 ceph-mon[32440]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T11:17:50.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:49 smithi080 ceph-mon[29126]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:50.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:49 smithi080 ceph-mon[29126]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T11:17:50.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:17:50.136+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa82c063b90 con 0x7fa8180afb80 2024-04-25T11:17:50.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:49 smithi196 ceph-mon[32659]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:50.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:49 smithi196 ceph-mon[32659]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T11:17:51.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:50 smithi082 ceph-mon[32440]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:51.000 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:50 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:51.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:50 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:51.001 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:50 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:51.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:50 smithi080 ceph-mon[29126]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:51.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:50 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:51.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:50 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:51.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:50 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:51.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:50 smithi196 ceph-mon[32659]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:17:51.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:50 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:17:51.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:50 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:17:51.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:50 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:17:52.062 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:51 smithi082 ceph-mon[32440]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:52.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:51 smithi080 ceph-mon[29126]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:52.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:51 smithi196 ceph-mon[32659]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:53.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:52 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/1022313590' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]: dispatch 2024-04-25T11:17:53.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:52 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]: dispatch 2024-04-25T11:17:53.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:52 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]': finished 2024-04-25T11:17:53.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:52 smithi082 ceph-mon[32440]: osdmap e29: 5 total, 4 up, 5 in 2024-04-25T11:17:53.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:52 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:17:53.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:52 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/1022313590' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]: dispatch 2024-04-25T11:17:53.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:52 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]: dispatch 2024-04-25T11:17:53.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:52 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]': finished 2024-04-25T11:17:53.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:52 smithi080 ceph-mon[29126]: osdmap e29: 5 total, 4 up, 5 in 2024-04-25T11:17:53.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:52 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:17:53.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:52 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/1022313590' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]: dispatch 2024-04-25T11:17:53.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:52 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]: dispatch 2024-04-25T11:17:53.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:52 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbdae8fe-80db-417f-b27b-b7a436f3035b"}]': finished 2024-04-25T11:17:53.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:52 smithi196 ceph-mon[32659]: osdmap e29: 5 total, 4 up, 5 in 2024-04-25T11:17:53.447 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:52 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:17:54.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:54 smithi080 ceph-mon[29126]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:54.286 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:54 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/2707259673' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:54.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:54 smithi196 ceph-mon[32659]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:54.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:54 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/2707259673' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:54.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:54 smithi082 ceph-mon[32440]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:17:54.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:54 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/2707259673' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:17:56.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:56 smithi080 ceph-mon[29126]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-25T11:17:56.635 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:56 smithi082 ceph-mon[32440]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-25T11:17:56.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:56 smithi196 ceph-mon[32659]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-25T11:17:58.562 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:17:58 smithi082 ceph-mon[32440]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:17:58.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:17:58 smithi080 ceph-mon[29126]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:17:58.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:17:58 smithi196 ceph-mon[32659]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:18:00.399 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:00 smithi082 ceph-mon[32440]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-25T11:18:00.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:00 smithi080 ceph-mon[29126]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-25T11:18:00.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:00 smithi196 ceph-mon[32659]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-25T11:18:01.410 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T11:18:01.410 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:01.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T11:18:01.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:01.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T11:18:01.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:02.342 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:02 smithi082 ceph-mon[32440]: Deploying daemon osd.4 on smithi082 2024-04-25T11:18:02.342 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:02 smithi082 ceph-mon[32440]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:02.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:02 smithi080 ceph-mon[29126]: Deploying daemon osd.4 on smithi082 2024-04-25T11:18:02.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:02 smithi080 ceph-mon[29126]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:02.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:02 smithi196 ceph-mon[32659]: Deploying daemon osd.4 on smithi082 2024-04-25T11:18:02.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:02 smithi196 ceph-mon[32659]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:04.584 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:04 smithi082 ceph-mon[32440]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-25T11:18:04.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:04 smithi080 ceph-mon[29126]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-25T11:18:04.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:04 smithi196 ceph-mon[32659]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-25T11:18:06.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:06 smithi080 ceph-mon[29126]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T11:18:06.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:06 smithi196 ceph-mon[32659]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T11:18:06.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:06 smithi082 ceph-mon[32440]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T11:18:07.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:07.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:07.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:07.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:07.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:07.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:07.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:07.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:07.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:08.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:08 smithi080 ceph-mon[29126]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:08.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:08 smithi196 ceph-mon[32659]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:08.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:08 smithi082 ceph-mon[32440]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:09.950 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 4 on host 'smithi082' 2024-04-25T11:18:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.949+0000 7fa8309ef700 1 -- 172.21.15.82:0/4125863547 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa82c063b90 con 0x7fa8180afb80 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa8180afb80 msgr2=0x7fa8180b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa8180afb80 0x7fa8180b2090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa814005950 tx=0x7fa8140058e0 comp rx=0 tx=0).stop 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 msgr2=0x7fa82c19a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c19a7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa81c006010 tx=0x7fa81c009510 comp rx=0 tx=0).stop 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 shutdown_connections 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa8180afb80 0x7fa8180b2090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa82c109fa0 0x7fa82c1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:09.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa82c104ce0 0x7fa82c19a7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:09.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 --2- 172.21.15.82:0/4125863547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa82c107640 0x7fa82c19ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:09.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.953+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 >> 172.21.15.82:0/4125863547 conn(0x7fa82c0fe740 msgr2=0x7fa82c1057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:18:09.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.954+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 shutdown_connections 2024-04-25T11:18:09.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:18:09.954+0000 7fa8319f1700 1 -- 172.21.15.82:0/4125863547 wait complete. 2024-04-25T11:18:10.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:10 smithi082 ceph-mon[32440]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:10.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:10 smithi082 ceph-mon[32440]: from='osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T11:18:10.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:10 smithi082 ceph-mon[32440]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T11:18:10.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:10 smithi080 ceph-mon[29126]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:10 smithi080 ceph-mon[29126]: from='osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T11:18:10.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:10 smithi080 ceph-mon[29126]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T11:18:10.649 DEBUG:teuthology.orchestra.run.smithi082:osd.4> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.4.service 2024-04-25T11:18:10.651 INFO:tasks.cephadm:Deploying osd.5 on smithi196 with /dev/vg_nvme/lv_3... 2024-04-25T11:18:10.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T11:18:10.678 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:10 smithi196 ceph-mon[32659]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:10.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:10.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:10 smithi196 ceph-mon[32659]: from='osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T11:18:10.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:10 smithi196 ceph-mon[32659]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T11:18:10.895 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:18:12.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-mon[32440]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:12.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-mon[32440]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T11:18:12.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-mon[32440]: from='osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:18:12.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-mon[32440]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T11:18:12.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:12.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-mon[32440]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:18:12.501 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4[43795]: 2024-04-25T11:18:12.265+0000 7fa669db9700 -1 osd.4 0 waiting for initial osdmap 2024-04-25T11:18:12.501 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:18:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4[43795]: 2024-04-25T11:18:12.271+0000 7fa665b6e700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:18:12.569 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:12 smithi196 ceph-mon[32659]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:12.569 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:12 smithi196 ceph-mon[32659]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T11:18:12.569 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:12 smithi196 ceph-mon[32659]: from='osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:18:12.569 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:12 smithi196 ceph-mon[32659]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T11:18:12.569 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:12.570 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:12 smithi196 ceph-mon[32659]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:18:12.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:12 smithi080 ceph-mon[29126]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:12.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:12 smithi080 ceph-mon[29126]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T11:18:12.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:12 smithi080 ceph-mon[29126]: from='osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:18:12.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:12 smithi080 ceph-mon[29126]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T11:18:12.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:12.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:12 smithi080 ceph-mon[29126]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:18:13.167 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T11:18:13.167 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T11:18:13.167 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-25T11:18:13.167 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-25T11:18:13.167 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114203 s, 918 MB/s 2024-04-25T11:18:13.167 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-25T11:18:13.384 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:13 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:18:13.385 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:13 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:18:13.385 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:13 smithi082 ceph-mon[32440]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:18:13.385 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:13 smithi082 ceph-mon[32440]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T11:18:13.385 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:13.385 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:13.471 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:13 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:18:13.471 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:13 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:18:13.471 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:13 smithi196 ceph-mon[32659]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:18:13.472 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:13 smithi196 ceph-mon[32659]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T11:18:13.472 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:13.472 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:13.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:13 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:18:13.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:13 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:18:13.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:13 smithi080 ceph-mon[29126]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:18:13.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:13 smithi080 ceph-mon[29126]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T11:18:13.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:13.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:13.891 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_3 2024-04-25T11:18:14.175 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:18:14.567 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:14.567 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] boot 2024-04-25T11:18:14.567 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: osdmap e32: 5 total, 5 up, 5 in 2024-04-25T11:18:14.567 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:14.567 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:14.568 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] boot 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: osdmap e32: 5 total, 5 up, 5 in 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:14.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:14.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:14.636 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: osd.4 [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] boot 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: osdmap e32: 5 total, 5 up, 5 in 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:14.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:14.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:14.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:14.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:14.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:14.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:14.751 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:15.581 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:15 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi082 2024-04-25T11:18:15.581 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:15 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-25T11:18:15.581 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:15 smithi196 ceph-mon[32659]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T11:18:15.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:15 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi082 2024-04-25T11:18:15.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:15 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-25T11:18:15.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:15 smithi080 ceph-mon[29126]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T11:18:15.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:15 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi082 2024-04-25T11:18:15.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:15 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-25T11:18:15.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:15 smithi082 ceph-mon[32440]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T11:18:15.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 -- 172.21.15.196:0/4196886281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102220 msgr2=0x7f1204102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:15.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 --2- 172.21.15.196:0/4196886281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102220 0x7f1204102630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009990 tx=0x7f11f8009ca0 comp rx=0 tx=0).stop 2024-04-25T11:18:15.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 -- 172.21.15.196:0/4196886281 shutdown_connections 2024-04-25T11:18:15.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 --2- 172.21.15.196:0/4196886281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1204102b70 0x7f120410c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:15.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 --2- 172.21.15.196:0/4196886281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12041057d0 0x7f1204105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:15.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 --2- 172.21.15.196:0/4196886281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102220 0x7f1204102630 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:15.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 -- 172.21.15.196:0/4196886281 >> 172.21.15.196:0/4196886281 conn(0x7f12040fdef0 msgr2=0x7f12041003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 -- 172.21.15.196:0/4196886281 shutdown_connections 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.814+0000 7f120a374700 1 -- 172.21.15.196:0/4196886281 wait complete. 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 Processor -- start 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 -- start start 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1204102220 0x7f120419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102b70 0x7f120419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12041057d0 0x7f12041a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f120410fc90 con 0x7f1204102220 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f120410fb10 con 0x7f12041057d0 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f120a374700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f120410fe10 con 0x7f1204102b70 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f12037fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102b70 0x7f120419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f1203fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1204102220 0x7f120419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f12037fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102b70 0x7f120419ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:46684/0 (socket says 172.21.15.196:46684) 2024-04-25T11:18:15.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f12037fe700 1 -- 172.21.15.196:0/653057927 learned_addr learned my addr 172.21.15.196:0/653057927 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:18:15.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.815+0000 7f1208911700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12041057d0 0x7f12041a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12037fe700 1 -- 172.21.15.196:0/653057927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12041057d0 msgr2=0x7f12041a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12037fe700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12041057d0 0x7f12041a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12037fe700 1 -- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1204102220 msgr2=0x7f120419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12037fe700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1204102220 0x7f120419a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12037fe700 1 -- 172.21.15.196:0/653057927 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12041a22d0 con 0x7f1204102b70 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f1203fff700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1204102220 0x7f120419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12037fe700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102b70 0x7f120419ad40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006010 tx=0x7f11f80047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12017fa700 1 -- 172.21.15.196:0/653057927 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8027070 con 0x7f1204102b70 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12041a2560 con 0x7f1204102b70 2024-04-25T11:18:15.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12017fa700 1 -- 172.21.15.196:0/653057927 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11f8004000 con 0x7f1204102b70 2024-04-25T11:18:15.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f12017fa700 1 -- 172.21.15.196:0/653057927 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8022d30 con 0x7f1204102b70 2024-04-25T11:18:15.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.816+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12041a29b0 con 0x7f1204102b70 2024-04-25T11:18:15.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.817+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1204051190 con 0x7f1204102b70 2024-04-25T11:18:15.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.819+0000 7f12017fa700 1 -- 172.21.15.196:0/653057927 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f11f802a070 con 0x7f1204102b70 2024-04-25T11:18:15.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.819+0000 7f12017fa700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f11ec0afb80 0x7f11ec0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:15.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.819+0000 7f12017fa700 1 -- 172.21.15.196:0/653057927 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7f11f80dec50 con 0x7f1204102b70 2024-04-25T11:18:15.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.820+0000 7f1203fff700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f11ec0afb80 0x7f11ec0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:15.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.820+0000 7f1203fff700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f11ec0afb80 0x7f11ec0b2090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f120406bfb0 tx=0x7f11f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:18:15.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:15.823+0000 7f12017fa700 1 -- 172.21.15.196:0/653057927 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f11f8013070 con 0x7f1204102b70 2024-04-25T11:18:16.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:16.029+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1204063b90 con 0x7f11ec0afb80 2024-04-25T11:18:16.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:16 smithi080 ceph-mon[29126]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:16.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:18:16.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:18:16.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:16.635 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:16 smithi196 ceph-mon[32659]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:16.635 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:18:16.635 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:18:16.635 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:16.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:16 smithi082 ceph-mon[32440]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:16.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:18:16.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:18:16.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:17.622 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:17 smithi196 ceph-mon[32659]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:18:17.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:17 smithi080 ceph-mon[29126]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:18:17.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:17 smithi082 ceph-mon[32440]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:18:18.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:18 smithi196 ceph-mon[32659]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:18.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:18 smithi080 ceph-mon[29126]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:18.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:18 smithi082 ceph-mon[32440]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:19.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/496721794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]: dispatch 2024-04-25T11:18:19.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:19 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]: dispatch 2024-04-25T11:18:19.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:19 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]': finished 2024-04-25T11:18:19.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:19 smithi080 ceph-mon[29126]: osdmap e34: 6 total, 5 up, 6 in 2024-04-25T11:18:19.635 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:19.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/496721794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]: dispatch 2024-04-25T11:18:19.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:19 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]: dispatch 2024-04-25T11:18:19.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:19 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]': finished 2024-04-25T11:18:19.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:19 smithi196 ceph-mon[32659]: osdmap e34: 6 total, 5 up, 6 in 2024-04-25T11:18:19.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:19.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/496721794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]: dispatch 2024-04-25T11:18:19.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:19 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]: dispatch 2024-04-25T11:18:19.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:19 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7a50804-7087-46cc-b4fb-0f6487dc15e2"}]': finished 2024-04-25T11:18:19.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:19 smithi082 ceph-mon[32440]: osdmap e34: 6 total, 5 up, 6 in 2024-04-25T11:18:19.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:20.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:20 smithi080 ceph-mon[29126]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:20.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/3622556605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:18:20.667 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:20 smithi082 ceph-mon[32440]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:20.668 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/3622556605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:18:20.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:20 smithi196 ceph-mon[32659]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:20.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/3622556605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:18:22.574 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:22 smithi196 ceph-mon[32659]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:22.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:22 smithi080 ceph-mon[29126]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:22.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:22 smithi082 ceph-mon[32440]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:24 smithi196 ceph-mon[32659]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:24.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:24 smithi080 ceph-mon[29126]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:24.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:24 smithi082 ceph-mon[32440]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:26.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:26 smithi080 ceph-mon[29126]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:26.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:26 smithi196 ceph-mon[32659]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:26.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:26 smithi082 ceph-mon[32440]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:27.592 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T11:18:27.592 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:27.592 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:27 smithi196 ceph-mon[32659]: Deploying daemon osd.5 on smithi196 2024-04-25T11:18:27.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T11:18:27.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:27.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:27 smithi080 ceph-mon[29126]: Deploying daemon osd.5 on smithi196 2024-04-25T11:18:27.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T11:18:27.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:27.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:27 smithi082 ceph-mon[32440]: Deploying daemon osd.5 on smithi196 2024-04-25T11:18:28.615 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:28 smithi196 ceph-mon[32659]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:28.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:28 smithi080 ceph-mon[29126]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:28.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:28 smithi082 ceph-mon[32440]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:30.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:30 smithi196 ceph-mon[32659]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:30.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:30 smithi080 ceph-mon[29126]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:30.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:30 smithi082 ceph-mon[32440]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:32.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:32 smithi080 ceph-mon[29126]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:32.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:32 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:32.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:32 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:32.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:32 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:32 smithi196 ceph-mon[32659]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:32 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:32.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:32 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:32.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:32 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:32.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:32 smithi082 ceph-mon[32440]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:32.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:32 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:32.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:32 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:32.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:32 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:34.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:34 smithi080 ceph-mon[29126]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:34.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:34 smithi196 ceph-mon[32659]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:34.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:34 smithi082 ceph-mon[32440]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:35.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.996+0000 7f12017fa700 1 -- 172.21.15.196:0/653057927 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1204063b90 con 0x7f11ec0afb80 2024-04-25T11:18:35.996 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 5 on host 'smithi196' 2024-04-25T11:18:35.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f11ec0afb80 msgr2=0x7f11ec0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:35.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f11ec0afb80 0x7f11ec0b2090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f120406bfb0 tx=0x7f11f400b410 comp rx=0 tx=0).stop 2024-04-25T11:18:35.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102b70 msgr2=0x7f120419ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:35.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102b70 0x7f120419ad40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006010 tx=0x7f11f80047b0 comp rx=0 tx=0).stop 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 shutdown_connections 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f11ec0afb80 0x7f11ec0b2090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12041057d0 0x7f12041a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1204102220 0x7f120419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 --2- 172.21.15.196:0/653057927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1204102b70 0x7f120419ad40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 >> 172.21.15.196:0/653057927 conn(0x7f12040fdef0 msgr2=0x7f1204108770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 shutdown_connections 2024-04-25T11:18:35.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:18:35.999+0000 7f120a374700 1 -- 172.21.15.196:0/653057927 wait complete. 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T11:18:36.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:36 smithi080 ceph-mon[29126]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T11:18:36.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:36.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T11:18:36.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:36 smithi196 ceph-mon[32659]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T11:18:36.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:36.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:36.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T11:18:36.750 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:36 smithi082 ceph-mon[32440]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T11:18:36.786 DEBUG:teuthology.orchestra.run.smithi196:osd.5> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.5.service 2024-04-25T11:18:36.788 INFO:tasks.cephadm:Deploying osd.6 on smithi080 with /dev/vg_nvme/lv_2... 2024-04-25T11:18:36.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T11:18:37.040 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:18:38.234 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:18:38.004+0000 7f242b6ea700 -1 osd.5 0 waiting for initial osdmap 2024-04-25T11:18:38.234 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:18:38.012+0000 7f242749f700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:18:38.234 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-mon[32659]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T11:18:38.234 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-mon[32659]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T11:18:38.234 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-mon[32659]: from='osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:18:38.234 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:38.234 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-mon[32659]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:18:38.235 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:38 smithi196 ceph-mon[32659]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:38.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:38 smithi080 ceph-mon[29126]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T11:18:38.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:38 smithi080 ceph-mon[29126]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T11:18:38.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:38 smithi080 ceph-mon[29126]: from='osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:18:38.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:38 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:38.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:38 smithi080 ceph-mon[29126]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:18:38.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:38 smithi080 ceph-mon[29126]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:38.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:38 smithi082 ceph-mon[32440]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T11:18:38.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:38 smithi082 ceph-mon[32440]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T11:18:38.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:38 smithi082 ceph-mon[32440]: from='osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:18:38.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:38 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:38.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:38 smithi082 ceph-mon[32440]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:18:38.500 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:38 smithi082 ceph-mon[32440]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-04-25T11:18:39.136 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T11:18:39.136 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T11:18:39.136 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-25T11:18:39.136 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-25T11:18:39.137 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122657 s, 855 MB/s 2024-04-25T11:18:39.137 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-25T11:18:39.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:39 smithi080 ceph-mon[29126]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:18:39.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:39 smithi080 ceph-mon[29126]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T11:18:39.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:39 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:39.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:39 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:39.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:39 smithi196 ceph-mon[32659]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:18:39.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:39 smithi196 ceph-mon[32659]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T11:18:39.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:39 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:39.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:39 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:39.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:39 smithi082 ceph-mon[32440]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:18:39.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:39 smithi082 ceph-mon[32440]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T11:18:39.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:39 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:39.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:39 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:39.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2024-04-25T11:18:40.076 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] boot 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: osdmap e37: 6 total, 6 up, 6 in 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:40.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:40.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:40.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:40.135 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.195 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:18:40.195 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] boot 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: osdmap e37: 6 total, 6 up, 6 in 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:40.196 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:18:40.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:18:40.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: osd.5 [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] boot 2024-04-25T11:18:40.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: osdmap e37: 6 total, 6 up, 6 in 2024-04-25T11:18:40.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:18:40.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:40.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:40.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:18:40.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:40.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:40.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:18:40.250 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:41.111 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:41 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi196 2024-04-25T11:18:41.111 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:41 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi196 to 8544M 2024-04-25T11:18:41.111 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:41 smithi080 ceph-mon[29126]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T11:18:41.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:41 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi196 2024-04-25T11:18:41.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:41 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi196 to 8544M 2024-04-25T11:18:41.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:41 smithi196 ceph-mon[32659]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T11:18:41.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:41 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi196 2024-04-25T11:18:41.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:41 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi196 to 8544M 2024-04-25T11:18:41.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:41 smithi082 ceph-mon[32440]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T11:18:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 -- 172.21.15.80:0/1424491556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 msgr2=0x7f7a2c103ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 --2- 172.21.15.80:0/1424491556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c103ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009990 tx=0x7f7a20009ca0 comp rx=0 tx=0).stop 2024-04-25T11:18:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 -- 172.21.15.80:0/1424491556 shutdown_connections 2024-04-25T11:18:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 --2- 172.21.15.80:0/1424491556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2c104ba0 0x7f7a2c10b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 --2- 172.21.15.80:0/1424491556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c103ab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 --2- 172.21.15.80:0/1424491556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c104080 0x7f7a2c104510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 -- 172.21.15.80:0/1424491556 >> 172.21.15.80:0/1424491556 conn(0x7f7a2c0fded0 msgr2=0x7f7a2c100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 -- 172.21.15.80:0/1424491556 shutdown_connections 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 -- 172.21.15.80:0/1424491556 wait complete. 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 Processor -- start 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.654+0000 7f7a33101700 1 -- start start 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a33101700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a33101700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c104080 0x7f7a2c19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a33101700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2c104ba0 0x7f7a2c1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a33101700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c10fcf0 con 0x7f7a2c1036a0 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a33101700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c10fb70 con 0x7f7a2c104080 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a33101700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c10fe70 con 0x7f7a2c104ba0 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c19a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56084/0 (socket says 172.21.15.80:56084) 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 -- 172.21.15.80:0/3488100947 learned_addr learned my addr 172.21.15.80:0/3488100947 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a2bfff700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c104080 0x7f7a2c19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a3169e700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2c104ba0 0x7f7a2c1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 -- 172.21.15.80:0/3488100947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2c104ba0 msgr2=0x7f7a2c1a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2c104ba0 0x7f7a2c1a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 -- 172.21.15.80:0/3488100947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c104080 msgr2=0x7f7a2c19ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c104080 0x7f7a2c19ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 -- 172.21.15.80:0/3488100947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2c1a2320 con 0x7f7a2c1036a0 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a30e9d700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c19a7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a20006010 tx=0x7f7a200047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a29ffb700 1 -- 172.21.15.80:0/3488100947 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20026070 con 0x7f7a2c1036a0 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2c1a25b0 con 0x7f7a2c1036a0 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a29ffb700 1 -- 172.21.15.80:0/3488100947 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a20021410 con 0x7f7a2c1036a0 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.655+0000 7f7a29ffb700 1 -- 172.21.15.80:0/3488100947 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20017650 con 0x7f7a2c1036a0 2024-04-25T11:18:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.656+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a2c1a2a10 con 0x7f7a2c1036a0 2024-04-25T11:18:41.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.657+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2c051190 con 0x7f7a2c1036a0 2024-04-25T11:18:41.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.658+0000 7f7a29ffb700 1 -- 172.21.15.80:0/3488100947 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f7a20029070 con 0x7f7a2c1036a0 2024-04-25T11:18:41.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.659+0000 7f7a29ffb700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7a1c0afb80 0x7f7a1c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:18:41.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.659+0000 7f7a2bfff700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7a1c0afb80 0x7f7a1c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:18:41.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.659+0000 7f7a29ffb700 1 -- 172.21.15.80:0/3488100947 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7f7a200df240 con 0x7f7a2c1036a0 2024-04-25T11:18:41.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.659+0000 7f7a2bfff700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7a1c0afb80 0x7f7a1c0b2090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c19b870 tx=0x7f7a1800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:18:41.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.663+0000 7f7a29ffb700 1 -- 172.21.15.80:0/3488100947 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7a20030020 con 0x7f7a2c1036a0 2024-04-25T11:18:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:18:41.871+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7a2c063ad0 con 0x7f7a1c0afb80 2024-04-25T11:18:42.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:42 smithi080 ceph-mon[29126]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T11:18:42.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:42 smithi080 ceph-mon[29126]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:42.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:18:42.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:18:42.134 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:42.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:42 smithi196 ceph-mon[32659]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T11:18:42.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:42 smithi196 ceph-mon[32659]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:42.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:18:42.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:18:42.446 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:42.501 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:42 smithi082 ceph-mon[32440]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T11:18:42.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:42 smithi082 ceph-mon[32440]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:42.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:18:42.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:18:42.502 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:43.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:43 smithi080 ceph-mon[29126]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:18:43.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:43 smithi196 ceph-mon[32659]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:18:43.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:43 smithi082 ceph-mon[32440]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:18:44.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:44 smithi080 ceph-mon[29126]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:44.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:44 smithi196 ceph-mon[32659]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:44.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:44 smithi082 ceph-mon[32440]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:45.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:45 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1173706540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd84057a-f5a0-4027-9b4e-e6948e1aa055"}]: dispatch 2024-04-25T11:18:45.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:45 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1173706540' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd84057a-f5a0-4027-9b4e-e6948e1aa055"}]': finished 2024-04-25T11:18:45.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:45 smithi080 ceph-mon[29126]: osdmap e40: 7 total, 6 up, 7 in 2024-04-25T11:18:45.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:18:45.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:45 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1173706540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd84057a-f5a0-4027-9b4e-e6948e1aa055"}]: dispatch 2024-04-25T11:18:45.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:45 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1173706540' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd84057a-f5a0-4027-9b4e-e6948e1aa055"}]': finished 2024-04-25T11:18:45.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:45 smithi196 ceph-mon[32659]: osdmap e40: 7 total, 6 up, 7 in 2024-04-25T11:18:45.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:18:45.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:45 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1173706540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd84057a-f5a0-4027-9b4e-e6948e1aa055"}]: dispatch 2024-04-25T11:18:45.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:45 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1173706540' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd84057a-f5a0-4027-9b4e-e6948e1aa055"}]': finished 2024-04-25T11:18:45.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:45 smithi082 ceph-mon[32440]: osdmap e40: 7 total, 6 up, 7 in 2024-04-25T11:18:45.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:45 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:18:46.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:46 smithi080 ceph-mon[29126]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:18:46.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:46 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3430774378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:18:46.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:46 smithi196 ceph-mon[32659]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:18:46.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:46 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3430774378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:18:46.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:46 smithi082 ceph-mon[32440]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:18:46.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:46 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3430774378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:18:48.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:48 smithi080 ceph-mon[29126]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T11:18:48.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:48 smithi196 ceph-mon[32659]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T11:18:48.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:48 smithi082 ceph-mon[32440]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T11:18:50.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:50 smithi082 ceph-mon[32440]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T11:18:50.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:50 smithi080 ceph-mon[29126]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T11:18:50.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:50 smithi196 ceph-mon[32659]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T11:18:52.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:52 smithi080 ceph-mon[29126]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:52.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:52 smithi196 ceph-mon[32659]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:52.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:52 smithi082 ceph-mon[32440]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:53.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:53 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T11:18:53.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:53 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:53.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:53 smithi080 ceph-mon[29126]: Deploying daemon osd.6 on smithi080 2024-04-25T11:18:53.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:53 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T11:18:53.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:53 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:53.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:53 smithi196 ceph-mon[32659]: Deploying daemon osd.6 on smithi080 2024-04-25T11:18:53.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:53 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T11:18:53.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:53 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:18:53.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:53 smithi082 ceph-mon[32440]: Deploying daemon osd.6 on smithi080 2024-04-25T11:18:54.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:54 smithi080 ceph-mon[29126]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:54.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:54 smithi196 ceph-mon[32659]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:54.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:54 smithi082 ceph-mon[32440]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:18:56.576 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:56 smithi080 ceph-mon[29126]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:56.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:56 smithi196 ceph-mon[32659]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:56.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:56 smithi082 ceph-mon[32440]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:58.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:58 smithi080 ceph-mon[29126]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:58.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:58 smithi196 ceph-mon[32659]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:58.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:58 smithi082 ceph-mon[32440]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:59.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:59.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:59.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:59.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:18:59 smithi080 ceph-mon[29126]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:59.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:59.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:59.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:59.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:18:59 smithi196 ceph-mon[32659]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:18:59.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:59.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:18:59.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:18:59.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:18:59 smithi082 ceph-mon[32440]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:02.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:02 smithi080 ceph-mon[29126]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:02.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:02 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:02 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:02 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:02.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:02 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:02.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:02 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:02 smithi196 ceph-mon[32659]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:02.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:02 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:02 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:02 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:02.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:02 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:02.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:02 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.729 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 6 on host 'smithi080' 2024-04-25T11:19:02.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.729+0000 7f7a29ffb700 1 -- 172.21.15.80:0/3488100947 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7a2c063ad0 con 0x7f7a1c0afb80 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7a1c0afb80 msgr2=0x7f7a1c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7a1c0afb80 0x7f7a1c0b2090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c19b870 tx=0x7f7a1800b410 comp rx=0 tx=0).stop 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 msgr2=0x7f7a2c19a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c19a7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a20006010 tx=0x7f7a200047b0 comp rx=0 tx=0).stop 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 shutdown_connections 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7a1c0afb80 0x7f7a1c0b2090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2c104ba0 0x7f7a2c1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a2c1036a0 0x7f7a2c19a7c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:02.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 --2- 172.21.15.80:0/3488100947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c104080 0x7f7a2c19ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:02.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 >> 172.21.15.80:0/3488100947 conn(0x7f7a2c0fded0 msgr2=0x7f7a2c107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:19:02.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 shutdown_connections 2024-04-25T11:19:02.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:19:02.732+0000 7f7a33101700 1 -- 172.21.15.80:0/3488100947 wait complete. 2024-04-25T11:19:02.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:02 smithi082 ceph-mon[32440]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:02.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:02 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:02 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:02.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:02 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:02.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:02 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:02.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:02 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:03 smithi080 ceph-mon[29126]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T11:19:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:03.385 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:03.528 DEBUG:teuthology.orchestra.run.smithi080:osd.6> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.6.service 2024-04-25T11:19:03.530 INFO:tasks.cephadm:Deploying osd.7 on smithi082 with /dev/vg_nvme/lv_2... 2024-04-25T11:19:03.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T11:19:03.557 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:03 smithi082 ceph-mon[32440]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T11:19:03.557 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:03.557 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:03.557 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:03.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:03 smithi196 ceph-mon[32659]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T11:19:03.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:03.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:03.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:03.777 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:19:04.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:04 smithi082 ceph-mon[32440]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:04.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:04 smithi082 ceph-mon[32440]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T11:19:04.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:04 smithi082 ceph-mon[32440]: osdmap e41: 7 total, 6 up, 7 in 2024-04-25T11:19:04.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:04 smithi082 ceph-mon[32440]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:19:04.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:04.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:04 smithi080 ceph-mon[29126]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:04.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:04 smithi080 ceph-mon[29126]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T11:19:04.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:04 smithi080 ceph-mon[29126]: osdmap e41: 7 total, 6 up, 7 in 2024-04-25T11:19:04.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:04 smithi080 ceph-mon[29126]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:19:04.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:04.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:04 smithi196 ceph-mon[32659]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:04.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:04 smithi196 ceph-mon[32659]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T11:19:04.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:04 smithi196 ceph-mon[32659]: osdmap e41: 7 total, 6 up, 7 in 2024-04-25T11:19:04.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:04 smithi196 ceph-mon[32659]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:19:04.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:05.030 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:19:04 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:19:04.760+0000 7fad688c1700 -1 osd.6 0 waiting for initial osdmap 2024-04-25T11:19:05.031 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:19:04 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:19:04.769+0000 7fad6066e700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:19:05.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:05 smithi080 ceph-mon[29126]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:19:05.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:05 smithi080 ceph-mon[29126]: osdmap e42: 7 total, 6 up, 7 in 2024-04-25T11:19:05.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:05.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:05.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:05 smithi080 ceph-mon[29126]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' 2024-04-25T11:19:05.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:05 smithi196 ceph-mon[32659]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:19:05.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:05 smithi196 ceph-mon[32659]: osdmap e42: 7 total, 6 up, 7 in 2024-04-25T11:19:05.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:05.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:05.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:05 smithi196 ceph-mon[32659]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' 2024-04-25T11:19:05.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:05 smithi082 ceph-mon[32440]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:19:05.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:05 smithi082 ceph-mon[32440]: osdmap e42: 7 total, 6 up, 7 in 2024-04-25T11:19:05.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:05.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:05.749 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:05 smithi082 ceph-mon[32440]: from='osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562]' entity='osd.6' 2024-04-25T11:19:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T11:19:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T11:19:05.860 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-25T11:19:05.860 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-25T11:19:05.860 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113137 s, 927 MB/s 2024-04-25T11:19:05.860 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-25T11:19:06.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:06 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:19:06.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:06 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:19:06.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:06 smithi080 ceph-mon[29126]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:06.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:06.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:06 smithi080 ceph-mon[29126]: osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] boot 2024-04-25T11:19:06.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:06 smithi080 ceph-mon[29126]: osdmap e43: 7 total, 7 up, 7 in 2024-04-25T11:19:06.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:06 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:06.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:06 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:19:06.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:06 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:19:06.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:06 smithi196 ceph-mon[32659]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:06.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:06.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:06 smithi196 ceph-mon[32659]: osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] boot 2024-04-25T11:19:06.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:06 smithi196 ceph-mon[32659]: osdmap e43: 7 total, 7 up, 7 in 2024-04-25T11:19:06.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:06 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:06.658 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:06 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:19:06.658 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:06 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:19:06.658 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:06 smithi082 ceph-mon[32440]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-04-25T11:19:06.658 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:06.658 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:06 smithi082 ceph-mon[32440]: osd.6 [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] boot 2024-04-25T11:19:06.659 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:06 smithi082 ceph-mon[32440]: osdmap e43: 7 total, 7 up, 7 in 2024-04-25T11:19:06.659 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:06 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:19:06.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-04-25T11:19:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:19:08.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi080 2024-04-25T11:19:08.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:08.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:07 smithi082 ceph-mon[32440]: osdmap e44: 7 total, 7 up, 7 in 2024-04-25T11:19:08.315 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi080 2024-04-25T11:19:08.315 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:08.316 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:07 smithi196 ceph-mon[32659]: osdmap e44: 7 total, 7 up, 7 in 2024-04-25T11:19:08.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi080 2024-04-25T11:19:08.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:08.384 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:07 smithi080 ceph-mon[29126]: osdmap e44: 7 total, 7 up, 7 in 2024-04-25T11:19:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.708+0000 7ff96cf49700 1 -- 172.21.15.82:0/281141760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff968105880 msgr2=0x7ff968105c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.708+0000 7ff96cf49700 1 --2- 172.21.15.82:0/281141760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff968105880 0x7ff968105c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009990 tx=0x7ff95c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:19:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 -- 172.21.15.82:0/281141760 shutdown_connections 2024-04-25T11:19:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 --2- 172.21.15.82:0/281141760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9681048b0 0x7ff96810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 --2- 172.21.15.82:0/281141760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff968105880 0x7ff968105c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 --2- 172.21.15.82:0/281141760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff968103e30 0x7ff968104240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 -- 172.21.15.82:0/281141760 >> 172.21.15.82:0/281141760 conn(0x7ff9680ff8a0 msgr2=0x7ff968101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 -- 172.21.15.82:0/281141760 shutdown_connections 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 -- 172.21.15.82:0/281141760 wait complete. 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 Processor -- start 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.709+0000 7ff96cf49700 1 -- start start 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96cf49700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff968103e30 0x7ff96819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96cf49700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9681048b0 0x7ff96819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96cf49700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff968105880 0x7ff9681a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96cf49700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff96810fdc0 con 0x7ff968103e30 2024-04-25T11:19:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96cf49700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff96810fc40 con 0x7ff9681048b0 2024-04-25T11:19:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96cf49700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff96810ff40 con 0x7ff968105880 2024-04-25T11:19:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9681048b0 0x7ff96819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9681048b0 0x7ff96819ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55474/0 (socket says 172.21.15.82:55474) 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 -- 172.21.15.82:0/1365945772 learned_addr learned my addr 172.21.15.82:0/1365945772 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96659c700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff968103e30 0x7ff96819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff966d9d700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff968105880 0x7ff9681a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 -- 172.21.15.82:0/1365945772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff968105880 msgr2=0x7ff9681a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff968105880 0x7ff9681a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 -- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff968103e30 msgr2=0x7ff96819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff968103e30 0x7ff96819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 -- 172.21.15.82:0/1365945772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9681a2440 con 0x7ff9681048b0 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff966d9d700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff968105880 0x7ff9681a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff965d9b700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9681048b0 0x7ff96819ae20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e9c0 tx=0x7ff95800ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff9577fe700 1 -- 172.21.15.82:0/1365945772 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95800cbd0 con 0x7ff9681048b0 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff9577fe700 1 -- 172.21.15.82:0/1365945772 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff95800cd70 con 0x7ff9681048b0 2024-04-25T11:19:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9681a2730 con 0x7ff9681048b0 2024-04-25T11:19:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.710+0000 7ff9577fe700 1 -- 172.21.15.82:0/1365945772 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958010430 con 0x7ff9681048b0 2024-04-25T11:19:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.711+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9681a2c20 con 0x7ff9681048b0 2024-04-25T11:19:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.711+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff968051190 con 0x7ff9681048b0 2024-04-25T11:19:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.714+0000 7ff9577fe700 1 -- 172.21.15.82:0/1365945772 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7ff958004750 con 0x7ff9681048b0 2024-04-25T11:19:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.714+0000 7ff9577fe700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9500afb80 0x7ff9500b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.714+0000 7ff9577fe700 1 -- 172.21.15.82:0/1365945772 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7ff9580de500 con 0x7ff9681048b0 2024-04-25T11:19:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.715+0000 7ff96659c700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9500afb80 0x7ff9500b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.715+0000 7ff96659c700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9500afb80 0x7ff9500b2090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b760 tx=0x7ff95c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:19:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.718+0000 7ff9577fe700 1 -- 172.21.15.82:0/1365945772 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff958053ff0 con 0x7ff9681048b0 2024-04-25T11:19:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:08.924+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff96802e8f0 con 0x7ff9500afb80 2024-04-25T11:19:09.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:19:09.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:19:09.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:09.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:19:09.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:19:09.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:09.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:19:09.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:19:09.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:10.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:10 smithi082 ceph-mon[32440]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:19:10.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:10 smithi082 ceph-mon[32440]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:10.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:10 smithi080 ceph-mon[29126]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:19:10.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:10 smithi080 ceph-mon[29126]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:10.444 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:10 smithi196 ceph-mon[32659]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:19:10.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:10 smithi196 ceph-mon[32659]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:12.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:12 smithi082 ceph-mon[32440]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:12.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:12 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/4146535161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]: dispatch 2024-04-25T11:19:12.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:12 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]: dispatch 2024-04-25T11:19:12.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:12 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]': finished 2024-04-25T11:19:12.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:12 smithi082 ceph-mon[32440]: osdmap e45: 8 total, 7 up, 8 in 2024-04-25T11:19:12.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:12.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:12 smithi080 ceph-mon[29126]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:12.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:12 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/4146535161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]: dispatch 2024-04-25T11:19:12.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:12 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]: dispatch 2024-04-25T11:19:12.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:12 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]': finished 2024-04-25T11:19:12.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:12 smithi080 ceph-mon[29126]: osdmap e45: 8 total, 7 up, 8 in 2024-04-25T11:19:12.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:12.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:12 smithi196 ceph-mon[32659]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:12.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:12 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/4146535161' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]: dispatch 2024-04-25T11:19:12.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:12 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]: dispatch 2024-04-25T11:19:12.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:12 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "854ef90b-8feb-45c3-a5c9-175a69bf967d"}]': finished 2024-04-25T11:19:12.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:12 smithi196 ceph-mon[32659]: osdmap e45: 8 total, 7 up, 8 in 2024-04-25T11:19:12.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:13.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/1855833376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:19:13.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/1855833376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:19:13.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/1855833376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:19:14.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:14 smithi080 ceph-mon[29126]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:14.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:14 smithi196 ceph-mon[32659]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:14.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:14 smithi082 ceph-mon[32440]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:16.498 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:16 smithi082 ceph-mon[32440]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:16.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:16 smithi080 ceph-mon[29126]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:16.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:16 smithi196 ceph-mon[32659]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:18.468 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:18 smithi082 ceph-mon[32440]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:18.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:18 smithi080 ceph-mon[29126]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:18.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:18 smithi196 ceph-mon[32659]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:19.498 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T11:19:19.498 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:19.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T11:19:19.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:19.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T11:19:19.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:20.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:20 smithi080 ceph-mon[29126]: Deploying daemon osd.7 on smithi082 2024-04-25T11:19:20.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:20 smithi080 ceph-mon[29126]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:20.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:20 smithi196 ceph-mon[32659]: Deploying daemon osd.7 on smithi082 2024-04-25T11:19:20.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:20 smithi196 ceph-mon[32659]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:20.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:20 smithi082 ceph-mon[32440]: Deploying daemon osd.7 on smithi082 2024-04-25T11:19:20.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:20 smithi082 ceph-mon[32440]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:22.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:22 smithi082 ceph-mon[32440]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:22.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:22 smithi080 ceph-mon[29126]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:22.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:22 smithi196 ceph-mon[32659]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:24.436 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:24 smithi082 ceph-mon[32440]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:24.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:24 smithi080 ceph-mon[29126]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:24.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:24 smithi196 ceph-mon[32659]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:25.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:25.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:25.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:25.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:25.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:25.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:25.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:25.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:25.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:26.588 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:26 smithi082 ceph-mon[32440]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:26.621 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:26 smithi080 ceph-mon[29126]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:26.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:26 smithi196 ceph-mon[32659]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:28.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:28 smithi080 ceph-mon[29126]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:28.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:28.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:28.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:28 smithi196 ceph-mon[32659]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:28.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:28.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:28.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.715 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:28 smithi082 ceph-mon[32440]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:28.715 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.715 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:28.715 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:28.715 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:28.715 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:29.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.092+0000 7ff9577fe700 1 -- 172.21.15.82:0/1365945772 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff96802e8f0 con 0x7ff9500afb80 2024-04-25T11:19:29.090 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 7 on host 'smithi082' 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9500afb80 msgr2=0x7ff9500b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9500afb80 0x7ff9500b2090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b760 tx=0x7ff95c005fb0 comp rx=0 tx=0).stop 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9681048b0 msgr2=0x7ff96819ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9681048b0 0x7ff96819ae20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e9c0 tx=0x7ff95800ed80 comp rx=0 tx=0).stop 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 shutdown_connections 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9500afb80 0x7ff9500b2090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff968105880 0x7ff9681a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff968103e30 0x7ff96819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 --2- 172.21.15.82:0/1365945772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9681048b0 0x7ff96819ae20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 >> 172.21.15.82:0/1365945772 conn(0x7ff9680ff8a0 msgr2=0x7ff9681085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:19:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 shutdown_connections 2024-04-25T11:19:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:19:29.094+0000 7ff96cf49700 1 -- 172.21.15.82:0/1365945772 wait complete. 2024-04-25T11:19:29.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:29 smithi080 ceph-mon[29126]: from='osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T11:19:29.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:29 smithi080 ceph-mon[29126]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T11:19:29.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:29.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:29.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:29 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:29.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:29 smithi196 ceph-mon[32659]: from='osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T11:19:29.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:29 smithi196 ceph-mon[32659]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T11:19:29.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:29.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:29.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:29 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:29.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:29 smithi082 ceph-mon[32440]: from='osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T11:19:29.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:29 smithi082 ceph-mon[32440]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T11:19:29.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:29.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:29.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:29 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:29.795 DEBUG:teuthology.orchestra.run.smithi082:osd.7> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.7.service 2024-04-25T11:19:29.798 INFO:tasks.cephadm:Deploying osd.8 on smithi196 with /dev/vg_nvme/lv_2... 2024-04-25T11:19:29.798 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T11:19:30.044 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:19:30.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:30 smithi196 ceph-mon[32659]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:30.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:30 smithi196 ceph-mon[32659]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T11:19:30.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:30 smithi196 ceph-mon[32659]: osdmap e46: 8 total, 7 up, 8 in 2024-04-25T11:19:30.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:30 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:30.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:30 smithi196 ceph-mon[32659]: from='osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:19:30.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:30 smithi196 ceph-mon[32659]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:19:30.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:30 smithi080 ceph-mon[29126]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:30.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:30 smithi080 ceph-mon[29126]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T11:19:30.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:30 smithi080 ceph-mon[29126]: osdmap e46: 8 total, 7 up, 8 in 2024-04-25T11:19:30.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:30 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:30.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:30 smithi080 ceph-mon[29126]: from='osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:19:30.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:30 smithi080 ceph-mon[29126]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:19:30.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-mon[32440]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:30.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-mon[32440]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T11:19:30.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-mon[32440]: osdmap e46: 8 total, 7 up, 8 in 2024-04-25T11:19:30.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:30.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-mon[32440]: from='osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:19:30.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-mon[32440]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:19:31.052 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:19:30.773+0000 7f50478d4700 -1 osd.7 0 waiting for initial osdmap 2024-04-25T11:19:31.052 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:19:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:19:30.782+0000 7f503f681700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:19:31.444 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:31 smithi196 ceph-mon[32659]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:19:31.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:31 smithi196 ceph-mon[32659]: osdmap e47: 8 total, 7 up, 8 in 2024-04-25T11:19:31.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:31 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:31.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:31 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:31.445 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:31 smithi196 ceph-mon[32659]: from='osd.7 ' entity='osd.7' 2024-04-25T11:19:31.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:31 smithi080 ceph-mon[29126]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:19:31.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:31 smithi080 ceph-mon[29126]: osdmap e47: 8 total, 7 up, 8 in 2024-04-25T11:19:31.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:31 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:31.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:31 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:31.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:31 smithi080 ceph-mon[29126]: from='osd.7 ' entity='osd.7' 2024-04-25T11:19:31.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:31 smithi082 ceph-mon[32440]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:19:31.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:31 smithi082 ceph-mon[32440]: osdmap e47: 8 total, 7 up, 8 in 2024-04-25T11:19:31.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:31 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:31.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:31 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:31.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:31 smithi082 ceph-mon[32440]: from='osd.7 ' entity='osd.7' 2024-04-25T11:19:32.067 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T11:19:32.067 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T11:19:32.067 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-25T11:19:32.067 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-25T11:19:32.067 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128405 s, 817 MB/s 2024-04-25T11:19:32.067 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-25T11:19:32.498 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:32 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:19:32.498 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:32 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:19:32.498 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:32 smithi082 ceph-mon[32440]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:32.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:32 smithi082 ceph-mon[32440]: osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] boot 2024-04-25T11:19:32.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:32 smithi082 ceph-mon[32440]: osdmap e48: 8 total, 8 up, 8 in 2024-04-25T11:19:32.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:32 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:32.499 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:32 smithi082 ceph-mon[32440]: osdmap e49: 8 total, 8 up, 8 in 2024-04-25T11:19:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:32 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:19:32.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:32 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:19:32.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:32 smithi080 ceph-mon[29126]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:32.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:32 smithi080 ceph-mon[29126]: osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] boot 2024-04-25T11:19:32.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:32 smithi080 ceph-mon[29126]: osdmap e48: 8 total, 8 up, 8 in 2024-04-25T11:19:32.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:32 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:32.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:32 smithi080 ceph-mon[29126]: osdmap e49: 8 total, 8 up, 8 in 2024-04-25T11:19:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:32 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:19:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:32 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:19:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:32 smithi196 ceph-mon[32659]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-25T11:19:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:32 smithi196 ceph-mon[32659]: osd.7 [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] boot 2024-04-25T11:19:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:32 smithi196 ceph-mon[32659]: osdmap e48: 8 total, 8 up, 8 in 2024-04-25T11:19:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:32 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:19:32.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:32 smithi196 ceph-mon[32659]: osdmap e49: 8 total, 8 up, 8 in 2024-04-25T11:19:32.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_2 2024-04-25T11:19:33.046 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:19:34.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: osdmap e50: 8 total, 8 up, 8 in 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi082 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:33 smithi080 ceph-mon[29126]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:34.167 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: osdmap e50: 8 total, 8 up, 8 in 2024-04-25T11:19:34.167 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi082 2024-04-25T11:19:34.167 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.167 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.167 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.167 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.168 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.168 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-25T11:19:34.168 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.168 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:34.168 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:34.168 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.168 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:33 smithi196 ceph-mon[32659]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:34.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: osdmap e50: 8 total, 8 up, 8 in 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi082 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:34.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:33 smithi082 ceph-mon[32440]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 -- 172.21.15.196:0/3477477093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104bb0 msgr2=0x7fe30c10b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 --2- 172.21.15.196:0/3477477093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104bb0 0x7fe30c10b460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b0a0 tx=0x7fe30400b3b0 comp rx=0 tx=0).stop 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 -- 172.21.15.196:0/3477477093 shutdown_connections 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 --2- 172.21.15.196:0/3477477093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104bb0 0x7fe30c10b460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 --2- 172.21.15.196:0/3477477093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30c1030e0 0x7fe30c1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 --2- 172.21.15.196:0/3477477093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe30c104210 0x7fe30c104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 -- 172.21.15.196:0/3477477093 >> 172.21.15.196:0/3477477093 conn(0x7fe30c0fe740 msgr2=0x7fe30c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.694+0000 7fe3132f8700 1 -- 172.21.15.196:0/3477477093 shutdown_connections 2024-04-25T11:19:34.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 -- 172.21.15.196:0/3477477093 wait complete. 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 Processor -- start 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 -- start start 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe30c1030e0 0x7fe30c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104210 0x7fe30c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30c104bb0 0x7fe30c1a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c10eba0 con 0x7fe30c104bb0 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c10ea20 con 0x7fe30c1030e0 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.695+0000 7fe3132f8700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c10ed20 con 0x7fe30c104210 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104210 0x7fe30c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104210 0x7fe30c19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:57378/0 (socket says 172.21.15.196:57378) 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 -- 172.21.15.196:0/2560718294 learned_addr learned my addr 172.21.15.196:0/2560718294 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe311094700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe30c1030e0 0x7fe30c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe311895700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30c104bb0 0x7fe30c1a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:34.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 -- 172.21.15.196:0/2560718294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe30c1030e0 msgr2=0x7fe30c19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe30c1030e0 0x7fe30c19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 -- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30c104bb0 msgr2=0x7fe30c1a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30c104bb0 0x7fe30c1a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 -- 172.21.15.196:0/2560718294 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1a44e0 con 0x7fe30c104210 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe311895700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30c104bb0 0x7fe30c1a3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe310893700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104210 0x7fe30c19cec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c920 tx=0x7fe2fc00cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe3027fc700 1 -- 172.21.15.196:0/2560718294 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc007b00 con 0x7fe30c104210 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe3027fc700 1 -- 172.21.15.196:0/2560718294 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2fc004ce0 con 0x7fe30c104210 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe3027fc700 1 -- 172.21.15.196:0/2560718294 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc005550 con 0x7fe30c104210 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1a47d0 con 0x7fe30c104210 2024-04-25T11:19:34.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.696+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1a4d60 con 0x7fe30c104210 2024-04-25T11:19:34.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.697+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c051190 con 0x7fe30c104210 2024-04-25T11:19:34.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.700+0000 7fe3027fc700 1 -- 172.21.15.196:0/2560718294 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe2fc007ca0 con 0x7fe30c104210 2024-04-25T11:19:34.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.700+0000 7fe3027fc700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe2f80afc00 0x7fe2f80b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:19:34.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.700+0000 7fe3027fc700 1 -- 172.21.15.196:0/2560718294 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5397+0+0 (secure 0 0 0) 0x7fe2fc0ddf40 con 0x7fe30c104210 2024-04-25T11:19:34.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.701+0000 7fe311094700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe2f80afc00 0x7fe2f80b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:19:34.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.701+0000 7fe311094700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe2f80afc00 0x7fe2f80b2110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe30c104110 tx=0x7fe30800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:19:34.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.704+0000 7fe3027fc700 1 -- 172.21.15.196:0/2560718294 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe2fc014030 con 0x7fe30c104210 2024-04-25T11:19:34.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:34.911+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe30c1a4fc0 con 0x7fe2f80afc00 2024-04-25T11:19:35.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:34 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:19:35.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:34 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:19:35.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:34 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:35.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:34 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:19:35.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:34 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:19:35.249 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:34 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:35.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:19:35.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:19:35.383 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:34 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:36.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:35 smithi196 ceph-mon[32659]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:19:36.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:35 smithi196 ceph-mon[32659]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:36.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:35 smithi082 ceph-mon[32440]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:19:36.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:35 smithi082 ceph-mon[32440]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:36.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:35 smithi080 ceph-mon[29126]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:19:36.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:35 smithi080 ceph-mon[29126]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:38.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:38 smithi080 ceph-mon[29126]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:19:38.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/394512901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]: dispatch 2024-04-25T11:19:38.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:38 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]: dispatch 2024-04-25T11:19:38.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:38 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]': finished 2024-04-25T11:19:38.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:38 smithi080 ceph-mon[29126]: osdmap e51: 9 total, 8 up, 9 in 2024-04-25T11:19:38.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:38 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:38.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:38 smithi196 ceph-mon[32659]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:19:38.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/394512901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]: dispatch 2024-04-25T11:19:38.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:38 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]: dispatch 2024-04-25T11:19:38.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:38 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]': finished 2024-04-25T11:19:38.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:38 smithi196 ceph-mon[32659]: osdmap e51: 9 total, 8 up, 9 in 2024-04-25T11:19:38.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:38 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:38.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:38 smithi082 ceph-mon[32440]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:19:38.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/394512901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]: dispatch 2024-04-25T11:19:38.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:38 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]: dispatch 2024-04-25T11:19:38.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:38 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ef2bc4-8039-4330-a4eb-1c75fe5da3e0"}]': finished 2024-04-25T11:19:38.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:38 smithi082 ceph-mon[32440]: osdmap e51: 9 total, 8 up, 9 in 2024-04-25T11:19:38.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:38 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:39.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:39 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/2368853032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:19:39.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:39 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/2368853032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:19:39.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:39 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/2368853032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:19:40.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:40 smithi080 ceph-mon[29126]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T11:19:40.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:40 smithi196 ceph-mon[32659]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T11:19:40.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:40 smithi082 ceph-mon[32440]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T11:19:42.444 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:42 smithi196 ceph-mon[32659]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-25T11:19:42.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:42 smithi080 ceph-mon[29126]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-25T11:19:42.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:42 smithi082 ceph-mon[32440]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-25T11:19:44.444 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:44 smithi196 ceph-mon[32659]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:19:44.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:44 smithi080 ceph-mon[29126]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:19:44.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:44 smithi082 ceph-mon[32440]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:19:45.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T11:19:45.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:45 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:45.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T11:19:45.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:45 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:45.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:45 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T11:19:45.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:45 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:46.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:46 smithi080 ceph-mon[29126]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:19:46.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:46 smithi080 ceph-mon[29126]: Deploying daemon osd.8 on smithi196 2024-04-25T11:19:46.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:46 smithi196 ceph-mon[32659]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:19:46.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:46 smithi196 ceph-mon[32659]: Deploying daemon osd.8 on smithi196 2024-04-25T11:19:46.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:46 smithi082 ceph-mon[32440]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:19:46.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:46 smithi082 ceph-mon[32440]: Deploying daemon osd.8 on smithi196 2024-04-25T11:19:48.621 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:48 smithi196 ceph-mon[32659]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:48.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:48 smithi080 ceph-mon[29126]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:48.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:48 smithi082 ceph-mon[32440]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:50.536 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:50 smithi196 ceph-mon[32659]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:50.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:50 smithi080 ceph-mon[29126]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:50.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:50 smithi082 ceph-mon[32440]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:52.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:52 smithi080 ceph-mon[29126]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:52.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:52 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:52.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:52 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:52.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:52 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:52.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:52 smithi196 ceph-mon[32659]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:52.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:52 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:52.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:52 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:52.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:52 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:52.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:52 smithi082 ceph-mon[32440]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:52.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:52 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:52.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:52 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:52.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:52 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:54.613 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:54 smithi196 ceph-mon[32659]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:54.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:54 smithi080 ceph-mon[29126]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:54 smithi082 ceph-mon[32440]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:55.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.377+0000 7fe3027fc700 1 -- 172.21.15.196:0/2560718294 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe30c1a4fc0 con 0x7fe2f80afc00 2024-04-25T11:19:55.375 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 8 on host 'smithi196' 2024-04-25T11:19:55.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe2f80afc00 msgr2=0x7fe2f80b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:55.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe2f80afc00 0x7fe2f80b2110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe30c104110 tx=0x7fe30800b410 comp rx=0 tx=0).stop 2024-04-25T11:19:55.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104210 msgr2=0x7fe30c19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:19:55.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104210 0x7fe30c19cec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c920 tx=0x7fe2fc00cc30 comp rx=0 tx=0).stop 2024-04-25T11:19:55.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 shutdown_connections 2024-04-25T11:19:55.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe2f80afc00 0x7fe2f80b2110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:55.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30c104bb0 0x7fe30c1a3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:55.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe30c1030e0 0x7fe30c19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:55.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 --2- 172.21.15.196:0/2560718294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe30c104210 0x7fe30c19cec0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:19:55.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.379+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 >> 172.21.15.196:0/2560718294 conn(0x7fe30c0fe740 msgr2=0x7fe30c100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:19:55.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.380+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 shutdown_connections 2024-04-25T11:19:55.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:19:55.380+0000 7fe3132f8700 1 -- 172.21.15.196:0/2560718294 wait complete. 2024-04-25T11:19:55.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:55.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:55.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:19:56.091 DEBUG:teuthology.orchestra.run.smithi196:osd.8> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.8.service 2024-04-25T11:19:56.093 INFO:tasks.cephadm:Deploying osd.9 on smithi080 with /dev/vg_nvme/lv_1... 2024-04-25T11:19:56.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T11:19:56.328 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:19:56.650 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:56 smithi196 ceph-mon[32659]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T11:19:56.650 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:56 smithi196 ceph-mon[32659]: osdmap e52: 9 total, 8 up, 9 in 2024-04-25T11:19:56.650 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:56.650 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:56 smithi196 ceph-mon[32659]: from='osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:19:56.650 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:56 smithi196 ceph-mon[32659]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:19:56.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:56 smithi080 ceph-mon[29126]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T11:19:56.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:56 smithi080 ceph-mon[29126]: osdmap e52: 9 total, 8 up, 9 in 2024-04-25T11:19:56.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:56.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:56 smithi080 ceph-mon[29126]: from='osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:19:56.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:56 smithi080 ceph-mon[29126]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:19:56.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:56 smithi082 ceph-mon[32440]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T11:19:56.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:56 smithi082 ceph-mon[32440]: osdmap e52: 9 total, 8 up, 9 in 2024-04-25T11:19:56.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:56.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:56 smithi082 ceph-mon[32440]: from='osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:19:56.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:56 smithi082 ceph-mon[32440]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:19:56.944 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:19:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:19:56.835+0000 7ff862be6700 -1 osd.8 0 waiting for initial osdmap 2024-04-25T11:19:56.945 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:19:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:19:56.845+0000 7ff85a192700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: osdmap e53: 9 total, 8 up, 9 in 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: osdmap e54: 9 total, 8 up, 9 in 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: from='osd.8 ' entity='osd.8' 2024-04-25T11:19:57.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:57 smithi196 ceph-mon[32659]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:57.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:19:57.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: osdmap e53: 9 total, 8 up, 9 in 2024-04-25T11:19:57.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: osdmap e54: 9 total, 8 up, 9 in 2024-04-25T11:19:57.728 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.729 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: from='osd.8 ' entity='osd.8' 2024-04-25T11:19:57.729 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:57 smithi080 ceph-mon[29126]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: osdmap e53: 9 total, 8 up, 9 in 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: osdmap e54: 9 total, 8 up, 9 in 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: from='osd.8 ' entity='osd.8' 2024-04-25T11:19:57.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:57 smithi082 ceph-mon[32440]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-04-25T11:19:58.433 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T11:19:58.434 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T11:19:58.434 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-25T11:19:58.434 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-25T11:19:58.434 INFO:teuthology.orchestra.run.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114193 s, 918 MB/s 2024-04-25T11:19:58.434 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-25T11:19:58.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:58 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:19:58.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:58 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:19:58.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:58.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:58 smithi196 ceph-mon[32659]: osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] boot 2024-04-25T11:19:58.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:58 smithi196 ceph-mon[32659]: osdmap e55: 9 total, 9 up, 9 in 2024-04-25T11:19:58.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:58.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:58 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:19:58.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:58 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:19:58.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:58.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:58 smithi082 ceph-mon[32440]: osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] boot 2024-04-25T11:19:58.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:58 smithi082 ceph-mon[32440]: osdmap e55: 9 total, 9 up, 9 in 2024-04-25T11:19:58.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:58.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:58 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:19:58.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:58 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:19:58.774 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:58.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:58 smithi080 ceph-mon[29126]: osd.8 [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] boot 2024-04-25T11:19:58.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:58 smithi080 ceph-mon[29126]: osdmap e55: 9 total, 9 up, 9 in 2024-04-25T11:19:58.775 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:19:59.152 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2024-04-25T11:19:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:19:59.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: osdmap e56: 9 total, 9 up, 9 in 2024-04-25T11:19:59.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi196 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi196 to 5696M 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:19:59 smithi080 ceph-mon[29126]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: osdmap e56: 9 total, 9 up, 9 in 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi196 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi196 to 5696M 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:19:59 smithi082 ceph-mon[32440]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:19:59.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: osdmap e56: 9 total, 9 up, 9 in 2024-04-25T11:19:59.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi196 2024-04-25T11:19:59.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.945 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:19:59.945 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi196 to 5696M 2024-04-25T11:19:59.945 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.945 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:19:59.945 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:19:59.945 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:19:59.945 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:19:59 smithi196 ceph-mon[32659]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:00.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:00 smithi082 ceph-mon[32440]: osdmap e57: 9 total, 9 up, 9 in 2024-04-25T11:20:00.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:00 smithi082 ceph-mon[32440]: overall HEALTH_OK 2024-04-25T11:20:00.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:00 smithi080 ceph-mon[29126]: osdmap e57: 9 total, 9 up, 9 in 2024-04-25T11:20:00.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:00 smithi080 ceph-mon[29126]: overall HEALTH_OK 2024-04-25T11:20:00.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:00 smithi196 ceph-mon[32659]: osdmap e57: 9 total, 9 up, 9 in 2024-04-25T11:20:00.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:00 smithi196 ceph-mon[32659]: overall HEALTH_OK 2024-04-25T11:20:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 -- 172.21.15.80:0/891706408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 msgr2=0x7fa95010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 --2- 172.21.15.80:0/891706408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa95010c3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa94800b0a0 tx=0x7fa94800b3b0 comp rx=0 tx=0).stop 2024-04-25T11:20:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 -- 172.21.15.80:0/891706408 shutdown_connections 2024-04-25T11:20:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 --2- 172.21.15.80:0/891706408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa95010c3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 --2- 172.21.15.80:0/891706408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa950104ce0 0x7fa950107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 --2- 172.21.15.80:0/891706408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa950107640 0x7fa950109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 -- 172.21.15.80:0/891706408 >> 172.21.15.80:0/891706408 conn(0x7fa9500fe740 msgr2=0x7fa950100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:20:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 -- 172.21.15.80:0/891706408 shutdown_connections 2024-04-25T11:20:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.154+0000 7fa954ae7700 1 -- 172.21.15.80:0/891706408 wait complete. 2024-04-25T11:20:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 Processor -- start 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 -- start start 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa950104ce0 0x7fa95019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa950107640 0x7fa95019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa9501a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa95010fcc0 con 0x7fa950109fa0 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa95010fb40 con 0x7fa950104ce0 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa954ae7700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa95010fe40 con 0x7fa950107640 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa94ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa9501a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa94ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa9501a3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56752/0 (socket says 172.21.15.80:56752) 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa94ed9d700 1 -- 172.21.15.80:0/829220587 learned_addr learned my addr 172.21.15.80:0/829220587 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:20:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.155+0000 7fa94e59c700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa950104ce0 0x7fa95019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa945d9b700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa950107640 0x7fa95019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa94ed9d700 1 -- 172.21.15.80:0/829220587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa950107640 msgr2=0x7fa95019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa94ed9d700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa950107640 0x7fa95019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa94ed9d700 1 -- 172.21.15.80:0/829220587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa950104ce0 msgr2=0x7fa95019c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa94ed9d700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa950104ce0 0x7fa95019c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa94ed9d700 1 -- 172.21.15.80:0/829220587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9501a44c0 con 0x7fa950109fa0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa94ed9d700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa9501a3e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa94800b070 tx=0x7fa948004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa947fff700 1 -- 172.21.15.80:0/829220587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948021070 con 0x7fa950109fa0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9501a4750 con 0x7fa950109fa0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa947fff700 1 -- 172.21.15.80:0/829220587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa948007c80 con 0x7fa950109fa0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa947fff700 1 -- 172.21.15.80:0/829220587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948005280 con 0x7fa950109fa0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.156+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9501a4d10 con 0x7fa950109fa0 2024-04-25T11:20:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.157+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa950051190 con 0x7fa950109fa0 2024-04-25T11:20:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.159+0000 7fa947fff700 1 -- 172.21.15.80:0/829220587 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fa948024070 con 0x7fa950109fa0 2024-04-25T11:20:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.159+0000 7fa947fff700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa93c0afb80 0x7fa93c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.160+0000 7fa94e59c700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa93c0afb80 0x7fa93c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.160+0000 7fa947fff700 1 -- 172.21.15.80:0/829220587 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7fa94800f020 con 0x7fa950109fa0 2024-04-25T11:20:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.160+0000 7fa94e59c700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa93c0afb80 0x7fa93c0b2090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9500762e0 tx=0x7fa940009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:20:01.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.163+0000 7fa947fff700 1 -- 172.21.15.80:0/829220587 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa94802b020 con 0x7fa950109fa0 2024-04-25T11:20:01.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:01.371+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa950063ad0 con 0x7fa93c0afb80 2024-04-25T11:20:01.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:01 smithi082 ceph-mon[32440]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:01.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:01.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:01.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:01 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:01.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:01 smithi080 ceph-mon[29126]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:01.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:01.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:01.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:01 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:01.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:01 smithi196 ceph-mon[32659]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:01.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:01.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:01.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:01 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:02.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:02 smithi080 ceph-mon[29126]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:02.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:02 smithi082 ceph-mon[32440]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:02.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:02 smithi196 ceph-mon[32659]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:03.567 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:03 smithi080 ceph-mon[29126]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:20:03.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:03 smithi082 ceph-mon[32440]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:20:03.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:03 smithi196 ceph-mon[32659]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:20:04.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:04 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1001081848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88aaa775-ab55-451c-b0cf-ef29189adf6a"}]: dispatch 2024-04-25T11:20:04.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:04 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1001081848' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88aaa775-ab55-451c-b0cf-ef29189adf6a"}]': finished 2024-04-25T11:20:04.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:04 smithi082 ceph-mon[32440]: osdmap e58: 10 total, 9 up, 10 in 2024-04-25T11:20:04.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:04 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:04.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:04 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1001081848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88aaa775-ab55-451c-b0cf-ef29189adf6a"}]: dispatch 2024-04-25T11:20:04.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:04 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1001081848' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88aaa775-ab55-451c-b0cf-ef29189adf6a"}]': finished 2024-04-25T11:20:04.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:04 smithi080 ceph-mon[29126]: osdmap e58: 10 total, 9 up, 10 in 2024-04-25T11:20:04.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:04 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:04.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:04 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1001081848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88aaa775-ab55-451c-b0cf-ef29189adf6a"}]: dispatch 2024-04-25T11:20:04.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:04 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1001081848' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88aaa775-ab55-451c-b0cf-ef29189adf6a"}]': finished 2024-04-25T11:20:04.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:04 smithi196 ceph-mon[32659]: osdmap e58: 10 total, 9 up, 10 in 2024-04-25T11:20:04.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:04 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:05.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:05 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1101636235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:05.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:05 smithi082 ceph-mon[32440]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-04-25T11:20:05.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:05 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1101636235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:05.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:05 smithi080 ceph-mon[29126]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-04-25T11:20:05.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:05 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1101636235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:05.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:05 smithi196 ceph-mon[32659]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-04-25T11:20:08.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:08 smithi080 ceph-mon[29126]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:20:08.647 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:08 smithi196 ceph-mon[32659]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:20:08.725 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:08 smithi082 ceph-mon[32440]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:20:10.586 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:10 smithi080 ceph-mon[29126]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T11:20:10.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:10 smithi196 ceph-mon[32659]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T11:20:10.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:10 smithi082 ceph-mon[32440]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T11:20:12.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:12 smithi080 ceph-mon[29126]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:20:12.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T11:20:12.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:12.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:12 smithi196 ceph-mon[32659]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:20:12.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T11:20:12.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:12 smithi082 ceph-mon[32440]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:20:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T11:20:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:13.634 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:13 smithi080 ceph-mon[29126]: Deploying daemon osd.9 on smithi080 2024-04-25T11:20:13.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:13 smithi196 ceph-mon[32659]: Deploying daemon osd.9 on smithi080 2024-04-25T11:20:13.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:13 smithi082 ceph-mon[32440]: Deploying daemon osd.9 on smithi080 2024-04-25T11:20:14.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:14 smithi080 ceph-mon[29126]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:14.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:14 smithi196 ceph-mon[32659]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:14.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:14 smithi082 ceph-mon[32440]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:16.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:16 smithi080 ceph-mon[29126]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:16.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:16 smithi196 ceph-mon[32659]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:16.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:16 smithi082 ceph-mon[32440]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:18.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:18 smithi080 ceph-mon[29126]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:18.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:18 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:18.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:18 smithi196 ceph-mon[32659]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:18.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:18 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:18.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:18 smithi082 ceph-mon[32440]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:18.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:18 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:19.497 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:19.497 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:19.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:19.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:19.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:19.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:20.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:20 smithi080 ceph-mon[29126]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:20.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:20 smithi196 ceph-mon[32659]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:20.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:20 smithi082 ceph-mon[32440]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:22.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:22 smithi080 ceph-mon[29126]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:22.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:22 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:22 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:22 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:22.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:22 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:22.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:22 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:22 smithi080 ceph-mon[29126]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T11:20:22.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.631+0000 7fa947fff700 1 -- 172.21.15.80:0/829220587 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa950063ad0 con 0x7fa93c0afb80 2024-04-25T11:20:22.628 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 9 on host 'smithi080' 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa93c0afb80 msgr2=0x7fa93c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa93c0afb80 0x7fa93c0b2090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9500762e0 tx=0x7fa940009190 comp rx=0 tx=0).stop 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 msgr2=0x7fa9501a3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa9501a3e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa94800b070 tx=0x7fa948004e40 comp rx=0 tx=0).stop 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 shutdown_connections 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa93c0afb80 0x7fa93c0b2090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa950109fa0 0x7fa9501a3e40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa950104ce0 0x7fa95019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 --2- 172.21.15.80:0/829220587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa950107640 0x7fa95019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 >> 172.21.15.80:0/829220587 conn(0x7fa9500fe740 msgr2=0x7fa950104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 shutdown_connections 2024-04-25T11:20:22.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:20:22.634+0000 7fa954ae7700 1 -- 172.21.15.80:0/829220587 wait complete. 2024-04-25T11:20:22.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:22 smithi196 ceph-mon[32659]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:22.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:22 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:22 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:22 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:22.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:22 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:22.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:22 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:22 smithi196 ceph-mon[32659]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T11:20:22.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:22 smithi082 ceph-mon[32440]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:22.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:22 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:22 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:22 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:22.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:22 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:22.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:22 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:22.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:22 smithi082 ceph-mon[32440]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T11:20:23.310 DEBUG:teuthology.orchestra.run.smithi080:osd.9> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.9.service 2024-04-25T11:20:23.313 INFO:tasks.cephadm:Deploying osd.10 on smithi082 with /dev/vg_nvme/lv_1... 2024-04-25T11:20:23.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T11:20:23.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T11:20:23.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: osdmap e59: 10 total, 9 up, 10 in 2024-04-25T11:20:23.555 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:20:23.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:23.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:23.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:23.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:23.556 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-mon[29126]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:23.556 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:20:23.466+0000 7f25d19fb700 -1 osd.9 0 waiting for initial osdmap 2024-04-25T11:20:23.556 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:20:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:20:23.480+0000 7f25cd7b0700 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:20:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:20:23.682 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T11:20:23.682 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: osdmap e59: 10 total, 9 up, 10 in 2024-04-25T11:20:23.683 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:20:23.683 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:23.683 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:23.683 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:23.683 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:23.683 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:23 smithi082 ceph-mon[32440]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:23.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T11:20:23.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: osdmap e59: 10 total, 9 up, 10 in 2024-04-25T11:20:23.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-25T11:20:23.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:23.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:23.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:23.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:23.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:23 smithi196 ceph-mon[32659]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:24.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:24 smithi082 ceph-mon[32440]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:20:24.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:24 smithi082 ceph-mon[32440]: osdmap e60: 10 total, 9 up, 10 in 2024-04-25T11:20:24.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:24 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:24.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:24 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:24.786 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:24 smithi080 ceph-mon[29126]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:20:24.786 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:24 smithi080 ceph-mon[29126]: osdmap e60: 10 total, 9 up, 10 in 2024-04-25T11:20:24.786 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:24.786 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:24 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:24.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:24 smithi196 ceph-mon[32659]: from='osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-25T11:20:24.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:24 smithi196 ceph-mon[32659]: osdmap e60: 10 total, 9 up, 10 in 2024-04-25T11:20:24.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:24 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:24.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:24 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:25.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:25 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:20:25.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:25 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:20:25.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:25.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:25 smithi080 ceph-mon[29126]: osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] boot 2024-04-25T11:20:25.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:25 smithi080 ceph-mon[29126]: osdmap e61: 10 total, 10 up, 10 in 2024-04-25T11:20:25.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:25 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:25.738 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:25 smithi080 ceph-mon[29126]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:25.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:25 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:20:25.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:25 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:20:25.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:25.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:25 smithi082 ceph-mon[32440]: osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] boot 2024-04-25T11:20:25.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:25 smithi082 ceph-mon[32440]: osdmap e61: 10 total, 10 up, 10 in 2024-04-25T11:20:25.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:25 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:25.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:25 smithi082 ceph-mon[32440]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:25.765 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T11:20:25.765 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T11:20:25.766 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-25T11:20:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-25T11:20:25.766 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111788 s, 938 MB/s 2024-04-25T11:20:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-25T11:20:25.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:25 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:20:25.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:25 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:20:25.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:25.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:25 smithi196 ceph-mon[32659]: osd.9 [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] boot 2024-04-25T11:20:25.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:25 smithi196 ceph-mon[32659]: osdmap e61: 10 total, 10 up, 10 in 2024-04-25T11:20:25.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:25 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:20:25.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:25 smithi196 ceph-mon[32659]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-04-25T11:20:26.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-04-25T11:20:26.684 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:20:26.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:26 smithi082 ceph-mon[32440]: osdmap e62: 10 total, 10 up, 10 in 2024-04-25T11:20:26.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:26 smithi080 ceph-mon[29126]: osdmap e62: 10 total, 10 up, 10 in 2024-04-25T11:20:26.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:26 smithi196 ceph-mon[32659]: osdmap e62: 10 total, 10 up, 10 in 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi080 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.825 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-25T11:20:27.826 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.826 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:27.826 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:27.826 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.826 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:27 smithi082 ceph-mon[32440]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:27.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi080 2024-04-25T11:20:27.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-25T11:20:27.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:27.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:27.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:27 smithi080 ceph-mon[29126]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:27.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi080 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:27.944 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:27 smithi196 ceph-mon[32659]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 -- 172.21.15.82:0/3343433025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 msgr2=0x7f53d4103520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 --2- 172.21.15.82:0/3343433025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d4103520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00b0a0 tx=0x7f53cc00b3b0 comp rx=0 tx=0).stop 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 -- 172.21.15.82:0/3343433025 shutdown_connections 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 --2- 172.21.15.82:0/3343433025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d4104be0 0x7f53d410b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 --2- 172.21.15.82:0/3343433025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d4103520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 --2- 172.21.15.82:0/3343433025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53d4104240 0x7f53d4104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 -- 172.21.15.82:0/3343433025 >> 172.21.15.82:0/3343433025 conn(0x7f53d40fe750 msgr2=0x7f53d4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.377+0000 7f53db2e1700 1 -- 172.21.15.82:0/3343433025 shutdown_connections 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 -- 172.21.15.82:0/3343433025 wait complete. 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 Processor -- start 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 -- start start 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d406bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53d4104240 0x7f53d419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d4104be0 0x7f53d41a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53d410eb50 con 0x7f53d4104be0 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53d410e9d0 con 0x7f53d4103110 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.378+0000 7f53db2e1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53d410ecd0 con 0x7f53d4104240 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d406bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d406bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38128/0 (socket says 172.21.15.82:38128) 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 -- 172.21.15.82:0/4165526031 learned_addr learned my addr 172.21.15.82:0/4165526031 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d987e700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d4104be0 0x7f53d41a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d887c700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53d4104240 0x7f53d419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 -- 172.21.15.82:0/4165526031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53d4104240 msgr2=0x7f53d419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53d4104240 0x7f53d419f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 -- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d4104be0 msgr2=0x7f53d41a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d4104be0 0x7f53d41a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 -- 172.21.15.82:0/4165526031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d41a2320 con 0x7f53d4103110 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d887c700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53d4104240 0x7f53d419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d907d700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d406bf40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00b780 tx=0x7f53cc004d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d27fc700 1 -- 172.21.15.82:0/4165526031 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc021070 con 0x7f53d4103110 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d27fc700 1 -- 172.21.15.82:0/4165526031 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53cc007c00 con 0x7f53d4103110 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53d27fc700 1 -- 172.21.15.82:0/4165526031 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0052c0 con 0x7f53d4103110 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d41a25b0 con 0x7f53d4103110 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.379+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d41a2aa0 con 0x7f53d4103110 2024-04-25T11:20:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.380+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d4051190 con 0x7f53d4103110 2024-04-25T11:20:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.382+0000 7f53d27fc700 1 -- 172.21.15.82:0/4165526031 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f53cc024070 con 0x7f53d4103110 2024-04-25T11:20:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.382+0000 7f53d27fc700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53bc0afb80 0x7f53bc0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.383+0000 7f53d27fc700 1 -- 172.21.15.82:0/4165526031 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7f53cc00f020 con 0x7f53d4103110 2024-04-25T11:20:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.383+0000 7f53d887c700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53bc0afb80 0x7f53bc0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.383+0000 7f53d887c700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53bc0afb80 0x7f53bc0b2090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53d406b8f0 tx=0x7f53c800a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:20:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.386+0000 7f53d27fc700 1 -- 172.21.15.82:0/4165526031 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f53cc02b020 con 0x7f53d4103110 2024-04-25T11:20:28.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:28.592+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f53d4063ad0 con 0x7f53bc0afb80 2024-04-25T11:20:28.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:28.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:28.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:28 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:28.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:28.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:28.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:28 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:29.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:29.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:29.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:28 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:29.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:29 smithi082 ceph-mon[32440]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:29.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:29 smithi082 ceph-mon[32440]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:29.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:29 smithi196 ceph-mon[32659]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:29.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:29 smithi196 ceph-mon[32659]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:30.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:29 smithi080 ceph-mon[29126]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:30.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:29 smithi080 ceph-mon[29126]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:32.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:32 smithi080 ceph-mon[29126]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:32 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/1929119573' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]: dispatch 2024-04-25T11:20:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:32 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]: dispatch 2024-04-25T11:20:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:32 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]': finished 2024-04-25T11:20:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:32 smithi080 ceph-mon[29126]: osdmap e63: 11 total, 10 up, 11 in 2024-04-25T11:20:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:32 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:32.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:32 smithi080 ceph-mon[29126]: from='client.? 172.21.15.82:0/2349412708' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:32.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:32 smithi196 ceph-mon[32659]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:32.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:32 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/1929119573' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]: dispatch 2024-04-25T11:20:32.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:32 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]: dispatch 2024-04-25T11:20:32.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:32 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]': finished 2024-04-25T11:20:32.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:32 smithi196 ceph-mon[32659]: osdmap e63: 11 total, 10 up, 11 in 2024-04-25T11:20:32.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:32 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:32.694 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:32 smithi196 ceph-mon[32659]: from='client.? 172.21.15.82:0/2349412708' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:32.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:32 smithi082 ceph-mon[32440]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:32.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:32 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/1929119573' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]: dispatch 2024-04-25T11:20:32.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:32 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]: dispatch 2024-04-25T11:20:32.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:32 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9"}]': finished 2024-04-25T11:20:32.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:32 smithi082 ceph-mon[32440]: osdmap e63: 11 total, 10 up, 11 in 2024-04-25T11:20:32.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:32 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:32.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:32 smithi082 ceph-mon[32440]: from='client.? 172.21.15.82:0/2349412708' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:34.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:34 smithi080 ceph-mon[29126]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:34.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:34 smithi196 ceph-mon[32659]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:34.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:34 smithi082 ceph-mon[32440]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:36.593 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:36 smithi082 ceph-mon[32440]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:36.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:36 smithi080 ceph-mon[29126]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:36.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:36 smithi196 ceph-mon[32659]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:38.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:38 smithi080 ceph-mon[29126]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:38.643 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:38 smithi082 ceph-mon[32440]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:38.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:38 smithi196 ceph-mon[32659]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:39.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:39 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T11:20:39.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:39 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:39.667 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:39 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T11:20:39.667 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:39 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:39.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:39 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T11:20:39.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:39 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:40 smithi080 ceph-mon[29126]: Deploying daemon osd.10 on smithi082 2024-04-25T11:20:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:40 smithi080 ceph-mon[29126]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:40 smithi196 ceph-mon[32659]: Deploying daemon osd.10 on smithi082 2024-04-25T11:20:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:40 smithi196 ceph-mon[32659]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:40.716 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:40 smithi082 ceph-mon[32440]: Deploying daemon osd.10 on smithi082 2024-04-25T11:20:40.716 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:40 smithi082 ceph-mon[32440]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:42 smithi080 ceph-mon[29126]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:42.646 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:42 smithi082 ceph-mon[32440]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:42.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:42 smithi196 ceph-mon[32659]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:44.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:44 smithi082 ceph-mon[32440]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:44.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:44 smithi080 ceph-mon[29126]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:44.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:44 smithi196 ceph-mon[32659]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:46.497 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:46.497 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:46.497 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:46.497 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:46 smithi082 ceph-mon[32440]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:46.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:46.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:46.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:46.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:46 smithi080 ceph-mon[29126]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:46.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:46.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:46.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:46.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:46 smithi196 ceph-mon[32659]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:48 smithi082 ceph-mon[32440]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:48.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:48 smithi080 ceph-mon[29126]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:48.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:48 smithi196 ceph-mon[32659]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:49.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.559+0000 7f53d27fc700 1 -- 172.21.15.82:0/4165526031 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f53d4063ad0 con 0x7f53bc0afb80 2024-04-25T11:20:49.557 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 10 on host 'smithi082' 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53bc0afb80 msgr2=0x7f53bc0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53bc0afb80 0x7f53bc0b2090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53d406b8f0 tx=0x7f53c800a680 comp rx=0 tx=0).stop 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 msgr2=0x7f53d406bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d406bf40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00b780 tx=0x7f53cc004d70 comp rx=0 tx=0).stop 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 shutdown_connections 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53bc0afb80 0x7f53bc0b2090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d4104be0 0x7f53d41a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d4103110 0x7f53d406bf40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 --2- 172.21.15.82:0/4165526031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53d4104240 0x7f53d419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 >> 172.21.15.82:0/4165526031 conn(0x7f53d40fe750 msgr2=0x7f53d4107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 shutdown_connections 2024-04-25T11:20:49.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-25T11:20:49.562+0000 7f53db2e1700 1 -- 172.21.15.82:0/4165526031 wait complete. 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: from='osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T11:20:49.695 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:49 smithi196 ceph-mon[32659]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: from='osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T11:20:49.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:49 smithi082 ceph-mon[32440]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:49.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:49.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:49.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:49.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: from='osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T11:20:49.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T11:20:49.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:49 smithi080 ceph-mon[29126]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:50.227 DEBUG:teuthology.orchestra.run.smithi082:osd.10> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.10.service 2024-04-25T11:20:50.229 INFO:tasks.cephadm:Deploying osd.11 on smithi196 with /dev/vg_nvme/lv_1... 2024-04-25T11:20:50.229 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T11:20:50.477 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: from='osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: osdmap e64: 11 total, 10 up, 11 in 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:50.599 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:50 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:50.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T11:20:50.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: from='osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:20:50.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: osdmap e64: 11 total, 10 up, 11 in 2024-04-25T11:20:50.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:50.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:20:50.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:50.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:50.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:50.748 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:20:50.470+0000 7fbb834ff700 -1 osd.10 0 waiting for initial osdmap 2024-04-25T11:20:50.748 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:20:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:20:50.481+0000 7fbb7f2b4700 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:20:50.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T11:20:50.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: from='osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:20:50.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: osdmap e64: 11 total, 10 up, 11 in 2024-04-25T11:20:50.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:50.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-25T11:20:50.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:50.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:50.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:50 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:20:51.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:51 smithi082 ceph-mon[32440]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:20:51.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:51 smithi082 ceph-mon[32440]: osdmap e65: 11 total, 10 up, 11 in 2024-04-25T11:20:51.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:51.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:51.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:51 smithi082 ceph-mon[32440]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:51.880 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:51 smithi196 ceph-mon[32659]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:51 smithi196 ceph-mon[32659]: osdmap e65: 11 total, 10 up, 11 in 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:51 smithi196 ceph-mon[32659]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:51 smithi080 ceph-mon[29126]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:51 smithi080 ceph-mon[29126]: osdmap e65: 11 total, 10 up, 11 in 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:51.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:51.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:51 smithi080 ceph-mon[29126]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-04-25T11:20:52.619 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T11:20:52.619 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T11:20:52.619 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-25T11:20:52.619 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-25T11:20:52.619 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115988 s, 904 MB/s 2024-04-25T11:20:52.619 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-25T11:20:52.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:52 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:20:52.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:52 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:20:52.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:52 smithi196 ceph-mon[32659]: osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] boot 2024-04-25T11:20:52.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:52 smithi196 ceph-mon[32659]: osdmap e66: 11 total, 11 up, 11 in 2024-04-25T11:20:52.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:52 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:52.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:52 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:20:52.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:52 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:20:52.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:52 smithi082 ceph-mon[32440]: osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] boot 2024-04-25T11:20:52.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:52 smithi082 ceph-mon[32440]: osdmap e66: 11 total, 11 up, 11 in 2024-04-25T11:20:52.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:52 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:52.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:52 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:20:52.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:52 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:20:52.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:52 smithi080 ceph-mon[29126]: osd.10 [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] boot 2024-04-25T11:20:52.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:52 smithi080 ceph-mon[29126]: osdmap e66: 11 total, 11 up, 11 in 2024-04-25T11:20:52.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:52 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:20:53.280 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_1 2024-04-25T11:20:53.532 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:20:53.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:53 smithi196 ceph-mon[32659]: osdmap e67: 11 total, 11 up, 11 in 2024-04-25T11:20:53.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:53 smithi196 ceph-mon[32659]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:20:53.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:53 smithi082 ceph-mon[32440]: osdmap e67: 11 total, 11 up, 11 in 2024-04-25T11:20:53.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:53 smithi082 ceph-mon[32440]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:20:53.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:53 smithi080 ceph-mon[29126]: osdmap e67: 11 total, 11 up, 11 in 2024-04-25T11:20:53.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:53 smithi080 ceph-mon[29126]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: osdmap e68: 11 total, 11 up, 11 in 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi082 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:54.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:54.748 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: osdmap e68: 11 total, 11 up, 11 in 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi082 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:54.783 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: osdmap e68: 11 total, 11 up, 11 in 2024-04-25T11:20:54.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi082 2024-04-25T11:20:54.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:20:54.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-25T11:20:54.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:54.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:54.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:20:54.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 -- 172.21.15.196:0/161188747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 msgr2=0x7ff50c10b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 --2- 172.21.15.196:0/161188747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c10b460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff50400b0a0 tx=0x7ff50400b3b0 comp rx=0 tx=0).stop 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 -- 172.21.15.196:0/161188747 shutdown_connections 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 --2- 172.21.15.196:0/161188747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c10b460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 --2- 172.21.15.196:0/161188747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50c1030e0 0x7ff50c1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 --2- 172.21.15.196:0/161188747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff50c104210 0x7ff50c104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 -- 172.21.15.196:0/161188747 >> 172.21.15.196:0/161188747 conn(0x7ff50c0fe740 msgr2=0x7ff50c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 -- 172.21.15.196:0/161188747 shutdown_connections 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 -- 172.21.15.196:0/161188747 wait complete. 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 Processor -- start 2024-04-25T11:20:55.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.247+0000 7ff513b93700 1 -- start start 2024-04-25T11:20:55.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff50c1030e0 0x7ff50c199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:55.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50c104210 0x7ff50c199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:55.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:55.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c10eb60 con 0x7ff50c1030e0 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c10e9e0 con 0x7ff50c104210 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c10ece0 con 0x7ff50c104bb0 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c1a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:57266/0 (socket says 172.21.15.196:57266) 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 -- 172.21.15.196:0/2862857890 learned_addr learned my addr 172.21.15.196:0/2862857890 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff51192f700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff50c1030e0 0x7ff50c199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff51112e700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50c104210 0x7ff50c199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 -- 172.21.15.196:0/2862857890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50c104210 msgr2=0x7ff50c199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50c104210 0x7ff50c199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 -- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff50c1030e0 msgr2=0x7ff50c199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff50c1030e0 0x7ff50c199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 -- 172.21.15.196:0/2862857890 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c1a1170 con 0x7ff50c104bb0 2024-04-25T11:20:55.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff512130700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c1a0af0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff50400b070 tx=0x7ff504004ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:20:55.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff502ffd700 1 -- 172.21.15.196:0/2862857890 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504021070 con 0x7ff50c104bb0 2024-04-25T11:20:55.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff502ffd700 1 -- 172.21.15.196:0/2862857890 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff504007b80 con 0x7ff50c104bb0 2024-04-25T11:20:55.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff502ffd700 1 -- 172.21.15.196:0/2862857890 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040052a0 con 0x7ff50c104bb0 2024-04-25T11:20:55.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c1a1400 con 0x7ff50c104bb0 2024-04-25T11:20:55.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.248+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c1a1990 con 0x7ff50c104bb0 2024-04-25T11:20:55.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.250+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c051190 con 0x7ff50c104bb0 2024-04-25T11:20:55.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.251+0000 7ff502ffd700 1 -- 172.21.15.196:0/2862857890 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7ff504024070 con 0x7ff50c104bb0 2024-04-25T11:20:55.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.252+0000 7ff502ffd700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff4f80afc00 0x7ff4f80b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:20:55.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.252+0000 7ff502ffd700 1 -- 172.21.15.196:0/2862857890 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6694+0+0 (secure 0 0 0) 0x7ff50400f020 con 0x7ff50c104bb0 2024-04-25T11:20:55.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.252+0000 7ff51192f700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff4f80afc00 0x7ff4f80b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:20:55.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.253+0000 7ff51192f700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff4f80afc00 0x7ff4f80b2110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff50c104110 tx=0x7ff50800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:20:55.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.256+0000 7ff502ffd700 1 -- 172.21.15.196:0/2862857890 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff50402b020 con 0x7ff50c104bb0 2024-04-25T11:20:55.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:20:55.464+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff50c063ad0 con 0x7ff4f80afc00 2024-04-25T11:20:55.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:55 smithi082 ceph-mon[32440]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:20:55.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:55.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:55.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:55.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:55 smithi080 ceph-mon[29126]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:20:55.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:55.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:55.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:55.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:55 smithi196 ceph-mon[32659]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:20:55.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T11:20:55.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T11:20:55.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:20:56.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:56 smithi196 ceph-mon[32659]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:56.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:56 smithi082 ceph-mon[32440]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:56.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:56 smithi080 ceph-mon[29126]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:20:57.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:57 smithi080 ceph-mon[29126]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:20:57.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:57 smithi196 ceph-mon[32659]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:20:57.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:57 smithi082 ceph-mon[32440]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T11:20:58.769 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:58 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/1887160409' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]: dispatch 2024-04-25T11:20:58.769 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:58 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]: dispatch 2024-04-25T11:20:58.769 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:58 smithi196 ceph-mon[32659]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]': finished 2024-04-25T11:20:58.769 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:58 smithi196 ceph-mon[32659]: osdmap e69: 12 total, 11 up, 12 in 2024-04-25T11:20:58.769 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:58 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:20:58.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:58 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/1887160409' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]: dispatch 2024-04-25T11:20:58.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:58 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]: dispatch 2024-04-25T11:20:58.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:58 smithi080 ceph-mon[29126]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]': finished 2024-04-25T11:20:58.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:58 smithi080 ceph-mon[29126]: osdmap e69: 12 total, 11 up, 12 in 2024-04-25T11:20:58.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:58 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:20:58.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:58 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/1887160409' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]: dispatch 2024-04-25T11:20:58.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:58 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]: dispatch 2024-04-25T11:20:58.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:58 smithi082 ceph-mon[32440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "980819ee-a7db-463d-aa88-5d68654f58f5"}]': finished 2024-04-25T11:20:58.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:58 smithi082 ceph-mon[32440]: osdmap e69: 12 total, 11 up, 12 in 2024-04-25T11:20:58.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:58 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:20:59.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:59 smithi080 ceph-mon[29126]: from='client.? 172.21.15.196:0/1330501608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:59.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:20:59 smithi080 ceph-mon[29126]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-04-25T11:20:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:59 smithi196 ceph-mon[32659]: from='client.? 172.21.15.196:0/1330501608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:59.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:20:59 smithi196 ceph-mon[32659]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-04-25T11:20:59.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:59 smithi082 ceph-mon[32440]: from='client.? 172.21.15.196:0/1330501608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T11:20:59.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:20:59 smithi082 ceph-mon[32440]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-04-25T11:21:02.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:02 smithi196 ceph-mon[32659]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:21:02.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:02 smithi080 ceph-mon[29126]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:21:02.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:02 smithi082 ceph-mon[32440]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T11:21:04.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:04 smithi080 ceph-mon[29126]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T11:21:04.660 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:04 smithi196 ceph-mon[32659]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T11:21:04.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:04 smithi082 ceph-mon[32440]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T11:21:06.418 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:06 smithi196 ceph-mon[32659]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:21:06.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:06 smithi080 ceph-mon[29126]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:21:06.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:06 smithi082 ceph-mon[32440]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T11:21:07.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T11:21:07.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:07 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:07.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T11:21:07.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:07 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:07.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T11:21:07.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:07 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:08.621 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:08 smithi196 ceph-mon[32659]: Deploying daemon osd.11 on smithi196 2024-04-25T11:21:08.622 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:08 smithi196 ceph-mon[32659]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:08.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:08 smithi080 ceph-mon[29126]: Deploying daemon osd.11 on smithi196 2024-04-25T11:21:08.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:08 smithi080 ceph-mon[29126]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:08.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:08 smithi082 ceph-mon[32440]: Deploying daemon osd.11 on smithi196 2024-04-25T11:21:08.648 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:08 smithi082 ceph-mon[32440]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:10.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:10 smithi196 ceph-mon[32659]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:10.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:10 smithi080 ceph-mon[29126]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:10 smithi082 ceph-mon[32440]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:12.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:12 smithi080 ceph-mon[29126]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:12 smithi196 ceph-mon[32659]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:12.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:12 smithi082 ceph-mon[32440]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:13.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:13.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:13.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:13 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:13.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:13 smithi196 ceph-mon[32659]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:13.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:13.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:13.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:13 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:13.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:13 smithi082 ceph-mon[32440]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:13.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:13.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:13.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:13 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:13.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:13 smithi080 ceph-mon[29126]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:16.617 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:16 smithi196 ceph-mon[32659]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:16.617 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.617 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.617 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:16.617 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:16.617 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:16 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:16 smithi080 ceph-mon[29126]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:16.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:16.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:16.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:16 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.683+0000 7ff502ffd700 1 -- 172.21.15.196:0/2862857890 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff50c063ad0 con 0x7ff4f80afc00 2024-04-25T11:21:16.680 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 11 on host 'smithi196' 2024-04-25T11:21:16.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff4f80afc00 msgr2=0x7ff4f80b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:16.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff4f80afc00 0x7ff4f80b2110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff50c104110 tx=0x7ff50800b410 comp rx=0 tx=0).stop 2024-04-25T11:21:16.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 msgr2=0x7ff50c1a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c1a0af0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff50400b070 tx=0x7ff504004ce0 comp rx=0 tx=0).stop 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 shutdown_connections 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff4f80afc00 0x7ff4f80b2110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff50c104bb0 0x7ff50c1a0af0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff50c1030e0 0x7ff50c199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 --2- 172.21.15.196:0/2862857890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff50c104210 0x7ff50c199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 >> 172.21.15.196:0/2862857890 conn(0x7ff50c0fe740 msgr2=0x7ff50c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 shutdown_connections 2024-04-25T11:21:16.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:16.685+0000 7ff513b93700 1 -- 172.21.15.196:0/2862857890 wait complete. 2024-04-25T11:21:16.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:16 smithi082 ceph-mon[32440]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:16.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:16.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:16.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:16.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:16 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:17.352 DEBUG:teuthology.orchestra.run.smithi196:osd.11> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.11.service 2024-04-25T11:21:17.354 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-25T11:21:17.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T11:21:17.609 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:21:17.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:17 smithi080 ceph-mon[29126]: from='osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T11:21:17.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:17 smithi080 ceph-mon[29126]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T11:21:17.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:17 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:17.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:17 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:17.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:17 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:17.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:17 smithi196 ceph-mon[32659]: from='osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T11:21:17.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:17 smithi196 ceph-mon[32659]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T11:21:17.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:17 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:17.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:17 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:17.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:17 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:17.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:17 smithi082 ceph-mon[32440]: from='osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T11:21:17.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:17 smithi082 ceph-mon[32440]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T11:21:17.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:17 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:17.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:17 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:17.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:17 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:18.613 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-mon[32659]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:18.614 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-mon[32659]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T11:21:18.614 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-mon[32659]: from='osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:21:18.614 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-mon[32659]: osdmap e70: 12 total, 11 up, 12 in 2024-04-25T11:21:18.614 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:18.614 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-mon[32659]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:21:18.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:18 smithi080 ceph-mon[29126]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:18.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:18 smithi080 ceph-mon[29126]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T11:21:18.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:18 smithi080 ceph-mon[29126]: from='osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:21:18.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:18 smithi080 ceph-mon[29126]: osdmap e70: 12 total, 11 up, 12 in 2024-04-25T11:21:18.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:18 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:18.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:18 smithi080 ceph-mon[29126]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:21:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:18 smithi082 ceph-mon[32440]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:18 smithi082 ceph-mon[32440]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T11:21:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:18 smithi082 ceph-mon[32440]: from='osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:21:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:18 smithi082 ceph-mon[32440]: osdmap e70: 12 total, 11 up, 12 in 2024-04-25T11:21:18.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:18 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:18.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:18 smithi082 ceph-mon[32440]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-25T11:21:18.942 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:21:18.782+0000 7f515d732700 -1 osd.11 0 waiting for initial osdmap 2024-04-25T11:21:18.943 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:21:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:21:18.798+0000 7f51554df700 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T11:21:19.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 -- 172.21.15.80:0/2766813929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0102200 msgr2=0x7fefa0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:19.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 --2- 172.21.15.80:0/2766813929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0102200 0x7fefa0102610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef90009990 tx=0x7fef90009ca0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 -- 172.21.15.80:0/2766813929 shutdown_connections 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 --2- 172.21.15.80:0/2766813929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0102b50 0x7fefa010c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 --2- 172.21.15.80:0/2766813929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa01057b0 0x7fefa0105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 --2- 172.21.15.80:0/2766813929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0102200 0x7fefa0102610 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 -- 172.21.15.80:0/2766813929 >> 172.21.15.80:0/2766813929 conn(0x7fefa00fded0 msgr2=0x7fefa0100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 -- 172.21.15.80:0/2766813929 shutdown_connections 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.442+0000 7fefa7b80700 1 -- 172.21.15.80:0/2766813929 wait complete. 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 Processor -- start 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 -- start start 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0102200 0x7fefa0104d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:19.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102b50 0x7fefa0103430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa01057b0 0x7fefa0103970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fefa010fc70 con 0x7fefa01057b0 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefa010faf0 con 0x7fefa0102b50 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa7b80700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fefa010fdf0 con 0x7fefa0102200 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa611d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa01057b0 0x7fefa0103970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa591c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0102200 0x7fefa0104d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa611d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa01057b0 0x7fefa0103970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55354/0 (socket says 172.21.15.80:55354) 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa611d700 1 -- 172.21.15.80:0/1593688115 learned_addr learned my addr 172.21.15.80:0/1593688115 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa591c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0102200 0x7fefa0104d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:45942/0 (socket says 172.21.15.80:45942) 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa511b700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102b50 0x7fefa0103430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:19.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa611d700 1 -- 172.21.15.80:0/1593688115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0102200 msgr2=0x7fefa0104d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.443+0000 7fefa611d700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0102200 0x7fefa0104d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fefa611d700 1 -- 172.21.15.80:0/1593688115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102b50 msgr2=0x7fefa0103430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fefa611d700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102b50 0x7fefa0103430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fefa611d700 1 -- 172.21.15.80:0/1593688115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa01040d0 con 0x7fefa01057b0 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fefa611d700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa01057b0 0x7fefa0103970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef98007970 tx=0x7fef98007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fef96ffd700 1 -- 172.21.15.80:0/1593688115 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800d7d0 con 0x7fefa01057b0 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fef96ffd700 1 -- 172.21.15.80:0/1593688115 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef9800de20 con 0x7fefa01057b0 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa01a4830 con 0x7fefa01057b0 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fef96ffd700 1 -- 172.21.15.80:0/1593688115 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98005020 con 0x7fefa01057b0 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.444+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa01a4d10 con 0x7fefa01057b0 2024-04-25T11:21:19.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.445+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa0051190 con 0x7fefa01057b0 2024-04-25T11:21:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.447+0000 7fef96ffd700 1 -- 172.21.15.80:0/1593688115 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fef9801a020 con 0x7fefa01057b0 2024-04-25T11:21:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.448+0000 7fef96ffd700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afb80 0x7fef8c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.448+0000 7fefa591c700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afb80 0x7fef8c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.448+0000 7fef96ffd700 1 -- 172.21.15.80:0/1593688115 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7fef980de560 con 0x7fefa01057b0 2024-04-25T11:21:19.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.448+0000 7fefa591c700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afb80 0x7fef8c0b2090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fefa006bf50 tx=0x7fef9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.452+0000 7fef96ffd700 1 -- 172.21.15.80:0/1593688115 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef98010070 con 0x7fefa01057b0 2024-04-25T11:21:19.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:19 smithi080 ceph-mon[29126]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:21:19.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:19 smithi080 ceph-mon[29126]: osdmap e71: 12 total, 11 up, 12 in 2024-04-25T11:21:19.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:19 smithi080 ceph-mon[29126]: from='osd.11 ' entity='osd.11' 2024-04-25T11:21:19.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:19 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.651+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fefa002e8c0 con 0x7fefa01057b0 2024-04-25T11:21:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.651+0000 7fef96ffd700 1 -- 172.21.15.80:0/1593688115 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fef980a7700 con 0x7fefa01057b0 2024-04-25T11:21:19.648 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afb80 msgr2=0x7fef8c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afb80 0x7fef8c0b2090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fefa006bf50 tx=0x7fef9c00b410 comp rx=0 tx=0).stop 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa01057b0 msgr2=0x7fefa0103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa01057b0 0x7fefa0103970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef98007970 tx=0x7fef98007c80 comp rx=0 tx=0).stop 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 shutdown_connections 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afb80 0x7fef8c0b2090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa01057b0 0x7fefa0103970 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0102200 0x7fefa0104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 --2- 172.21.15.80:0/1593688115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102b50 0x7fefa0103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:19.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 >> 172.21.15.80:0/1593688115 conn(0x7fefa00fded0 msgr2=0x7fefa0108750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:19.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 shutdown_connections 2024-04-25T11:21:19.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:19.653+0000 7fefa7b80700 1 -- 172.21.15.80:0/1593688115 wait complete. 2024-04-25T11:21:19.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:19 smithi196 ceph-mon[32659]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:21:19.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:19 smithi196 ceph-mon[32659]: osdmap e71: 12 total, 11 up, 12 in 2024-04-25T11:21:19.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:19 smithi196 ceph-mon[32659]: from='osd.11 ' entity='osd.11' 2024-04-25T11:21:19.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:19 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:19 smithi082 ceph-mon[32440]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-25T11:21:19.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:19 smithi082 ceph-mon[32440]: osdmap e71: 12 total, 11 up, 12 in 2024-04-25T11:21:19.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:19.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:19 smithi082 ceph-mon[32440]: from='osd.11 ' entity='osd.11' 2024-04-25T11:21:19.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:19 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:20 smithi196 ceph-mon[32659]: purged_snaps scrub starts 2024-04-25T11:21:20.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:20 smithi196 ceph-mon[32659]: purged_snaps scrub ok 2024-04-25T11:21:20.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:20 smithi196 ceph-mon[32659]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:20.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1593688115' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T11:21:20.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:20 smithi196 ceph-mon[32659]: osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] boot 2024-04-25T11:21:20.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:20 smithi196 ceph-mon[32659]: osdmap e72: 12 total, 12 up, 12 in 2024-04-25T11:21:20.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:20 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:20.476 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1714044051,"num_in_osds":12,"osd_in_since":1714044058,"num_remapped_pgs":0} 2024-04-25T11:21:20.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:20 smithi080 ceph-mon[29126]: purged_snaps scrub starts 2024-04-25T11:21:20.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:20 smithi080 ceph-mon[29126]: purged_snaps scrub ok 2024-04-25T11:21:20.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:20 smithi080 ceph-mon[29126]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:20.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1593688115' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T11:21:20.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:20 smithi080 ceph-mon[29126]: osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] boot 2024-04-25T11:21:20.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:20 smithi080 ceph-mon[29126]: osdmap e72: 12 total, 12 up, 12 in 2024-04-25T11:21:20.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:20 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:20.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:20 smithi082 ceph-mon[32440]: purged_snaps scrub starts 2024-04-25T11:21:20.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:20 smithi082 ceph-mon[32440]: purged_snaps scrub ok 2024-04-25T11:21:20.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:20 smithi082 ceph-mon[32440]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-04-25T11:21:20.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1593688115' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T11:21:20.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:20 smithi082 ceph-mon[32440]: osd.11 [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] boot 2024-04-25T11:21:20.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:20 smithi082 ceph-mon[32440]: osdmap e72: 12 total, 12 up, 12 in 2024-04-25T11:21:20.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:20 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:21:21.478 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T11:21:21.718 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: Detected new or changed devices on smithi196 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi196 to 4272M 2024-04-25T11:21:21.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:21.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:21.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: osdmap e73: 12 total, 12 up, 12 in 2024-04-25T11:21:21.841 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:21 smithi080 ceph-mon[29126]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:21.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: Detected new or changed devices on smithi196 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi196 to 4272M 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: osdmap e73: 12 total, 12 up, 12 in 2024-04-25T11:21:21.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:21 smithi196 ceph-mon[32659]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:21.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: Detected new or changed devices on smithi196 2024-04-25T11:21:21.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi196 to 4272M 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: osdmap e73: 12 total, 12 up, 12 in 2024-04-25T11:21:21.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:21 smithi082 ceph-mon[32440]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 -- 172.21.15.80:0/1531088946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78181045e0 msgr2=0x7f78181049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1531088946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78181045e0 0x7f78181049f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f780c0099c0 tx=0x7f780c009cd0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 -- 172.21.15.80:0/1531088946 shutdown_connections 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1531088946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7818104f30 0x7f781810b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1531088946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78181036e0 0x7f7818103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1531088946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78181045e0 0x7f78181049f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 -- 172.21.15.80:0/1531088946 >> 172.21.15.80:0/1531088946 conn(0x7f78180fded0 msgr2=0x7f7818100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 -- 172.21.15.80:0/1531088946 shutdown_connections 2024-04-25T11:21:23.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 -- 172.21.15.80:0/1531088946 wait complete. 2024-04-25T11:21:23.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.576+0000 7f781dfc6700 1 Processor -- start 2024-04-25T11:21:23.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f781dfc6700 1 -- start start 2024-04-25T11:21:23.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f781dfc6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78181036e0 0x7f781819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:23.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f781dfc6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78181045e0 0x7f781819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f781dfc6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7818104f30 0x7f78181a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f781dfc6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f781810edb0 con 0x7f7818104f30 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f781dfc6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f781810ec30 con 0x7f78181045e0 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f781dfc6700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f781810ef30 con 0x7f78181036e0 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7818104f30 0x7f78181a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7816ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78181045e0 0x7f781819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7818104f30 0x7f78181a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55358/0 (socket says 172.21.15.80:55358) 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 -- 172.21.15.80:0/1279854115 learned_addr learned my addr 172.21.15.80:0/1279854115 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f78177fe700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78181036e0 0x7f781819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 -- 172.21.15.80:0/1279854115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78181036e0 msgr2=0x7f781819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78181036e0 0x7f781819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 -- 172.21.15.80:0/1279854115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78181045e0 msgr2=0x7f781819af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:23.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78181045e0 0x7f781819af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.577+0000 7f7817fff700 1 -- 172.21.15.80:0/1279854115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78181a2540 con 0x7f7818104f30 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.578+0000 7f7817fff700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7818104f30 0x7f78181a1ec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f781000ada0 tx=0x7f781000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.578+0000 7f7814ff9700 1 -- 172.21.15.80:0/1279854115 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810017020 con 0x7f7818104f30 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.578+0000 7f7814ff9700 1 -- 172.21.15.80:0/1279854115 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f781000cd80 con 0x7f7818104f30 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.578+0000 7f7814ff9700 1 -- 172.21.15.80:0/1279854115 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810013ad0 con 0x7f7818104f30 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.578+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78181a2830 con 0x7f7818104f30 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.578+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78181a2dc0 con 0x7f7818104f30 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.579+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7818051190 con 0x7f7818104f30 2024-04-25T11:21:23.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.581+0000 7f7814ff9700 1 -- 172.21.15.80:0/1279854115 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f781000a0d0 con 0x7f7818104f30 2024-04-25T11:21:23.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.582+0000 7f7814ff9700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78000afc00 0x7f78000b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:23.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.582+0000 7f78177fe700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78000afc00 0x7f78000b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:23.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.582+0000 7f7814ff9700 1 -- 172.21.15.80:0/1279854115 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f78100deb70 con 0x7f7818104f30 2024-04-25T11:21:23.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.582+0000 7f78177fe700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78000afc00 0x7f78000b2110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7808005950 tx=0x7f780800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:23.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.585+0000 7f7814ff9700 1 -- 172.21.15.80:0/1279854115 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7810021020 con 0x7f7818104f30 2024-04-25T11:21:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.784+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f78181a2f90 con 0x7f7818104f30 2024-04-25T11:21:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.784+0000 7f7814ff9700 1 -- 172.21.15.80:0/1279854115 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f78100a7c80 con 0x7f7818104f30 2024-04-25T11:21:23.781 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78000afc00 msgr2=0x7f78000b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78000afc00 0x7f78000b2110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7808005950 tx=0x7f780800a300 comp rx=0 tx=0).stop 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7818104f30 msgr2=0x7f78181a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7818104f30 0x7f78181a1ec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f781000ada0 tx=0x7f781000c330 comp rx=0 tx=0).stop 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 shutdown_connections 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78000afc00 0x7f78000b2110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7818104f30 0x7f78181a1ec0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78181036e0 0x7f781819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 --2- 172.21.15.80:0/1279854115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78181045e0 0x7f781819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 >> 172.21.15.80:0/1279854115 conn(0x7f78180fded0 msgr2=0x7f78180ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 shutdown_connections 2024-04-25T11:21:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:23.786+0000 7f781dfc6700 1 -- 172.21.15.80:0/1279854115 wait complete. 2024-04-25T11:21:24.461 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:24 smithi080 ceph-mon[29126]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:24.461 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:24 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1279854115' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T11:21:24.488 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1714044079,"num_in_osds":12,"osd_in_since":1714044058,"num_remapped_pgs":0} 2024-04-25T11:21:24.489 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T11:21:24.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:24 smithi196 ceph-mon[32659]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:24.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:24 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1279854115' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T11:21:24.723 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:21:24.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:24 smithi082 ceph-mon[32440]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:24.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:24 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1279854115' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T11:21:26.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:26 smithi080 ceph-mon[29126]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:26.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 -- 172.21.15.80:0/1557674520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102f90 msgr2=0x7f22bc111020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:26.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 --2- 172.21.15.80:0/1557674520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102f90 0x7f22bc111020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f22b400b0a0 tx=0x7f22b400b3b0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 -- 172.21.15.80:0/1557674520 shutdown_connections 2024-04-25T11:21:26.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 --2- 172.21.15.80:0/1557674520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102f90 0x7f22bc111020 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 --2- 172.21.15.80:0/1557674520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22bc1091b0 0x7f22bc1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 --2- 172.21.15.80:0/1557674520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc102640 0x7f22bc102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 -- 172.21.15.80:0/1557674520 >> 172.21.15.80:0/1557674520 conn(0x7f22bc0fe370 msgr2=0x7f22bc1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 -- 172.21.15.80:0/1557674520 shutdown_connections 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.535+0000 7f22c3706700 1 -- 172.21.15.80:0/1557674520 wait complete. 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 Processor -- start 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 -- start start 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102640 0x7f22bc19ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22bc102f90 0x7f22bc19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc1091b0 0x7f22bc19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1144d0 con 0x7f22bc102640 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc114350 con 0x7f22bc102f90 2024-04-25T11:21:26.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c3706700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc114650 con 0x7f22bc1091b0 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102640 0x7f22bc19ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102640 0x7f22bc19ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56906/0 (socket says 172.21.15.80:56906) 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 -- 172.21.15.80:0/55752537 learned_addr learned my addr 172.21.15.80:0/55752537 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c1ca3700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc1091b0 0x7f22bc19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c0ca1700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22bc102f90 0x7f22bc19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 -- 172.21.15.80:0/55752537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc1091b0 msgr2=0x7f22bc19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc1091b0 0x7f22bc19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 -- 172.21.15.80:0/55752537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22bc102f90 msgr2=0x7f22bc19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22bc102f90 0x7f22bc19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c14a2700 1 -- 172.21.15.80:0/55752537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc19fc30 con 0x7f22bc102640 2024-04-25T11:21:26.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.536+0000 7f22c1ca3700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc1091b0 0x7f22bc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.537+0000 7f22c14a2700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102640 0x7f22bc19ad60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00b4d0 tx=0x7f22ac00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.537+0000 7f22b27fc700 1 -- 172.21.15.80:0/55752537 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac015020 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.537+0000 7f22b27fc700 1 -- 172.21.15.80:0/55752537 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac011ce0 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.537+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc19ff20 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.537+0000 7f22b27fc700 1 -- 172.21.15.80:0/55752537 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac010cf0 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.537+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc1a7840 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.538+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc10c750 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.539+0000 7f22b27fc700 1 -- 172.21.15.80:0/55752537 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f22ac018020 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.540+0000 7f22b27fc700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f22a80afb80 0x7f22a80b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.540+0000 7f22c0ca1700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f22a80afb80 0x7f22a80b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.540+0000 7f22b27fc700 1 -- 172.21.15.80:0/55752537 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f22ac0de590 con 0x7f22bc102640 2024-04-25T11:21:26.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.540+0000 7f22c0ca1700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f22a80afb80 0x7f22a80b2090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22b8005fd0 tx=0x7f22b800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:26.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.544+0000 7f22b27fc700 1 -- 172.21.15.80:0/55752537 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f22ac01f020 con 0x7f22bc102640 2024-04-25T11:21:26.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:26 smithi196 ceph-mon[32659]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:26.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.743+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22bc19c0c0 con 0x7f22bc102640 2024-04-25T11:21:26.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.744+0000 7f22b27fc700 1 -- 172.21.15.80:0/55752537 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18420 (secure 0 0 0) 0x7f22ac0a7610 con 0x7f22bc102640 2024-04-25T11:21:26.741 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:26.741 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":73,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:21:20.799095+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:21:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f22a80afb80 msgr2=0x7f22a80b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:26.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f22a80afb80 0x7f22a80b2090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22b8005fd0 tx=0x7f22b800a560 comp rx=0 tx=0).stop 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102640 msgr2=0x7f22bc19ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102640 0x7f22bc19ad60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00b4d0 tx=0x7f22ac00b890 comp rx=0 tx=0).stop 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 shutdown_connections 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f22a80afb80 0x7f22a80b2090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc1091b0 0x7f22bc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22bc102640 0x7f22bc19ad60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 --2- 172.21.15.80:0/55752537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22bc102f90 0x7f22bc19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 >> 172.21.15.80:0/55752537 conn(0x7f22bc0fe370 msgr2=0x7f22bc0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 shutdown_connections 2024-04-25T11:21:26.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:26.746+0000 7f22c3706700 1 -- 172.21.15.80:0/55752537 wait complete. 2024-04-25T11:21:26.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:26 smithi082 ceph-mon[32440]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:27.508 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:21:27.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-25T11:21:27.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:27 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/55752537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:21:27.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:27 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/55752537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:21:27.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:27 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/55752537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:21:27.746 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:21:28.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:28 smithi080 ceph-mon[29126]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:28.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:28 smithi196 ceph-mon[32659]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:28.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:28 smithi082 ceph-mon[32440]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:29.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 -- 172.21.15.80:0/2366562219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b10103890 msgr2=0x7f0b10103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 --2- 172.21.15.80:0/2366562219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b10103890 0x7f0b10103ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009990 tx=0x7f0b04009ca0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 -- 172.21.15.80:0/2366562219 shutdown_connections 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 --2- 172.21.15.80:0/2366562219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b101041e0 0x7f0b1010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 --2- 172.21.15.80:0/2366562219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b10109180 0x7f0b10109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 --2- 172.21.15.80:0/2366562219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b10103890 0x7f0b10103ca0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 -- 172.21.15.80:0/2366562219 >> 172.21.15.80:0/2366562219 conn(0x7f0b100fe370 msgr2=0x7f0b101007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 -- 172.21.15.80:0/2366562219 shutdown_connections 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.468+0000 7f0b168e0700 1 -- 172.21.15.80:0/2366562219 wait complete. 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 Processor -- start 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 -- start start 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10103890 0x7f0b101a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b101041e0 0x7f0b101a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b10109180 0x7f0b1019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0b10113250 con 0x7f0b101041e0 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0b101130d0 con 0x7f0b10103890 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b168e0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0b101133d0 con 0x7f0b10109180 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b0f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b101041e0 0x7f0b101a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b0f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b101041e0 0x7f0b101a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56912/0 (socket says 172.21.15.80:56912) 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b0f7fe700 1 -- 172.21.15.80:0/3587219486 learned_addr learned my addr 172.21.15.80:0/3587219486 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b14e7d700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b10109180 0x7f0b1019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.469+0000 7f0b0ffff700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10103890 0x7f0b101a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0f7fe700 1 -- 172.21.15.80:0/3587219486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b10109180 msgr2=0x7f0b1019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0f7fe700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b10109180 0x7f0b1019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0f7fe700 1 -- 172.21.15.80:0/3587219486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10103890 msgr2=0x7f0b101a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0f7fe700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10103890 0x7f0b101a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0f7fe700 1 -- 172.21.15.80:0/3587219486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1019b280 con 0x7f0b101041e0 2024-04-25T11:21:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0f7fe700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b101041e0 0x7f0b101a0f30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400b5c0 tx=0x7f0b040047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:29.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0d7fa700 1 -- 172.21.15.80:0/3587219486 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04027070 con 0x7f0b101041e0 2024-04-25T11:21:29.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1019b510 con 0x7f0b101041e0 2024-04-25T11:21:29.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0d7fa700 1 -- 172.21.15.80:0/3587219486 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b04003f20 con 0x7f0b101041e0 2024-04-25T11:21:29.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b0d7fa700 1 -- 172.21.15.80:0/3587219486 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04022c80 con 0x7f0b101041e0 2024-04-25T11:21:29.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.470+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1019b9f0 con 0x7f0b101041e0 2024-04-25T11:21:29.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.471+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b101048a0 con 0x7f0b101041e0 2024-04-25T11:21:29.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.472+0000 7f0b0d7fa700 1 -- 172.21.15.80:0/3587219486 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f0b0402a070 con 0x7f0b101041e0 2024-04-25T11:21:29.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.473+0000 7f0b0d7fa700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0af80afb80 0x7f0af80b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:29.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.473+0000 7f0b0ffff700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0af80afb80 0x7f0af80b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:29.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.473+0000 7f0b0d7fa700 1 -- 172.21.15.80:0/3587219486 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f0b040dfc60 con 0x7f0b101041e0 2024-04-25T11:21:29.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.473+0000 7f0b0ffff700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0af80afb80 0x7f0af80b2090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b1019bea0 tx=0x7f0b0000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:29.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.477+0000 7f0b0d7fa700 1 -- 172.21.15.80:0/3587219486 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0b04031020 con 0x7f0b101041e0 2024-04-25T11:21:29.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.674+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b101a77a0 con 0x7f0b101041e0 2024-04-25T11:21:29.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.674+0000 7f0b0d7fa700 1 -- 172.21.15.80:0/3587219486 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f0b04013070 con 0x7f0b101041e0 2024-04-25T11:21:29.671 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0af80afb80 msgr2=0x7f0af80b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0af80afb80 0x7f0af80b2090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b1019bea0 tx=0x7f0b0000b5b0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b101041e0 msgr2=0x7f0b101a0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b101041e0 0x7f0b101a0f30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400b5c0 tx=0x7f0b040047b0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 shutdown_connections 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0af80afb80 0x7f0af80b2090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b10109180 0x7f0b1019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b10103890 0x7f0b101a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 --2- 172.21.15.80:0/3587219486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b101041e0 0x7f0b101a0f30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 >> 172.21.15.80:0/3587219486 conn(0x7f0b100fe370 msgr2=0x7f0b100fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 shutdown_connections 2024-04-25T11:21:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:29.676+0000 7f0b168e0700 1 -- 172.21.15.80:0/3587219486 wait complete. 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.a on smithi080 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.d on smithi080 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.g on smithi080 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.j on smithi080 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.b on smithi082 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.e on smithi082 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.h on smithi082 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.k on smithi082 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.c on smithi196 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.f on smithi196 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.i on smithi196 2024-04-25T11:21:30.469 INFO:tasks.cephadm:Adding mds.l on smithi196 2024-04-25T11:21:30.470 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l' 2024-04-25T11:21:30.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:30 smithi080 ceph-mon[29126]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:30.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:30 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3587219486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:21:30.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:30 smithi196 ceph-mon[32659]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:30.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:30 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3587219486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:21:30.721 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:21:30.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:30 smithi082 ceph-mon[32440]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:30.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:30 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3587219486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:21:32.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 -- 172.21.15.196:0/2192252616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104ba0 msgr2=0x7fa56010b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 --2- 172.21.15.196:0/2192252616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104ba0 0x7fa56010b450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa55800b0a0 tx=0x7fa55800b3b0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 -- 172.21.15.196:0/2192252616 shutdown_connections 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 --2- 172.21.15.196:0/2192252616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104ba0 0x7fa56010b450 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 --2- 172.21.15.196:0/2192252616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5601030d0 0x7fa5601034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 --2- 172.21.15.196:0/2192252616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa560104200 0x7fa560104610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 -- 172.21.15.196:0/2192252616 >> 172.21.15.196:0/2192252616 conn(0x7fa5600fe710 msgr2=0x7fa560100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 -- 172.21.15.196:0/2192252616 shutdown_connections 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.434+0000 7fa567d34700 1 -- 172.21.15.196:0/2192252616 wait complete. 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 Processor -- start 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 -- start start 2024-04-25T11:21:32.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5601030d0 0x7fa560106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104200 0x7fa560105540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa560104ba0 0x7fa560105a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa56010eb50 con 0x7fa560104ba0 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa56010e9d0 con 0x7fa5601030d0 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa567d34700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa56010ecd0 con 0x7fa560104200 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104200 0x7fa560105540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104200 0x7fa560105540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:49516/0 (socket says 172.21.15.196:49516) 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 -- 172.21.15.196:0/1480757057 learned_addr learned my addr 172.21.15.196:0/1480757057 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5662d1700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa560104ba0 0x7fa560105a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa565ad0700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5601030d0 0x7fa560106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 -- 172.21.15.196:0/1480757057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5601030d0 msgr2=0x7fa560106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5601030d0 0x7fa560106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 -- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa560104ba0 msgr2=0x7fa560105a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa560104ba0 0x7fa560105a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa5652cf700 1 -- 172.21.15.196:0/1480757057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5601061e0 con 0x7fa560104200 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.435+0000 7fa565ad0700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5601030d0 0x7fa560106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.436+0000 7fa5652cf700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104200 0x7fa560105540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c920 tx=0x7fa55000cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.436+0000 7fa556ffd700 1 -- 172.21.15.196:0/1480757057 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550007b00 con 0x7fa560104200 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.436+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5601a4860 con 0x7fa560104200 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.436+0000 7fa556ffd700 1 -- 172.21.15.196:0/1480757057 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa550004ce0 con 0x7fa560104200 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.436+0000 7fa556ffd700 1 -- 172.21.15.196:0/1480757057 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550005500 con 0x7fa560104200 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.436+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5601a4d40 con 0x7fa560104200 2024-04-25T11:21:32.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.437+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa560051190 con 0x7fa560104200 2024-04-25T11:21:32.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.438+0000 7fa556ffd700 1 -- 172.21.15.196:0/1480757057 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fa550007ca0 con 0x7fa560104200 2024-04-25T11:21:32.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.439+0000 7fa556ffd700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa54c0afb80 0x7fa54c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:32.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.439+0000 7fa556ffd700 1 -- 172.21.15.196:0/1480757057 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fa5500de700 con 0x7fa560104200 2024-04-25T11:21:32.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.439+0000 7fa565ad0700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa54c0afb80 0x7fa54c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:32.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.440+0000 7fa565ad0700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa54c0afb80 0x7fa54c0b2090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa55c005fd0 tx=0x7fa55c005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:32.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.443+0000 7fa556ffd700 1 -- 172.21.15.196:0/1480757057 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa550014030 con 0x7fa560104200 2024-04-25T11:21:32.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:32 smithi196 ceph-mon[32659]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:32.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:32 smithi080 ceph-mon[29126]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:32.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.649+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}) -- 0x7fa560100700 con 0x7fa54c0afb80 2024-04-25T11:21:32.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.658+0000 7fa556ffd700 1 -- 172.21.15.196:0/1480757057 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa560100700 con 0x7fa54c0afb80 2024-04-25T11:21:32.655 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mds.all update... 2024-04-25T11:21:32.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa54c0afb80 msgr2=0x7fa54c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:32.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa54c0afb80 0x7fa54c0b2090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa55c005fd0 tx=0x7fa55c005f00 comp rx=0 tx=0).stop 2024-04-25T11:21:32.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104200 msgr2=0x7fa560105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:32.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104200 0x7fa560105540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c920 tx=0x7fa55000cc30 comp rx=0 tx=0).stop 2024-04-25T11:21:32.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 shutdown_connections 2024-04-25T11:21:32.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa54c0afb80 0x7fa54c0b2090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa560104ba0 0x7fa560105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5601030d0 0x7fa560106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 --2- 172.21.15.196:0/1480757057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa560104200 0x7fa560105540 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:32.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 >> 172.21.15.196:0/1480757057 conn(0x7fa5600fe710 msgr2=0x7fa5600ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:32.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 shutdown_connections 2024-04-25T11:21:32.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-25T11:21:32.661+0000 7fa567d34700 1 -- 172.21.15.196:0/1480757057 wait complete. 2024-04-25T11:21:32.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:32 smithi082 ceph-mon[32440]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:33.349 DEBUG:teuthology.orchestra.run.smithi080:mds.a> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.a.service 2024-04-25T11:21:33.351 DEBUG:teuthology.orchestra.run.smithi080:mds.d> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.d.service 2024-04-25T11:21:33.394 DEBUG:teuthology.orchestra.run.smithi080:mds.g> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.g.service 2024-04-25T11:21:33.438 DEBUG:teuthology.orchestra.run.smithi080:mds.j> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.j.service 2024-04-25T11:21:33.482 DEBUG:teuthology.orchestra.run.smithi082:mds.b> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.b.service 2024-04-25T11:21:33.485 DEBUG:teuthology.orchestra.run.smithi082:mds.e> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.e.service 2024-04-25T11:21:33.528 DEBUG:teuthology.orchestra.run.smithi082:mds.h> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.h.service 2024-04-25T11:21:33.571 DEBUG:teuthology.orchestra.run.smithi082:mds.k> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.k.service 2024-04-25T11:21:33.614 DEBUG:teuthology.orchestra.run.smithi196:mds.c> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.c.service 2024-04-25T11:21:33.616 DEBUG:teuthology.orchestra.run.smithi196:mds.f> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.f.service 2024-04-25T11:21:33.659 DEBUG:teuthology.orchestra.run.smithi196:mds.i> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.i.service 2024-04-25T11:21:33.701 DEBUG:teuthology.orchestra.run.smithi196:mds.l> sudo journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.l.service 2024-04-25T11:21:33.745 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-25T11:21:33.745 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:21:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 -- 172.21.15.80:0/1560538362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c103c00 msgr2=0x7f049c104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 --2- 172.21.15.80:0/1560538362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c103c00 0x7f049c104010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0490009900 tx=0x7f049002a410 comp rx=0 tx=0).stop 2024-04-25T11:21:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 -- 172.21.15.80:0/1560538362 shutdown_connections 2024-04-25T11:21:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 --2- 172.21.15.80:0/1560538362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c103c00 0x7f049c104010 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:33.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 --2- 172.21.15.80:0/1560538362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f049c108900 0x7f049c10ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 --2- 172.21.15.80:0/1560538362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f049c1029c0 0x7f049c1036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 -- 172.21.15.80:0/1560538362 >> 172.21.15.80:0/1560538362 conn(0x7f049c0fdbd0 msgr2=0x7f049c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 -- 172.21.15.80:0/1560538362 shutdown_connections 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.872+0000 7f04a191f640 1 -- 172.21.15.80:0/1560538362 wait complete. 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 Processor -- start 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 -- start start 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f049c1029c0 0x7f049c06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f049c103c00 0x7f049c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c108900 0x7f049c1a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f049c10e4c0 con 0x7f049c108900 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f049c10e340 con 0x7f049c1029c0 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f04a191f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f049c10e640 con 0x7f049c103c00 2024-04-25T11:21:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c108900 0x7f049c1a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c108900 0x7f049c1a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56944/0 (socket says 172.21.15.80:56944) 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 -- 172.21.15.80:0/3232093581 learned_addr learned my addr 172.21.15.80:0/3232093581 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049a7fc640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f049c103c00 0x7f049c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049affd640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f049c1029c0 0x7f049c06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 -- 172.21.15.80:0/3232093581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f049c103c00 msgr2=0x7f049c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f049c103c00 0x7f049c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 -- 172.21.15.80:0/3232093581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f049c1029c0 msgr2=0x7f049c06a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f049c1029c0 0x7f049c06a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.873+0000 7f049b7fe640 1 -- 172.21.15.80:0/3232093581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c1a1d00 con 0x7f049c108900 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.874+0000 7f049b7fe640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c108900 0x7f049c1a14e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0494009fd0 tx=0x7f049400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.874+0000 7f04a091d640 1 -- 172.21.15.80:0/3232093581 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494017070 con 0x7f049c108900 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.874+0000 7f04a091d640 1 -- 172.21.15.80:0/3232093581 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0494003e20 con 0x7f049c108900 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.874+0000 7f04a091d640 1 -- 172.21.15.80:0/3232093581 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494010460 con 0x7f049c108900 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.874+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c1a1ff0 con 0x7f049c108900 2024-04-25T11:21:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.874+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c1a2450 con 0x7f049c108900 2024-04-25T11:21:33.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.875+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c06afd0 con 0x7f049c108900 2024-04-25T11:21:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.876+0000 7f04a091d640 1 -- 172.21.15.80:0/3232093581 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f0494003970 con 0x7f049c108900 2024-04-25T11:21:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.877+0000 7f04a091d640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04840afb70 0x7f04840b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.877+0000 7f049affd640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04840afb70 0x7f04840b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.877+0000 7f04a091d640 1 -- 172.21.15.80:0/3232093581 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f04940de3c0 con 0x7f049c108900 2024-04-25T11:21:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.877+0000 7f049affd640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04840afb70 0x7f04840b2080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f049c1035c0 tx=0x7f048c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:33.881+0000 7f04a091d640 1 -- 172.21.15.80:0/3232093581 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f049c06afd0 con 0x7f049c108900 2024-04-25T11:21:33.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:21:33.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-25T11:21:33.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:33.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:33.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:33.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:33.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:33.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:33.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:33.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:33.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:33 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:33.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:21:33.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-25T11:21:33.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:33.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:33.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:33.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:33.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:33.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:33.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:33.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:33.997 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:33 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:34.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.059+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f049c02dcb0 con 0x7f049c108900 2024-04-25T11:21:34.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.060+0000 7f04a091d640 1 -- 172.21.15.80:0/3232093581 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18420 (secure 0 0 0) 0x7f049c02dcb0 con 0x7f049c108900 2024-04-25T11:21:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:34.057 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":73,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:21:20.799095+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04840afb70 msgr2=0x7f04840b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04840afb70 0x7f04840b2080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f049c1035c0 tx=0x7f048c00a2d0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c108900 msgr2=0x7f049c1a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c108900 0x7f049c1a14e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0494009fd0 tx=0x7f049400b260 comp rx=0 tx=0).stop 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 shutdown_connections 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04840afb70 0x7f04840b2080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f049c108900 0x7f049c1a14e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f049c103c00 0x7f049c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 --2- 172.21.15.80:0/3232093581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f049c1029c0 0x7f049c06a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.062+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 >> 172.21.15.80:0/3232093581 conn(0x7f049c0fdbd0 msgr2=0x7f049c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.063+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 shutdown_connections 2024-04-25T11:21:34.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.063+0000 7f04a191f640 1 -- 172.21.15.80:0/3232093581 wait complete. 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:21:34.069 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:34.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:34.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:34.070 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:33 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:34.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:21:34.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:21:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.184+0000 7fd68118c640 1 -- 172.21.15.80:0/2659030185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 msgr2=0x7fd67c10bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.184+0000 7fd68118c640 1 --2- 172.21.15.80:0/2659030185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c10bcb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd674009900 tx=0x7fd67402a410 comp rx=0 tx=0).stop 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.184+0000 7fd68118c640 1 -- 172.21.15.80:0/2659030185 shutdown_connections 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.184+0000 7fd68118c640 1 --2- 172.21.15.80:0/2659030185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c10bcb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.184+0000 7fd68118c640 1 --2- 172.21.15.80:0/2659030185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67c106f30 0x7fd67c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.184+0000 7fd68118c640 1 --2- 172.21.15.80:0/2659030185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd67c1045d0 0x7fd67c1069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.184+0000 7fd68118c640 1 -- 172.21.15.80:0/2659030185 >> 172.21.15.80:0/2659030185 conn(0x7fd67c0fdbd0 msgr2=0x7fd67c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.185+0000 7fd68118c640 1 -- 172.21.15.80:0/2659030185 shutdown_connections 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.185+0000 7fd68118c640 1 -- 172.21.15.80:0/2659030185 wait complete. 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.185+0000 7fd68118c640 1 Processor -- start 2024-04-25T11:21:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.185+0000 7fd68118c640 1 -- start start 2024-04-25T11:21:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd68118c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd67c1045d0 0x7fd67c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd68118c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67c106f30 0x7fd67c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd68118c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c1a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd68118c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10f610 con 0x7fd67c109890 2024-04-25T11:21:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd68118c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10f490 con 0x7fd67c106f30 2024-04-25T11:21:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd68118c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10f790 con 0x7fd67c1045d0 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c1a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c1a1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56954/0 (socket says 172.21.15.80:56954) 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 -- 172.21.15.80:0/803172965 learned_addr learned my addr 172.21.15.80:0/803172965 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67a59c640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67c106f30 0x7fd67c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67ad9d640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd67c1045d0 0x7fd67c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 -- 172.21.15.80:0/803172965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd67c1045d0 msgr2=0x7fd67c19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd67c1045d0 0x7fd67c19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 -- 172.21.15.80:0/803172965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67c106f30 msgr2=0x7fd67c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67c106f30 0x7fd67c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 -- 172.21.15.80:0/803172965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c1a2080 con 0x7fd67c109890 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd67b59e640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c1a1a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd674009230 tx=0x7fd6740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd663fff640 1 -- 172.21.15.80:0/803172965 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67403f030 con 0x7fd67c109890 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c1a2310 con 0x7fd67c109890 2024-04-25T11:21:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd663fff640 1 -- 172.21.15.80:0/803172965 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd674031910 con 0x7fd67c109890 2024-04-25T11:21:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.186+0000 7fd663fff640 1 -- 172.21.15.80:0/803172965 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674035070 con 0x7fd67c109890 2024-04-25T11:21:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.187+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c1a2800 con 0x7fd67c109890 2024-04-25T11:21:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.188+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c06c2a0 con 0x7fd67c109890 2024-04-25T11:21:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.189+0000 7fd663fff640 1 -- 172.21.15.80:0/803172965 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fd674042030 con 0x7fd67c109890 2024-04-25T11:21:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.189+0000 7fd663fff640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6640afaf0 0x7fd6640b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.190+0000 7fd67ad9d640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6640afaf0 0x7fd6640b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.190+0000 7fd663fff640 1 -- 172.21.15.80:0/803172965 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd6740fed10 con 0x7fd67c109890 2024-04-25T11:21:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.190+0000 7fd67ad9d640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6640afaf0 0x7fd6640b2000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd67c06a8b0 tx=0x7fd66c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:34.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.194+0000 7fd663fff640 1 -- 172.21.15.80:0/803172965 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd6740c7740 con 0x7fd67c109890 2024-04-25T11:21:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.369+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd67c1a2a60 con 0x7fd67c109890 2024-04-25T11:21:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.369+0000 7fd663fff640 1 -- 172.21.15.80:0/803172965 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fd6740cba40 con 0x7fd67c109890 2024-04-25T11:21:34.366 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:21:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6640afaf0 msgr2=0x7fd6640b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6640afaf0 0x7fd6640b2000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd67c06a8b0 tx=0x7fd66c009500 comp rx=0 tx=0).stop 2024-04-25T11:21:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 msgr2=0x7fd67c1a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c1a1a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd674009230 tx=0x7fd6740042f0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 shutdown_connections 2024-04-25T11:21:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6640afaf0 0x7fd6640b2000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67c109890 0x7fd67c1a1a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67c106f30 0x7fd67c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 --2- 172.21.15.80:0/803172965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd67c1045d0 0x7fd67c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 >> 172.21.15.80:0/803172965 conn(0x7fd67c0fdbd0 msgr2=0x7fd67c105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 shutdown_connections 2024-04-25T11:21:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.371+0000 7fd68118c640 1 -- 172.21.15.80:0/803172965 wait complete. 2024-04-25T11:21:34.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.489+0000 7f257026e640 1 -- 172.21.15.80:0/1144208804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2568103c00 msgr2=0x7f2568104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.489+0000 7f257026e640 1 --2- 172.21.15.80:0/1144208804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2568103c00 0x7f2568104010 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2558009900 tx=0x7f255802a410 comp rx=0 tx=0).stop 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- 172.21.15.80:0/1144208804 shutdown_connections 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 --2- 172.21.15.80:0/1144208804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2568103c00 0x7f2568104010 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 --2- 172.21.15.80:0/1144208804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2568108900 0x7f256810ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 --2- 172.21.15.80:0/1144208804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25681029c0 0x7f25681036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- 172.21.15.80:0/1144208804 >> 172.21.15.80:0/1144208804 conn(0x7f25680fdbd0 msgr2=0x7f2568100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- 172.21.15.80:0/1144208804 shutdown_connections 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- 172.21.15.80:0/1144208804 wait complete. 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 Processor -- start 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- start start 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25681029c0 0x7f256806a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2568103c00 0x7f256819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568108900 0x7f25681a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f256810e4e0 con 0x7f25681029c0 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f256810e360 con 0x7f2568103c00 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f257026e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f256810e660 con 0x7f2568108900 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f256e00a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25681029c0 0x7f256806a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f256e00a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25681029c0 0x7f256806a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56972/0 (socket says 172.21.15.80:56972) 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.490+0000 7f256e00a640 1 -- 172.21.15.80:0/2586355707 learned_addr learned my addr 172.21.15.80:0/2586355707 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256e80b640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568108900 0x7f25681a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256d809640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2568103c00 0x7f256819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256e00a640 1 -- 172.21.15.80:0/2586355707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568108900 msgr2=0x7f25681a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256e00a640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568108900 0x7f25681a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256e00a640 1 -- 172.21.15.80:0/2586355707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2568103c00 msgr2=0x7f256819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256e00a640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2568103c00 0x7f256819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256e00a640 1 -- 172.21.15.80:0/2586355707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25681a1d40 con 0x7f25681029c0 2024-04-25T11:21:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256d809640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2568103c00 0x7f256819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:21:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f256e00a640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25681029c0 0x7f256806a920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f256400e9f0 tx=0x7f256400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f255f7fe640 1 -- 172.21.15.80:0/2586355707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256400ccc0 con 0x7f25681029c0 2024-04-25T11:21:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f255f7fe640 1 -- 172.21.15.80:0/2586355707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25640035f0 con 0x7f25681029c0 2024-04-25T11:21:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25681a1fd0 con 0x7f25681029c0 2024-04-25T11:21:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f255f7fe640 1 -- 172.21.15.80:0/2586355707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256400ce60 con 0x7f25681029c0 2024-04-25T11:21:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.491+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25681a2440 con 0x7f25681029c0 2024-04-25T11:21:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.492+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2568107710 con 0x7f25681029c0 2024-04-25T11:21:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.494+0000 7f255f7fe640 1 -- 172.21.15.80:0/2586355707 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f2564003aa0 con 0x7f25681029c0 2024-04-25T11:21:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.495+0000 7f255f7fe640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25540afaf0 0x7f25540b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.495+0000 7f256d809640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25540afaf0 0x7f25540b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.495+0000 7f255f7fe640 1 -- 172.21.15.80:0/2586355707 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f25640debe0 con 0x7f25681029c0 2024-04-25T11:21:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.495+0000 7f256d809640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25540afaf0 0x7f25540b2000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2558000c00 tx=0x7f2558005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.498+0000 7f255f7fe640 1 -- 172.21.15.80:0/2586355707 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f25640a7c60 con 0x7f25681029c0 2024-04-25T11:21:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.714+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f256802db50 con 0x7f25681029c0 2024-04-25T11:21:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.715+0000 7f255f7fe640 1 -- 172.21.15.80:0/2586355707 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f25640a7560 con 0x7f25681029c0 2024-04-25T11:21:34.711 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T11:21:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 1 2024-04-25T11:21:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25540afaf0 msgr2=0x7f25540b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25540afaf0 0x7f25540b2000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2558000c00 tx=0x7f2558005d50 comp rx=0 tx=0).stop 2024-04-25T11:21:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25681029c0 msgr2=0x7f256806a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25681029c0 0x7f256806a920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f256400e9f0 tx=0x7f256400eeb0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 shutdown_connections 2024-04-25T11:21:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25540afaf0 0x7f25540b2000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2568108900 0x7f25681a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2568103c00 0x7f256819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 --2- 172.21.15.80:0/2586355707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25681029c0 0x7f256806a920 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 >> 172.21.15.80:0/2586355707 conn(0x7f25680fdbd0 msgr2=0x7f25681048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 shutdown_connections 2024-04-25T11:21:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:34.717+0000 7f257026e640 1 -- 172.21.15.80:0/2586355707 wait complete. 2024-04-25T11:21:34.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:34 smithi196 ceph-mon[32659]: Deploying daemon mds.l on smithi196 2024-04-25T11:21:34.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:34 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3232093581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:21:34.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:34 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/803172965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:21:34.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:34 smithi082 ceph-mon[32440]: Deploying daemon mds.l on smithi196 2024-04-25T11:21:34.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:34 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3232093581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:21:34.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:34 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/803172965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:21:35.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:34 smithi080 ceph-mon[29126]: Deploying daemon mds.l on smithi196 2024-04-25T11:21:35.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:34 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3232093581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:21:35.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:34 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/803172965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:21:35.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:35 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2586355707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:35.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:35 smithi196 ceph-mon[32659]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:35.942 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:35 smithi196 systemd[1]: Starting Ceph mds.l for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:21:35.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:35 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2586355707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:35.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:35 smithi082 ceph-mon[32440]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:36.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:35 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2586355707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:36.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:35 smithi080 ceph-mon[29126]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:36.245 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:35 smithi196 podman[63051]: 2024-04-25 11:21:35.856059199 +0000 UTC m=+0.018205957 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:21:36.245 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:35 smithi196 podman[63051]: 2024-04-25 11:21:35.983518589 +0000 UTC m=+0.145665331 container create 6f38fb2a60e439ca9deca75bf10617e28390a4dd4703f5ee43f9fcdd625011f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:21:36.245 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:36 smithi196 podman[63051]: 2024-04-25 11:21:36.249048037 +0000 UTC m=+0.411194781 container init 6f38fb2a60e439ca9deca75bf10617e28390a4dd4703f5ee43f9fcdd625011f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-25T11:21:36.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:36 smithi196 podman[63051]: 2024-04-25 11:21:36.251746617 +0000 UTC m=+0.413893367 container start 6f38fb2a60e439ca9deca75bf10617e28390a4dd4703f5ee43f9fcdd625011f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-25T11:21:36.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:36 smithi196 ceph-mds[63070]: -- 172.21.15.196:0/836887581 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5602a5033a40 con 0x5602a507ba80 2024-04-25T11:21:36.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l[63066]: starting mds.l at 2024-04-25T11:21:36.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:36 smithi196 bash[63051]: 6f38fb2a60e439ca9deca75bf10617e28390a4dd4703f5ee43f9fcdd625011f9 2024-04-25T11:21:36.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:21:36 smithi196 systemd[1]: Started Ceph mds.l for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:36.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 -- 172.21.15.80:0/3229553846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c103c00 msgr2=0x7f885c104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 --2- 172.21.15.80:0/3229553846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c103c00 0x7f885c104010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8850009900 tx=0x7f885002a410 comp rx=0 tx=0).stop 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 -- 172.21.15.80:0/3229553846 shutdown_connections 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 --2- 172.21.15.80:0/3229553846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c103c00 0x7f885c104010 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 --2- 172.21.15.80:0/3229553846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c108900 0x7f885c10ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 --2- 172.21.15.80:0/3229553846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f885c1029c0 0x7f885c1036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 -- 172.21.15.80:0/3229553846 >> 172.21.15.80:0/3229553846 conn(0x7f885c0fdbd0 msgr2=0x7f885c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 -- 172.21.15.80:0/3229553846 shutdown_connections 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.857+0000 7f88628ee640 1 -- 172.21.15.80:0/3229553846 wait complete. 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 Processor -- start 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 -- start start 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1029c0 0x7f885c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f885c103c00 0x7f885c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c108900 0x7f885c1a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10e4c0 con 0x7f885c108900 2024-04-25T11:21:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10e340 con 0x7f885c1029c0 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f88628ee640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10e640 con 0x7f885c103c00 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f8860e8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c108900 0x7f885c1a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f8860e8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c108900 0x7f885c1a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43156/0 (socket says 172.21.15.80:43156) 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f8860e8b640 1 -- 172.21.15.80:0/2713031126 learned_addr learned my addr 172.21.15.80:0/2713031126 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f885bfff640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1029c0 0x7f885c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.858+0000 7f885b7fe640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f885c103c00 0x7f885c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f8860e8b640 1 -- 172.21.15.80:0/2713031126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f885c103c00 msgr2=0x7f885c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f8860e8b640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f885c103c00 0x7f885c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f8860e8b640 1 -- 172.21.15.80:0/2713031126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1029c0 msgr2=0x7f885c06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f8860e8b640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1029c0 0x7f885c06a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f8860e8b640 1 -- 172.21.15.80:0/2713031126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c1a1d20 con 0x7f885c108900 2024-04-25T11:21:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f8860e8b640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c108900 0x7f885c1a1500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f885400eb10 tx=0x7f885400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f88597fa640 1 -- 172.21.15.80:0/2713031126 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854004b20 con 0x7f885c108900 2024-04-25T11:21:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c1a1fb0 con 0x7f885c108900 2024-04-25T11:21:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f88597fa640 1 -- 172.21.15.80:0/2713031126 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8854004cc0 con 0x7f885c108900 2024-04-25T11:21:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f88597fa640 1 -- 172.21.15.80:0/2713031126 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854010670 con 0x7f885c108900 2024-04-25T11:21:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.859+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c1a2420 con 0x7f885c108900 2024-04-25T11:21:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.860+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c107710 con 0x7f885c108900 2024-04-25T11:21:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.861+0000 7f88597fa640 1 -- 172.21.15.80:0/2713031126 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f8854005020 con 0x7f885c108900 2024-04-25T11:21:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.862+0000 7f88597fa640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88440afaf0 0x7f88440b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.862+0000 7f885bfff640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88440afaf0 0x7f88440b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.862+0000 7f88597fa640 1 -- 172.21.15.80:0/2713031126 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f88540ded00 con 0x7f885c108900 2024-04-25T11:21:36.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.863+0000 7f885bfff640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88440afaf0 0x7f88440b2000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f885c1035c0 tx=0x7f884c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:36.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:36.867+0000 7f88597fa640 1 -- 172.21.15.80:0/2713031126 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f88540a7d80 con 0x7f885c108900 2024-04-25T11:21:37.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.084+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f885c02dd70 con 0x7f885c108900 2024-04-25T11:21:37.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.085+0000 7f88597fa640 1 -- 172.21.15.80:0/2713031126 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f88540a7680 con 0x7f885c108900 2024-04-25T11:21:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:37.081 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T11:21:37.082 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 2 2024-04-25T11:21:37.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88440afaf0 msgr2=0x7f88440b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:37.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88440afaf0 0x7f88440b2000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f885c1035c0 tx=0x7f884c00b390 comp rx=0 tx=0).stop 2024-04-25T11:21:37.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c108900 msgr2=0x7f885c1a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c108900 0x7f885c1a1500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f885400eb10 tx=0x7f885400c2d0 comp rx=0 tx=0).stop 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 shutdown_connections 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88440afaf0 0x7f88440b2000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f885c108900 0x7f885c1a1500 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f885c103c00 0x7f885c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 --2- 172.21.15.80:0/2713031126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1029c0 0x7f885c06a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 >> 172.21.15.80:0/2713031126 conn(0x7f885c0fdbd0 msgr2=0x7f885c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 shutdown_connections 2024-04-25T11:21:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:37.087+0000 7f88628ee640 1 -- 172.21.15.80:0/2713031126 wait complete. 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6832/3230889920,v1:172.21.15.196:6833/3230889920] up:boot 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: fsmap 1 up:standby 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:37.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:37.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:37.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:37 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2713031126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:37.389 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6832/3230889920,v1:172.21.15.196:6833/3230889920] up:boot 2024-04-25T11:21:37.389 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: fsmap 1 up:standby 2024-04-25T11:21:37.389 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T11:21:37.390 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.390 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.390 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.390 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:37.390 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:37.390 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:37.390 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:37 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2713031126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:37.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6832/3230889920,v1:172.21.15.196:6833/3230889920] up:boot 2024-04-25T11:21:37.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: fsmap 1 up:standby 2024-04-25T11:21:37.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T11:21:37.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:37.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:37.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:37.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:37.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:37 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2713031126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:38.479 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:38 smithi082 ceph-mon[32440]: Deploying daemon mds.k on smithi082 2024-04-25T11:21:38.479 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:38 smithi082 ceph-mon[32440]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:38.593 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:38 smithi196 ceph-mon[32659]: Deploying daemon mds.k on smithi082 2024-04-25T11:21:38.593 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:38 smithi196 ceph-mon[32659]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:38.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:38 smithi080 ceph-mon[29126]: Deploying daemon mds.k on smithi082 2024-04-25T11:21:38.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:38 smithi080 ceph-mon[29126]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:38.746 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:38 smithi082 systemd[1]: Starting Ceph mds.k for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:21:39.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:39.116 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:38 smithi082 podman[62240]: 2024-04-25 11:21:38.772726139 +0000 UTC m=+0.017997963 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:21:39.116 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:38 smithi082 podman[62240]: 2024-04-25 11:21:38.88521327 +0000 UTC m=+0.130485080 container create 88a655b1c17661aeb1cc1f889e5c120f519796b795d37fe841aec548781d5829 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-25T11:21:39.116 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:39 smithi082 podman[62240]: 2024-04-25 11:21:39.121183117 +0000 UTC m=+0.366454928 container init 88a655b1c17661aeb1cc1f889e5c120f519796b795d37fe841aec548781d5829 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-25T11:21:39.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 -- 172.21.15.80:0/1837791235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 msgr2=0x7f67d4109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 --2- 172.21.15.80:0/1837791235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d4109380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009900 tx=0x7f67c802a410 comp rx=0 tx=0).stop 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 -- 172.21.15.80:0/1837791235 shutdown_connections 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 --2- 172.21.15.80:0/1837791235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d4109380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 --2- 172.21.15.80:0/1837791235 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d41098c0 0x7f67d410bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 --2- 172.21.15.80:0/1837791235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d4104600 0x7f67d4106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 -- 172.21.15.80:0/1837791235 >> 172.21.15.80:0/1837791235 conn(0x7f67d40fdc00 msgr2=0x7f67d41000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 -- 172.21.15.80:0/1837791235 shutdown_connections 2024-04-25T11:21:39.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.228+0000 7f67d8d15640 1 -- 172.21.15.80:0/1837791235 wait complete. 2024-04-25T11:21:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 Processor -- start 2024-04-25T11:21:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 -- start start 2024-04-25T11:21:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d4104600 0x7f67d419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d41098c0 0x7f67d41a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f67d410f620 con 0x7f67d4106f60 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67d410f4a0 con 0x7f67d4104600 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d8d15640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f67d410f7a0 con 0x7f67d41098c0 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d419a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43176/0 (socket says 172.21.15.80:43176) 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d1d9b640 1 -- 172.21.15.80:0/303371222 learned_addr learned my addr 172.21.15.80:0/303371222 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d259c640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d4104600 0x7f67d419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d2d9d640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d41098c0 0x7f67d41a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d1d9b640 1 -- 172.21.15.80:0/303371222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d41098c0 msgr2=0x7f67d41a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d1d9b640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d41098c0 0x7f67d41a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d1d9b640 1 -- 172.21.15.80:0/303371222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d4104600 msgr2=0x7f67d419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.229+0000 7f67d1d9b640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d4104600 0x7f67d419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.230+0000 7f67d1d9b640 1 -- 172.21.15.80:0/303371222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d41a1dd0 con 0x7f67d4106f60 2024-04-25T11:21:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.230+0000 7f67d1d9b640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d419a7d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f67c8006010 tx=0x7f67c8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.230+0000 7f67c37fe640 1 -- 172.21.15.80:0/303371222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c803f030 con 0x7f67d4106f60 2024-04-25T11:21:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.230+0000 7f67c37fe640 1 -- 172.21.15.80:0/303371222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67c8003aa0 con 0x7f67d4106f60 2024-04-25T11:21:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.230+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d41a2060 con 0x7f67d4106f60 2024-04-25T11:21:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.230+0000 7f67c37fe640 1 -- 172.21.15.80:0/303371222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8035070 con 0x7f67d4106f60 2024-04-25T11:21:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.230+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d41a25a0 con 0x7f67d4106f60 2024-04-25T11:21:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.231+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d40ff720 con 0x7f67d4106f60 2024-04-25T11:21:39.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.232+0000 7f67c37fe640 1 -- 172.21.15.80:0/303371222 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f67c8042030 con 0x7f67d4106f60 2024-04-25T11:21:39.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.233+0000 7f67c37fe640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f67bc0afb70 0x7f67bc0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:39.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.233+0000 7f67d259c640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f67bc0afb70 0x7f67bc0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:39.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.234+0000 7f67c37fe640 1 -- 172.21.15.80:0/303371222 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f67c80fece0 con 0x7f67d4106f60 2024-04-25T11:21:39.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.234+0000 7f67d259c640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f67bc0afb70 0x7f67bc0b2080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67d406bc90 tx=0x7f67c4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:39.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.238+0000 7f67c37fe640 1 -- 172.21.15.80:0/303371222 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f67c80c7d60 con 0x7f67d4106f60 2024-04-25T11:21:39.391 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:39 smithi082 podman[62240]: 2024-04-25 11:21:39.124106196 +0000 UTC m=+0.369378006 container start 88a655b1c17661aeb1cc1f889e5c120f519796b795d37fe841aec548781d5829 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:21:39.391 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:39 smithi082 ceph-mds[62259]: -- 172.21.15.82:0/1557204351 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b38ea65a40 con 0x55b38eaada80 2024-04-25T11:21:39.391 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:39 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k[62255]: starting mds.k at 2024-04-25T11:21:39.391 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:39 smithi082 bash[62240]: 88a655b1c17661aeb1cc1f889e5c120f519796b795d37fe841aec548781d5829 2024-04-25T11:21:39.391 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:21:39 smithi082 systemd[1]: Started Ceph mds.k for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:39.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.466+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d402db50 con 0x7f67d4106f60 2024-04-25T11:21:39.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.467+0000 7f67c37fe640 1 -- 172.21.15.80:0/303371222 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f67c80c7660 con 0x7f67d4106f60 2024-04-25T11:21:39.463 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:39.464 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T11:21:39.464 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2024-04-25T11:21:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f67bc0afb70 msgr2=0x7f67bc0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f67bc0afb70 0x7f67bc0b2080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67d406bc90 tx=0x7f67c4009500 comp rx=0 tx=0).stop 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 msgr2=0x7f67d419a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d419a7d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f67c8006010 tx=0x7f67c8031a50 comp rx=0 tx=0).stop 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 shutdown_connections 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f67bc0afb70 0x7f67bc0b2080 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d4106f60 0x7f67d419a7d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d41098c0 0x7f67d41a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 --2- 172.21.15.80:0/303371222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d4104600 0x7f67d419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 >> 172.21.15.80:0/303371222 conn(0x7f67d40fdc00 msgr2=0x7f67d4105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 shutdown_connections 2024-04-25T11:21:39.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:39.469+0000 7f67d8d15640 1 -- 172.21.15.80:0/303371222 wait complete. 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6832/942979898,v1:172.21.15.82:6833/942979898] up:boot 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: fsmap 2 up:standby 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:40.568 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:40.568 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:40.568 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: Deploying daemon mds.j on smithi080 2024-04-25T11:21:40.568 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:40 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/303371222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:40.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6832/942979898,v1:172.21.15.82:6833/942979898] up:boot 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: fsmap 2 up:standby 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: Deploying daemon mds.j on smithi080 2024-04-25T11:21:40.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:40 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/303371222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:40.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:40.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6832/942979898,v1:172.21.15.82:6833/942979898] up:boot 2024-04-25T11:21:40.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: fsmap 2 up:standby 2024-04-25T11:21:40.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T11:21:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: Deploying daemon mds.j on smithi080 2024-04-25T11:21:40.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:40 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/303371222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:41.478 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:41.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 -- 172.21.15.80:0/3430760753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c103ad0 msgr2=0x7fdd8c1047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:41.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 --2- 172.21.15.80:0/3430760753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c103ad0 0x7fdd8c1047d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009900 tx=0x7fdd7c02a410 comp rx=0 tx=0).stop 2024-04-25T11:21:41.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 -- 172.21.15.80:0/3430760753 shutdown_connections 2024-04-25T11:21:41.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 --2- 172.21.15.80:0/3430760753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd8c109a10 0x7fdd8c10be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 --2- 172.21.15.80:0/3430760753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c104d10 0x7fdd8c105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 --2- 172.21.15.80:0/3430760753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c103ad0 0x7fdd8c1047d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 -- 172.21.15.80:0/3430760753 >> 172.21.15.80:0/3430760753 conn(0x7fdd8c0fecc0 msgr2=0x7fdd8c101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 -- 172.21.15.80:0/3430760753 shutdown_connections 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.614+0000 7fdd9180d640 1 -- 172.21.15.80:0/3430760753 wait complete. 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.615+0000 7fdd9180d640 1 Processor -- start 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.615+0000 7fdd9180d640 1 -- start start 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.615+0000 7fdd9180d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd8c103ad0 0x7fdd8c076850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.615+0000 7fdd9180d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c104d10 0x7fdd8c074ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9180d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c109a10 0x7fdd8c075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9180d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c10f620 con 0x7fdd8c104d10 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9180d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c10f4a0 con 0x7fdd8c109a10 2024-04-25T11:21:41.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9180d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c10f7a0 con 0x7fdd8c103ad0 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c104d10 0x7fdd8c074ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c104d10 0x7fdd8c074ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43188/0 (socket says 172.21.15.80:43188) 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 -- 172.21.15.80:0/262462280 learned_addr learned my addr 172.21.15.80:0/262462280 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8affd640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd8c103ad0 0x7fdd8c076850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8b7fe640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c109a10 0x7fdd8c075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 -- 172.21.15.80:0/262462280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd8c103ad0 msgr2=0x7fdd8c076850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd8c103ad0 0x7fdd8c076850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 -- 172.21.15.80:0/262462280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c109a10 msgr2=0x7fdd8c075430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c109a10 0x7fdd8c075430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 -- 172.21.15.80:0/262462280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c075b60 con 0x7fdd8c104d10 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8affd640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd8c103ad0 0x7fdd8c076850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8b7fe640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c109a10 0x7fdd8c075430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd8a7fc640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c104d10 0x7fdd8c074ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000d950 tx=0x7fdd8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9080b640 1 -- 172.21.15.80:0/262462280 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80017070 con 0x7fdd8c104d10 2024-04-25T11:21:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8c1a42c0 con 0x7fdd8c104d10 2024-04-25T11:21:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9080b640 1 -- 172.21.15.80:0/262462280 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd80009c30 con 0x7fdd8c104d10 2024-04-25T11:21:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9080b640 1 -- 172.21.15.80:0/262462280 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000f620 con 0x7fdd8c104d10 2024-04-25T11:21:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.616+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8c1a47b0 con 0x7fdd8c104d10 2024-04-25T11:21:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.618+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8c108820 con 0x7fdd8c104d10 2024-04-25T11:21:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.620+0000 7fdd9080b640 1 -- 172.21.15.80:0/262462280 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fdd80010460 con 0x7fdd8c104d10 2024-04-25T11:21:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.620+0000 7fdd9080b640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdd740afaf0 0x7fdd740b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.620+0000 7fdd9080b640 1 -- 172.21.15.80:0/262462280 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdd800de4a0 con 0x7fdd8c104d10 2024-04-25T11:21:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.620+0000 7fdd8affd640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdd740afaf0 0x7fdd740b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.621+0000 7fdd8affd640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdd740afaf0 0x7fdd740b2000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c02aa00 tx=0x7fdd7c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:41.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.625+0000 7fdd9080b640 1 -- 172.21.15.80:0/262462280 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdd800a7520 con 0x7fdd8c104d10 2024-04-25T11:21:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.849+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd8c02df10 con 0x7fdd8c104d10 2024-04-25T11:21:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.850+0000 7fdd9080b640 1 -- 172.21.15.80:0/262462280 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7fdd80009de0 con 0x7fdd8c104d10 2024-04-25T11:21:41.846 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:41.846 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T11:21:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2024-04-25T11:21:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdd740afaf0 msgr2=0x7fdd740b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdd740afaf0 0x7fdd740b2000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c02aa00 tx=0x7fdd7c031400 comp rx=0 tx=0).stop 2024-04-25T11:21:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c104d10 msgr2=0x7fdd8c074ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c104d10 0x7fdd8c074ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000d950 tx=0x7fdd8000de10 comp rx=0 tx=0).stop 2024-04-25T11:21:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 shutdown_connections 2024-04-25T11:21:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdd740afaf0 0x7fdd740b2000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd8c104d10 0x7fdd8c074ef0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c109a10 0x7fdd8c075430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 --2- 172.21.15.80:0/262462280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd8c103ad0 0x7fdd8c076850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 >> 172.21.15.80:0/262462280 conn(0x7fdd8c0fecc0 msgr2=0x7fdd8c1059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 shutdown_connections 2024-04-25T11:21:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:41.852+0000 7fdd9180d640 1 -- 172.21.15.80:0/262462280 wait complete. 2024-04-25T11:21:42.284 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 25 11:21:42 smithi080 systemd[1]: Started Ceph mds.j for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:42.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/262462280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:42.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:42 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/262462280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:42.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:42 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/262462280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:42.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:42 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:43.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:43 smithi080 ceph-mon[29126]: Deploying daemon mds.d on smithi080 2024-04-25T11:21:43.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:43 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.80:6834/620066651,v1:172.21.15.80:6835/620066651] up:boot 2024-04-25T11:21:43.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:43 smithi080 ceph-mon[29126]: fsmap 3 up:standby 2024-04-25T11:21:43.528 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:43 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T11:21:43.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:43 smithi196 ceph-mon[32659]: Deploying daemon mds.d on smithi080 2024-04-25T11:21:43.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:43 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.80:6834/620066651,v1:172.21.15.80:6835/620066651] up:boot 2024-04-25T11:21:43.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:43 smithi196 ceph-mon[32659]: fsmap 3 up:standby 2024-04-25T11:21:43.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:43 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T11:21:43.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:43 smithi082 ceph-mon[32440]: Deploying daemon mds.d on smithi080 2024-04-25T11:21:43.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:43 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.80:6834/620066651,v1:172.21.15.80:6835/620066651] up:boot 2024-04-25T11:21:43.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:43 smithi082 ceph-mon[32440]: fsmap 3 up:standby 2024-04-25T11:21:43.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:43 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T11:21:43.860 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:44.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 -- 172.21.15.80:0/3985569224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480102230 msgr2=0x7f048010bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:44.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 --2- 172.21.15.80:0/3985569224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480102230 0x7f048010bc90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0478009ca0 tx=0x7f047802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 -- 172.21.15.80:0/3985569224 shutdown_connections 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 --2- 172.21.15.80:0/3985569224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480102230 0x7f048010bc90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 --2- 172.21.15.80:0/3985569224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0480101730 0x7f0480101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 --2- 172.21.15.80:0/3985569224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0480105080 0x7f0480105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 -- 172.21.15.80:0/3985569224 >> 172.21.15.80:0/3985569224 conn(0x7f04800fd330 msgr2=0x7f04800ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 -- 172.21.15.80:0/3985569224 shutdown_connections 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 -- 172.21.15.80:0/3985569224 wait complete. 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 Processor -- start 2024-04-25T11:21:44.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.006+0000 7f0486430640 1 -- start start 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f0486430640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480101730 0x7f04801041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f0486430640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0480102230 0x7f04801028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f0486430640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0480105080 0x7f0480102e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f0486430640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f048010f5f0 con 0x7f0480101730 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f0486430640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f048010f470 con 0x7f0480102230 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f0486430640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f048010f770 con 0x7f0480105080 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480101730 0x7f04801041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480101730 0x7f04801041e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43212/0 (socket says 172.21.15.80:43212) 2024-04-25T11:21:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 -- 172.21.15.80:0/1210890202 learned_addr learned my addr 172.21.15.80:0/1210890202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047f7fe640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0480102230 0x7f04801028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f04849cd640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0480105080 0x7f0480102e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 -- 172.21.15.80:0/1210890202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0480105080 msgr2=0x7f0480102e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0480105080 0x7f0480102e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 -- 172.21.15.80:0/1210890202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0480102230 msgr2=0x7f04801028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0480102230 0x7f04801028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 -- 172.21.15.80:0/1210890202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04801034f0 con 0x7f0480101730 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047f7fe640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0480102230 0x7f04801028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047ffff640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480101730 0x7f04801041e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0470005fd0 tx=0x7f047000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f047d7fa640 1 -- 172.21.15.80:0/1210890202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470017070 con 0x7f0480101730 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.007+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04801a4290 con 0x7f0480101730 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.008+0000 7f047d7fa640 1 -- 172.21.15.80:0/1210890202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0470009c30 con 0x7f0480101730 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.008+0000 7f047d7fa640 1 -- 172.21.15.80:0/1210890202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470003d10 con 0x7f0480101730 2024-04-25T11:21:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.008+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04801a4750 con 0x7f0480101730 2024-04-25T11:21:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.009+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048010aa20 con 0x7f0480101730 2024-04-25T11:21:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.011+0000 7f047d7fa640 1 -- 172.21.15.80:0/1210890202 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f0470003eb0 con 0x7f0480101730 2024-04-25T11:21:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.011+0000 7f047d7fa640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04680afaf0 0x7f04680b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.011+0000 7f047f7fe640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04680afaf0 0x7f04680b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.011+0000 7f047d7fa640 1 -- 172.21.15.80:0/1210890202 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f04700dec40 con 0x7f0480101730 2024-04-25T11:21:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.012+0000 7f047f7fe640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04680afaf0 0x7f04680b2000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0480103b80 tx=0x7f0474005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.015+0000 7f047d7fa640 1 -- 172.21.15.80:0/1210890202 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0470020030 con 0x7f0480101730 2024-04-25T11:21:44.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.251+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f048002db50 con 0x7f0480101730 2024-04-25T11:21:44.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.252+0000 7f047d7fa640 1 -- 172.21.15.80:0/1210890202 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3040 (secure 0 0 0) 0x7f0470009de0 con 0x7f0480101730 2024-04-25T11:21:44.248 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:44.248 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T11:21:44.248 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 4 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04680afaf0 msgr2=0x7f04680b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04680afaf0 0x7f04680b2000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0480103b80 tx=0x7f0474005e70 comp rx=0 tx=0).stop 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480101730 msgr2=0x7f04801041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480101730 0x7f04801041e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0470005fd0 tx=0x7f047000dde0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 shutdown_connections 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f04680afaf0 0x7f04680b2000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0480105080 0x7f0480102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0480102230 0x7f04801028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 --2- 172.21.15.80:0/1210890202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0480101730 0x7f04801041e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:44.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 >> 172.21.15.80:0/1210890202 conn(0x7f04800fd330 msgr2=0x7f0480107bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:44.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 shutdown_connections 2024-04-25T11:21:44.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:44.254+0000 7f0486430640 1 -- 172.21.15.80:0/1210890202 wait complete. 2024-04-25T11:21:44.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:44 smithi080 ceph-mon[29126]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:44.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:44 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1210890202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:44.529 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 systemd[1]: Starting Ceph mds.d for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:21:44.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:44 smithi196 ceph-mon[32659]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:44.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:44 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1210890202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:44.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:44 smithi082 ceph-mon[32440]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:44.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:44 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1210890202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:44.809 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 podman[69641]: 2024-04-25 11:21:44.436500778 +0000 UTC m=+0.017662948 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:21:44.809 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 podman[69641]: 2024-04-25 11:21:44.570284687 +0000 UTC m=+0.151446855 container create d96ba53fdd88d73b6431d10c1e9f4c6dff855eb15635cd90d05db4c673a6ddde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-25T11:21:44.809 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 podman[69641]: 2024-04-25 11:21:44.813850977 +0000 UTC m=+0.395013140 container init d96ba53fdd88d73b6431d10c1e9f4c6dff855eb15635cd90d05db4c673a6ddde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-25T11:21:45.130 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 podman[69641]: 2024-04-25 11:21:44.817157614 +0000 UTC m=+0.398319774 container start d96ba53fdd88d73b6431d10c1e9f4c6dff855eb15635cd90d05db4c673a6ddde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-25T11:21:45.130 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 ceph-mds[69660]: -- 172.21.15.80:0/1074138250 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d5aba7a40 con 0x557d5abefa80 2024-04-25T11:21:45.131 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d[69656]: starting mds.d at 2024-04-25T11:21:45.131 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 bash[69641]: d96ba53fdd88d73b6431d10c1e9f4c6dff855eb15635cd90d05db4c673a6ddde 2024-04-25T11:21:45.131 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:21:44 smithi080 systemd[1]: Started Ceph mds.d for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: Deploying daemon mds.e on smithi082 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.80:6836/461835634,v1:172.21.15.80:6837/461835634] up:boot 2024-04-25T11:21:46.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: fsmap 4 up:standby 2024-04-25T11:21:46.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:46 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T11:21:46.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: Deploying daemon mds.e on smithi082 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.80:6836/461835634,v1:172.21.15.80:6837/461835634] up:boot 2024-04-25T11:21:46.289 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: fsmap 4 up:standby 2024-04-25T11:21:46.290 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:46 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T11:21:46.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 -- 172.21.15.80:0/2648899810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81045f0 msgr2=0x7fe8c8106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:46.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/2648899810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81045f0 0x7fe8c8106a10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009900 tx=0x7fe8c402a410 comp rx=0 tx=0).stop 2024-04-25T11:21:46.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 -- 172.21.15.80:0/2648899810 shutdown_connections 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/2648899810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c81098b0 0x7fe8c810bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/2648899810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8c8106f50 0x7fe8c8109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/2648899810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81045f0 0x7fe8c8106a10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 -- 172.21.15.80:0/2648899810 >> 172.21.15.80:0/2648899810 conn(0x7fe8c80fdbf0 msgr2=0x7fe8c81000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 -- 172.21.15.80:0/2648899810 shutdown_connections 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 -- 172.21.15.80:0/2648899810 wait complete. 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 Processor -- start 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.390+0000 7fe8cfee0640 1 -- start start 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cfee0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c81045f0 0x7fe8c819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cfee0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8c8106f50 0x7fe8c819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cfee0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81098b0 0x7fe8c81a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cfee0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c810f600 con 0x7fe8c81098b0 2024-04-25T11:21:46.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cfee0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c810f480 con 0x7fe8c81045f0 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cfee0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c810f780 con 0x7fe8c8106f50 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81098b0 0x7fe8c81a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81098b0 0x7fe8c81a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43262/0 (socket says 172.21.15.80:43262) 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 -- 172.21.15.80:0/1806804872 learned_addr learned my addr 172.21.15.80:0/1806804872 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cdc7c640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c81045f0 0x7fe8c819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8cd47b640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8c8106f50 0x7fe8c819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 -- 172.21.15.80:0/1806804872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8c8106f50 msgr2=0x7fe8c819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8c8106f50 0x7fe8c819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 -- 172.21.15.80:0/1806804872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c81045f0 msgr2=0x7fe8c819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c81045f0 0x7fe8c819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 -- 172.21.15.80:0/1806804872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c81a1d50 con 0x7fe8c81098b0 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8ce47d640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81098b0 0x7fe8c81a16e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000e9d0 tx=0x7fe8c000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8beffd640 1 -- 172.21.15.80:0/1806804872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000cd80 con 0x7fe8c81098b0 2024-04-25T11:21:46.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.391+0000 7fe8beffd640 1 -- 172.21.15.80:0/1806804872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8c0005020 con 0x7fe8c81098b0 2024-04-25T11:21:46.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.392+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c81a1fe0 con 0x7fe8c81098b0 2024-04-25T11:21:46.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.392+0000 7fe8beffd640 1 -- 172.21.15.80:0/1806804872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00116d0 con 0x7fe8c81098b0 2024-04-25T11:21:46.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.392+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c81a24a0 con 0x7fe8c81098b0 2024-04-25T11:21:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.393+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c80ff710 con 0x7fe8c81098b0 2024-04-25T11:21:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.394+0000 7fe8beffd640 1 -- 172.21.15.80:0/1806804872 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe8c00051d0 con 0x7fe8c81098b0 2024-04-25T11:21:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.394+0000 7fe8beffd640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe8b40afb70 0x7fe8b40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.395+0000 7fe8cdc7c640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe8b40afb70 0x7fe8b40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.395+0000 7fe8beffd640 1 -- 172.21.15.80:0/1806804872 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe8c00de870 con 0x7fe8c81098b0 2024-04-25T11:21:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.395+0000 7fe8cdc7c640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe8b40afb70 0x7fe8b40b2080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009230 tx=0x7fe8c4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.399+0000 7fe8beffd640 1 -- 172.21.15.80:0/1806804872 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe8c0016030 con 0x7fe8c81098b0 2024-04-25T11:21:46.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:46.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:46.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:46.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:46.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: Deploying daemon mds.e on smithi082 2024-04-25T11:21:46.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:46.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.80:6836/461835634,v1:172.21.15.80:6837/461835634] up:boot 2024-04-25T11:21:46.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: fsmap 4 up:standby 2024-04-25T11:21:46.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:46 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T11:21:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.615+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8c802dd70 con 0x7fe8c81098b0 2024-04-25T11:21:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.615+0000 7fe8beffd640 1 -- 172.21.15.80:0/1806804872 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3862 (secure 0 0 0) 0x7fe8c00a72a0 con 0x7fe8c81098b0 2024-04-25T11:21:46.612 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:46.612 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T11:21:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 5 2024-04-25T11:21:46.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.617+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe8b40afb70 msgr2=0x7fe8b40b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:46.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.617+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe8b40afb70 0x7fe8b40b2080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009230 tx=0x7fe8c4031400 comp rx=0 tx=0).stop 2024-04-25T11:21:46.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.617+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81098b0 msgr2=0x7fe8c81a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:46.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.617+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81098b0 0x7fe8c81a16e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000e9d0 tx=0x7fe8c000ee90 comp rx=0 tx=0).stop 2024-04-25T11:21:46.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 shutdown_connections 2024-04-25T11:21:46.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe8b40afb70 0x7fe8b40b2080 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8c81098b0 0x7fe8c81a16e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8c8106f50 0x7fe8c819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 --2- 172.21.15.80:0/1806804872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8c81045f0 0x7fe8c819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:46.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 >> 172.21.15.80:0/1806804872 conn(0x7fe8c80fdbf0 msgr2=0x7fe8c8105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:46.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 shutdown_connections 2024-04-25T11:21:46.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:46.618+0000 7fe8cfee0640 1 -- 172.21.15.80:0/1806804872 wait complete. 2024-04-25T11:21:47.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:47 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1806804872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:47.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:47 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1806804872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:47.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:47 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1806804872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:47.496 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 systemd[1]: Starting Ceph mds.e for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:21:47.763 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 podman[62561]: 2024-04-25 11:21:47.410390595 +0000 UTC m=+0.017920834 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:21:47.763 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 podman[62561]: 2024-04-25 11:21:47.532267035 +0000 UTC m=+0.139797263 container create 0fe8dddd2e876f893034bf0a4913ef62ee068eac32c5d2f2e36ca360c6db39a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5) 2024-04-25T11:21:47.763 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 podman[62561]: 2024-04-25 11:21:47.768244852 +0000 UTC m=+0.375775079 container init 0fe8dddd2e876f893034bf0a4913ef62ee068eac32c5d2f2e36ca360c6db39a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:21:48.058 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 podman[62561]: 2024-04-25 11:21:47.770743419 +0000 UTC m=+0.378273647 container start 0fe8dddd2e876f893034bf0a4913ef62ee068eac32c5d2f2e36ca360c6db39a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-25T11:21:48.058 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 ceph-mds[62580]: -- 172.21.15.82:0/2097948001 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c42b6e9a40 con 0x55c42b731a80 2024-04-25T11:21:48.058 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e[62576]: starting mds.e at 2024-04-25T11:21:48.058 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 bash[62561]: 0fe8dddd2e876f893034bf0a4913ef62ee068eac32c5d2f2e36ca360c6db39a1 2024-04-25T11:21:48.058 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:21:47 smithi082 systemd[1]: Started Ceph mds.e for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:48.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:48 smithi080 ceph-mon[29126]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:48.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:48.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:48.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:48 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:48.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:48 smithi196 ceph-mon[32659]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:48.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:48.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:48.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:48 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:48 smithi082 ceph-mon[32440]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:48.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:48 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:48.627 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:48.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 -- 172.21.15.80:0/3902192573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff060103c20 msgr2=0x7ff060104030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 --2- 172.21.15.80:0/3902192573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff060103c20 0x7ff060104030 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff050009900 tx=0x7ff05002a410 comp rx=0 tx=0).stop 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 -- 172.21.15.80:0/3902192573 shutdown_connections 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 --2- 172.21.15.80:0/3902192573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff060103c20 0x7ff060104030 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 --2- 172.21.15.80:0/3902192573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff060108920 0x7ff06010ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 --2- 172.21.15.80:0/3902192573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0601029e0 0x7ff0601036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 -- 172.21.15.80:0/3902192573 >> 172.21.15.80:0/3902192573 conn(0x7ff0600fdbf0 msgr2=0x7ff060100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 -- 172.21.15.80:0/3902192573 shutdown_connections 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.750+0000 7ff0668af640 1 -- 172.21.15.80:0/3902192573 wait complete. 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 Processor -- start 2024-04-25T11:21:48.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 -- start start 2024-04-25T11:21:48.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0601029e0 0x7ff060075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:48.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff060103c20 0x7ff06019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff060108920 0x7ff0601a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff06010e4e0 con 0x7ff0601029e0 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff06010e360 con 0x7ff060108920 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff0668af640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff06010e660 con 0x7ff060103c20 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0601029e0 0x7ff060075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0601029e0 0x7ff060075860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58334/0 (socket says 172.21.15.80:58334) 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 -- 172.21.15.80:0/1740011966 learned_addr learned my addr 172.21.15.80:0/1740011966 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff064e4c640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff060108920 0x7ff0601a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05f7fe640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff060103c20 0x7ff06019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 -- 172.21.15.80:0/1740011966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff060103c20 msgr2=0x7ff06019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff060103c20 0x7ff06019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 -- 172.21.15.80:0/1740011966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff060108920 msgr2=0x7ff0601a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff060108920 0x7ff0601a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.751+0000 7ff05ffff640 1 -- 172.21.15.80:0/1740011966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0601a1cb0 con 0x7ff0601029e0 2024-04-25T11:21:48.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.752+0000 7ff05ffff640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0601029e0 0x7ff060075860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff04800c970 tx=0x7ff04800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:48.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.752+0000 7ff05d7fa640 1 -- 172.21.15.80:0/1740011966 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff048007c70 con 0x7ff0601029e0 2024-04-25T11:21:48.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.752+0000 7ff05d7fa640 1 -- 172.21.15.80:0/1740011966 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff048007e10 con 0x7ff0601029e0 2024-04-25T11:21:48.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.752+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0601a1fa0 con 0x7ff0601029e0 2024-04-25T11:21:48.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.752+0000 7ff05d7fa640 1 -- 172.21.15.80:0/1740011966 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0480187b0 con 0x7ff0601029e0 2024-04-25T11:21:48.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.752+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0601a2400 con 0x7ff0601029e0 2024-04-25T11:21:48.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.753+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06006a1c0 con 0x7ff0601029e0 2024-04-25T11:21:48.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.754+0000 7ff05d7fa640 1 -- 172.21.15.80:0/1740011966 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7ff04800fab0 con 0x7ff0601029e0 2024-04-25T11:21:48.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.755+0000 7ff05d7fa640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff04c0afaf0 0x7ff04c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:48.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.755+0000 7ff05f7fe640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff04c0afaf0 0x7ff04c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:48.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.755+0000 7ff05d7fa640 1 -- 172.21.15.80:0/1740011966 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff0480de900 con 0x7ff0601029e0 2024-04-25T11:21:48.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.756+0000 7ff05f7fe640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff04c0afaf0 0x7ff04c0b2000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff050009230 tx=0x7ff050031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:48.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.759+0000 7ff05d7fa640 1 -- 172.21.15.80:0/1740011966 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff048053ff0 con 0x7ff0601029e0 2024-04-25T11:21:48.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.974+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff06002dc10 con 0x7ff0601029e0 2024-04-25T11:21:48.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.975+0000 7ff05d7fa640 1 -- 172.21.15.80:0/1740011966 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4687 (secure 0 0 0) 0x7ff06006a1c0 con 0x7ff0601029e0 2024-04-25T11:21:48.971 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:48.971 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-25T11:21:48.971 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2024-04-25T11:21:48.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff04c0afaf0 msgr2=0x7ff04c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:48.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff04c0afaf0 0x7ff04c0b2000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff050009230 tx=0x7ff050031400 comp rx=0 tx=0).stop 2024-04-25T11:21:48.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0601029e0 msgr2=0x7ff060075860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:48.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0601029e0 0x7ff060075860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff04800c970 tx=0x7ff04800ce30 comp rx=0 tx=0).stop 2024-04-25T11:21:48.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 shutdown_connections 2024-04-25T11:21:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff04c0afaf0 0x7ff04c0b2000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff060108920 0x7ff0601a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff060103c20 0x7ff06019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 --2- 172.21.15.80:0/1740011966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0601029e0 0x7ff060075860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 >> 172.21.15.80:0/1740011966 conn(0x7ff0600fdbf0 msgr2=0x7ff060104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 shutdown_connections 2024-04-25T11:21:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:48.977+0000 7ff0668af640 1 -- 172.21.15.80:0/1740011966 wait complete. 2024-04-25T11:21:49.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:49 smithi196 ceph-mon[32659]: Deploying daemon mds.f on smithi196 2024-04-25T11:21:49.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:49 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6834/4149738023,v1:172.21.15.82:6835/4149738023] up:boot 2024-04-25T11:21:49.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:49 smithi196 ceph-mon[32659]: fsmap 5 up:standby 2024-04-25T11:21:49.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:49 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:21:49.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:49 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1740011966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:49.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:49 smithi080 ceph-mon[29126]: Deploying daemon mds.f on smithi196 2024-04-25T11:21:49.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:49 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6834/4149738023,v1:172.21.15.82:6835/4149738023] up:boot 2024-04-25T11:21:49.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:49 smithi080 ceph-mon[29126]: fsmap 5 up:standby 2024-04-25T11:21:49.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:49 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:21:49.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:49 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1740011966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:49.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:49 smithi082 ceph-mon[32440]: Deploying daemon mds.f on smithi196 2024-04-25T11:21:49.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:49 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6834/4149738023,v1:172.21.15.82:6835/4149738023] up:boot 2024-04-25T11:21:49.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:49 smithi082 ceph-mon[32440]: fsmap 5 up:standby 2024-04-25T11:21:49.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:49 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:21:49.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:49 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1740011966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:50.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:50 smithi196 ceph-mon[32659]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:50.193 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 systemd[1]: Starting Ceph mds.f for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:21:50.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:50 smithi080 ceph-mon[29126]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:50.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:50 smithi082 ceph-mon[32440]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:50.549 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 podman[63357]: 2024-04-25 11:21:50.290043059 +0000 UTC m=+0.114466395 container create d30e06c9f41ddf7ea5bb3a8baacbb77ca4c44c9e38f7cd2d1548bb6796e2d3fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-04-25T11:21:50.550 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 podman[63357]: 2024-04-25 11:21:50.193777729 +0000 UTC m=+0.018201065 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:21:50.550 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 podman[63357]: 2024-04-25 11:21:50.517726818 +0000 UTC m=+0.342150155 container init d30e06c9f41ddf7ea5bb3a8baacbb77ca4c44c9e38f7cd2d1548bb6796e2d3fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-25T11:21:50.550 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 podman[63357]: 2024-04-25 11:21:50.520385871 +0000 UTC m=+0.344809207 container start d30e06c9f41ddf7ea5bb3a8baacbb77ca4c44c9e38f7cd2d1548bb6796e2d3fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T11:21:50.942 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 ceph-mds[63376]: -- 172.21.15.196:0/1596770198 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d200cba40 con 0x556d20113180 2024-04-25T11:21:50.942 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f[63372]: starting mds.f at 2024-04-25T11:21:50.942 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 bash[63357]: d30e06c9f41ddf7ea5bb3a8baacbb77ca4c44c9e38f7cd2d1548bb6796e2d3fa 2024-04-25T11:21:50.942 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:21:50 smithi196 systemd[1]: Started Ceph mds.f for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:50.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:51.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 -- 172.21.15.80:0/1895806258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c10ba60 msgr2=0x7f315c10dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:51.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 --2- 172.21.15.80:0/1895806258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c10ba60 0x7f315c10dea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3154009ca0 tx=0x7f315402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 -- 172.21.15.80:0/1895806258 shutdown_connections 2024-04-25T11:21:51.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 --2- 172.21.15.80:0/1895806258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c10ba60 0x7f315c10dea0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 --2- 172.21.15.80:0/1895806258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f315c0769f0 0x7f315c10b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 --2- 172.21.15.80:0/1895806258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f315c0760a0 0x7f315c0764b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 -- 172.21.15.80:0/1895806258 >> 172.21.15.80:0/1895806258 conn(0x7f315c0fed40 msgr2=0x7f315c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 -- 172.21.15.80:0/1895806258 shutdown_connections 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 -- 172.21.15.80:0/1895806258 wait complete. 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 Processor -- start 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.119+0000 7f3163b57640 1 -- start start 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3163b57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c0760a0 0x7f315c19c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3163b57640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f315c0769f0 0x7f315c19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3163b57640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f315c10ba60 0x7f315c1a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3163b57640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f315c111800 con 0x7f315c0760a0 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3163b57640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f315c111680 con 0x7f315c10ba60 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3163b57640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f315c111980 con 0x7f315c0769f0 2024-04-25T11:21:51.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c0760a0 0x7f315c19c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c0760a0 0x7f315c19c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58352/0 (socket says 172.21.15.80:58352) 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 -- 172.21.15.80:0/1898890182 learned_addr learned my addr 172.21.15.80:0/1898890182 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31610f2640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f315c0769f0 0x7f315c19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31620f4640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f315c10ba60 0x7f315c1a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 -- 172.21.15.80:0/1898890182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f315c0769f0 msgr2=0x7f315c19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f315c0769f0 0x7f315c19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 -- 172.21.15.80:0/1898890182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f315c10ba60 msgr2=0x7f315c1a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f315c10ba60 0x7f315c1a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 -- 172.21.15.80:0/1898890182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c1a3eb0 con 0x7f315c0760a0 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31620f4640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f315c10ba60 0x7f315c1a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:21:51.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f31618f3640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c0760a0 0x7f315c19c370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9c0 tx=0x7f314c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:51.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3152ffd640 1 -- 172.21.15.80:0/1898890182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c00cd80 con 0x7f315c0760a0 2024-04-25T11:21:51.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3152ffd640 1 -- 172.21.15.80:0/1898890182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f314c0054d0 con 0x7f315c0760a0 2024-04-25T11:21:51.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.120+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c1a41a0 con 0x7f315c0760a0 2024-04-25T11:21:51.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.121+0000 7f3152ffd640 1 -- 172.21.15.80:0/1898890182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c010430 con 0x7f315c0760a0 2024-04-25T11:21:51.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.121+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c1a46f0 con 0x7f315c0760a0 2024-04-25T11:21:51.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.122+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c10ac20 con 0x7f315c0760a0 2024-04-25T11:21:51.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.123+0000 7f3152ffd640 1 -- 172.21.15.80:0/1898890182 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f314c004fd0 con 0x7f315c0760a0 2024-04-25T11:21:51.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.124+0000 7f3152ffd640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31480afaf0 0x7f31480b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:51.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.124+0000 7f31610f2640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31480afaf0 0x7f31480b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:51.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.124+0000 7f3152ffd640 1 -- 172.21.15.80:0/1898890182 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f314c0dec00 con 0x7f315c0760a0 2024-04-25T11:21:51.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.124+0000 7f31610f2640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31480afaf0 0x7f31480b2000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f315c19d410 tx=0x7f3158005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:51.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.128+0000 7f3152ffd640 1 -- 172.21.15.80:0/1898890182 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f314c0e5080 con 0x7f315c0760a0 2024-04-25T11:21:51.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.346+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f315c02db50 con 0x7f315c0760a0 2024-04-25T11:21:51.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.347+0000 7f3152ffd640 1 -- 172.21.15.80:0/1898890182 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7f314c0a7c80 con 0x7f315c0760a0 2024-04-25T11:21:51.343 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:51.343 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-25T11:21:51.344 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2024-04-25T11:21:51.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31480afaf0 msgr2=0x7f31480b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31480afaf0 0x7f31480b2000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f315c19d410 tx=0x7f3158005f90 comp rx=0 tx=0).stop 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c0760a0 msgr2=0x7f315c19c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c0760a0 0x7f315c19c370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9c0 tx=0x7f314c00ee80 comp rx=0 tx=0).stop 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 shutdown_connections 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31480afaf0 0x7f31480b2000 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f315c10ba60 0x7f315c1a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f315c0769f0 0x7f315c19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 --2- 172.21.15.80:0/1898890182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f315c0760a0 0x7f315c19c370 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 >> 172.21.15.80:0/1898890182 conn(0x7f315c0fed40 msgr2=0x7f315c0ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 shutdown_connections 2024-04-25T11:21:51.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:51.349+0000 7f3163b57640 1 -- 172.21.15.80:0/1898890182 wait complete. 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: Deploying daemon mds.c on smithi196 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6834/3574274014,v1:172.21.15.196:6835/3574274014] up:boot 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: fsmap 6 up:standby 2024-04-25T11:21:51.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:21:51.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:51.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:51 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1898890182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: Deploying daemon mds.c on smithi196 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6834/3574274014,v1:172.21.15.196:6835/3574274014] up:boot 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: fsmap 6 up:standby 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:51.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:51 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1898890182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:52.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:52.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:52.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:52.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: Deploying daemon mds.c on smithi196 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6834/3574274014,v1:172.21.15.196:6835/3574274014] up:boot 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: fsmap 6 up:standby 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:52.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:51 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1898890182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:52.942 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:52 smithi196 systemd[1]: Starting Ceph mds.c for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:21:53.325 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 podman[63666]: 2024-04-25 11:21:52.952028475 +0000 UTC m=+0.018287218 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:21:53.325 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 podman[63666]: 2024-04-25 11:21:53.068666589 +0000 UTC m=+0.134925317 container create fd0fbdd31f9daabce8fcde593a15e18448ea97865f01ab4128e1d93a639cb1be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T11:21:53.325 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 podman[63666]: 2024-04-25 11:21:53.330153479 +0000 UTC m=+0.396412208 container init fd0fbdd31f9daabce8fcde593a15e18448ea97865f01ab4128e1d93a639cb1be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T11:21:53.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:53.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.484+0000 7fefa53ce640 1 -- 172.21.15.80:0/63104157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0102a00 msgr2=0x7fefa0103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:53.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.484+0000 7fefa53ce640 1 --2- 172.21.15.80:0/63104157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0102a00 0x7fefa0103700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fef90009900 tx=0x7fef9002a410 comp rx=0 tx=0).stop 2024-04-25T11:21:53.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.484+0000 7fefa53ce640 1 -- 172.21.15.80:0/63104157 shutdown_connections 2024-04-25T11:21:53.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.484+0000 7fefa53ce640 1 --2- 172.21.15.80:0/63104157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0108940 0x7fefa010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.484+0000 7fefa53ce640 1 --2- 172.21.15.80:0/63104157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0103c40 0x7fefa0104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.484+0000 7fefa53ce640 1 --2- 172.21.15.80:0/63104157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0102a00 0x7fefa0103700 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.485+0000 7fefa53ce640 1 -- 172.21.15.80:0/63104157 >> 172.21.15.80:0/63104157 conn(0x7fefa00fdbf0 msgr2=0x7fefa01000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.485+0000 7fefa53ce640 1 -- 172.21.15.80:0/63104157 shutdown_connections 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.485+0000 7fefa53ce640 1 -- 172.21.15.80:0/63104157 wait complete. 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.485+0000 7fefa53ce640 1 Processor -- start 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.485+0000 7fefa53ce640 1 -- start start 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fefa53ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102a00 0x7fefa010d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fefa53ce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0103c40 0x7fefa010b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fefa53ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0108940 0x7fefa010beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fefa53ce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fefa010f630 con 0x7fefa0108940 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fefa53ce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefa010f4b0 con 0x7fefa0102a00 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fefa53ce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fefa010f7b0 con 0x7fefa0103c40 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0108940 0x7fefa010beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0108940 0x7fefa010beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58358/0 (socket says 172.21.15.80:58358) 2024-04-25T11:21:53.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef967fc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0103c40 0x7fefa010b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 -- 172.21.15.80:0/2322252456 learned_addr learned my addr 172.21.15.80:0/2322252456 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9effd640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102a00 0x7fefa010d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 -- 172.21.15.80:0/2322252456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0103c40 msgr2=0x7fefa010b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0103c40 0x7fefa010b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 -- 172.21.15.80:0/2322252456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102a00 msgr2=0x7fefa010d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102a00 0x7fefa010d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 -- 172.21.15.80:0/2322252456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa010c5e0 con 0x7fefa0108940 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9effd640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102a00 0x7fefa010d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9f7fe640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0108940 0x7fefa010beb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef9800efd0 tx=0x7fef9800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9cff9640 1 -- 172.21.15.80:0/2322252456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98003b70 con 0x7fefa0108940 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fef9cff9640 1 -- 172.21.15.80:0/2322252456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef98003d10 con 0x7fefa0108940 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.486+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa01a42c0 con 0x7fefa0108940 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.487+0000 7fef9cff9640 1 -- 172.21.15.80:0/2322252456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef980108a0 con 0x7fefa0108940 2024-04-25T11:21:53.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.487+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa01a4730 con 0x7fefa0108940 2024-04-25T11:21:53.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.488+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa0107750 con 0x7fefa0108940 2024-04-25T11:21:53.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.492+0000 7fef9cff9640 1 -- 172.21.15.80:0/2322252456 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fef98004b40 con 0x7fefa0108940 2024-04-25T11:21:53.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.493+0000 7fef9cff9640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afaf0 0x7fef8c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:53.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.493+0000 7fef9effd640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afaf0 0x7fef8c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:53.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.493+0000 7fef9cff9640 1 -- 172.21.15.80:0/2322252456 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fef980deff0 con 0x7fefa0108940 2024-04-25T11:21:53.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.494+0000 7fef9effd640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afaf0 0x7fef8c0b2000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef90009230 tx=0x7fef90000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:53.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.496+0000 7fef9cff9640 1 -- 172.21.15.80:0/2322252456 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef980a8070 con 0x7fefa0108940 2024-04-25T11:21:53.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 podman[63666]: 2024-04-25 11:21:53.332689279 +0000 UTC m=+0.398948007 container start fd0fbdd31f9daabce8fcde593a15e18448ea97865f01ab4128e1d93a639cb1be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-04-25T11:21:53.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 ceph-mds[63685]: -- 172.21.15.196:0/2348914402 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561cbca71a40 con 0x561cbcab9600 2024-04-25T11:21:53.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: starting mds.c at 2024-04-25T11:21:53.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 bash[63666]: fd0fbdd31f9daabce8fcde593a15e18448ea97865f01ab4128e1d93a639cb1be 2024-04-25T11:21:53.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:21:53 smithi196 systemd[1]: Started Ceph mds.c for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:53.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.731+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefa002db50 con 0x7fefa0108940 2024-04-25T11:21:53.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.732+0000 7fef9cff9640 1 -- 172.21.15.80:0/2322252456 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7fef980a7970 con 0x7fefa0108940 2024-04-25T11:21:53.727 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:53.727 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-25T11:21:53.727 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afaf0 msgr2=0x7fef8c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afaf0 0x7fef8c0b2000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef90009230 tx=0x7fef90000bc0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0108940 msgr2=0x7fefa010beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0108940 0x7fefa010beb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef9800efd0 tx=0x7fef9800c6a0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 shutdown_connections 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef8c0afaf0 0x7fef8c0b2000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefa0108940 0x7fefa010beb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa0103c40 0x7fefa010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 --2- 172.21.15.80:0/2322252456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefa0102a00 0x7fefa010d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 >> 172.21.15.80:0/2322252456 conn(0x7fefa00fdbf0 msgr2=0x7fefa0104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:53.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 shutdown_connections 2024-04-25T11:21:53.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:53.734+0000 7fefa53ce640 1 -- 172.21.15.80:0/2322252456 wait complete. 2024-04-25T11:21:54.449 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:54.450 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.450 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.450 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.450 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:54.450 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:54.450 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:54.450 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:54 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2322252456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:54.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:54.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:54.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:54.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:54.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:54 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2322252456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:54.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:54 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2322252456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:55.463 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:55 smithi082 ceph-mon[32440]: Deploying daemon mds.h on smithi082 2024-04-25T11:21:55.463 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:55 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6836/2620156093,v1:172.21.15.196:6837/2620156093] up:boot 2024-04-25T11:21:55.464 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:55 smithi082 ceph-mon[32440]: fsmap 7 up:standby 2024-04-25T11:21:55.464 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:21:55.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:55 smithi080 ceph-mon[29126]: Deploying daemon mds.h on smithi082 2024-04-25T11:21:55.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:55 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6836/2620156093,v1:172.21.15.196:6837/2620156093] up:boot 2024-04-25T11:21:55.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:55 smithi080 ceph-mon[29126]: fsmap 7 up:standby 2024-04-25T11:21:55.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:21:55.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:55 smithi196 ceph-mon[32659]: Deploying daemon mds.h on smithi082 2024-04-25T11:21:55.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:55 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6836/2620156093,v1:172.21.15.196:6837/2620156093] up:boot 2024-04-25T11:21:55.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:55 smithi196 ceph-mon[32659]: fsmap 7 up:standby 2024-04-25T11:21:55.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:21:55.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 -- 172.21.15.80:0/483759800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc108920 msgr2=0x7f60bc10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/483759800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc108920 0x7f60bc10ad40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009ca0 tx=0x7f60b402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:21:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 -- 172.21.15.80:0/483759800 shutdown_connections 2024-04-25T11:21:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/483759800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc108920 0x7f60bc10ad40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/483759800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60bc103c20 0x7f60bc104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/483759800 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60bc1029e0 0x7f60bc1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 -- 172.21.15.80:0/483759800 >> 172.21.15.80:0/483759800 conn(0x7f60bc0fdbf0 msgr2=0x7f60bc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 -- 172.21.15.80:0/483759800 shutdown_connections 2024-04-25T11:21:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.857+0000 7f60c1cd8640 1 -- 172.21.15.80:0/483759800 wait complete. 2024-04-25T11:21:55.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 Processor -- start 2024-04-25T11:21:55.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 -- start start 2024-04-25T11:21:55.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc1029e0 0x7f60bc1990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:55.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60bc103c20 0x7f60bc199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60bc108920 0x7f60bc1a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc10e4f0 con 0x7f60bc1029e0 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc10e370 con 0x7f60bc103c20 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60c1cd8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc10e670 con 0x7f60bc108920 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60bb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc1029e0 0x7f60bc1990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60bb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc1029e0 0x7f60bc1990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58370/0 (socket says 172.21.15.80:58370) 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60bb7fe640 1 -- 172.21.15.80:0/2169759294 learned_addr learned my addr 172.21.15.80:0/2169759294 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.858+0000 7f60baffd640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60bc103c20 0x7f60bc199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60bbfff640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60bc108920 0x7f60bc1a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60bb7fe640 1 -- 172.21.15.80:0/2169759294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60bc108920 msgr2=0x7f60bc1a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60bb7fe640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60bc108920 0x7f60bc1a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60bb7fe640 1 -- 172.21.15.80:0/2169759294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60bc103c20 msgr2=0x7f60bc199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60bb7fe640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60bc103c20 0x7f60bc199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:55.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60bb7fe640 1 -- 172.21.15.80:0/2169759294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1a0c20 con 0x7f60bc1029e0 2024-04-25T11:21:55.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60bb7fe640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc1029e0 0x7f60bc1990e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00d740 tx=0x7f60ac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:55.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60b8ff9640 1 -- 172.21.15.80:0/2169759294 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac017070 con 0x7f60bc1029e0 2024-04-25T11:21:55.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60b8ff9640 1 -- 172.21.15.80:0/2169759294 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60ac00de50 con 0x7f60bc1029e0 2024-04-25T11:21:55.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc1a0f10 con 0x7f60bc1029e0 2024-04-25T11:21:55.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60b8ff9640 1 -- 172.21.15.80:0/2169759294 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac003c30 con 0x7f60bc1029e0 2024-04-25T11:21:55.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.859+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc1a1370 con 0x7f60bc1029e0 2024-04-25T11:21:55.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.860+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60bc06a190 con 0x7f60bc1029e0 2024-04-25T11:21:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.861+0000 7f60b8ff9640 1 -- 172.21.15.80:0/2169759294 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f60ac003dd0 con 0x7f60bc1029e0 2024-04-25T11:21:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.862+0000 7f60b8ff9640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f60a40afaf0 0x7f60a40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.862+0000 7f60baffd640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f60a40afaf0 0x7f60a40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.862+0000 7f60b8ff9640 1 -- 172.21.15.80:0/2169759294 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f60ac0de190 con 0x7f60bc1029e0 2024-04-25T11:21:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.863+0000 7f60baffd640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f60a40afaf0 0x7f60a40b2000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f60bc19a180 tx=0x7f60b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:55.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:55.867+0000 7f60b8ff9640 1 -- 172.21.15.80:0/2169759294 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f60ac0a7210 con 0x7f60bc1029e0 2024-04-25T11:21:56.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.081+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60bc0637a0 con 0x7f60bc1029e0 2024-04-25T11:21:56.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.081+0000 7f60b8ff9640 1 -- 172.21.15.80:0/2169759294 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6343 (secure 0 0 0) 0x7f60ac0a6b10 con 0x7f60bc1029e0 2024-04-25T11:21:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:56.077 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-25T11:21:56.077 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2024-04-25T11:21:56.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f60a40afaf0 msgr2=0x7f60a40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:56.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f60a40afaf0 0x7f60a40b2000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f60bc19a180 tx=0x7f60b0005f90 comp rx=0 tx=0).stop 2024-04-25T11:21:56.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc1029e0 msgr2=0x7f60bc1990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:56.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc1029e0 0x7f60bc1990e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00d740 tx=0x7f60ac00dc00 comp rx=0 tx=0).stop 2024-04-25T11:21:56.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 shutdown_connections 2024-04-25T11:21:56.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f60a40afaf0 0x7f60a40b2000 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:56.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60bc108920 0x7f60bc1a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:56.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60bc103c20 0x7f60bc199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:56.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 --2- 172.21.15.80:0/2169759294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60bc1029e0 0x7f60bc1990e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:56.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 >> 172.21.15.80:0/2169759294 conn(0x7f60bc0fdbf0 msgr2=0x7f60bc104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:56.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.083+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 shutdown_connections 2024-04-25T11:21:56.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:56.084+0000 7f60c1cd8640 1 -- 172.21.15.80:0/2169759294 wait complete. 2024-04-25T11:21:56.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:56 smithi082 ceph-mon[32440]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:56.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:56 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2169759294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:56.496 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:21:56 smithi082 systemd[1]: Started Ceph mds.h for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:56.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:56 smithi080 ceph-mon[29126]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:56.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:56 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2169759294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:56 smithi196 ceph-mon[32659]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:56.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:56 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2169759294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: Deploying daemon mds.i on smithi196 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] up:boot 2024-04-25T11:21:57.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: fsmap 8 up:standby 2024-04-25T11:21:57.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:57 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: Deploying daemon mds.i on smithi196 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:57.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] up:boot 2024-04-25T11:21:57.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: fsmap 8 up:standby 2024-04-25T11:21:57.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:57 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: Deploying daemon mds.i on smithi196 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:57.882 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] up:boot 2024-04-25T11:21:57.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: fsmap 8 up:standby 2024-04-25T11:21:57.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:57 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:21:58.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:21:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 -- 172.21.15.80:0/1993881562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c103b30 msgr2=0x7fb60c104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 --2- 172.21.15.80:0/1993881562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c103b30 0x7fb60c104000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009900 tx=0x7fb5fc02a410 comp rx=0 tx=0).stop 2024-04-25T11:21:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 -- 172.21.15.80:0/1993881562 shutdown_connections 2024-04-25T11:21:58.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 --2- 172.21.15.80:0/1993881562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c103b30 0x7fb60c104000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 --2- 172.21.15.80:0/1993881562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c104690 0x7fb60c10ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 --2- 172.21.15.80:0/1993881562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60c102fd0 0x7fb60c1033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 -- 172.21.15.80:0/1993881562 >> 172.21.15.80:0/1993881562 conn(0x7fb60c0fd370 msgr2=0x7fb60c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 -- 172.21.15.80:0/1993881562 shutdown_connections 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.214+0000 7fb613d0d640 1 -- 172.21.15.80:0/1993881562 wait complete. 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 Processor -- start 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 -- start start 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102fd0 0x7fb60c19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60c103b30 0x7fb60c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c19f4e0 0x7fb60c1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c10f860 con 0x7fb60c19f4e0 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c10f6e0 con 0x7fb60c102fd0 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb613d0d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c10f9e0 con 0x7fb60c103b30 2024-04-25T11:21:58.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb6122aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c19f4e0 0x7fb60c1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb6122aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c19f4e0 0x7fb60c1a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33150/0 (socket says 172.21.15.80:33150) 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb6122aa640 1 -- 172.21.15.80:0/118239346 learned_addr learned my addr 172.21.15.80:0/118239346 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb6112a8640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60c103b30 0x7fb60c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.215+0000 7fb611aa9640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102fd0 0x7fb60c19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb6122aa640 1 -- 172.21.15.80:0/118239346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60c103b30 msgr2=0x7fb60c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb6122aa640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60c103b30 0x7fb60c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb6122aa640 1 -- 172.21.15.80:0/118239346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102fd0 msgr2=0x7fb60c19a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb6122aa640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102fd0 0x7fb60c19a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb6122aa640 1 -- 172.21.15.80:0/118239346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c1a1f70 con 0x7fb60c19f4e0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb6122aa640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c19f4e0 0x7fb60c1a1900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb604009fd0 tx=0x7fb60400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb602ffd640 1 -- 172.21.15.80:0/118239346 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604017070 con 0x7fb60c19f4e0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb602ffd640 1 -- 172.21.15.80:0/118239346 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb604003e20 con 0x7fb60c19f4e0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb602ffd640 1 -- 172.21.15.80:0/118239346 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604010460 con 0x7fb60c19f4e0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c1a2260 con 0x7fb60c19f4e0 2024-04-25T11:21:58.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.216+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c1a2760 con 0x7fb60c19f4e0 2024-04-25T11:21:58.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.217+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60c06b3a0 con 0x7fb60c19f4e0 2024-04-25T11:21:58.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.219+0000 7fb602ffd640 1 -- 172.21.15.80:0/118239346 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fb604003970 con 0x7fb60c19f4e0 2024-04-25T11:21:58.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.220+0000 7fb602ffd640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb5f80afaf0 0x7fb5f80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:21:58.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.220+0000 7fb611aa9640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb5f80afaf0 0x7fb5f80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:21:58.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.220+0000 7fb602ffd640 1 -- 172.21.15.80:0/118239346 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb6040de450 con 0x7fb60c19f4e0 2024-04-25T11:21:58.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.220+0000 7fb611aa9640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb5f80afaf0 0x7fb5f80b2000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb60c103a30 tx=0x7fb60800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:21:58.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.224+0000 7fb602ffd640 1 -- 172.21.15.80:0/118239346 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6040a6e80 con 0x7fb60c19f4e0 2024-04-25T11:21:58.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.439+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb60c1073e0 con 0x7fb60c19f4e0 2024-04-25T11:21:58.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.440+0000 7fb602ffd640 1 -- 172.21.15.80:0/118239346 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7168 (secure 0 0 0) 0x7fb6040ab180 con 0x7fb60c19f4e0 2024-04-25T11:21:58.435 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:21:58.435 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T11:21:58.435 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-25T11:21:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb5f80afaf0 msgr2=0x7fb5f80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb5f80afaf0 0x7fb5f80b2000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb60c103a30 tx=0x7fb60800b390 comp rx=0 tx=0).stop 2024-04-25T11:21:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c19f4e0 msgr2=0x7fb60c1a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:21:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c19f4e0 0x7fb60c1a1900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb604009fd0 tx=0x7fb60400b260 comp rx=0 tx=0).stop 2024-04-25T11:21:58.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 shutdown_connections 2024-04-25T11:21:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb5f80afaf0 0x7fb5f80b2000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60c19f4e0 0x7fb60c1a1900 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60c103b30 0x7fb60c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 --2- 172.21.15.80:0/118239346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102fd0 0x7fb60c19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:21:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 >> 172.21.15.80:0/118239346 conn(0x7fb60c0fd370 msgr2=0x7fb60c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:21:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 shutdown_connections 2024-04-25T11:21:58.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:21:58.442+0000 7fb613d0d640 1 -- 172.21.15.80:0/118239346 wait complete. 2024-04-25T11:21:58.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:58 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/118239346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:58.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:58 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/118239346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:58.942 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:58 smithi196 systemd[1]: Starting Ceph mds.i for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:21:58.995 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:58 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/118239346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:21:59.248 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:58 smithi196 podman[63975]: 2024-04-25 11:21:58.869136108 +0000 UTC m=+0.018690632 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:21:59.248 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:58 smithi196 podman[63975]: 2024-04-25 11:21:58.991404343 +0000 UTC m=+0.140958851 container create b2f85528d22ece9704290d71de9f31257669363dac3bac2cf5eec7c9a56356b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T11:21:59.249 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:59 smithi196 podman[63975]: 2024-04-25 11:21:59.253841098 +0000 UTC m=+0.403395606 container init b2f85528d22ece9704290d71de9f31257669363dac3bac2cf5eec7c9a56356b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:21:59.536 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:59 smithi196 podman[63975]: 2024-04-25 11:21:59.25659101 +0000 UTC m=+0.406145528 container start b2f85528d22ece9704290d71de9f31257669363dac3bac2cf5eec7c9a56356b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD) 2024-04-25T11:21:59.536 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mds[63994]: -- 172.21.15.196:0/714716023 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a80471a40 con 0x555a804b9180 2024-04-25T11:21:59.536 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i[63990]: starting mds.i at 2024-04-25T11:21:59.537 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:59 smithi196 bash[63975]: b2f85528d22ece9704290d71de9f31257669363dac3bac2cf5eec7c9a56356b5 2024-04-25T11:21:59.537 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:21:59 smithi196 systemd[1]: Started Ceph mds.i for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:21:59.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:59 smithi080 ceph-mon[29126]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:59.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:59.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:59.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:21:59 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mon[32659]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:59.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:21:59 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:21:59.995 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:59 smithi082 ceph-mon[32440]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:21:59.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:21:59.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:21:59.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:21:59.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:21:59 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:00.449 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:22:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 -- 172.21.15.80:0/45864249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 msgr2=0x7f4bfc10bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 --2- 172.21.15.80:0/45864249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc10bc90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009ca0 tx=0x7f4bf402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 -- 172.21.15.80:0/45864249 shutdown_connections 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 --2- 172.21.15.80:0/45864249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc10bc90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 --2- 172.21.15.80:0/45864249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bfc101730 0x7f4bfc101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 --2- 172.21.15.80:0/45864249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bfc105080 0x7f4bfc105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 -- 172.21.15.80:0/45864249 >> 172.21.15.80:0/45864249 conn(0x7f4bfc0fd330 msgr2=0x7f4bfc0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 -- 172.21.15.80:0/45864249 shutdown_connections 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.565+0000 7f4c03d64640 1 -- 172.21.15.80:0/45864249 wait complete. 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 Processor -- start 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 -- start start 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bfc101730 0x7f4bfc19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bfc105080 0x7f4bfc1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc10f610 con 0x7f4bfc102230 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc10f490 con 0x7f4bfc101730 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c03d64640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc10f790 con 0x7f4bfc105080 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33160/0 (socket says 172.21.15.80:33160) 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 -- 172.21.15.80:0/186455300 learned_addr learned my addr 172.21.15.80:0/186455300 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c02301640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bfc105080 0x7f4bfc1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c01b00640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bfc101730 0x7f4bfc19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 -- 172.21.15.80:0/186455300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bfc105080 msgr2=0x7f4bfc1a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bfc105080 0x7f4bfc1a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 -- 172.21.15.80:0/186455300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bfc101730 msgr2=0x7f4bfc19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bfc101730 0x7f4bfc19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.566+0000 7f4c012ff640 1 -- 172.21.15.80:0/186455300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc1a1c60 con 0x7f4bfc102230 2024-04-25T11:22:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.567+0000 7f4c02301640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bfc105080 0x7f4bfc1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.567+0000 7f4c012ff640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc19a710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00d770 tx=0x7f4bec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.567+0000 7f4bf2ffd640 1 -- 172.21.15.80:0/186455300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec017070 con 0x7f4bfc102230 2024-04-25T11:22:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.567+0000 7f4bf2ffd640 1 -- 172.21.15.80:0/186455300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bec0054d0 con 0x7f4bfc102230 2024-04-25T11:22:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.567+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc1a1f50 con 0x7f4bfc102230 2024-04-25T11:22:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.567+0000 7f4bf2ffd640 1 -- 172.21.15.80:0/186455300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec004c30 con 0x7f4bfc102230 2024-04-25T11:22:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.567+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc1a23c0 con 0x7f4bfc102230 2024-04-25T11:22:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.568+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc10aa20 con 0x7f4bfc102230 2024-04-25T11:22:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.570+0000 7f4bf2ffd640 1 -- 172.21.15.80:0/186455300 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f4bec004dd0 con 0x7f4bfc102230 2024-04-25T11:22:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.571+0000 7f4bf2ffd640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4be80afaf0 0x7f4be80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.571+0000 7f4c01b00640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4be80afaf0 0x7f4be80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.571+0000 7f4bf2ffd640 1 -- 172.21.15.80:0/186455300 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f4bec0de700 con 0x7f4bfc102230 2024-04-25T11:22:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.571+0000 7f4c01b00640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4be80afaf0 0x7f4be80b2000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8005fd0 tx=0x7f4bf8005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.574+0000 7f4bf2ffd640 1 -- 172.21.15.80:0/186455300 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4bec0a7780 con 0x7f4bfc102230 2024-04-25T11:22:00.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:00 smithi080 ceph-mon[29126]: Deploying daemon mds.g on smithi080 2024-04-25T11:22:00.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:00 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] up:boot 2024-04-25T11:22:00.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:00 smithi080 ceph-mon[29126]: fsmap 9 up:standby 2024-04-25T11:22:00.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:00 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:22:00.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.799+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bfc02dd10 con 0x7f4bfc102230 2024-04-25T11:22:00.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.800+0000 7f4bf2ffd640 1 -- 172.21.15.80:0/186455300 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7998 (secure 0 0 0) 0x7f4bec0a7080 con 0x7f4bfc102230 2024-04-25T11:22:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:00.795 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T11:22:00.796 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-04-25T11:22:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4be80afaf0 msgr2=0x7f4be80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4be80afaf0 0x7f4be80b2000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8005fd0 tx=0x7f4bf8005ce0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 msgr2=0x7f4bfc19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc19a710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00d770 tx=0x7f4bec00dc30 comp rx=0 tx=0).stop 2024-04-25T11:22:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 shutdown_connections 2024-04-25T11:22:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4be80afaf0 0x7f4be80b2000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bfc102230 0x7f4bfc19a710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bfc105080 0x7f4bfc1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 --2- 172.21.15.80:0/186455300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bfc101730 0x7f4bfc19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 >> 172.21.15.80:0/186455300 conn(0x7f4bfc0fd330 msgr2=0x7f4bfc107bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 shutdown_connections 2024-04-25T11:22:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:00.802+0000 7f4c03d64640 1 -- 172.21.15.80:0/186455300 wait complete. 2024-04-25T11:22:00.941 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:00 smithi196 ceph-mon[32659]: Deploying daemon mds.g on smithi080 2024-04-25T11:22:00.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:00 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] up:boot 2024-04-25T11:22:00.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:00 smithi196 ceph-mon[32659]: fsmap 9 up:standby 2024-04-25T11:22:00.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:00 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:22:00.995 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:00 smithi082 ceph-mon[32440]: Deploying daemon mds.g on smithi080 2024-04-25T11:22:00.995 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:00 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] up:boot 2024-04-25T11:22:00.995 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:00 smithi082 ceph-mon[32440]: fsmap 9 up:standby 2024-04-25T11:22:00.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:00 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:22:01.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:01 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/186455300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:01.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:01 smithi080 ceph-mon[29126]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:01.941 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:01 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/186455300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:01.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:01 smithi196 ceph-mon[32659]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:01.995 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:01 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/186455300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:01.996 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:01 smithi082 ceph-mon[32440]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:02.380 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 25 11:22:02 smithi080 systemd[1]: Started Ceph mds.g for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:22:02.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.926+0000 7f18cc8ee640 1 -- 172.21.15.80:0/855006957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8109a20 msgr2=0x7f18c810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.926+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/855006957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8109a20 0x7f18c810be40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009ca0 tx=0x7f18c002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 -- 172.21.15.80:0/855006957 shutdown_connections 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/855006957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8109a20 0x7f18c810be40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/855006957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18c8104d20 0x7f18c8105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/855006957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18c8103ae0 0x7f18c81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 -- 172.21.15.80:0/855006957 >> 172.21.15.80:0/855006957 conn(0x7f18c80fed10 msgr2=0x7f18c8101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 -- 172.21.15.80:0/855006957 shutdown_connections 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 -- 172.21.15.80:0/855006957 wait complete. 2024-04-25T11:22:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 Processor -- start 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 -- start start 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.927+0000 7f18cc8ee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18c8103ae0 0x7f18c8077910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18cc8ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8104d20 0x7f18c8076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18cc8ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18c8109a20 0x7f18c8076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18cc8ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810f610 con 0x7f18c8104d20 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18cc8ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810f490 con 0x7f18c8109a20 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18cc8ee640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810f790 con 0x7f18c8103ae0 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8104d20 0x7f18c8076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8104d20 0x7f18c8076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33188/0 (socket says 172.21.15.80:33188) 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 -- 172.21.15.80:0/1003679315 learned_addr learned my addr 172.21.15.80:0/1003679315 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18c6d9d640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18c8109a20 0x7f18c8076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:02.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18c659c640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18c8103ae0 0x7f18c8077910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 -- 172.21.15.80:0/1003679315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18c8103ae0 msgr2=0x7f18c8077910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18c8103ae0 0x7f18c8077910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 -- 172.21.15.80:0/1003679315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18c8109a20 msgr2=0x7f18c8076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18c8109a20 0x7f18c8076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 -- 172.21.15.80:0/1003679315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c8076c20 con 0x7f18c8104d20 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bffff640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8104d20 0x7f18c8076000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d950 tx=0x7f18b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bf7fe640 1 -- 172.21.15.80:0/1003679315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0017070 con 0x7f18c8104d20 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bf7fe640 1 -- 172.21.15.80:0/1003679315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18b0009c30 con 0x7f18c8104d20 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18bf7fe640 1 -- 172.21.15.80:0/1003679315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b000f620 con 0x7f18c8104d20 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c81a42a0 con 0x7f18c8104d20 2024-04-25T11:22:02.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.928+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c81a4760 con 0x7f18c8104d20 2024-04-25T11:22:02.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.929+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c806a190 con 0x7f18c8104d20 2024-04-25T11:22:02.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.931+0000 7f18bf7fe640 1 -- 172.21.15.80:0/1003679315 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f18b0010460 con 0x7f18c8104d20 2024-04-25T11:22:02.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.932+0000 7f18bf7fe640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f18b40afb70 0x7f18b40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:02.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.932+0000 7f18c659c640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f18b40afb70 0x7f18b40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:02.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.932+0000 7f18bf7fe640 1 -- 172.21.15.80:0/1003679315 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f18b00de2d0 con 0x7f18c8104d20 2024-04-25T11:22:02.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.932+0000 7f18c659c640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f18b40afb70 0x7f18b40b2080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18b8005fd0 tx=0x7f18b8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:02.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:02.936+0000 7f18bf7fe640 1 -- 172.21.15.80:0/1003679315 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f18b00a73d0 con 0x7f18c8104d20 2024-04-25T11:22:03.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.165+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18c802dec0 con 0x7f18c8104d20 2024-04-25T11:22:03.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.166+0000 7f18bf7fe640 1 -- 172.21.15.80:0/1003679315 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8821 (secure 0 0 0) 0x7f18b0009de0 con 0x7f18c8104d20 2024-04-25T11:22:03.161 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:03.161 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T11:22:03.161 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2024-04-25T11:22:03.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f18b40afb70 msgr2=0x7f18b40b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:03.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f18b40afb70 0x7f18b40b2080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18b8005fd0 tx=0x7f18b8005850 comp rx=0 tx=0).stop 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8104d20 msgr2=0x7f18c8076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8104d20 0x7f18c8076000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d950 tx=0x7f18b000de10 comp rx=0 tx=0).stop 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 shutdown_connections 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f18b40afb70 0x7f18b40b2080 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18c8104d20 0x7f18c8076000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18c8109a20 0x7f18c8076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 --2- 172.21.15.80:0/1003679315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18c8103ae0 0x7f18c8077910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 >> 172.21.15.80:0/1003679315 conn(0x7f18c80fed10 msgr2=0x7f18c8105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 shutdown_connections 2024-04-25T11:22:03.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:03.168+0000 7f18cc8ee640 1 -- 172.21.15.80:0/1003679315 wait complete. 2024-04-25T11:22:03.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:22:03.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:22:03.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:03.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: Deploying daemon mds.a on smithi080 2024-04-25T11:22:03.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.80:6838/362397006,v1:172.21.15.80:6839/362397006] up:boot 2024-04-25T11:22:03.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: fsmap 10 up:standby 2024-04-25T11:22:03.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T11:22:03.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:03 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1003679315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:03.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: Deploying daemon mds.a on smithi080 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.80:6838/362397006,v1:172.21.15.80:6839/362397006] up:boot 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: fsmap 10 up:standby 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T11:22:03.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:03 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1003679315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: Deploying daemon mds.a on smithi080 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.80:6838/362397006,v1:172.21.15.80:6839/362397006] up:boot 2024-04-25T11:22:03.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: fsmap 10 up:standby 2024-04-25T11:22:03.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T11:22:03.693 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:03 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1003679315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:04.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:04 smithi082 ceph-mon[32440]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:04.544 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:04 smithi080 ceph-mon[29126]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:04.544 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 systemd[1]: Starting Ceph mds.a for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:22:04.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:04 smithi196 ceph-mon[32659]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:04.795 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 podman[70603]: 2024-04-25 11:22:04.451657432 +0000 UTC m=+0.018401213 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:22:04.796 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 podman[70603]: 2024-04-25 11:22:04.562698471 +0000 UTC m=+0.129442235 container create 8ccd7807e23ad29b00c95dc8e9f54ddc285bcd2a83812ee101acb9c6cf70881a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-25T11:22:04.796 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 podman[70603]: 2024-04-25 11:22:04.798626006 +0000 UTC m=+0.365369771 container init 8ccd7807e23ad29b00c95dc8e9f54ddc285bcd2a83812ee101acb9c6cf70881a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:22:04.796 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 podman[70603]: 2024-04-25 11:22:04.801105131 +0000 UTC m=+0.367848896 container start 8ccd7807e23ad29b00c95dc8e9f54ddc285bcd2a83812ee101acb9c6cf70881a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-25T11:22:05.130 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 ceph-mds[70622]: -- 172.21.15.80:0/3857612720 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e6336bfa40 con 0x55e633707180 2024-04-25T11:22:05.130 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a[70618]: starting mds.a at 2024-04-25T11:22:05.130 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 bash[70603]: 8ccd7807e23ad29b00c95dc8e9f54ddc285bcd2a83812ee101acb9c6cf70881a 2024-04-25T11:22:05.131 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:22:04 smithi080 systemd[1]: Started Ceph mds.a for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:22:05.175 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:22:05.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 -- 172.21.15.80:0/1931863563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c1029c0 msgr2=0x7f026c1036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:05.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 --2- 172.21.15.80:0/1931863563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c1029c0 0x7f026c1036c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0268009900 tx=0x7f026802a410 comp rx=0 tx=0).stop 2024-04-25T11:22:05.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 -- 172.21.15.80:0/1931863563 shutdown_connections 2024-04-25T11:22:05.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 --2- 172.21.15.80:0/1931863563 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f026c108900 0x7f026c10ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 --2- 172.21.15.80:0/1931863563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c103c00 0x7f026c104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 --2- 172.21.15.80:0/1931863563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c1029c0 0x7f026c1036c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 -- 172.21.15.80:0/1931863563 >> 172.21.15.80:0/1931863563 conn(0x7f026c0fdbd0 msgr2=0x7f026c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 -- 172.21.15.80:0/1931863563 shutdown_connections 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.294+0000 7f0274084640 1 -- 172.21.15.80:0/1931863563 wait complete. 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 Processor -- start 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 -- start start 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c1029c0 0x7f026c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c103c00 0x7f026c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f026c108900 0x7f026c1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f026c10e520 con 0x7f026c103c00 2024-04-25T11:22:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f026c10e3a0 con 0x7f026c1029c0 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0274084640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f026c10e6a0 con 0x7f026c108900 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c103c00 0x7f026c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c103c00 0x7f026c19f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33246/0 (socket says 172.21.15.80:33246) 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 -- 172.21.15.80:0/1483146497 learned_addr learned my addr 172.21.15.80:0/1483146497 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0271e20640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c1029c0 0x7f026c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f0272621640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f026c108900 0x7f026c1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 -- 172.21.15.80:0/1483146497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f026c108900 msgr2=0x7f026c1a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f026c108900 0x7f026c1a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 -- 172.21.15.80:0/1483146497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c1029c0 msgr2=0x7f026c06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c1029c0 0x7f026c06a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.295+0000 7f027161f640 1 -- 172.21.15.80:0/1483146497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c1a1d90 con 0x7f026c103c00 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.296+0000 7f027161f640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c103c00 0x7f026c19f020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d950 tx=0x7f025c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.296+0000 7f0262ffd640 1 -- 172.21.15.80:0/1483146497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c017030 con 0x7f026c103c00 2024-04-25T11:22:05.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.296+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c1a2080 con 0x7f026c103c00 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.296+0000 7f0262ffd640 1 -- 172.21.15.80:0/1483146497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f025c004020 con 0x7f026c103c00 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.296+0000 7f0262ffd640 1 -- 172.21.15.80:0/1483146497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0047a0 con 0x7f026c103c00 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.296+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c1a25d0 con 0x7f026c103c00 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.297+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026c107710 con 0x7f026c103c00 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.298+0000 7f0262ffd640 1 -- 172.21.15.80:0/1483146497 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f025c009a30 con 0x7f026c103c00 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.299+0000 7f0262ffd640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f02580afaf0 0x7f02580b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.299+0000 7f0271e20640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f02580afaf0 0x7f02580b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.299+0000 7f0262ffd640 1 -- 172.21.15.80:0/1483146497 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f025c0de8d0 con 0x7f026c103c00 2024-04-25T11:22:05.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.299+0000 7f0271e20640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f02580afaf0 0x7f02580b2000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0268005ab0 tx=0x7f0268031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:05.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.302+0000 7f0262ffd640 1 -- 172.21.15.80:0/1483146497 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f025c0a7950 con 0x7f026c103c00 2024-04-25T11:22:05.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.517+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f026c02db50 con 0x7f026c103c00 2024-04-25T11:22:05.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.518+0000 7f0262ffd640 1 -- 172.21.15.80:0/1483146497 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9647 (secure 0 0 0) 0x7f025c0a7250 con 0x7f026c103c00 2024-04-25T11:22:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:05.514 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T11:22:05.514 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 12 2024-04-25T11:22:05.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f02580afaf0 msgr2=0x7f02580b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:05.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f02580afaf0 0x7f02580b2000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0268005ab0 tx=0x7f0268031400 comp rx=0 tx=0).stop 2024-04-25T11:22:05.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c103c00 msgr2=0x7f026c19f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:05.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c103c00 0x7f026c19f020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d950 tx=0x7f025c00de10 comp rx=0 tx=0).stop 2024-04-25T11:22:05.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 shutdown_connections 2024-04-25T11:22:05.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f02580afaf0 0x7f02580b2000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f026c103c00 0x7f026c19f020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f026c108900 0x7f026c1a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 --2- 172.21.15.80:0/1483146497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c1029c0 0x7f026c06a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:05.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 >> 172.21.15.80:0/1483146497 conn(0x7f026c0fdbd0 msgr2=0x7f026c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:05.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 shutdown_connections 2024-04-25T11:22:05.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:05.520+0000 7f0274084640 1 -- 172.21.15.80:0/1483146497 wait complete. 2024-04-25T11:22:06.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: Deploying daemon mds.b on smithi082 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.80:6840/4101739388,v1:172.21.15.80:6841/4101739388] up:boot 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: fsmap 11 up:standby 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:06.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:05 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1483146497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:06.380 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:22:06.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:22:06.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:06.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: Deploying daemon mds.b on smithi082 2024-04-25T11:22:06.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.80:6840/4101739388,v1:172.21.15.80:6841/4101739388] up:boot 2024-04-25T11:22:06.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: fsmap 11 up:standby 2024-04-25T11:22:06.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T11:22:06.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:06.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:05 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1483146497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: Deploying daemon mds.b on smithi082 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.80:6840/4101739388,v1:172.21.15.80:6841/4101739388] up:boot 2024-04-25T11:22:06.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: fsmap 11 up:standby 2024-04-25T11:22:06.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T11:22:06.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:06.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:05 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1483146497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:07.495 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 systemd[1]: Starting Ceph mds.b for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:22:07.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 -- 172.21.15.80:0/4248681666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 msgr2=0x7f89101054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 --2- 172.21.15.80:0/4248681666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101054a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8900009900 tx=0x7f890002a410 comp rx=0 tx=0).stop 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 -- 172.21.15.80:0/4248681666 shutdown_connections 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 --2- 172.21.15.80:0/4248681666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8910102240 0x7f891010bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 --2- 172.21.15.80:0/4248681666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8910101740 0x7f8910101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 --2- 172.21.15.80:0/4248681666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101054a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 -- 172.21.15.80:0/4248681666 >> 172.21.15.80:0/4248681666 conn(0x7f89100fd340 msgr2=0x7f89100ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 -- 172.21.15.80:0/4248681666 shutdown_connections 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.661+0000 7f8915b6c640 1 -- 172.21.15.80:0/4248681666 wait complete. 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 Processor -- start 2024-04-25T11:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 -- start start 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8910101740 0x7f891019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8910102240 0x7f891019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f891010f5e0 con 0x7f8910105090 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f891010f460 con 0x7f8910102240 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f8915b6c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f891010f760 con 0x7f8910101740 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f890ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f890ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60304/0 (socket says 172.21.15.80:60304) 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f890ffff640 1 -- 172.21.15.80:0/3666793337 learned_addr learned my addr 172.21.15.80:0/3666793337 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.662+0000 7f890f7fe640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8910101740 0x7f891019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f8907fff640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8910102240 0x7f891019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890ffff640 1 -- 172.21.15.80:0/3666793337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8910101740 msgr2=0x7f891019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890ffff640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8910101740 0x7f891019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890ffff640 1 -- 172.21.15.80:0/3666793337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8910102240 msgr2=0x7f891019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890ffff640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8910102240 0x7f891019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890ffff640 1 -- 172.21.15.80:0/3666793337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89101a1d50 con 0x7f8910105090 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f8907fff640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8910102240 0x7f891019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890ffff640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101a16e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f890800eb10 tx=0x7f890800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890d7fa640 1 -- 172.21.15.80:0/3666793337 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908004b20 con 0x7f8910105090 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890d7fa640 1 -- 172.21.15.80:0/3666793337 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8908004cc0 con 0x7f8910105090 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89101a1fe0 con 0x7f8910105090 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f890d7fa640 1 -- 172.21.15.80:0/3666793337 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908010670 con 0x7f8910105090 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.663+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89101a2450 con 0x7f8910105090 2024-04-25T11:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.664+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8910108a20 con 0x7f8910105090 2024-04-25T11:22:07.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.666+0000 7f890d7fa640 1 -- 172.21.15.80:0/3666793337 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f8908005000 con 0x7f8910105090 2024-04-25T11:22:07.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.667+0000 7f890d7fa640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88fc0afaf0 0x7f88fc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:07.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.667+0000 7f890f7fe640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88fc0afaf0 0x7f88fc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:07.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.667+0000 7f890d7fa640 1 -- 172.21.15.80:0/3666793337 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f89080defa0 con 0x7f8910105090 2024-04-25T11:22:07.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.668+0000 7f890f7fe640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88fc0afaf0 0x7f88fc0b2000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8900005ab0 tx=0x7f8900031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:07.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.671+0000 7f890d7fa640 1 -- 172.21.15.80:0/3666793337 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8908053ff0 con 0x7f8910105090 2024-04-25T11:22:07.805 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 podman[63182]: 2024-04-25 11:22:07.409661021 +0000 UTC m=+0.018006509 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:22:07.806 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 podman[63182]: 2024-04-25 11:22:07.562302714 +0000 UTC m=+0.170648176 container create ee77e2f0910e32169f2eb98aee5347c3c005ae91065b3ef11957e926edf8be95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:22:07.806 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 podman[63182]: 2024-04-25 11:22:07.811050305 +0000 UTC m=+0.419395766 container init ee77e2f0910e32169f2eb98aee5347c3c005ae91065b3ef11957e926edf8be95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-25T11:22:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.886+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f891002db50 con 0x7f8910105090 2024-04-25T11:22:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.887+0000 7f890d7fa640 1 -- 172.21.15.80:0/3666793337 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9647 (secure 0 0 0) 0x7f89080a8020 con 0x7f8910105090 2024-04-25T11:22:07.883 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:07.883 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T11:22:07.883 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 12 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88fc0afaf0 msgr2=0x7f88fc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88fc0afaf0 0x7f88fc0b2000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8900005ab0 tx=0x7f8900031400 comp rx=0 tx=0).stop 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 msgr2=0x7f89101a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101a16e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f890800eb10 tx=0x7f890800c2d0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 shutdown_connections 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f88fc0afaf0 0x7f88fc0b2000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8910105090 0x7f89101a16e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8910102240 0x7f891019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 --2- 172.21.15.80:0/3666793337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8910101740 0x7f891019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:07.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 >> 172.21.15.80:0/3666793337 conn(0x7f89100fd340 msgr2=0x7f8910105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:07.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 shutdown_connections 2024-04-25T11:22:07.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:07.889+0000 7f8915b6c640 1 -- 172.21.15.80:0/3666793337 wait complete. 2024-04-25T11:22:08.245 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 podman[63182]: 2024-04-25 11:22:07.813709104 +0000 UTC m=+0.422054568 container start ee77e2f0910e32169f2eb98aee5347c3c005ae91065b3ef11957e926edf8be95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T11:22:08.245 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 ceph-mds[63201]: -- 172.21.15.82:0/854503495 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611b31eda40 con 0x5611b3235600 2024-04-25T11:22:08.246 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: starting mds.b at 2024-04-25T11:22:08.246 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 bash[63182]: ee77e2f0910e32169f2eb98aee5347c3c005ae91065b3ef11957e926edf8be95 2024-04-25T11:22:08.246 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:07 smithi082 systemd[1]: Started Ceph mds.b for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3666793337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:08 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3666793337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:08 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:22:08.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:08.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3666793337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:08.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:08.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:08 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:22:09.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:09 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] up:boot 2024-04-25T11:22:09.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:09 smithi082 ceph-mon[32440]: fsmap 12 up:standby 2024-04-25T11:22:09.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:09 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:22:09.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:09 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] up:boot 2024-04-25T11:22:09.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:09 smithi080 ceph-mon[29126]: fsmap 12 up:standby 2024-04-25T11:22:09.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:09 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:22:09.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:09 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] up:boot 2024-04-25T11:22:09.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:09 smithi196 ceph-mon[32659]: fsmap 12 up:standby 2024-04-25T11:22:09.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:09 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:22:09.897 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:22:10.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 -- 172.21.15.80:0/2115069902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec1029c0 msgr2=0x7fcdec1036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2115069902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec1029c0 0x7fcdec1036c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009900 tx=0x7fcde402a410 comp rx=0 tx=0).stop 2024-04-25T11:22:10.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 -- 172.21.15.80:0/2115069902 shutdown_connections 2024-04-25T11:22:10.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2115069902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdec108900 0x7fcdec10ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2115069902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdec103c00 0x7fcdec104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2115069902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec1029c0 0x7fcdec1036c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 -- 172.21.15.80:0/2115069902 >> 172.21.15.80:0/2115069902 conn(0x7fcdec0fdbd0 msgr2=0x7fcdec100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 -- 172.21.15.80:0/2115069902 shutdown_connections 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 -- 172.21.15.80:0/2115069902 wait complete. 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.021+0000 7fcdf4670640 1 Processor -- start 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 -- start start 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdec1029c0 0x7fcdec19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec103c00 0x7fcdec19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdec108900 0x7fcdec1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec10e4a0 con 0x7fcdec103c00 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec10e320 con 0x7fcdec1029c0 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec10e620 con 0x7fcdec108900 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec103c00 0x7fcdec19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec103c00 0x7fcdec19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60322/0 (socket says 172.21.15.80:60322) 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 -- 172.21.15.80:0/2498438663 learned_addr learned my addr 172.21.15.80:0/2498438663 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf240c640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdec1029c0 0x7fcdec19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf2c0d640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdec108900 0x7fcdec1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 -- 172.21.15.80:0/2498438663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdec108900 msgr2=0x7fcdec1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdec108900 0x7fcdec1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 -- 172.21.15.80:0/2498438663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdec1029c0 msgr2=0x7fcdec19a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdec1029c0 0x7fcdec19a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 -- 172.21.15.80:0/2498438663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec1a1d70 con 0x7fcdec103c00 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf1c0b640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec103c00 0x7fcdec19a770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00d950 tx=0x7fcddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcde37fe640 1 -- 172.21.15.80:0/2498438663 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc017030 con 0x7fcdec103c00 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcde37fe640 1 -- 172.21.15.80:0/2498438663 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcddc004020 con 0x7fcdec103c00 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdec1a2060 con 0x7fcdec103c00 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.022+0000 7fcde37fe640 1 -- 172.21.15.80:0/2498438663 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0047a0 con 0x7fcdec103c00 2024-04-25T11:22:10.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.023+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdec1a25b0 con 0x7fcdec103c00 2024-04-25T11:22:10.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.023+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdec1a2870 con 0x7fcdec103c00 2024-04-25T11:22:10.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.025+0000 7fcde37fe640 1 -- 172.21.15.80:0/2498438663 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fcddc009a30 con 0x7fcdec103c00 2024-04-25T11:22:10.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.026+0000 7fcde37fe640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcdd80afaf0 0x7fcdd80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.026+0000 7fcdf240c640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcdd80afaf0 0x7fcdd80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.026+0000 7fcde37fe640 1 -- 172.21.15.80:0/2498438663 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fcddc0de800 con 0x7fcdec103c00 2024-04-25T11:22:10.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.026+0000 7fcdf240c640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcdd80afaf0 0x7fcdd80b2000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005ab0 tx=0x7fcde4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:10.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.029+0000 7fcde37fe640 1 -- 172.21.15.80:0/2498438663 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcddc0a7880 con 0x7fcdec103c00 2024-04-25T11:22:10.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.252+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdec1a2a40 con 0x7fcdec103c00 2024-04-25T11:22:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.252+0000 7fcde37fe640 1 -- 172.21.15.80:0/2498438663 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10473 (secure 0 0 0) 0x7fcddc0a7180 con 0x7fcdec103c00 2024-04-25T11:22:10.248 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:10.248 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-25T11:22:10.249 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 13 2024-04-25T11:22:10.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcdd80afaf0 msgr2=0x7fcdd80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcdd80afaf0 0x7fcdd80b2000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005ab0 tx=0x7fcde4031400 comp rx=0 tx=0).stop 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec103c00 msgr2=0x7fcdec19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec103c00 0x7fcdec19a770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00d950 tx=0x7fcddc00de10 comp rx=0 tx=0).stop 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 shutdown_connections 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcdd80afaf0 0x7fcdd80b2000 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdec103c00 0x7fcdec19a770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdec108900 0x7fcdec1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 --2- 172.21.15.80:0/2498438663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdec1029c0 0x7fcdec19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.254+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 >> 172.21.15.80:0/2498438663 conn(0x7fcdec0fdbd0 msgr2=0x7fcdec109ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.255+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 shutdown_connections 2024-04-25T11:22:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.255+0000 7fcdf4670640 1 -- 172.21.15.80:0/2498438663 wait complete. 2024-04-25T11:22:10.263 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.377+0000 7fba7f615640 1 -- 172.21.15.80:0/1414951471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78103910 msgr2=0x7fba78103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.377+0000 7fba7f615640 1 --2- 172.21.15.80:0/1414951471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78103910 0x7fba78103dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba74009900 tx=0x7fba7402a410 comp rx=0 tx=0).stop 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.377+0000 7fba7f615640 1 -- 172.21.15.80:0/1414951471 shutdown_connections 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.377+0000 7fba7f615640 1 --2- 172.21.15.80:0/1414951471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78103910 0x7fba78103dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.377+0000 7fba7f615640 1 --2- 172.21.15.80:0/1414951471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba78104450 0x7fba7810ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.377+0000 7fba7f615640 1 --2- 172.21.15.80:0/1414951471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 0x7fba78103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.377+0000 7fba7f615640 1 -- 172.21.15.80:0/1414951471 >> 172.21.15.80:0/1414951471 conn(0x7fba780fd330 msgr2=0x7fba780ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:10.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 -- 172.21.15.80:0/1414951471 shutdown_connections 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 -- 172.21.15.80:0/1414951471 wait complete. 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 Processor -- start 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 -- start start 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 0x7fba78199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba78103910 0x7fba78199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78104450 0x7fba781a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba7810e520 con 0x7fba78104450 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba7810e3a0 con 0x7fba78103910 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.378+0000 7fba7f615640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fba7810e6a0 con 0x7fba78102f30 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7dbb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78104450 0x7fba781a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 0x7fba78199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7dbb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78104450 0x7fba781a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60336/0 (socket says 172.21.15.80:60336) 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7dbb2640 1 -- 172.21.15.80:0/2601505934 learned_addr learned my addr 172.21.15.80:0/2601505934 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 0x7fba78199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:34148/0 (socket says 172.21.15.80:34148) 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7cbb0640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba78103910 0x7fba78199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 -- 172.21.15.80:0/2601505934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba78103910 msgr2=0x7fba78199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba78103910 0x7fba78199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 -- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78104450 msgr2=0x7fba781a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78104450 0x7fba781a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 -- 172.21.15.80:0/2601505934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba781a0c60 con 0x7fba78102f30 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7dbb2640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78104450 0x7fba781a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7cbb0640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba78103910 0x7fba78199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:22:10.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7d3b1640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 0x7fba78199120 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba78069bf0 tx=0x7fba6800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:10.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba6e7fc640 1 -- 172.21.15.80:0/2601505934 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6800cc40 con 0x7fba78102f30 2024-04-25T11:22:10.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba781a0f50 con 0x7fba78102f30 2024-04-25T11:22:10.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba6e7fc640 1 -- 172.21.15.80:0/2601505934 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba6800cde0 con 0x7fba78102f30 2024-04-25T11:22:10.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba6e7fc640 1 -- 172.21.15.80:0/2601505934 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68004a00 con 0x7fba78102f30 2024-04-25T11:22:10.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.379+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba781a1360 con 0x7fba78102f30 2024-04-25T11:22:10.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.380+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba781078d0 con 0x7fba78102f30 2024-04-25T11:22:10.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.382+0000 7fba6e7fc640 1 -- 172.21.15.80:0/2601505934 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fba68004ba0 con 0x7fba78102f30 2024-04-25T11:22:10.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.382+0000 7fba6e7fc640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba640afaf0 0x7fba640b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.382+0000 7fba7cbb0640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba640afaf0 0x7fba640b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.382+0000 7fba6e7fc640 1 -- 172.21.15.80:0/2601505934 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fba680de790 con 0x7fba78102f30 2024-04-25T11:22:10.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.383+0000 7fba7cbb0640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba640afaf0 0x7fba640b2000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba74009230 tx=0x7fba74031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:10.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.386+0000 7fba6e7fc640 1 -- 172.21.15.80:0/2601505934 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fba680a7800 con 0x7fba78102f30 2024-04-25T11:22:10.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.568+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba7802dda0 con 0x7fba78102f30 2024-04-25T11:22:10.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.570+0000 7fba6e7fc640 1 -- 172.21.15.80:0/2601505934 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18420 (secure 0 0 0) 0x7fba680a7100 con 0x7fba78102f30 2024-04-25T11:22:10.566 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:10.566 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":73,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:21:20.799095+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:22:10.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba640afaf0 msgr2=0x7fba640b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba640afaf0 0x7fba640b2000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba74009230 tx=0x7fba74031400 comp rx=0 tx=0).stop 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 msgr2=0x7fba78199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 0x7fba78199120 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba78069bf0 tx=0x7fba6800ee50 comp rx=0 tx=0).stop 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 shutdown_connections 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba640afaf0 0x7fba640b2000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba78104450 0x7fba781a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba78103910 0x7fba78199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 --2- 172.21.15.80:0/2601505934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba78102f30 0x7fba78199120 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 >> 172.21.15.80:0/2601505934 conn(0x7fba780fd330 msgr2=0x7fba78104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 shutdown_connections 2024-04-25T11:22:10.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.572+0000 7fba7f615640 1 -- 172.21.15.80:0/2601505934 wait complete. 2024-04-25T11:22:10.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:10.577 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2498438663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:10.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:10 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:22:10.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:22:10.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2498438663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:10.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:10 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.702+0000 7f55af6f0640 1 -- 172.21.15.80:0/2229322774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8104250 msgr2=0x7f55a8106670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.702+0000 7f55af6f0640 1 --2- 172.21.15.80:0/2229322774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8104250 0x7f55a8106670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009900 tx=0x7f55a402a410 comp rx=0 tx=0).stop 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.702+0000 7f55af6f0640 1 -- 172.21.15.80:0/2229322774 shutdown_connections 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.702+0000 7f55af6f0640 1 --2- 172.21.15.80:0/2229322774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55a8109770 0x7f55a810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.702+0000 7f55af6f0640 1 --2- 172.21.15.80:0/2229322774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55a8106c40 0x7f55a81090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.702+0000 7f55af6f0640 1 --2- 172.21.15.80:0/2229322774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8104250 0x7f55a8106670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.702+0000 7f55af6f0640 1 -- 172.21.15.80:0/2229322774 >> 172.21.15.80:0/2229322774 conn(0x7f55a80fdbd0 msgr2=0x7f55a8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 -- 172.21.15.80:0/2229322774 shutdown_connections 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 -- 172.21.15.80:0/2229322774 wait complete. 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 Processor -- start 2024-04-25T11:22:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 -- start start 2024-04-25T11:22:10.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55a8104250 0x7f55a819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55a8106c40 0x7f55a819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8109770 0x7f55a81a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f55a810f5d0 con 0x7f55a8109770 2024-04-25T11:22:10.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55a810f450 con 0x7f55a8106c40 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.703+0000 7f55af6f0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f55a810f750 con 0x7f55a8104250 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8109770 0x7f55a81a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8109770 0x7f55a81a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60348/0 (socket says 172.21.15.80:60348) 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 -- 172.21.15.80:0/3570017552 learned_addr learned my addr 172.21.15.80:0/3570017552 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55ad48c640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55a8104250 0x7f55a819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55acc8b640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55a8106c40 0x7f55a819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 -- 172.21.15.80:0/3570017552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55a8104250 msgr2=0x7f55a819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55a8104250 0x7f55a819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 -- 172.21.15.80:0/3570017552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55a8106c40 msgr2=0x7f55a819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55a8106c40 0x7f55a819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 -- 172.21.15.80:0/3570017552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a81a20d0 con 0x7f55a8109770 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55adc8d640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8109770 0x7f55a81a1a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55a000efd0 tx=0x7f55a000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:10.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f559e7fc640 1 -- 172.21.15.80:0/3570017552 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0003b70 con 0x7f55a8109770 2024-04-25T11:22:10.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a81a23c0 con 0x7f55a8109770 2024-04-25T11:22:10.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f559e7fc640 1 -- 172.21.15.80:0/3570017552 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55a0003d10 con 0x7f55a8109770 2024-04-25T11:22:10.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f559e7fc640 1 -- 172.21.15.80:0/3570017552 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a00108a0 con 0x7f55a8109770 2024-04-25T11:22:10.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.704+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a81a28c0 con 0x7f55a8109770 2024-04-25T11:22:10.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.705+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a806c2a0 con 0x7f55a8109770 2024-04-25T11:22:10.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.707+0000 7f559e7fc640 1 -- 172.21.15.80:0/3570017552 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f55a0004b40 con 0x7f55a8109770 2024-04-25T11:22:10.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.708+0000 7f559e7fc640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f55940afaf0 0x7f55940b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:10.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.708+0000 7f559e7fc640 1 -- 172.21.15.80:0/3570017552 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f55a00def80 con 0x7f55a8109770 2024-04-25T11:22:10.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.708+0000 7f55ad48c640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f55940afaf0 0x7f55940b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:10.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.708+0000 7f55ad48c640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f55940afaf0 0x7f55940b2000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009230 tx=0x7f55a4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:10.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.712+0000 7f559e7fc640 1 -- 172.21.15.80:0/3570017552 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f55a00a8000 con 0x7f55a8109770 2024-04-25T11:22:10.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:10.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2498438663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:10.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:10 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:10.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.906+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f55a81a2b80 con 0x7f55a8109770 2024-04-25T11:22:10.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.906+0000 7f559e7fc640 1 -- 172.21.15.80:0/3570017552 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f55a00a7900 con 0x7f55a8109770 2024-04-25T11:22:10.902 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:22:10.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f55940afaf0 msgr2=0x7f55940b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f55940afaf0 0x7f55940b2000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009230 tx=0x7f55a4031400 comp rx=0 tx=0).stop 2024-04-25T11:22:10.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8109770 msgr2=0x7f55a81a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:10.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8109770 0x7f55a81a1a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55a000efd0 tx=0x7f55a000c6a0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 shutdown_connections 2024-04-25T11:22:10.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f55940afaf0 0x7f55940b2000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a8109770 0x7f55a81a1a60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55a8106c40 0x7f55a819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 --2- 172.21.15.80:0/3570017552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55a8104250 0x7f55a819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:10.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 >> 172.21.15.80:0/3570017552 conn(0x7f55a80fdbd0 msgr2=0x7f55a8105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:10.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 shutdown_connections 2024-04-25T11:22:10.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:10.909+0000 7f55af6f0640 1 -- 172.21.15.80:0/3570017552 wait complete. 2024-04-25T11:22:10.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T11:22:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 -- 172.21.15.80:0/2298300530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 msgr2=0x7f1cf4104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/2298300530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf4104010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009900 tx=0x7f1ce402a410 comp rx=0 tx=0).stop 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 -- 172.21.15.80:0/2298300530 shutdown_connections 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/2298300530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf4104010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/2298300530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf4108900 0x7f1cf410ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/2298300530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cf41029c0 0x7f1cf41036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 -- 172.21.15.80:0/2298300530 >> 172.21.15.80:0/2298300530 conn(0x7f1cf40fdbd0 msgr2=0x7f1cf4100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 -- 172.21.15.80:0/2298300530 shutdown_connections 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.029+0000 7f1cf96f9640 1 -- 172.21.15.80:0/2298300530 wait complete. 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 Processor -- start 2024-04-25T11:22:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 -- start start 2024-04-25T11:22:11.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cf41029c0 0x7f1cf410d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf410b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf4108900 0x7f1cf410be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf410f5f0 con 0x7f1cf4103c00 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf410f470 con 0x7f1cf41029c0 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf96f9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf410f770 con 0x7f1cf4108900 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf27fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf410b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf27fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf410b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60364/0 (socket says 172.21.15.80:60364) 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.030+0000 7f1cf27fc640 1 -- 172.21.15.80:0/538126630 learned_addr learned my addr 172.21.15.80:0/538126630 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf2ffd640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cf41029c0 0x7f1cf410d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf37fe640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf4108900 0x7f1cf410be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf27fc640 1 -- 172.21.15.80:0/538126630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf4108900 msgr2=0x7f1cf410be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf27fc640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf4108900 0x7f1cf410be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf27fc640 1 -- 172.21.15.80:0/538126630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cf41029c0 msgr2=0x7f1cf410d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf27fc640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cf41029c0 0x7f1cf410d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf27fc640 1 -- 172.21.15.80:0/538126630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf410c5a0 con 0x7f1cf4103c00 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf27fc640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf410b930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4006010 tx=0x7f1ce4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cdbfff640 1 -- 172.21.15.80:0/538126630 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce403f030 con 0x7f1cf4103c00 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cdbfff640 1 -- 172.21.15.80:0/538126630 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce4003aa0 con 0x7f1cf4103c00 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cdbfff640 1 -- 172.21.15.80:0/538126630 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4035070 con 0x7f1cf4103c00 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf41a42d0 con 0x7f1cf4103c00 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.031+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf41a4680 con 0x7f1cf4103c00 2024-04-25T11:22:11.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.032+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf406afa0 con 0x7f1cf4103c00 2024-04-25T11:22:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.034+0000 7f1cdbfff640 1 -- 172.21.15.80:0/538126630 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f1ce4042030 con 0x7f1cf4103c00 2024-04-25T11:22:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.035+0000 7f1cdbfff640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1cdc0afaf0 0x7f1cdc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.035+0000 7f1cf2ffd640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1cdc0afaf0 0x7f1cdc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.035+0000 7f1cdbfff640 1 -- 172.21.15.80:0/538126630 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f1ce40ff340 con 0x7f1cf4103c00 2024-04-25T11:22:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.036+0000 7f1cf2ffd640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1cdc0afaf0 0x7f1cdc0b2000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1cf41035c0 tx=0x7f1ce8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.039+0000 7f1cdbfff640 1 -- 172.21.15.80:0/538126630 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1ce40c7d70 con 0x7f1cf4103c00 2024-04-25T11:22:11.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.225+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1cf40637a0 con 0x7f1cf4103c00 2024-04-25T11:22:11.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.225+0000 7f1cdbfff640 1 -- 172.21.15.80:0/538126630 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f1ce40cc070 con 0x7f1cf4103c00 2024-04-25T11:22:11.221 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:11.221 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-25T11:22:11.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:22:11.222 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-25T11:22:11.222 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-25T11:22:11.222 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:22:11.222 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-25T11:22:11.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1cdc0afaf0 msgr2=0x7f1cdc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1cdc0afaf0 0x7f1cdc0b2000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1cf41035c0 tx=0x7f1ce8005f90 comp rx=0 tx=0).stop 2024-04-25T11:22:11.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 msgr2=0x7f1cf410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf410b930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4006010 tx=0x7f1ce4031a50 comp rx=0 tx=0).stop 2024-04-25T11:22:11.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 shutdown_connections 2024-04-25T11:22:11.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f1cdc0afaf0 0x7f1cdc0b2000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1cf4103c00 0x7f1cf410b930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf4108900 0x7f1cf410be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 --2- 172.21.15.80:0/538126630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cf41029c0 0x7f1cf410d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 >> 172.21.15.80:0/538126630 conn(0x7f1cf40fdbd0 msgr2=0x7f1cf41048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:11.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.227+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 shutdown_connections 2024-04-25T11:22:11.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.228+0000 7f1cf96f9640 1 -- 172.21.15.80:0/538126630 wait complete. 2024-04-25T11:22:11.234 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T11:22:11.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T11:22:11.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.351+0000 7fec9b7d7640 1 -- 172.21.15.80:0/2767854117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94108920 msgr2=0x7fec9410ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.351+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/2767854117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94108920 0x7fec9410ad40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009900 tx=0x7fec8c02a410 comp rx=0 tx=0).stop 2024-04-25T11:22:11.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.351+0000 7fec9b7d7640 1 -- 172.21.15.80:0/2767854117 shutdown_connections 2024-04-25T11:22:11.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.351+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/2767854117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94108920 0x7fec9410ad40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.351+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/2767854117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec94103c20 0x7fec94104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.351+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/2767854117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec941029e0 0x7fec941036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.351+0000 7fec9b7d7640 1 -- 172.21.15.80:0/2767854117 >> 172.21.15.80:0/2767854117 conn(0x7fec940fdbd0 msgr2=0x7fec94100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 -- 172.21.15.80:0/2767854117 shutdown_connections 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 -- 172.21.15.80:0/2767854117 wait complete. 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 Processor -- start 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 -- start start 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec941029e0 0x7fec9419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94103c20 0x7fec9419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec94108920 0x7fec941a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fec9410e510 con 0x7fec94103c20 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec9410e390 con 0x7fec94108920 2024-04-25T11:22:11.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.352+0000 7fec9b7d7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fec9410e690 con 0x7fec941029e0 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94103c20 0x7fec9419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94103c20 0x7fec9419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60380/0 (socket says 172.21.15.80:60380) 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 -- 172.21.15.80:0/1712339747 learned_addr learned my addr 172.21.15.80:0/1712339747 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec99d74640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec94108920 0x7fec941a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec99573640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec941029e0 0x7fec9419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 -- 172.21.15.80:0/1712339747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec941029e0 msgr2=0x7fec9419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec941029e0 0x7fec9419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 -- 172.21.15.80:0/1712339747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec94108920 msgr2=0x7fec941a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec94108920 0x7fec941a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 -- 172.21.15.80:0/1712339747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec941a2040 con 0x7fec94103c20 2024-04-25T11:22:11.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.353+0000 7fec98d72640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94103c20 0x7fec9419aa40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d770 tx=0x7fec8400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:11.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.356+0000 7fec8a7fc640 1 -- 172.21.15.80:0/1712339747 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84017070 con 0x7fec94103c20 2024-04-25T11:22:11.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.356+0000 7fec8a7fc640 1 -- 172.21.15.80:0/1712339747 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec840054d0 con 0x7fec94103c20 2024-04-25T11:22:11.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.356+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec941a2330 con 0x7fec94103c20 2024-04-25T11:22:11.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.356+0000 7fec8a7fc640 1 -- 172.21.15.80:0/1712339747 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84004c30 con 0x7fec94103c20 2024-04-25T11:22:11.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.356+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec941a2830 con 0x7fec94103c20 2024-04-25T11:22:11.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.357+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9406c2a0 con 0x7fec94103c20 2024-04-25T11:22:11.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.358+0000 7fec8a7fc640 1 -- 172.21.15.80:0/1712339747 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fec84004dd0 con 0x7fec94103c20 2024-04-25T11:22:11.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.359+0000 7fec8a7fc640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fec800afaf0 0x7fec800b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:11.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.359+0000 7fec99573640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fec800afaf0 0x7fec800b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:11.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.359+0000 7fec8a7fc640 1 -- 172.21.15.80:0/1712339747 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fec840de5a0 con 0x7fec94103c20 2024-04-25T11:22:11.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.359+0000 7fec99573640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fec800afaf0 0x7fec800b2000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec941035e0 tx=0x7fec90009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.363+0000 7fec8a7fc640 1 -- 172.21.15.80:0/1712339747 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fec840a6fd0 con 0x7fec94103c20 2024-04-25T11:22:11.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:11 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2601505934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:11.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:11 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3570017552' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:22:11.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:11 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/538126630' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T11:22:11.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:11.567+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fec941a2cf0 con 0x7fec94103c20 2024-04-25T11:22:11.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:11 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2601505934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:11.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:11 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3570017552' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:22:11.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:11 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/538126630' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T11:22:11.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:11 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2601505934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:11.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:11 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3570017552' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:22:11.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:11 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/538126630' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T11:22:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.369+0000 7fec8a7fc640 1 -- 172.21.15.80:0/1712339747 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fec840ab2d0 con 0x7fec94103c20 2024-04-25T11:22:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fec800afaf0 msgr2=0x7fec800b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fec800afaf0 0x7fec800b2000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec941035e0 tx=0x7fec90009670 comp rx=0 tx=0).stop 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94103c20 msgr2=0x7fec9419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94103c20 0x7fec9419aa40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d770 tx=0x7fec8400dc30 comp rx=0 tx=0).stop 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 shutdown_connections 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fec800afaf0 0x7fec800b2000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec94103c20 0x7fec9419aa40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec94108920 0x7fec941a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 --2- 172.21.15.80:0/1712339747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec941029e0 0x7fec9419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 >> 172.21.15.80:0/1712339747 conn(0x7fec940fdbd0 msgr2=0x7fec94109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 shutdown_connections 2024-04-25T11:22:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.371+0000 7fec9b7d7640 1 -- 172.21.15.80:0/1712339747 wait complete. 2024-04-25T11:22:12.381 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T11:22:12.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 -- 172.21.15.80:0/600955910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8109a40 msgr2=0x7f53c810be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:12.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/600955910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8109a40 0x7f53c810be60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009ca0 tx=0x7f53c002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 -- 172.21.15.80:0/600955910 shutdown_connections 2024-04-25T11:22:12.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/600955910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8109a40 0x7f53c810be60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/600955910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53c8104d40 0x7f53c8105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/600955910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c8103b00 0x7f53c8104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 -- 172.21.15.80:0/600955910 >> 172.21.15.80:0/600955910 conn(0x7f53c80fed10 msgr2=0x7f53c81011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 -- 172.21.15.80:0/600955910 shutdown_connections 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.500+0000 7f53cfcd8640 1 -- 172.21.15.80:0/600955910 wait complete. 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 Processor -- start 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 -- start start 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c8103b00 0x7f53c819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8104d40 0x7f53c819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53c8109a40 0x7f53c81a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53c810f630 con 0x7f53c8104d40 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53c810f4b0 con 0x7f53c8103b00 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cfcd8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53c810f7b0 con 0x7f53c8109a40 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8104d40 0x7f53c819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8104d40 0x7f53c819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60394/0 (socket says 172.21.15.80:60394) 2024-04-25T11:22:12.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 -- 172.21.15.80:0/381586809 learned_addr learned my addr 172.21.15.80:0/381586809 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53ce275640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53c8109a40 0x7f53c81a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cda74640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c8103b00 0x7f53c819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 -- 172.21.15.80:0/381586809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53c8109a40 msgr2=0x7f53c81a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53c8109a40 0x7f53c81a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 -- 172.21.15.80:0/381586809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c8103b00 msgr2=0x7f53c819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c8103b00 0x7f53c819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 -- 172.21.15.80:0/381586809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c81a1d10 con 0x7f53c8104d40 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cda74640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c8103b00 0x7f53c819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.501+0000 7f53cd273640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8104d40 0x7f53c819a710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53b800e9f0 tx=0x7f53b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.502+0000 7f53beffd640 1 -- 172.21.15.80:0/381586809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b800cd80 con 0x7f53c8104d40 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.502+0000 7f53beffd640 1 -- 172.21.15.80:0/381586809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53b80054d0 con 0x7f53c8104d40 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.502+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c81a1fa0 con 0x7f53c8104d40 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.502+0000 7f53beffd640 1 -- 172.21.15.80:0/381586809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8010690 con 0x7f53c8104d40 2024-04-25T11:22:12.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.502+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c81a2460 con 0x7f53c8104d40 2024-04-25T11:22:12.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.503+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c8108850 con 0x7f53c8104d40 2024-04-25T11:22:12.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.504+0000 7f53beffd640 1 -- 172.21.15.80:0/381586809 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f53b8004e30 con 0x7f53c8104d40 2024-04-25T11:22:12.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.505+0000 7f53beffd640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53b40afaf0 0x7f53b40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:12.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.505+0000 7f53cda74640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53b40afaf0 0x7f53b40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:12.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.505+0000 7f53beffd640 1 -- 172.21.15.80:0/381586809 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7497+0+0 (secure 0 0 0) 0x7f53b80def90 con 0x7f53c8104d40 2024-04-25T11:22:12.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.505+0000 7f53cda74640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53b40afaf0 0x7f53b40b2000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53c8104700 tx=0x7f53c400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:12.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.509+0000 7f53beffd640 1 -- 172.21.15.80:0/381586809 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f53b8053ff0 con 0x7f53c8104d40 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1712339747' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:12.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:22:12.631 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:12.688+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f53c802db50 con 0x7f53c8104d40 2024-04-25T11:22:12.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:12.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1712339747' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:22:12.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:12.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1712339747' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T11:22:12.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:22:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:22:12.747 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:22:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.375+0000 7f53beffd640 1 -- 172.21.15.80:0/381586809 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) ==== 170+0+0 (secure 0 0 0) 0x7f53b80a7ea0 con 0x7f53c8104d40 2024-04-25T11:22:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-25T11:22:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53b40afaf0 msgr2=0x7f53b40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53b40afaf0 0x7f53b40b2000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53c8104700 tx=0x7f53c400a560 comp rx=0 tx=0).stop 2024-04-25T11:22:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8104d40 msgr2=0x7f53c819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8104d40 0x7f53c819a710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53b800e9f0 tx=0x7f53b800edf0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 shutdown_connections 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53b40afaf0 0x7f53b40b2000 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53c8104d40 0x7f53c819a710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53c8109a40 0x7f53c81a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 --2- 172.21.15.80:0/381586809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c8103b00 0x7f53c819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 >> 172.21.15.80:0/381586809 conn(0x7f53c80fed10 msgr2=0x7f53c8105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 shutdown_connections 2024-04-25T11:22:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.377+0000 7f53cfcd8640 1 -- 172.21.15.80:0/381586809 wait complete. 2024-04-25T11:22:13.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 -- 172.21.15.80:0/766643019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 msgr2=0x7f9ee41047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/766643019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee41047f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009900 tx=0x7f9ed402a410 comp rx=0 tx=0).stop 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 -- 172.21.15.80:0/766643019 shutdown_connections 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/766643019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee4109a30 0x7f9ee410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/766643019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104d30 0x7f9ee4105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/766643019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee41047f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 -- 172.21.15.80:0/766643019 >> 172.21.15.80:0/766643019 conn(0x7f9ee40fece0 msgr2=0x7f9ee4101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 -- 172.21.15.80:0/766643019 shutdown_connections 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 -- 172.21.15.80:0/766643019 wait complete. 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.510+0000 7f9ee98e9640 1 Processor -- start 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee98e9640 1 -- start start 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee98e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee98e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104d30 0x7f9ee419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee98e9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee4109a30 0x7f9ee41a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee98e9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee410f650 con 0x7f9ee4103af0 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee98e9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee410f4d0 con 0x7f9ee4104d30 2024-04-25T11:22:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee98e9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee410f7d0 con 0x7f9ee4109a30 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60406/0 (socket says 172.21.15.80:60406) 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 -- 172.21.15.80:0/243206856 learned_addr learned my addr 172.21.15.80:0/243206856 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 -- 172.21.15.80:0/243206856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee4109a30 msgr2=0x7f9ee41a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee4109a30 0x7f9ee41a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee27fc640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104d30 0x7f9ee419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 -- 172.21.15.80:0/243206856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104d30 msgr2=0x7f9ee419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104d30 0x7f9ee419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 -- 172.21.15.80:0/243206856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee41a1db0 con 0x7f9ee4103af0 2024-04-25T11:22:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee27fc640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104d30 0x7f9ee419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.511+0000 7f9ee2ffd640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee419a2e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006010 tx=0x7f9ed4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.512+0000 7f9ee88e7640 1 -- 172.21.15.80:0/243206856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed403f030 con 0x7f9ee4103af0 2024-04-25T11:22:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.512+0000 7f9ee88e7640 1 -- 172.21.15.80:0/243206856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ed4003aa0 con 0x7f9ee4103af0 2024-04-25T11:22:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.512+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee41a2040 con 0x7f9ee4103af0 2024-04-25T11:22:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.512+0000 7f9ee88e7640 1 -- 172.21.15.80:0/243206856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4035070 con 0x7f9ee4103af0 2024-04-25T11:22:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.512+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee41a25b0 con 0x7f9ee4103af0 2024-04-25T11:22:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.513+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee4108840 con 0x7f9ee4103af0 2024-04-25T11:22:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.514+0000 7f9ee88e7640 1 -- 172.21.15.80:0/243206856 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f9ed4042030 con 0x7f9ee4103af0 2024-04-25T11:22:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.515+0000 7f9ee88e7640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9ecc0afaf0 0x7f9ecc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.515+0000 7f9ee27fc640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9ecc0afaf0 0x7f9ecc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.515+0000 7f9ee88e7640 1 -- 172.21.15.80:0/243206856 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7879+0+0 (secure 0 0 0) 0x7f9ed40ff5f0 con 0x7f9ee4103af0 2024-04-25T11:22:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.516+0000 7f9ee27fc640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9ecc0afaf0 0x7f9ecc0b2000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ee419b380 tx=0x7f9ed8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:13.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.519+0000 7f9ee88e7640 1 -- 172.21.15.80:0/243206856 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9ed40c8360 con 0x7f9ee4103af0 2024-04-25T11:22:13.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1712339747' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T11:22:13.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:13 smithi080 ceph-mon[29126]: osdmap e74: 12 total, 12 up, 12 in 2024-04-25T11:22:13.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/381586809' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T11:22:13.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1712339747' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T11:22:13.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:13 smithi196 ceph-mon[32659]: osdmap e74: 12 total, 12 up, 12 in 2024-04-25T11:22:13.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/381586809' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T11:22:13.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:13.735+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9ee402db50 con 0x7f9ee4103af0 2024-04-25T11:22:13.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1712339747' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T11:22:13.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:13 smithi082 ceph-mon[32440]: osdmap e74: 12 total, 12 up, 12 in 2024-04-25T11:22:13.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/381586809' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T11:22:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.377+0000 7f9ee88e7640 1 -- 172.21.15.80:0/243206856 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f9ed40c7c60 con 0x7f9ee4103af0 2024-04-25T11:22:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T11:22:14.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9ecc0afaf0 msgr2=0x7f9ecc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9ecc0afaf0 0x7f9ecc0b2000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ee419b380 tx=0x7f9ed8005f90 comp rx=0 tx=0).stop 2024-04-25T11:22:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 msgr2=0x7f9ee419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee419a2e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006010 tx=0x7f9ed4004270 comp rx=0 tx=0).stop 2024-04-25T11:22:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 shutdown_connections 2024-04-25T11:22:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9ecc0afaf0 0x7f9ecc0b2000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee4109a30 0x7f9ee41a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104d30 0x7f9ee419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 --2- 172.21.15.80:0/243206856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ee4103af0 0x7f9ee419a2e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.380+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 >> 172.21.15.80:0/243206856 conn(0x7f9ee40fece0 msgr2=0x7f9ee4105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.381+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 shutdown_connections 2024-04-25T11:22:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.381+0000 7f9ee98e9640 1 -- 172.21.15.80:0/243206856 wait complete. 2024-04-25T11:22:14.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:22:14.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 -- 172.21.15.80:0/1964713330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4103b00 msgr2=0x7f06a4104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 --2- 172.21.15.80:0/1964713330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4103b00 0x7f06a4104800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0698009900 tx=0x7f069802a410 comp rx=0 tx=0).stop 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 -- 172.21.15.80:0/1964713330 shutdown_connections 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 --2- 172.21.15.80:0/1964713330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a4109a40 0x7f06a410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 --2- 172.21.15.80:0/1964713330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06a4104d40 0x7f06a4105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 --2- 172.21.15.80:0/1964713330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4103b00 0x7f06a4104800 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 -- 172.21.15.80:0/1964713330 >> 172.21.15.80:0/1964713330 conn(0x7f06a40fed30 msgr2=0x7f06a41011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 -- 172.21.15.80:0/1964713330 shutdown_connections 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 -- 172.21.15.80:0/1964713330 wait complete. 2024-04-25T11:22:14.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.521+0000 7f06a92e2640 1 Processor -- start 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a92e2640 1 -- start start 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a92e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a4103b00 0x7f06a4076850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a92e2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06a4104d40 0x7f06a4074ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a92e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4109a40 0x7f06a4075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a92e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410f600 con 0x7f06a4109a40 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a92e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410f480 con 0x7f06a4103b00 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a92e2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410f780 con 0x7f06a4104d40 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4109a40 0x7f06a4075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4109a40 0x7f06a4075430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60426/0 (socket says 172.21.15.80:60426) 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 -- 172.21.15.80:0/337266892 learned_addr learned my addr 172.21.15.80:0/337266892 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:14.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a27fc640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06a4104d40 0x7f06a4074ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a2ffd640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a4103b00 0x7f06a4076850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 -- 172.21.15.80:0/337266892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06a4104d40 msgr2=0x7f06a4074ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06a4104d40 0x7f06a4074ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 -- 172.21.15.80:0/337266892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a4103b00 msgr2=0x7f06a4076850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a4103b00 0x7f06a4076850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.522+0000 7f06a37fe640 1 -- 172.21.15.80:0/337266892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a4075ad0 con 0x7f06a4109a40 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.523+0000 7f06a37fe640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4109a40 0x7f06a4075430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f069c00cce0 tx=0x7f069c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:14.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.523+0000 7f068bfff640 1 -- 172.21.15.80:0/337266892 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c00f450 con 0x7f06a4109a40 2024-04-25T11:22:14.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.523+0000 7f068bfff640 1 -- 172.21.15.80:0/337266892 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f069c00faa0 con 0x7f06a4109a40 2024-04-25T11:22:14.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.523+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a41a42f0 con 0x7f06a4109a40 2024-04-25T11:22:14.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.523+0000 7f068bfff640 1 -- 172.21.15.80:0/337266892 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c018b70 con 0x7f06a4109a40 2024-04-25T11:22:14.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.523+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a41a4700 con 0x7f06a4109a40 2024-04-25T11:22:14.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.524+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a4108850 con 0x7f06a4109a40 2024-04-25T11:22:14.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.525+0000 7f068bfff640 1 -- 172.21.15.80:0/337266892 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f069c018d10 con 0x7f06a4109a40 2024-04-25T11:22:14.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.526+0000 7f068bfff640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f068c0afb70 0x7f068c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.526+0000 7f068bfff640 1 -- 172.21.15.80:0/337266892 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f069c0deec0 con 0x7f06a4109a40 2024-04-25T11:22:14.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.526+0000 7f06a2ffd640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f068c0afb70 0x7f068c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.526+0000 7f06a2ffd640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f068c0afb70 0x7f068c0b2080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0698005ab0 tx=0x7f0698031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:14.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.529+0000 7f068bfff640 1 -- 172.21.15.80:0/337266892 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f069c014030 con 0x7f06a4109a40 2024-04-25T11:22:14.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:14 smithi196 ceph-mon[32659]: pgmap v283: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:14.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:14 smithi196 ceph-mon[32659]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T11:22:14.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/381586809' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T11:22:14.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:14 smithi196 ceph-mon[32659]: osdmap e75: 12 total, 12 up, 12 in 2024-04-25T11:22:14.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/243206856' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T11:22:14.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:14 smithi196 ceph-mon[32659]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T11:22:14.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.709+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06a402dd20 con 0x7f06a4109a40 2024-04-25T11:22:14.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.711+0000 7f068bfff640 1 -- 172.21.15.80:0/337266892 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22196 (secure 0 0 0) 0x7f069c0a7d00 con 0x7f06a4109a40 2024-04-25T11:22:14.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:14.707 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":76,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:13.737448+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f068c0afb70 msgr2=0x7f068c0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f068c0afb70 0x7f068c0b2080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0698005ab0 tx=0x7f0698031400 comp rx=0 tx=0).stop 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4109a40 msgr2=0x7f06a4075430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4109a40 0x7f06a4075430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f069c00cce0 tx=0x7f069c00a620 comp rx=0 tx=0).stop 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 shutdown_connections 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f068c0afb70 0x7f068c0b2080 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06a4109a40 0x7f06a4075430 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06a4104d40 0x7f06a4074ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 --2- 172.21.15.80:0/337266892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a4103b00 0x7f06a4076850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 >> 172.21.15.80:0/337266892 conn(0x7f06a40fed30 msgr2=0x7f06a4105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:14.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 shutdown_connections 2024-04-25T11:22:14.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.713+0000 7f06a92e2640 1 -- 172.21.15.80:0/337266892 wait complete. 2024-04-25T11:22:14.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:14 smithi080 ceph-mon[29126]: pgmap v283: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:14.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:14 smithi080 ceph-mon[29126]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T11:22:14.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/381586809' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T11:22:14.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:14 smithi080 ceph-mon[29126]: osdmap e75: 12 total, 12 up, 12 in 2024-04-25T11:22:14.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/243206856' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T11:22:14.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:14 smithi080 ceph-mon[29126]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T11:22:14.721 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:22:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:14 smithi082 ceph-mon[32440]: pgmap v283: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:14 smithi082 ceph-mon[32440]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T11:22:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/381586809' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T11:22:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:14 smithi082 ceph-mon[32440]: osdmap e75: 12 total, 12 up, 12 in 2024-04-25T11:22:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/243206856' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T11:22:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:14 smithi082 ceph-mon[32440]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 -- 172.21.15.80:0/4137224806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac0074f10 msgr2=0x7f6ac0075320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 --2- 172.21.15.80:0/4137224806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac0074f10 0x7f6ac0075320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009900 tx=0x7f6ab002a410 comp rx=0 tx=0).stop 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 -- 172.21.15.80:0/4137224806 shutdown_connections 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 --2- 172.21.15.80:0/4137224806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ac010bac0 0x7f6ac010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 --2- 172.21.15.80:0/4137224806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac0075860 0x7f6ac010b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 --2- 172.21.15.80:0/4137224806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac0074f10 0x7f6ac0075320 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 -- 172.21.15.80:0/4137224806 >> 172.21.15.80:0/4137224806 conn(0x7f6ac00fecc0 msgr2=0x7f6ac0101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 -- 172.21.15.80:0/4137224806 shutdown_connections 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.833+0000 7f6ac5453640 1 -- 172.21.15.80:0/4137224806 wait complete. 2024-04-25T11:22:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 Processor -- start 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 -- start start 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac0074f10 0x7f6ac019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ac0075860 0x7f6ac019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac010bac0 0x7f6ac01a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01117a0 con 0x7f6ac010bac0 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0111620 con 0x7f6ac0074f10 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ac5453640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0111920 con 0x7f6ac0075860 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac010bac0 0x7f6ac01a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac010bac0 0x7f6ac01a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60444/0 (socket says 172.21.15.80:60444) 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 -- 172.21.15.80:0/518996510 learned_addr learned my addr 172.21.15.80:0/518996510 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abeffd640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac0074f10 0x7f6ac019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6ab7fff640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ac0075860 0x7f6ac019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 -- 172.21.15.80:0/518996510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ac0075860 msgr2=0x7f6ac019c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ac0075860 0x7f6ac019c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 -- 172.21.15.80:0/518996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac0074f10 msgr2=0x7f6ac019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac0074f10 0x7f6ac019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.834+0000 7f6abf7fe640 1 -- 172.21.15.80:0/518996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac01a3f70 con 0x7f6ac010bac0 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.835+0000 7f6abf7fe640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac010bac0 0x7f6ac01a3900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800cad0 tx=0x7f6ab800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.835+0000 7f6abcff9640 1 -- 172.21.15.80:0/518996510 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800ae20 con 0x7f6ac010bac0 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.835+0000 7f6abcff9640 1 -- 172.21.15.80:0/518996510 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ab8005020 con 0x7f6ac010bac0 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.835+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac01a4260 con 0x7f6ac010bac0 2024-04-25T11:22:14.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.835+0000 7f6abcff9640 1 -- 172.21.15.80:0/518996510 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800f6b0 con 0x7f6ac010bac0 2024-04-25T11:22:14.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.835+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac01a47b0 con 0x7f6ac010bac0 2024-04-25T11:22:14.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.836+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac010a390 con 0x7f6ac010bac0 2024-04-25T11:22:14.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.838+0000 7f6abcff9640 1 -- 172.21.15.80:0/518996510 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f6ab80051d0 con 0x7f6ac010bac0 2024-04-25T11:22:14.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.839+0000 7f6abcff9640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6aac0afb70 0x7f6aac0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:14.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.839+0000 7f6abeffd640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6aac0afb70 0x7f6aac0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:14.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.839+0000 7f6abcff9640 1 -- 172.21.15.80:0/518996510 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f6ab80def30 con 0x7f6ac010bac0 2024-04-25T11:22:14.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.839+0000 7f6abeffd640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6aac0afb70 0x7f6aac0b2080 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009230 tx=0x7f6ab0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:14.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:14.842+0000 7f6abcff9640 1 -- 172.21.15.80:0/518996510 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ab8014030 con 0x7f6ac010bac0 2024-04-25T11:22:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.019+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ac00637a0 con 0x7f6ac010bac0 2024-04-25T11:22:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.021+0000 7f6abcff9640 1 -- 172.21.15.80:0/518996510 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22196 (secure 0 0 0) 0x7f6ab80a7c40 con 0x7f6ac010bac0 2024-04-25T11:22:15.017 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:15.017 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":76,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:13.737448+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:22:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6aac0afb70 msgr2=0x7f6aac0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6aac0afb70 0x7f6aac0b2080 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009230 tx=0x7f6ab0031400 comp rx=0 tx=0).stop 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac010bac0 msgr2=0x7f6ac01a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac010bac0 0x7f6ac01a3900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800cad0 tx=0x7f6ab800cf90 comp rx=0 tx=0).stop 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 shutdown_connections 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6aac0afb70 0x7f6aac0b2080 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac010bac0 0x7f6ac01a3900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ac0075860 0x7f6ac019c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 --2- 172.21.15.80:0/518996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac0074f10 0x7f6ac019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 >> 172.21.15.80:0/518996510 conn(0x7f6ac00fecc0 msgr2=0x7f6ac0107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 shutdown_connections 2024-04-25T11:22:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.023+0000 7f6ac5453640 1 -- 172.21.15.80:0/518996510 wait complete. 2024-04-25T11:22:15.030 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T11:22:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.145+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3398668302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc105090 msgr2=0x7f53dc1054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.145+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3398668302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc105090 0x7f53dc1054a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009900 tx=0x7f53cc02a410 comp rx=0 tx=0).stop 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3398668302 shutdown_connections 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3398668302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc102240 0x7f53dc10bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3398668302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53dc101740 0x7f53dc101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3398668302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc105090 0x7f53dc1054a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3398668302 >> 172.21.15.80:0/3398668302 conn(0x7f53dc0fd340 msgr2=0x7f53dc0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3398668302 shutdown_connections 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3398668302 wait complete. 2024-04-25T11:22:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 Processor -- start 2024-04-25T11:22:15.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 -- start start 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.146+0000 7f53e1dd5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc101740 0x7f53dc104240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53e1dd5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53dc102240 0x7f53dc1028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53e1dd5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc105090 0x7f53dc102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53e1dd5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10f650 con 0x7f53dc101740 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53e1dd5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10f4d0 con 0x7f53dc105090 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53e1dd5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10f7d0 con 0x7f53dc102240 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc101740 0x7f53dc104240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc101740 0x7f53dc104240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60472/0 (socket says 172.21.15.80:60472) 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 -- 172.21.15.80:0/3984754365 learned_addr learned my addr 172.21.15.80:0/3984754365 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 -- 172.21.15.80:0/3984754365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53dc102240 msgr2=0x7f53dc1028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53daffd640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53dc102240 0x7f53dc1028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53dc102240 0x7f53dc1028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53dbfff640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc105090 0x7f53dc102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 -- 172.21.15.80:0/3984754365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc105090 msgr2=0x7f53dc102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc105090 0x7f53dc102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 -- 172.21.15.80:0/3984754365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc103550 con 0x7f53dc101740 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53daffd640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53dc102240 0x7f53dc1028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53dbfff640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc105090 0x7f53dc102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53db7fe640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc101740 0x7f53dc104240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f53cc006010 tx=0x7f53cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53d8ff9640 1 -- 172.21.15.80:0/3984754365 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc03f030 con 0x7f53dc101740 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53d8ff9640 1 -- 172.21.15.80:0/3984754365 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53cc003aa0 con 0x7f53dc101740 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc1a4380 con 0x7f53dc101740 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53d8ff9640 1 -- 172.21.15.80:0/3984754365 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc035070 con 0x7f53dc101740 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.147+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1a4800 con 0x7f53dc101740 2024-04-25T11:22:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.148+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc0692e0 con 0x7f53dc101740 2024-04-25T11:22:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.150+0000 7f53d8ff9640 1 -- 172.21.15.80:0/3984754365 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f53cc042030 con 0x7f53dc101740 2024-04-25T11:22:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.151+0000 7f53d8ff9640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53c40afaf0 0x7f53c40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.151+0000 7f53d8ff9640 1 -- 172.21.15.80:0/3984754365 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f53cc0ff670 con 0x7f53dc101740 2024-04-25T11:22:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.151+0000 7f53daffd640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53c40afaf0 0x7f53c40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.151+0000 7f53daffd640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53c40afaf0 0x7f53c40b2000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53d0006fd0 tx=0x7f53d0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:15.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.155+0000 7f53d8ff9640 1 -- 172.21.15.80:0/3984754365 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f53cc0c83a0 con 0x7f53dc101740 2024-04-25T11:22:15.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.373+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f53dc02df00 con 0x7f53dc101740 2024-04-25T11:22:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.396+0000 7f53d8ff9640 1 -- 172.21.15.80:0/3984754365 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f53dc02df00 con 0x7f53dc101740 2024-04-25T11:22:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53c40afaf0 msgr2=0x7f53c40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53c40afaf0 0x7f53c40b2000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53d0006fd0 tx=0x7f53d0008040 comp rx=0 tx=0).stop 2024-04-25T11:22:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc101740 msgr2=0x7f53dc104240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc101740 0x7f53dc104240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f53cc006010 tx=0x7f53cc004270 comp rx=0 tx=0).stop 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 shutdown_connections 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f53c40afaf0 0x7f53c40b2000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc105090 0x7f53dc102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53dc102240 0x7f53dc1028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 --2- 172.21.15.80:0/3984754365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53dc101740 0x7f53dc104240 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 >> 172.21.15.80:0/3984754365 conn(0x7f53dc0fd340 msgr2=0x7f53dc105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 shutdown_connections 2024-04-25T11:22:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.398+0000 7f53e1dd5640 1 -- 172.21.15.80:0/3984754365 wait complete. 2024-04-25T11:22:15.406 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-04-25T11:22:15.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-25T11:22:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/4214367176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8108930 msgr2=0x7f3cd810ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/4214367176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8108930 0x7f3cd810ad50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009ca0 tx=0x7f3cd002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/4214367176 shutdown_connections 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/4214367176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8108930 0x7f3cd810ad50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/4214367176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3cd8103c30 0x7f3cd8104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/4214367176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cd81029f0 0x7f3cd81036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/4214367176 >> 172.21.15.80:0/4214367176 conn(0x7f3cd80fdbc0 msgr2=0x7f3cd8100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/4214367176 shutdown_connections 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.521+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/4214367176 wait complete. 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 Processor -- start 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 -- start start 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cd81029f0 0x7f3cd819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8103c30 0x7f3cd819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3cd8108930 0x7f3cd81a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd810e520 con 0x7f3cd8103c30 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd810e3a0 con 0x7f3cd81029f0 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cdd2bf640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd810e6a0 con 0x7f3cd8108930 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8103c30 0x7f3cd819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8103c30 0x7f3cd819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60500/0 (socket says 172.21.15.80:60500) 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3ccffff640 1 -- 172.21.15.80:0/1150133131 learned_addr learned my addr 172.21.15.80:0/1150133131 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cd6ffd640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cd81029f0 0x7f3cd819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.522+0000 7f3cd77fe640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3cd8108930 0x7f3cd81a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3ccffff640 1 -- 172.21.15.80:0/1150133131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3cd8108930 msgr2=0x7f3cd81a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3ccffff640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3cd8108930 0x7f3cd81a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3ccffff640 1 -- 172.21.15.80:0/1150133131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cd81029f0 msgr2=0x7f3cd819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3ccffff640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cd81029f0 0x7f3cd819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3ccffff640 1 -- 172.21.15.80:0/1150133131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd81a1d30 con 0x7f3cd8103c30 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3cd77fe640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3cd8108930 0x7f3cd81a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3ccffff640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8103c30 0x7f3cd819a730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e9f0 tx=0x7f3cc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3cd4ff9640 1 -- 172.21.15.80:0/1150133131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000cd80 con 0x7f3cd8103c30 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3cd4ff9640 1 -- 172.21.15.80:0/1150133131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cc00054d0 con 0x7f3cd8103c30 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd81a1fc0 con 0x7f3cd8103c30 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3cd4ff9640 1 -- 172.21.15.80:0/1150133131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0010690 con 0x7f3cd8103c30 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.523+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd81a2460 con 0x7f3cd8103c30 2024-04-25T11:22:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.524+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd81a2720 con 0x7f3cd8103c30 2024-04-25T11:22:15.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.525+0000 7f3cd4ff9640 1 -- 172.21.15.80:0/1150133131 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f3cc0004e30 con 0x7f3cd8103c30 2024-04-25T11:22:15.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.526+0000 7f3cd4ff9640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3cc40afaf0 0x7f3cc40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:15.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.526+0000 7f3cd6ffd640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3cc40afaf0 0x7f3cc40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:15.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.526+0000 7f3cd4ff9640 1 -- 172.21.15.80:0/1150133131 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f3cc00df0f0 con 0x7f3cd8103c30 2024-04-25T11:22:15.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.526+0000 7f3cd6ffd640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3cc40afaf0 0x7f3cc40b2000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8005fd0 tx=0x7f3cc800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.529+0000 7f3cd4ff9640 1 -- 172.21.15.80:0/1150133131 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3cc0053ff0 con 0x7f3cd8103c30 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/243206856' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: osdmap e76: 12 total, 12 up, 12 in 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/337266892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/518996510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: pgmap v286: 97 pgs: 25 creating+peering, 15 active+clean, 57 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:15.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3984754365' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T11:22:15.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:15.746+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f3cd81a28f0 con 0x7f3cd8103c30 2024-04-25T11:22:15.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/243206856' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T11:22:15.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: osdmap e76: 12 total, 12 up, 12 in 2024-04-25T11:22:15.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T11:22:15.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T11:22:15.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/337266892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:15.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/518996510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:15.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: pgmap v286: 97 pgs: 25 creating+peering, 15 active+clean, 57 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:15.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3984754365' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T11:22:15.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/243206856' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T11:22:15.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: osdmap e76: 12 total, 12 up, 12 in 2024-04-25T11:22:15.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T11:22:15.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T11:22:15.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/337266892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:15.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/518996510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:15.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: pgmap v286: 97 pgs: 25 creating+peering, 15 active+clean, 57 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:22:15.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3984754365' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T11:22:16.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.405+0000 7f3cd4ff9640 1 -- 172.21.15.80:0/1150133131 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v16) ==== 105+0+0 (secure 0 0 0) 0x7f3cc00a7e20 con 0x7f3cd8103c30 2024-04-25T11:22:16.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3cc40afaf0 msgr2=0x7f3cc40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3cc40afaf0 0x7f3cc40b2000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8005fd0 tx=0x7f3cc800b410 comp rx=0 tx=0).stop 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8103c30 msgr2=0x7f3cd819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8103c30 0x7f3cd819a730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e9f0 tx=0x7f3cc000edf0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 shutdown_connections 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3cc40afaf0 0x7f3cc40b2000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd8103c30 0x7f3cd819a730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3cd8108930 0x7f3cd81a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 --2- 172.21.15.80:0/1150133131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cd81029f0 0x7f3cd819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 >> 172.21.15.80:0/1150133131 conn(0x7f3cd80fdbc0 msgr2=0x7f3cd8074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 shutdown_connections 2024-04-25T11:22:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.409+0000 7f3cdd2bf640 1 -- 172.21.15.80:0/1150133131 wait complete. 2024-04-25T11:22:16.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-25T11:22:16.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 -- 172.21.15.80:0/2893767524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc101750 msgr2=0x7f2fbc101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:16.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 --2- 172.21.15.80:0/2893767524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc101750 0x7f2fbc101bc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009900 tx=0x7f2fa402a410 comp rx=0 tx=0).stop 2024-04-25T11:22:16.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 -- 172.21.15.80:0/2893767524 shutdown_connections 2024-04-25T11:22:16.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 --2- 172.21.15.80:0/2893767524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc101750 0x7f2fbc101bc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 --2- 172.21.15.80:0/2893767524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc102250 0x7f2fbc10bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 --2- 172.21.15.80:0/2893767524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fbc1050a0 0x7f2fbc1054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 -- 172.21.15.80:0/2893767524 >> 172.21.15.80:0/2893767524 conn(0x7f2fbc0fd350 msgr2=0x7f2fbc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 -- 172.21.15.80:0/2893767524 shutdown_connections 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.550+0000 7f2fc1205640 1 -- 172.21.15.80:0/2893767524 wait complete. 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 Processor -- start 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 -- start start 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fbc101750 0x7f2fbc19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc102250 0x7f2fbc19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc1050a0 0x7f2fbc1a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc10f630 con 0x7f2fbc1050a0 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc10f4b0 con 0x7f2fbc102250 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fc1205640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc10f7b0 con 0x7f2fbc101750 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fbb59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc1050a0 0x7f2fbc1a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fbb59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc1050a0 0x7f2fbc1a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39452/0 (socket says 172.21.15.80:39452) 2024-04-25T11:22:16.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fbb59e640 1 -- 172.21.15.80:0/3808541482 learned_addr learned my addr 172.21.15.80:0/3808541482 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fbad9d640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fbc101750 0x7f2fbc19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.551+0000 7f2fba59c640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc102250 0x7f2fbc19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fbb59e640 1 -- 172.21.15.80:0/3808541482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fbc101750 msgr2=0x7f2fbc19a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fbb59e640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fbc101750 0x7f2fbc19a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fbb59e640 1 -- 172.21.15.80:0/3808541482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc102250 msgr2=0x7f2fbc19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fbb59e640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc102250 0x7f2fbc19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fbb59e640 1 -- 172.21.15.80:0/3808541482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc1a1cf0 con 0x7f2fbc1050a0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fbb59e640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc1050a0 0x7f2fbc1a1730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cce0 tx=0x7f2fb400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fb3fff640 1 -- 172.21.15.80:0/3808541482 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400f450 con 0x7f2fbc1050a0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc1a1fe0 con 0x7f2fbc1050a0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fb3fff640 1 -- 172.21.15.80:0/3808541482 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb400faa0 con 0x7f2fbc1050a0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fb3fff640 1 -- 172.21.15.80:0/3808541482 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4018b70 con 0x7f2fbc1050a0 2024-04-25T11:22:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.552+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc1a2440 con 0x7f2fbc1050a0 2024-04-25T11:22:16.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.553+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc108a30 con 0x7f2fbc1050a0 2024-04-25T11:22:16.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.554+0000 7f2fb3fff640 1 -- 172.21.15.80:0/3808541482 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f2fb4018d10 con 0x7f2fbc1050a0 2024-04-25T11:22:16.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.555+0000 7f2fb3fff640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2fa80afaf0 0x7f2fa80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:16.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.555+0000 7f2fbad9d640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2fa80afaf0 0x7f2fa80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:16.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.555+0000 7f2fb3fff640 1 -- 172.21.15.80:0/3808541482 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f2fb40deed0 con 0x7f2fbc1050a0 2024-04-25T11:22:16.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.555+0000 7f2fbad9d640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2fa80afaf0 0x7f2fa80b2000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2fac005fd0 tx=0x7f2fac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:16.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.559+0000 7f2fb3fff640 1 -- 172.21.15.80:0/3808541482 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2fb4014030 con 0x7f2fbc1050a0 2024-04-25T11:22:16.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:16 smithi196 ceph-mon[32659]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T11:22:16.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:16 smithi196 ceph-mon[32659]: Cluster is now healthy 2024-04-25T11:22:16.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:16 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3984754365' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T11:22:16.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:16 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] up:active 2024-04-25T11:22:16.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:16 smithi196 ceph-mon[32659]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T11:22:16.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:16 smithi196 ceph-mon[32659]: osdmap e77: 12 total, 12 up, 12 in 2024-04-25T11:22:16.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:16 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1150133131' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T11:22:16.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:16 smithi082 ceph-mon[32440]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T11:22:16.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:16 smithi082 ceph-mon[32440]: Cluster is now healthy 2024-04-25T11:22:16.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:16 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3984754365' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T11:22:16.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:16 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] up:active 2024-04-25T11:22:16.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:16 smithi082 ceph-mon[32440]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T11:22:16.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:16 smithi082 ceph-mon[32440]: osdmap e77: 12 total, 12 up, 12 in 2024-04-25T11:22:16.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:16 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1150133131' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T11:22:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:16.776+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f2fbc02dd10 con 0x7f2fbc1050a0 2024-04-25T11:22:16.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:16 smithi080 ceph-mon[29126]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T11:22:16.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:16 smithi080 ceph-mon[29126]: Cluster is now healthy 2024-04-25T11:22:16.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:16 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3984754365' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T11:22:16.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:16 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] up:active 2024-04-25T11:22:16.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:16 smithi080 ceph-mon[29126]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T11:22:16.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:16 smithi080 ceph-mon[29126]: osdmap e77: 12 total, 12 up, 12 in 2024-04-25T11:22:16.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:16 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1150133131' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T11:22:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.415+0000 7f2fb3fff640 1 -- 172.21.15.80:0/3808541482 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f2fb40a7c90 con 0x7f2fbc1050a0 2024-04-25T11:22:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2fa80afaf0 msgr2=0x7f2fa80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:17.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2fa80afaf0 0x7f2fa80b2000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2fac005fd0 tx=0x7f2fac00b390 comp rx=0 tx=0).stop 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc1050a0 msgr2=0x7f2fbc1a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc1050a0 0x7f2fbc1a1730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cce0 tx=0x7f2fb400a620 comp rx=0 tx=0).stop 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 shutdown_connections 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2fa80afaf0 0x7f2fa80b2000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fbc1050a0 0x7f2fbc1a1730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fbc102250 0x7f2fbc19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 --2- 172.21.15.80:0/3808541482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fbc101750 0x7f2fbc19a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 >> 172.21.15.80:0/3808541482 conn(0x7f2fbc0fd350 msgr2=0x7f2fbc105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 shutdown_connections 2024-04-25T11:22:17.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.418+0000 7f2fc1205640 1 -- 172.21.15.80:0/3808541482 wait complete. 2024-04-25T11:22:17.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T11:22:17.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 -- 172.21.15.80:0/3686794714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 msgr2=0x7f92f01054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:17.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 --2- 172.21.15.80:0/3686794714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01054c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009900 tx=0x7f92ec02a410 comp rx=0 tx=0).stop 2024-04-25T11:22:17.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 -- 172.21.15.80:0/3686794714 shutdown_connections 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 --2- 172.21.15.80:0/3686794714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92f0102260 0x7f92f010bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 --2- 172.21.15.80:0/3686794714 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92f0101760 0x7f92f0101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 --2- 172.21.15.80:0/3686794714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01054c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 -- 172.21.15.80:0/3686794714 >> 172.21.15.80:0/3686794714 conn(0x7f92f00fd380 msgr2=0x7f92f00ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 -- 172.21.15.80:0/3686794714 shutdown_connections 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.546+0000 7f92f7634640 1 -- 172.21.15.80:0/3686794714 wait complete. 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 Processor -- start 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 -- start start 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92f0101760 0x7f92f019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92f0102260 0x7f92f019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f92f010f670 con 0x7f92f01050b0 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92f010f4f0 con 0x7f92f0101760 2024-04-25T11:22:17.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f7634640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f92f010f7f0 con 0x7f92f0102260 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39472/0 (socket says 172.21.15.80:39472) 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 -- 172.21.15.80:0/917527069 learned_addr learned my addr 172.21.15.80:0/917527069 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f53d0640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92f0101760 0x7f92f019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f4bcf640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92f0102260 0x7f92f019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 -- 172.21.15.80:0/917527069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92f0102260 msgr2=0x7f92f019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92f0102260 0x7f92f019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 -- 172.21.15.80:0/917527069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92f0101760 msgr2=0x7f92f019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92f0101760 0x7f92f019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.547+0000 7f92f5bd1640 1 -- 172.21.15.80:0/917527069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f01a1df0 con 0x7f92f01050b0 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.548+0000 7f92f5bd1640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01a1780 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f92e800eb10 tx=0x7f92e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.548+0000 7f92e67fc640 1 -- 172.21.15.80:0/917527069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8004b20 con 0x7f92f01050b0 2024-04-25T11:22:17.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.548+0000 7f92e67fc640 1 -- 172.21.15.80:0/917527069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92e8004cc0 con 0x7f92f01050b0 2024-04-25T11:22:17.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.548+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f01a20e0 con 0x7f92f01050b0 2024-04-25T11:22:17.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.548+0000 7f92e67fc640 1 -- 172.21.15.80:0/917527069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8010670 con 0x7f92f01050b0 2024-04-25T11:22:17.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.548+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f01a26b0 con 0x7f92f01050b0 2024-04-25T11:22:17.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.549+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f0108a40 con 0x7f92f01050b0 2024-04-25T11:22:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.550+0000 7f92e67fc640 1 -- 172.21.15.80:0/917527069 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f92e8005000 con 0x7f92f01050b0 2024-04-25T11:22:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.551+0000 7f92e67fc640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92dc0afb70 0x7f92dc0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.551+0000 7f92f53d0640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92dc0afb70 0x7f92dc0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.551+0000 7f92e67fc640 1 -- 172.21.15.80:0/917527069 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f92e80df280 con 0x7f92f01050b0 2024-04-25T11:22:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.551+0000 7f92f53d0640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92dc0afb70 0x7f92dc0b2080 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f92ec005ab0 tx=0x7f92ec031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.554+0000 7f92e67fc640 1 -- 172.21.15.80:0/917527069 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f92e8053ff0 con 0x7f92f01050b0 2024-04-25T11:22:17.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T11:22:17.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1150133131' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T11:22:17.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T11:22:17.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T11:22:17.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-25T11:22:17.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-25T11:22:17.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3808541482' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T11:22:17.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:17 smithi196 ceph-mon[32659]: pgmap v288: 97 pgs: 25 creating+peering, 54 active+clean, 18 unknown; 579 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 4 op/s 2024-04-25T11:22:17.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T11:22:17.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1150133131' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T11:22:17.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T11:22:17.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T11:22:17.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-25T11:22:17.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-25T11:22:17.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3808541482' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T11:22:17.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:17 smithi082 ceph-mon[32440]: pgmap v288: 97 pgs: 25 creating+peering, 54 active+clean, 18 unknown; 579 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 4 op/s 2024-04-25T11:22:17.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:17.770+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f92f002db50 con 0x7f92f01050b0 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1150133131' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3808541482' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T11:22:17.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:17 smithi080 ceph-mon[29126]: pgmap v288: 97 pgs: 25 creating+peering, 54 active+clean, 18 unknown; 579 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 4 op/s 2024-04-25T11:22:18.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.424+0000 7f92e67fc640 1 -- 172.21.15.80:0/917527069 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f92e80a7fb0 con 0x7f92f01050b0 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92dc0afb70 msgr2=0x7f92dc0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92dc0afb70 0x7f92dc0b2080 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f92ec005ab0 tx=0x7f92ec031400 comp rx=0 tx=0).stop 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 msgr2=0x7f92f01a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01a1780 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f92e800eb10 tx=0x7f92e800c2d0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 shutdown_connections 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92dc0afb70 0x7f92dc0b2080 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92f01050b0 0x7f92f01a1780 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92f0102260 0x7f92f019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 --2- 172.21.15.80:0/917527069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92f0101760 0x7f92f019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 >> 172.21.15.80:0/917527069 conn(0x7f92f00fd380 msgr2=0x7f92f0105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 shutdown_connections 2024-04-25T11:22:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.427+0000 7f92f7634640 1 -- 172.21.15.80:0/917527069 wait complete. 2024-04-25T11:22:18.436 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-04-25T11:22:18.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-25T11:22:18.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 -- 172.21.15.80:0/3563802565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20108920 msgr2=0x7ffa2010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 --2- 172.21.15.80:0/3563802565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20108920 0x7ffa2010ad40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009ca0 tx=0x7ffa1802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 -- 172.21.15.80:0/3563802565 shutdown_connections 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 --2- 172.21.15.80:0/3563802565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20108920 0x7ffa2010ad40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 --2- 172.21.15.80:0/3563802565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa20103c20 0x7ffa20104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 --2- 172.21.15.80:0/3563802565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa201029e0 0x7ffa201036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 -- 172.21.15.80:0/3563802565 >> 172.21.15.80:0/3563802565 conn(0x7ffa200fdbd0 msgr2=0x7ffa20100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 -- 172.21.15.80:0/3563802565 shutdown_connections 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 -- 172.21.15.80:0/3563802565 wait complete. 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 Processor -- start 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.555+0000 7ffa265d6640 1 -- start start 2024-04-25T11:22:18.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa265d6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa201029e0 0x7ffa201993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa265d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20103c20 0x7ffa20199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa265d6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa20108920 0x7ffa201a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa265d6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2010e510 con 0x7ffa201029e0 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa265d6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2010e390 con 0x7ffa20103c20 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa265d6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2010e690 con 0x7ffa20108920 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa201029e0 0x7ffa201993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa201029e0 0x7ffa201993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39486/0 (socket says 172.21.15.80:39486) 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 -- 172.21.15.80:0/117364933 learned_addr learned my addr 172.21.15.80:0/117364933 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20103c20 0x7ffa20199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa24b73640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa20108920 0x7ffa201a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 -- 172.21.15.80:0/117364933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa20108920 msgr2=0x7ffa201a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa20108920 0x7ffa201a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 -- 172.21.15.80:0/117364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20103c20 msgr2=0x7ffa20199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20103c20 0x7ffa20199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 -- 172.21.15.80:0/117364933 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa201a0f20 con 0x7ffa201029e0 2024-04-25T11:22:18.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1ffff640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa201029e0 0x7ffa201993e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800e9f0 tx=0x7ffa0800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:18.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.556+0000 7ffa1d7fa640 1 -- 172.21.15.80:0/117364933 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ccc0 con 0x7ffa201029e0 2024-04-25T11:22:18.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.557+0000 7ffa1d7fa640 1 -- 172.21.15.80:0/117364933 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa080035f0 con 0x7ffa201029e0 2024-04-25T11:22:18.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.557+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa201a1210 con 0x7ffa201029e0 2024-04-25T11:22:18.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.557+0000 7ffa1d7fa640 1 -- 172.21.15.80:0/117364933 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ce60 con 0x7ffa201029e0 2024-04-25T11:22:18.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.557+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa201a1760 con 0x7ffa201029e0 2024-04-25T11:22:18.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.557+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa20107730 con 0x7ffa201029e0 2024-04-25T11:22:18.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.559+0000 7ffa1d7fa640 1 -- 172.21.15.80:0/117364933 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7ffa08003aa0 con 0x7ffa201029e0 2024-04-25T11:22:18.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.560+0000 7ffa1d7fa640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa0c0afaf0 0x7ffa0c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.560+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa0c0afaf0 0x7ffa0c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.560+0000 7ffa1d7fa640 1 -- 172.21.15.80:0/117364933 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7ffa080def40 con 0x7ffa201029e0 2024-04-25T11:22:18.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.560+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa0c0afaf0 0x7ffa0c0b2000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa100058c0 tx=0x7ffa1000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:18.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.564+0000 7ffa1d7fa640 1 -- 172.21.15.80:0/117364933 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffa080a7c50 con 0x7ffa201029e0 2024-04-25T11:22:18.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3808541482' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] up:active 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: Cluster is now healthy 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-25T11:22:18.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:18 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/917527069' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T11:22:18.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3808541482' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T11:22:18.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] up:active 2024-04-25T11:22:18.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: Cluster is now healthy 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/917527069' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: 2024-04-25T11:22:18.347+0000 7f4c64af1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T11:22:18.746 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:22:18 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: 2024-04-25T11:22:18.347+0000 7f4c64af1700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T11:22:18.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.766+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ffa2002dda0 con 0x7ffa0c0afaf0 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3808541482' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] up:active 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: Cluster is now healthy 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-25T11:22:18.768 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/917527069' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T11:22:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.795+0000 7ffa1d7fa640 1 -- 172.21.15.80:0/117364933 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffa2002dda0 con 0x7ffa0c0afaf0 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa0c0afaf0 msgr2=0x7ffa0c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa0c0afaf0 0x7ffa0c0b2000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa100058c0 tx=0x7ffa1000a250 comp rx=0 tx=0).stop 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa201029e0 msgr2=0x7ffa201993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa201029e0 0x7ffa201993e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800e9f0 tx=0x7ffa0800eeb0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 shutdown_connections 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa0c0afaf0 0x7ffa0c0b2000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa20108920 0x7ffa201a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20103c20 0x7ffa20199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 --2- 172.21.15.80:0/117364933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa201029e0 0x7ffa201993e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 >> 172.21.15.80:0/117364933 conn(0x7ffa200fdbd0 msgr2=0x7ffa20104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 shutdown_connections 2024-04-25T11:22:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.797+0000 7ffa265d6640 1 -- 172.21.15.80:0/117364933 wait complete. 2024-04-25T11:22:18.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 -- 172.21.15.80:0/146974623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40109a30 msgr2=0x7f3c4010be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 --2- 172.21.15.80:0/146974623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40109a30 0x7f3c4010be50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009ca0 tx=0x7f3c3802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 -- 172.21.15.80:0/146974623 shutdown_connections 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 --2- 172.21.15.80:0/146974623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40109a30 0x7f3c4010be50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 --2- 172.21.15.80:0/146974623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c40104d30 0x7f3c40105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 --2- 172.21.15.80:0/146974623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c40103af0 0x7f3c401047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 -- 172.21.15.80:0/146974623 >> 172.21.15.80:0/146974623 conn(0x7f3c400fece0 msgr2=0x7f3c40101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 -- 172.21.15.80:0/146974623 shutdown_connections 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.921+0000 7f3c46338640 1 -- 172.21.15.80:0/146974623 wait complete. 2024-04-25T11:22:18.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 Processor -- start 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 -- start start 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c40103af0 0x7f3c4019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40104d30 0x7f3c4019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c40109a30 0x7f3c401a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010f600 con 0x7f3c40104d30 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010f480 con 0x7f3c40109a30 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c46338640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010f780 con 0x7f3c40103af0 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40104d30 0x7f3c4019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40104d30 0x7f3c4019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39532/0 (socket says 172.21.15.80:39532) 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 -- 172.21.15.80:0/1263540575 learned_addr learned my addr 172.21.15.80:0/1263540575 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3ffff640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c40103af0 0x7f3c4019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c448d5640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c40109a30 0x7f3c401a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 -- 172.21.15.80:0/1263540575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c40103af0 msgr2=0x7f3c4019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c40103af0 0x7f3c4019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 -- 172.21.15.80:0/1263540575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c40109a30 msgr2=0x7f3c401a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c40109a30 0x7f3c401a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.922+0000 7f3c3f7fe640 1 -- 172.21.15.80:0/1263540575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c401a1cb0 con 0x7f3c40104d30 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.923+0000 7f3c3f7fe640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40104d30 0x7f3c4019a6b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d950 tx=0x7f3c3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.923+0000 7f3c3d7fa640 1 -- 172.21.15.80:0/1263540575 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34017070 con 0x7f3c40104d30 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.923+0000 7f3c3d7fa640 1 -- 172.21.15.80:0/1263540575 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c34009c30 con 0x7f3c40104d30 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.923+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c401a1fa0 con 0x7f3c40104d30 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.923+0000 7f3c3d7fa640 1 -- 172.21.15.80:0/1263540575 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400f620 con 0x7f3c40104d30 2024-04-25T11:22:18.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.923+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c401a2410 con 0x7f3c40104d30 2024-04-25T11:22:18.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.924+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c40108840 con 0x7f3c40104d30 2024-04-25T11:22:18.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.925+0000 7f3c3d7fa640 1 -- 172.21.15.80:0/1263540575 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f3c34010460 con 0x7f3c40104d30 2024-04-25T11:22:18.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.926+0000 7f3c3d7fa640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3c280afaf0 0x7f3c280b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:18.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.926+0000 7f3c3ffff640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3c280afaf0 0x7f3c280b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:18.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.926+0000 7f3c3d7fa640 1 -- 172.21.15.80:0/1263540575 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f3c340de690 con 0x7f3c40104d30 2024-04-25T11:22:18.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.926+0000 7f3c3ffff640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3c280afaf0 0x7f3c280b2000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c401046f0 tx=0x7f3c30005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:18.930+0000 7f3c3d7fa640 1 -- 172.21.15.80:0/1263540575 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3c34009de0 con 0x7f3c40104d30 2024-04-25T11:22:19.130 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:22:18.771+0000 7fed63947700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:22:19.130 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:22:18.771+0000 7fed63947700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:22:19.130 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:22:18.771+0000 7fed63947700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:22:19.130 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:22:18.771+0000 7fed63947700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:22:19.130 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:22:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:22:18.771+0000 7fed63947700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:22:19.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.136+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3c40063070 con 0x7f3c280afaf0 2024-04-25T11:22:19.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.162+0000 7f3c3d7fa640 1 -- 172.21.15.80:0/1263540575 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3c40063070 con 0x7f3c280afaf0 2024-04-25T11:22:19.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.164+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3c280afaf0 msgr2=0x7f3c280b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.164+0000 7f3c46338640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3c280afaf0 0x7f3c280b2000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c401046f0 tx=0x7f3c30005f90 comp rx=0 tx=0).stop 2024-04-25T11:22:19.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.164+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40104d30 msgr2=0x7f3c4019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.164+0000 7f3c46338640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40104d30 0x7f3c4019a6b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d950 tx=0x7f3c3400de10 comp rx=0 tx=0).stop 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 shutdown_connections 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f3c280afaf0 0x7f3c280b2000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c40104d30 0x7f3c4019a6b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c40109a30 0x7f3c401a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 --2- 172.21.15.80:0/1263540575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c40103af0 0x7f3c4019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 >> 172.21.15.80:0/1263540575 conn(0x7f3c400fece0 msgr2=0x7f3c40105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 shutdown_connections 2024-04-25T11:22:19.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.165+0000 7f3c46338640 1 -- 172.21.15.80:0/1263540575 wait complete. 2024-04-25T11:22:19.171 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2736215692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f81045d0 msgr2=0x7fe5f81069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2736215692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f81045d0 0x7fe5f81069f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009900 tx=0x7fe5e802a410 comp rx=0 tx=0).stop 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2736215692 shutdown_connections 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2736215692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5f8109890 0x7fe5f810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2736215692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f8106f30 0x7fe5f8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2736215692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f81045d0 0x7fe5f81069f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2736215692 >> 172.21.15.80:0/2736215692 conn(0x7fe5f80fdbd0 msgr2=0x7fe5f8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2736215692 shutdown_connections 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2736215692 wait complete. 2024-04-25T11:22:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 Processor -- start 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.289+0000 7fe5fea6e640 1 -- start start 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fea6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f81045d0 0x7fe5f819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fea6e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5f8106f30 0x7fe5f819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fea6e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f8109890 0x7fe5f81a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fea6e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f810f610 con 0x7fe5f8109890 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fea6e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f810f490 con 0x7fe5f81045d0 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fea6e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f810f790 con 0x7fe5f8106f30 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f8109890 0x7fe5f81a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f8109890 0x7fe5f81a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39544/0 (socket says 172.21.15.80:39544) 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 -- 172.21.15.80:0/2608518259 learned_addr learned my addr 172.21.15.80:0/2608518259 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fc80a640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f81045d0 0x7fe5f819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5f7fff640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5f8106f30 0x7fe5f819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 -- 172.21.15.80:0/2608518259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5f8106f30 msgr2=0x7fe5f819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5f8106f30 0x7fe5f819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 -- 172.21.15.80:0/2608518259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f81045d0 msgr2=0x7fe5f819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f81045d0 0x7fe5f819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 -- 172.21.15.80:0/2608518259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f81a2050 con 0x7fe5f8109890 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fd00b640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f8109890 0x7fe5f81a1a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000ccb0 tx=0x7fe5f000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0003970 con 0x7fe5f8109890 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f81a2340 con 0x7fe5f8109890 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5f0004030 con 0x7fe5f8109890 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.290+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000f6b0 con 0x7fe5f8109890 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.291+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f81a2840 con 0x7fe5f8109890 2024-04-25T11:22:19.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.291+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f806c2a0 con 0x7fe5f8109890 2024-04-25T11:22:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.293+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe5f0003b10 con 0x7fe5f8109890 2024-04-25T11:22:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.293+0000 7fe5f5ffb640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe5e00afaf0 0x7fe5e00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.293+0000 7fe5fc80a640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe5e00afaf0 0x7fe5e00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.294+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fe5f00defb0 con 0x7fe5f8109890 2024-04-25T11:22:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.294+0000 7fe5fc80a640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe5e00afaf0 0x7fe5e00b2000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8031440 tx=0x7fe5e80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.297+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5f0014070 con 0x7fe5f8109890 2024-04-25T11:22:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.449+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fe5f00a3870 con 0x7fe5f8109890 2024-04-25T11:22:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.513+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe5f8106630 con 0x7fe5e00afaf0 2024-04-25T11:22:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.518+0000 7fe5f5ffb640 1 -- 172.21.15.80:0/2608518259 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe5f8106630 con 0x7fe5e00afaf0 2024-04-25T11:22:19.514 INFO:teuthology.orchestra.run.smithi080.stdout:/volumes/qa/sv_0/355fe3b5-9f9f-405a-9b23-f847b46a88ac 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe5e00afaf0 msgr2=0x7fe5e00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe5e00afaf0 0x7fe5e00b2000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8031440 tx=0x7fe5e80314a0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f8109890 msgr2=0x7fe5f81a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f8109890 0x7fe5f81a1a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000ccb0 tx=0x7fe5f000a620 comp rx=0 tx=0).stop 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 shutdown_connections 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe5e00afaf0 0x7fe5e00b2000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5f8109890 0x7fe5f81a1a90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5f8106f30 0x7fe5f819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 --2- 172.21.15.80:0/2608518259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f81045d0 0x7fe5f819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 >> 172.21.15.80:0/2608518259 conn(0x7fe5f80fdbd0 msgr2=0x7fe5f8105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 shutdown_connections 2024-04-25T11:22:19.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.521+0000 7fe5fea6e640 1 -- 172.21.15.80:0/2608518259 wait complete. 2024-04-25T11:22:19.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-25T11:22:19.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 -- 172.21.15.80:0/3978423090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714102a00 msgr2=0x7ff714103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 --2- 172.21.15.80:0/3978423090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714102a00 0x7ff714103700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff704009900 tx=0x7ff70402a410 comp rx=0 tx=0).stop 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 -- 172.21.15.80:0/3978423090 shutdown_connections 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 --2- 172.21.15.80:0/3978423090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714108940 0x7ff71410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 --2- 172.21.15.80:0/3978423090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff714103c40 0x7ff714104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 --2- 172.21.15.80:0/3978423090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714102a00 0x7ff714103700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 -- 172.21.15.80:0/3978423090 >> 172.21.15.80:0/3978423090 conn(0x7ff7140fdbf0 msgr2=0x7ff7141000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 -- 172.21.15.80:0/3978423090 shutdown_connections 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 -- 172.21.15.80:0/3978423090 wait complete. 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.644+0000 7ff719bce640 1 Processor -- start 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff719bce640 1 -- start start 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff719bce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff714102a00 0x7ff71419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff719bce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714103c40 0x7ff71419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff719bce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714108940 0x7ff7141a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff719bce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff71410e580 con 0x7ff714108940 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff719bce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff71410e400 con 0x7ff714103c40 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff719bce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff71410e700 con 0x7ff714102a00 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714108940 0x7ff7141a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714108940 0x7ff7141a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39550/0 (socket says 172.21.15.80:39550) 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 -- 172.21.15.80:0/936197937 learned_addr learned my addr 172.21.15.80:0/936197937 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff7137fe640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff714102a00 0x7ff71419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff712ffd640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714103c40 0x7ff71419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 -- 172.21.15.80:0/936197937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff714102a00 msgr2=0x7ff71419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff714102a00 0x7ff71419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 -- 172.21.15.80:0/936197937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714103c40 msgr2=0x7ff71419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714103c40 0x7ff71419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 -- 172.21.15.80:0/936197937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7141a1e10 con 0x7ff714108940 2024-04-25T11:22:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff712ffd640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714103c40 0x7ff71419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff713fff640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714108940 0x7ff7141a17a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00cad0 tx=0x7ff70c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.645+0000 7ff710ff9640 1 -- 172.21.15.80:0/936197937 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00ae20 con 0x7ff714108940 2024-04-25T11:22:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.646+0000 7ff710ff9640 1 -- 172.21.15.80:0/936197937 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff70c005020 con 0x7ff714108940 2024-04-25T11:22:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.646+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7141a2100 con 0x7ff714108940 2024-04-25T11:22:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.646+0000 7ff710ff9640 1 -- 172.21.15.80:0/936197937 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00f6b0 con 0x7ff714108940 2024-04-25T11:22:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.646+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7141a26d0 con 0x7ff714108940 2024-04-25T11:22:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.647+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7141a2990 con 0x7ff714108940 2024-04-25T11:22:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.648+0000 7ff710ff9640 1 -- 172.21.15.80:0/936197937 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7ff70c0051d0 con 0x7ff714108940 2024-04-25T11:22:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.648+0000 7ff710ff9640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff6fc0afb80 0x7ff6fc0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.649+0000 7ff7137fe640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff6fc0afb80 0x7ff6fc0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.649+0000 7ff710ff9640 1 -- 172.21.15.80:0/936197937 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7ff70c0df0c0 con 0x7ff714108940 2024-04-25T11:22:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.649+0000 7ff7137fe640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff6fc0afb80 0x7ff6fc0b2090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff704005ab0 tx=0x7ff704031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.652+0000 7ff710ff9640 1 -- 172.21.15.80:0/936197937 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff70c014030 con 0x7ff714108940 2024-04-25T11:22:19.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/917527069' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T11:22:19.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:19 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] up:active 2024-04-25T11:22:19.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:19 smithi196 ceph-mon[32659]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-25T11:22:19.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:19 smithi196 ceph-mon[32659]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:22:19.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:19 smithi196 ceph-mon[32659]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:19.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:19 smithi196 ceph-mon[32659]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:19.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:19 smithi196 ceph-mon[32659]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 6.5 KiB/s wr, 18 op/s 2024-04-25T11:22:19.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/917527069' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T11:22:19.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:19 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] up:active 2024-04-25T11:22:19.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:19 smithi082 ceph-mon[32440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-25T11:22:19.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:19 smithi082 ceph-mon[32440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:22:19.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:19 smithi082 ceph-mon[32440]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:19.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:19 smithi082 ceph-mon[32440]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:19.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:19 smithi082 ceph-mon[32440]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 6.5 KiB/s wr, 18 op/s 2024-04-25T11:22:19.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.857+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff71410a5c0 con 0x7ff6fc0afb80 2024-04-25T11:22:19.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/917527069' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T11:22:19.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:19 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] up:active 2024-04-25T11:22:19.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:19 smithi080 ceph-mon[29126]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-25T11:22:19.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:19 smithi080 ceph-mon[29126]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:22:19.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:19 smithi080 ceph-mon[29126]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:19.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:19 smithi080 ceph-mon[29126]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:19.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:19 smithi080 ceph-mon[29126]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 6.5 KiB/s wr, 18 op/s 2024-04-25T11:22:19.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.884+0000 7ff710ff9640 1 -- 172.21.15.80:0/936197937 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff71410a5c0 con 0x7ff6fc0afb80 2024-04-25T11:22:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff6fc0afb80 msgr2=0x7ff6fc0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff6fc0afb80 0x7ff6fc0b2090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff704005ab0 tx=0x7ff704031400 comp rx=0 tx=0).stop 2024-04-25T11:22:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714108940 msgr2=0x7ff7141a17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714108940 0x7ff7141a17a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00cad0 tx=0x7ff70c00cf90 comp rx=0 tx=0).stop 2024-04-25T11:22:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 shutdown_connections 2024-04-25T11:22:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff6fc0afb80 0x7ff6fc0b2090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff714108940 0x7ff7141a17a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff714103c40 0x7ff71419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 --2- 172.21.15.80:0/936197937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff714102a00 0x7ff71419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:19.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.886+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 >> 172.21.15.80:0/936197937 conn(0x7ff7140fdbf0 msgr2=0x7ff714109eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:19.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.887+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 shutdown_connections 2024-04-25T11:22:19.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:19.887+0000 7ff719bce640 1 -- 172.21.15.80:0/936197937 wait complete. 2024-04-25T11:22:19.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-25T11:22:20.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 -- 172.21.15.80:0/1292334391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01098b0 msgr2=0x7fa1c010bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/1292334391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01098b0 0x7fa1c010bcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009ca0 tx=0x7fa1b802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 -- 172.21.15.80:0/1292334391 shutdown_connections 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/1292334391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01098b0 0x7fa1c010bcd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/1292334391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c0106f50 0x7fa1c0109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/1292334391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1c01045f0 0x7fa1c0106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 -- 172.21.15.80:0/1292334391 >> 172.21.15.80:0/1292334391 conn(0x7fa1c00fdbf0 msgr2=0x7fa1c01000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 -- 172.21.15.80:0/1292334391 shutdown_connections 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.010+0000 7fa1c48aa640 1 -- 172.21.15.80:0/1292334391 wait complete. 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 Processor -- start 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 -- start start 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01045f0 0x7fa1c019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c0106f50 0x7fa1c019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1c01098b0 0x7fa1c01a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010f680 con 0x7fa1c01045f0 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010f500 con 0x7fa1c0106f50 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1c48aa640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010f800 con 0x7fa1c01098b0 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1be59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01045f0 0x7fa1c019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1be59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01045f0 0x7fa1c019a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39568/0 (socket says 172.21.15.80:39568) 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1be59c640 1 -- 172.21.15.80:0/2972259972 learned_addr learned my addr 172.21.15.80:0/2972259972 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.011+0000 7fa1b7fff640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c0106f50 0x7fa1c019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1bed9d640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1c01098b0 0x7fa1c01a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1be59c640 1 -- 172.21.15.80:0/2972259972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1c01098b0 msgr2=0x7fa1c01a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1be59c640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1c01098b0 0x7fa1c01a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1be59c640 1 -- 172.21.15.80:0/2972259972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c0106f50 msgr2=0x7fa1c019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1be59c640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c0106f50 0x7fa1c019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1be59c640 1 -- 172.21.15.80:0/2972259972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c01a1d70 con 0x7fa1c01045f0 2024-04-25T11:22:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1be59c640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01045f0 0x7fa1c019a230 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b450 tx=0x7fa1b000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:20.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1b77fe640 1 -- 172.21.15.80:0/2972259972 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0015020 con 0x7fa1c01045f0 2024-04-25T11:22:20.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1b77fe640 1 -- 172.21.15.80:0/2972259972 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1b0011d40 con 0x7fa1c01045f0 2024-04-25T11:22:20.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c01a2060 con 0x7fa1c01045f0 2024-04-25T11:22:20.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1b77fe640 1 -- 172.21.15.80:0/2972259972 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000f340 con 0x7fa1c01045f0 2024-04-25T11:22:20.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.012+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c01a2630 con 0x7fa1c01045f0 2024-04-25T11:22:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.013+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c00ff710 con 0x7fa1c01045f0 2024-04-25T11:22:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.014+0000 7fa1b77fe640 1 -- 172.21.15.80:0/2972259972 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fa1b0018020 con 0x7fa1c01045f0 2024-04-25T11:22:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.015+0000 7fa1b77fe640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa1ac0afb80 0x7fa1ac0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.015+0000 7fa1b7fff640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa1ac0afb80 0x7fa1ac0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.015+0000 7fa1b77fe640 1 -- 172.21.15.80:0/2972259972 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fa1b00de5a0 con 0x7fa1c01045f0 2024-04-25T11:22:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.015+0000 7fa1b7fff640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa1ac0afb80 0x7fa1ac0b2090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1c019b2d0 tx=0x7fa1a800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.019+0000 7fa1b77fe640 1 -- 172.21.15.80:0/2972259972 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa1b001f020 con 0x7fa1c01045f0 2024-04-25T11:22:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.228+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa1c0062fe0 con 0x7fa1ac0afb80 2024-04-25T11:22:20.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.233+0000 7fa1b77fe640 1 -- 172.21.15.80:0/2972259972 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa1c0062fe0 con 0x7fa1ac0afb80 2024-04-25T11:22:20.229 INFO:teuthology.orchestra.run.smithi080.stdout:/volumes/qa/sv_1/38ab8361-f782-43e4-9220-6761784a9597 2024-04-25T11:22:20.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa1ac0afb80 msgr2=0x7fa1ac0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa1ac0afb80 0x7fa1ac0b2090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1c019b2d0 tx=0x7fa1a800b390 comp rx=0 tx=0).stop 2024-04-25T11:22:20.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01045f0 msgr2=0x7fa1c019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01045f0 0x7fa1c019a230 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b450 tx=0x7fa1b000b910 comp rx=0 tx=0).stop 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 shutdown_connections 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa1ac0afb80 0x7fa1ac0b2090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1c01098b0 0x7fa1c01a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c0106f50 0x7fa1c019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 --2- 172.21.15.80:0/2972259972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1c01045f0 0x7fa1c019a230 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 >> 172.21.15.80:0/2972259972 conn(0x7fa1c00fdbf0 msgr2=0x7fa1c01051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 shutdown_connections 2024-04-25T11:22:20.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.235+0000 7fa1c48aa640 1 -- 172.21.15.80:0/2972259972 wait complete. 2024-04-25T11:22:20.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:22:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 -- 172.21.15.80:0/2261353645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0102f90 msgr2=0x7f27e01033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2261353645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0102f90 0x7f27e01033a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009900 tx=0x7f27dc02a410 comp rx=0 tx=0).stop 2024-04-25T11:22:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 -- 172.21.15.80:0/2261353645 shutdown_connections 2024-04-25T11:22:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2261353645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27e0104490 0x7f27e010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2261353645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e0103970 0x7f27e0103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2261353645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0102f90 0x7f27e01033a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 -- 172.21.15.80:0/2261353645 >> 172.21.15.80:0/2261353645 conn(0x7f27e00fd390 msgr2=0x7f27e00ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 -- 172.21.15.80:0/2261353645 shutdown_connections 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.354+0000 7f27e85d7640 1 -- 172.21.15.80:0/2261353645 wait complete. 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 Processor -- start 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 -- start start 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e0102f90 0x7f27e01990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0103970 0x7f27e0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27e0104490 0x7f27e01a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f27e010e530 con 0x7f27e0103970 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27e010e3b0 con 0x7f27e0102f90 2024-04-25T11:22:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e85d7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27e010e6b0 con 0x7f27e0104490 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e5b72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0103970 0x7f27e0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e5b72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0103970 0x7f27e0199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39574/0 (socket says 172.21.15.80:39574) 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e5b72640 1 -- 172.21.15.80:0/2658371159 learned_addr learned my addr 172.21.15.80:0/2658371159 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e6373640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e0102f90 0x7f27e01990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.355+0000 7f27e6b74640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27e0104490 0x7f27e01a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e5b72640 1 -- 172.21.15.80:0/2658371159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27e0104490 msgr2=0x7f27e01a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e5b72640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27e0104490 0x7f27e01a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e5b72640 1 -- 172.21.15.80:0/2658371159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e0102f90 msgr2=0x7f27e01990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e5b72640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e0102f90 0x7f27e01990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e5b72640 1 -- 172.21.15.80:0/2658371159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e01a0c10 con 0x7f27e0103970 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e5b72640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0103970 0x7f27e0199610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f27d000d950 tx=0x7f27d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27d77fe640 1 -- 172.21.15.80:0/2658371159 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0017070 con 0x7f27e0103970 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e01a0f00 con 0x7f27e0103970 2024-04-25T11:22:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27d77fe640 1 -- 172.21.15.80:0/2658371159 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d0009c30 con 0x7f27e0103970 2024-04-25T11:22:20.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27d77fe640 1 -- 172.21.15.80:0/2658371159 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d000f620 con 0x7f27e0103970 2024-04-25T11:22:20.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.356+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e01a1370 con 0x7f27e0103970 2024-04-25T11:22:20.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.357+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e0107930 con 0x7f27e0103970 2024-04-25T11:22:20.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.358+0000 7f27d77fe640 1 -- 172.21.15.80:0/2658371159 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f27d0010460 con 0x7f27e0103970 2024-04-25T11:22:20.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.359+0000 7f27d77fe640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27cc0afb80 0x7f27cc0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.359+0000 7f27e6373640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27cc0afb80 0x7f27cc0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.359+0000 7f27d77fe640 1 -- 172.21.15.80:0/2658371159 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f27d00de830 con 0x7f27e0103970 2024-04-25T11:22:20.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.359+0000 7f27e6373640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27cc0afb80 0x7f27cc0b2090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009230 tx=0x7f27dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:20.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.363+0000 7f27d77fe640 1 -- 172.21.15.80:0/2658371159 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f27d00a7460 con 0x7f27e0103970 2024-04-25T11:22:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.583+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27e002dd10 con 0x7f27e0103970 2024-04-25T11:22:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.584+0000 7f27d77fe640 1 -- 172.21.15.80:0/2658371159 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f27d00bfe70 con 0x7f27e0103970 2024-04-25T11:22:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:20.580 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:22:18.430262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:22:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27cc0afb80 msgr2=0x7f27cc0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27cc0afb80 0x7f27cc0b2090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009230 tx=0x7f27dc031400 comp rx=0 tx=0).stop 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0103970 msgr2=0x7f27e0199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0103970 0x7f27e0199610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f27d000d950 tx=0x7f27d000de10 comp rx=0 tx=0).stop 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 shutdown_connections 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27cc0afb80 0x7f27cc0b2090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27e0103970 0x7f27e0199610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27e0104490 0x7f27e01a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 --2- 172.21.15.80:0/2658371159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e0102f90 0x7f27e01990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 >> 172.21.15.80:0/2658371159 conn(0x7f27e00fd390 msgr2=0x7f27e0104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 shutdown_connections 2024-04-25T11:22:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.586+0000 7f27e85d7640 1 -- 172.21.15.80:0/2658371159 wait complete. 2024-04-25T11:22:20.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:20 smithi080 ceph-mon[29126]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T11:22:20.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:20 smithi080 ceph-mon[29126]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:20 smithi080 ceph-mon[29126]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.592 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:20 smithi080 ceph-mon[29126]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:22:20.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:20 smithi196 ceph-mon[32659]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T11:22:20.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:20 smithi196 ceph-mon[32659]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:20 smithi196 ceph-mon[32659]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:20 smithi196 ceph-mon[32659]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 -- 172.21.15.80:0/192975329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc108920 msgr2=0x7f2bbc10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/192975329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc108920 0x7f2bbc10ad40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009ca0 tx=0x7f2bb402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 -- 172.21.15.80:0/192975329 shutdown_connections 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/192975329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc108920 0x7f2bbc10ad40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/192975329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc103c20 0x7f2bbc104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/192975329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc1029e0 0x7f2bbc1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 -- 172.21.15.80:0/192975329 >> 172.21.15.80:0/192975329 conn(0x7f2bbc0fdbd0 msgr2=0x7f2bbc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 -- 172.21.15.80:0/192975329 shutdown_connections 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.704+0000 7f2bc2e84640 1 -- 172.21.15.80:0/192975329 wait complete. 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 Processor -- start 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 -- start start 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc1029e0 0x7f2bbc19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc103c20 0x7f2bbc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc108920 0x7f2bbc1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc10e510 con 0x7f2bbc1029e0 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc10e390 con 0x7f2bbc108920 2024-04-25T11:22:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc2e84640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc10e690 con 0x7f2bbc103c20 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc0c20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc1029e0 0x7f2bbc19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc0c20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc1029e0 0x7f2bbc19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39598/0 (socket says 172.21.15.80:39598) 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.705+0000 7f2bc0c20640 1 -- 172.21.15.80:0/1861247548 learned_addr learned my addr 172.21.15.80:0/1861247548 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc1421640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc108920 0x7f2bbc1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bbbfff640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc103c20 0x7f2bbc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc0c20640 1 -- 172.21.15.80:0/1861247548 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc103c20 msgr2=0x7f2bbc19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc0c20640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc103c20 0x7f2bbc19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc0c20640 1 -- 172.21.15.80:0/1861247548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc108920 msgr2=0x7f2bbc1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc0c20640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc108920 0x7f2bbc1a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc0c20640 1 -- 172.21.15.80:0/1861247548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc1a1d40 con 0x7f2bbc1029e0 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc1421640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc108920 0x7f2bbc1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc0c20640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc1029e0 0x7f2bbc19a200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c970 tx=0x7f2bb000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/1861247548 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0004220 con 0x7f2bbc1029e0 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/1861247548 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bb00043c0 con 0x7f2bbc1029e0 2024-04-25T11:22:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc1a1fd0 con 0x7f2bbc1029e0 2024-04-25T11:22:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/1861247548 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb000f450 con 0x7f2bbc1029e0 2024-04-25T11:22:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.706+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc1a2490 con 0x7f2bbc1029e0 2024-04-25T11:22:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.707+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bbc1a2750 con 0x7f2bbc1029e0 2024-04-25T11:22:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.708+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/1861247548 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f2bb00079b0 con 0x7f2bbc1029e0 2024-04-25T11:22:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.709+0000 7f2bb9ffb640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2bac0afb80 0x7f2bac0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.709+0000 7f2bbbfff640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2bac0afb80 0x7f2bac0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.709+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/1861247548 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f2bb00dee10 con 0x7f2bbc1029e0 2024-04-25T11:22:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.709+0000 7f2bbbfff640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2bac0afb80 0x7f2bac0b2090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8005fd0 tx=0x7f2ba8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:20.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.713+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/1861247548 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2bb0014030 con 0x7f2bbc1029e0 2024-04-25T11:22:20.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:20 smithi082 ceph-mon[32440]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T11:22:20.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:20 smithi082 ceph-mon[32440]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:20 smithi082 ceph-mon[32440]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:20 smithi082 ceph-mon[32440]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:22:20.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.896+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bbc1a2920 con 0x7f2bbc1029e0 2024-04-25T11:22:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.897+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/1861247548 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22183 (secure 0 0 0) 0x7f2bb00a7a40 con 0x7f2bbc1029e0 2024-04-25T11:22:20.893 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:20.893 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":77,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:15.392029+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:22:20.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.899+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2bac0afb80 msgr2=0x7f2bac0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.899+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2bac0afb80 0x7f2bac0b2090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8005fd0 tx=0x7f2ba8005850 comp rx=0 tx=0).stop 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.899+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc1029e0 msgr2=0x7f2bbc19a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.899+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc1029e0 0x7f2bbc19a200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c970 tx=0x7f2bb000ce30 comp rx=0 tx=0).stop 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 shutdown_connections 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2bac0afb80 0x7f2bac0b2090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc108920 0x7f2bbc1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc103c20 0x7f2bbc19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 --2- 172.21.15.80:0/1861247548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc1029e0 0x7f2bbc19a200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 >> 172.21.15.80:0/1861247548 conn(0x7f2bbc0fdbd0 msgr2=0x7f2bbc074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 shutdown_connections 2024-04-25T11:22:20.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:20.900+0000 7f2bc2e84640 1 -- 172.21.15.80:0/1861247548 wait complete. 2024-04-25T11:22:20.907 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T11:22:20.907 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 -- 172.21.15.80:0/748696588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4068108900 msgr2=0x7f406810ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 --2- 172.21.15.80:0/748696588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4068108900 0x7f406810ad20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4060009ca0 tx=0x7f406002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 -- 172.21.15.80:0/748696588 shutdown_connections 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 --2- 172.21.15.80:0/748696588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4068108900 0x7f406810ad20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 --2- 172.21.15.80:0/748696588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4068103c00 0x7f4068104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 --2- 172.21.15.80:0/748696588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40681029c0 0x7f40681036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 -- 172.21.15.80:0/748696588 >> 172.21.15.80:0/748696588 conn(0x7f40680fdbd0 msgr2=0x7f4068100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 -- 172.21.15.80:0/748696588 shutdown_connections 2024-04-25T11:22:21.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 -- 172.21.15.80:0/748696588 wait complete. 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.019+0000 7f406fae7640 1 Processor -- start 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 -- start start 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40681029c0 0x7f40681990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4068103c00 0x7f4068199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4068108900 0x7f40681a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f406810e4f0 con 0x7f40681029c0 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f406810e370 con 0x7f4068103c00 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f406810e670 con 0x7f4068108900 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40681029c0 0x7f40681990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40681029c0 0x7f40681990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39612/0 (socket says 172.21.15.80:39612) 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 -- 172.21.15.80:0/146952561 learned_addr learned my addr 172.21.15.80:0/146952561 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406e084640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4068108900 0x7f40681a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d082640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4068103c00 0x7f4068199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 -- 172.21.15.80:0/146952561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4068108900 msgr2=0x7f40681a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4068108900 0x7f40681a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 -- 172.21.15.80:0/146952561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4068103c00 msgr2=0x7f4068199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4068103c00 0x7f4068199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 -- 172.21.15.80:0/146952561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40681a0c10 con 0x7f40681029c0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406e084640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4068108900 0x7f40681a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d082640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4068103c00 0x7f4068199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406d883640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40681029c0 0x7f40681990d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f405800d740 tx=0x7f405800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f405effd640 1 -- 172.21.15.80:0/146952561 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058017070 con 0x7f40681029c0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f405effd640 1 -- 172.21.15.80:0/146952561 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f405800de50 con 0x7f40681029c0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40681a0f00 con 0x7f40681029c0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f405effd640 1 -- 172.21.15.80:0/146952561 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058003c20 con 0x7f40681029c0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.020+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40681a1360 con 0x7f40681029c0 2024-04-25T11:22:21.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.021+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406806afa0 con 0x7f40681029c0 2024-04-25T11:22:21.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.023+0000 7f405effd640 1 -- 172.21.15.80:0/146952561 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f4058003dc0 con 0x7f40681029c0 2024-04-25T11:22:21.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.023+0000 7f405effd640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f40540afb80 0x7f40540b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.023+0000 7f406d082640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f40540afb80 0x7f40540b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.023+0000 7f405effd640 1 -- 172.21.15.80:0/146952561 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f40580deb10 con 0x7f40681029c0 2024-04-25T11:22:21.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.024+0000 7f406d082640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f40540afb80 0x7f40540b2090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f406819a170 tx=0x7f4064005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:21.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.027+0000 7f405effd640 1 -- 172.21.15.80:0/146952561 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f40580a7740 con 0x7f40681029c0 2024-04-25T11:22:21.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.202+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4068062fe0 con 0x7f40540afb80 2024-04-25T11:22:21.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.210+0000 7f405effd640 1 -- 172.21.15.80:0/146952561 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258904 (secure 0 0 0) 0x7f4068062fe0 con 0x7f40540afb80 2024-04-25T11:22:21.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:21.210 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.212+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f40540afb80 msgr2=0x7f40540b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.212+0000 7f406fae7640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f40540afb80 0x7f40540b2090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f406819a170 tx=0x7f4064005e70 comp rx=0 tx=0).stop 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40681029c0 msgr2=0x7f40681990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40681029c0 0x7f40681990d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f405800d740 tx=0x7f405800dc00 comp rx=0 tx=0).stop 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 shutdown_connections 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f40540afb80 0x7f40540b2090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4068108900 0x7f40681a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4068103c00 0x7f4068199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 --2- 172.21.15.80:0/146952561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40681029c0 0x7f40681990d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 >> 172.21.15.80:0/146952561 conn(0x7f40680fdbd0 msgr2=0x7f40681048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 shutdown_connections 2024-04-25T11:22:21.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.213+0000 7f406fae7640 1 -- 172.21.15.80:0/146952561 wait complete. 2024-04-25T11:22:21.220 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-04-25T11:22:19.288642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596282,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":223,"num_write_kb":2189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":250,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":350736,"kb_used_data":9864,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124591088,"statfs":{"total":1151940427776,"available":1151581274112,"internally_reserved":0,"allocated":10100736,"data_stored":6451955,"data_compressed":106839,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5914,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001322"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.408577+0000","last_change":"2024-04-25T11:22:14.408035+0000","last_active":"2024-04-25T11:22:14.408577+0000","last_peered":"2024-04-25T11:22:14.408577+0000","last_clean":"2024-04-25T11:22:14.408577+0000","last_became_active":"2024-04-25T11:22:14.407691+0000","last_became_peered":"2024-04-25T11:22:14.407691+0000","last_unstale":"2024-04-25T11:22:14.408577+0000","last_undegraded":"2024-04-25T11:22:14.408577+0000","last_fullsized":"2024-04-25T11:22:14.408577+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.193524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427832+0000","last_change":"2024-04-25T11:22:14.415270+0000","last_active":"2024-04-25T11:22:16.427832+0000","last_peered":"2024-04-25T11:22:16.427832+0000","last_clean":"2024-04-25T11:22:16.427832+0000","last_became_active":"2024-04-25T11:22:14.413962+0000","last_became_peered":"2024-04-25T11:22:14.413962+0000","last_unstale":"2024-04-25T11:22:16.427832+0000","last_undegraded":"2024-04-25T11:22:16.427832+0000","last_fullsized":"2024-04-25T11:22:16.427832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:31.160774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427726+0000","last_change":"2024-04-25T11:22:14.402643+0000","last_active":"2024-04-25T11:22:16.427726+0000","last_peered":"2024-04-25T11:22:16.427726+0000","last_clean":"2024-04-25T11:22:16.427726+0000","last_became_active":"2024-04-25T11:22:14.401940+0000","last_became_peered":"2024-04-25T11:22:14.401940+0000","last_unstale":"2024-04-25T11:22:16.427726+0000","last_undegraded":"2024-04-25T11:22:16.427726+0000","last_fullsized":"2024-04-25T11:22:16.427726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:47.270354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400803+0000","last_change":"2024-04-25T11:22:14.413726+0000","last_active":"2024-04-25T11:22:15.400803+0000","last_peered":"2024-04-25T11:22:15.400803+0000","last_clean":"2024-04-25T11:22:15.400803+0000","last_became_active":"2024-04-25T11:22:14.412971+0000","last_became_peered":"2024-04-25T11:22:14.412971+0000","last_unstale":"2024-04-25T11:22:15.400803+0000","last_undegraded":"2024-04-25T11:22:15.400803+0000","last_fullsized":"2024-04-25T11:22:15.400803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:42.017286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400723+0000","last_change":"2024-04-25T11:22:14.403390+0000","last_active":"2024-04-25T11:22:15.400723+0000","last_peered":"2024-04-25T11:22:15.400723+0000","last_clean":"2024-04-25T11:22:15.400723+0000","last_became_active":"2024-04-25T11:22:14.402999+0000","last_became_peered":"2024-04-25T11:22:14.402999+0000","last_unstale":"2024-04-25T11:22:15.400723+0000","last_undegraded":"2024-04-25T11:22:15.400723+0000","last_fullsized":"2024-04-25T11:22:15.400723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:59.283486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425576+0000","last_change":"2024-04-25T11:22:14.416583+0000","last_active":"2024-04-25T11:22:16.425576+0000","last_peered":"2024-04-25T11:22:16.425576+0000","last_clean":"2024-04-25T11:22:16.425576+0000","last_became_active":"2024-04-25T11:22:14.416249+0000","last_became_peered":"2024-04-25T11:22:14.416249+0000","last_unstale":"2024-04-25T11:22:16.425576+0000","last_undegraded":"2024-04-25T11:22:16.425576+0000","last_fullsized":"2024-04-25T11:22:16.425576+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:54.279133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.405368+0000","last_change":"2024-04-25T11:22:14.404800+0000","last_active":"2024-04-25T11:22:14.405368+0000","last_peered":"2024-04-25T11:22:14.405368+0000","last_clean":"2024-04-25T11:22:14.405368+0000","last_became_active":"2024-04-25T11:22:14.404445+0000","last_became_peered":"2024-04-25T11:22:14.404445+0000","last_unstale":"2024-04-25T11:22:14.405368+0000","last_undegraded":"2024-04-25T11:22:14.405368+0000","last_fullsized":"2024-04-25T11:22:14.405368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:04.467809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388191+0000","last_change":"2024-04-25T11:22:14.400669+0000","last_active":"2024-04-25T11:22:16.388191+0000","last_peered":"2024-04-25T11:22:16.388191+0000","last_clean":"2024-04-25T11:22:16.388191+0000","last_became_active":"2024-04-25T11:22:14.400090+0000","last_became_peered":"2024-04-25T11:22:14.400090+0000","last_unstale":"2024-04-25T11:22:16.388191+0000","last_undegraded":"2024-04-25T11:22:16.388191+0000","last_fullsized":"2024-04-25T11:22:16.388191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:24.467550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425767+0000","last_change":"2024-04-25T11:22:14.410119+0000","last_active":"2024-04-25T11:22:16.425767+0000","last_peered":"2024-04-25T11:22:16.425767+0000","last_clean":"2024-04-25T11:22:16.425767+0000","last_became_active":"2024-04-25T11:22:14.409736+0000","last_became_peered":"2024-04-25T11:22:14.409736+0000","last_unstale":"2024-04-25T11:22:16.425767+0000","last_undegraded":"2024-04-25T11:22:16.425767+0000","last_fullsized":"2024-04-25T11:22:16.425767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:57.842921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426148+0000","last_change":"2024-04-25T11:22:14.416368+0000","last_active":"2024-04-25T11:22:16.426148+0000","last_peered":"2024-04-25T11:22:16.426148+0000","last_clean":"2024-04-25T11:22:16.426148+0000","last_became_active":"2024-04-25T11:22:14.415888+0000","last_became_peered":"2024-04-25T11:22:14.415888+0000","last_unstale":"2024-04-25T11:22:16.426148+0000","last_undegraded":"2024-04-25T11:22:16.426148+0000","last_fullsized":"2024-04-25T11:22:16.426148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:00.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.405727+0000","last_change":"2024-04-25T11:22:14.402490+0000","last_active":"2024-04-25T11:22:14.405727+0000","last_peered":"2024-04-25T11:22:14.405727+0000","last_clean":"2024-04-25T11:22:14.405727+0000","last_became_active":"2024-04-25T11:22:14.402115+0000","last_became_peered":"2024-04-25T11:22:14.402115+0000","last_unstale":"2024-04-25T11:22:14.405727+0000","last_undegraded":"2024-04-25T11:22:14.405727+0000","last_fullsized":"2024-04-25T11:22:14.405727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:33.859749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400771+0000","last_change":"2024-04-25T11:22:14.420570+0000","last_active":"2024-04-25T11:22:15.400771+0000","last_peered":"2024-04-25T11:22:15.400771+0000","last_clean":"2024-04-25T11:22:15.400771+0000","last_became_active":"2024-04-25T11:22:14.420187+0000","last_became_peered":"2024-04-25T11:22:14.420187+0000","last_unstale":"2024-04-25T11:22:15.400771+0000","last_undegraded":"2024-04-25T11:22:15.400771+0000","last_fullsized":"2024-04-25T11:22:15.400771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:52.828114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.416545+0000","last_change":"2024-04-25T11:22:14.414789+0000","last_active":"2024-04-25T11:22:14.416545+0000","last_peered":"2024-04-25T11:22:14.416545+0000","last_clean":"2024-04-25T11:22:14.416545+0000","last_became_active":"2024-04-25T11:22:14.414465+0000","last_became_peered":"2024-04-25T11:22:14.414465+0000","last_unstale":"2024-04-25T11:22:14.416545+0000","last_undegraded":"2024-04-25T11:22:14.416545+0000","last_fullsized":"2024-04-25T11:22:14.416545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:44.691472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427101+0000","last_change":"2024-04-25T11:22:14.413268+0000","last_active":"2024-04-25T11:22:16.427101+0000","last_peered":"2024-04-25T11:22:16.427101+0000","last_clean":"2024-04-25T11:22:16.427101+0000","last_became_active":"2024-04-25T11:22:14.412897+0000","last_became_peered":"2024-04-25T11:22:14.412897+0000","last_unstale":"2024-04-25T11:22:16.427101+0000","last_undegraded":"2024-04-25T11:22:16.427101+0000","last_fullsized":"2024-04-25T11:22:16.427101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:49.997236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426889+0000","last_change":"2024-04-25T11:22:14.411114+0000","last_active":"2024-04-25T11:22:16.426889+0000","last_peered":"2024-04-25T11:22:16.426889+0000","last_clean":"2024-04-25T11:22:16.426889+0000","last_became_active":"2024-04-25T11:22:14.410700+0000","last_became_peered":"2024-04-25T11:22:14.410700+0000","last_unstale":"2024-04-25T11:22:16.426889+0000","last_undegraded":"2024-04-25T11:22:16.426889+0000","last_fullsized":"2024-04-25T11:22:16.426889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:38.367214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426462+0000","last_change":"2024-04-25T11:22:14.408073+0000","last_active":"2024-04-25T11:22:16.426462+0000","last_peered":"2024-04-25T11:22:16.426462+0000","last_clean":"2024-04-25T11:22:16.426462+0000","last_became_active":"2024-04-25T11:22:14.406878+0000","last_became_peered":"2024-04-25T11:22:14.406878+0000","last_unstale":"2024-04-25T11:22:16.426462+0000","last_undegraded":"2024-04-25T11:22:16.426462+0000","last_fullsized":"2024-04-25T11:22:16.426462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:00.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.408244+0000","last_change":"2024-04-25T11:22:14.406990+0000","last_active":"2024-04-25T11:22:14.408244+0000","last_peered":"2024-04-25T11:22:14.408244+0000","last_clean":"2024-04-25T11:22:14.408244+0000","last_became_active":"2024-04-25T11:22:14.406643+0000","last_became_peered":"2024-04-25T11:22:14.406643+0000","last_unstale":"2024-04-25T11:22:14.408244+0000","last_undegraded":"2024-04-25T11:22:14.408244+0000","last_fullsized":"2024-04-25T11:22:14.408244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:59.340291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401946+0000","last_change":"2024-04-25T11:22:14.410651+0000","last_active":"2024-04-25T11:22:15.401946+0000","last_peered":"2024-04-25T11:22:15.401946+0000","last_clean":"2024-04-25T11:22:15.401946+0000","last_became_active":"2024-04-25T11:22:14.410299+0000","last_became_peered":"2024-04-25T11:22:14.410299+0000","last_unstale":"2024-04-25T11:22:15.401946+0000","last_undegraded":"2024-04-25T11:22:15.401946+0000","last_fullsized":"2024-04-25T11:22:15.401946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:50.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426036+0000","last_change":"2024-04-25T11:22:14.405714+0000","last_active":"2024-04-25T11:22:16.426036+0000","last_peered":"2024-04-25T11:22:16.426036+0000","last_clean":"2024-04-25T11:22:16.426036+0000","last_became_active":"2024-04-25T11:22:14.405376+0000","last_became_peered":"2024-04-25T11:22:14.405376+0000","last_unstale":"2024-04-25T11:22:16.426036+0000","last_undegraded":"2024-04-25T11:22:16.426036+0000","last_fullsized":"2024-04-25T11:22:16.426036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:18.538532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"76'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401781+0000","last_change":"2024-04-25T11:22:13.401334+0000","last_active":"2024-04-25T11:22:15.401781+0000","last_peered":"2024-04-25T11:22:15.401781+0000","last_clean":"2024-04-25T11:22:15.401781+0000","last_became_active":"2024-04-25T11:22:13.400994+0000","last_became_peered":"2024-04-25T11:22:13.400994+0000","last_unstale":"2024-04-25T11:22:15.401781+0000","last_undegraded":"2024-04-25T11:22:15.401781+0000","last_fullsized":"2024-04-25T11:22:15.401781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:22.545839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388649+0000","last_change":"2024-04-25T11:22:14.411893+0000","last_active":"2024-04-25T11:22:16.388649+0000","last_peered":"2024-04-25T11:22:16.388649+0000","last_clean":"2024-04-25T11:22:16.388649+0000","last_became_active":"2024-04-25T11:22:14.409727+0000","last_became_peered":"2024-04-25T11:22:14.409727+0000","last_unstale":"2024-04-25T11:22:16.388649+0000","last_undegraded":"2024-04-25T11:22:16.388649+0000","last_fullsized":"2024-04-25T11:22:16.388649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:41.961790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388853+0000","last_change":"2024-04-25T11:22:13.398983+0000","last_active":"2024-04-25T11:22:16.388853+0000","last_peered":"2024-04-25T11:22:16.388853+0000","last_clean":"2024-04-25T11:22:16.388853+0000","last_became_active":"2024-04-25T11:22:13.397819+0000","last_became_peered":"2024-04-25T11:22:13.397819+0000","last_unstale":"2024-04-25T11:22:16.388853+0000","last_undegraded":"2024-04-25T11:22:16.388853+0000","last_fullsized":"2024-04-25T11:22:16.388853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:19.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.428006+0000","last_change":"2024-04-25T11:22:14.410589+0000","last_active":"2024-04-25T11:22:16.428006+0000","last_peered":"2024-04-25T11:22:16.428006+0000","last_clean":"2024-04-25T11:22:16.428006+0000","last_became_active":"2024-04-25T11:22:14.409921+0000","last_became_peered":"2024-04-25T11:22:14.409921+0000","last_unstale":"2024-04-25T11:22:16.428006+0000","last_undegraded":"2024-04-25T11:22:16.428006+0000","last_fullsized":"2024-04-25T11:22:16.428006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:59.251335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.432809+0000","last_change":"2024-04-25T11:22:13.406244+0000","last_active":"2024-04-25T11:22:17.432809+0000","last_peered":"2024-04-25T11:22:17.432809+0000","last_clean":"2024-04-25T11:22:17.432809+0000","last_became_active":"2024-04-25T11:22:13.405902+0000","last_became_peered":"2024-04-25T11:22:13.405902+0000","last_unstale":"2024-04-25T11:22:17.432809+0000","last_undegraded":"2024-04-25T11:22:17.432809+0000","last_fullsized":"2024-04-25T11:22:17.432809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:05.862922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426563+0000","last_change":"2024-04-25T11:22:14.421110+0000","last_active":"2024-04-25T11:22:16.426563+0000","last_peered":"2024-04-25T11:22:16.426563+0000","last_clean":"2024-04-25T11:22:16.426563+0000","last_became_active":"2024-04-25T11:22:14.420705+0000","last_became_peered":"2024-04-25T11:22:14.420705+0000","last_unstale":"2024-04-25T11:22:16.426563+0000","last_undegraded":"2024-04-25T11:22:16.426563+0000","last_fullsized":"2024-04-25T11:22:16.426563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:57.353467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400930+0000","last_change":"2024-04-25T11:22:13.406063+0000","last_active":"2024-04-25T11:22:15.400930+0000","last_peered":"2024-04-25T11:22:15.400930+0000","last_clean":"2024-04-25T11:22:15.400930+0000","last_became_active":"2024-04-25T11:22:13.405690+0000","last_became_peered":"2024-04-25T11:22:13.405690+0000","last_unstale":"2024-04-25T11:22:15.400930+0000","last_undegraded":"2024-04-25T11:22:15.400930+0000","last_fullsized":"2024-04-25T11:22:15.400930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:34.296298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.429846+0000","last_change":"2024-04-25T11:22:14.413077+0000","last_active":"2024-04-25T11:22:16.429846+0000","last_peered":"2024-04-25T11:22:16.429846+0000","last_clean":"2024-04-25T11:22:16.429846+0000","last_became_active":"2024-04-25T11:22:14.412712+0000","last_became_peered":"2024-04-25T11:22:14.412712+0000","last_unstale":"2024-04-25T11:22:16.429846+0000","last_undegraded":"2024-04-25T11:22:16.429846+0000","last_fullsized":"2024-04-25T11:22:16.429846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:41.683840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:18.441332+0000","last_change":"2024-04-25T11:22:13.396239+0000","last_active":"2024-04-25T11:22:18.441332+0000","last_peered":"2024-04-25T11:22:18.441332+0000","last_clean":"2024-04-25T11:22:18.441332+0000","last_became_active":"2024-04-25T11:22:13.395653+0000","last_became_peered":"2024-04-25T11:22:13.395653+0000","last_unstale":"2024-04-25T11:22:18.441332+0000","last_undegraded":"2024-04-25T11:22:18.441332+0000","last_fullsized":"2024-04-25T11:22:18.441332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:05.218927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400565+0000","last_change":"2024-04-25T11:22:14.409052+0000","last_active":"2024-04-25T11:22:15.400565+0000","last_peered":"2024-04-25T11:22:15.400565+0000","last_clean":"2024-04-25T11:22:15.400565+0000","last_became_active":"2024-04-25T11:22:14.408580+0000","last_became_peered":"2024-04-25T11:22:14.408580+0000","last_unstale":"2024-04-25T11:22:15.400565+0000","last_undegraded":"2024-04-25T11:22:15.400565+0000","last_fullsized":"2024-04-25T11:22:15.400565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:14.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425377+0000","last_change":"2024-04-25T11:22:13.399086+0000","last_active":"2024-04-25T11:22:16.425377+0000","last_peered":"2024-04-25T11:22:16.425377+0000","last_clean":"2024-04-25T11:22:16.425377+0000","last_became_active":"2024-04-25T11:22:13.398559+0000","last_became_peered":"2024-04-25T11:22:13.398559+0000","last_unstale":"2024-04-25T11:22:16.425377+0000","last_undegraded":"2024-04-25T11:22:16.425377+0000","last_fullsized":"2024-04-25T11:22:16.425377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:09.913470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427904+0000","last_change":"2024-04-25T11:22:14.414069+0000","last_active":"2024-04-25T11:22:16.427904+0000","last_peered":"2024-04-25T11:22:16.427904+0000","last_clean":"2024-04-25T11:22:16.427904+0000","last_became_active":"2024-04-25T11:22:14.413576+0000","last_became_peered":"2024-04-25T11:22:14.413576+0000","last_unstale":"2024-04-25T11:22:16.427904+0000","last_undegraded":"2024-04-25T11:22:16.427904+0000","last_fullsized":"2024-04-25T11:22:16.427904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:58.170612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388707+0000","last_change":"2024-04-25T11:22:13.392703+0000","last_active":"2024-04-25T11:22:14.388707+0000","last_peered":"2024-04-25T11:22:14.388707+0000","last_clean":"2024-04-25T11:22:14.388707+0000","last_became_active":"2024-04-25T11:22:13.392337+0000","last_became_peered":"2024-04-25T11:22:13.392337+0000","last_unstale":"2024-04-25T11:22:14.388707+0000","last_undegraded":"2024-04-25T11:22:14.388707+0000","last_fullsized":"2024-04-25T11:22:14.388707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:33.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388392+0000","last_change":"2024-04-25T11:22:14.398526+0000","last_active":"2024-04-25T11:22:16.388392+0000","last_peered":"2024-04-25T11:22:16.388392+0000","last_clean":"2024-04-25T11:22:16.388392+0000","last_became_active":"2024-04-25T11:22:14.398083+0000","last_became_peered":"2024-04-25T11:22:14.398083+0000","last_unstale":"2024-04-25T11:22:16.388392+0000","last_undegraded":"2024-04-25T11:22:16.388392+0000","last_fullsized":"2024-04-25T11:22:16.388392+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:03.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427504+0000","last_change":"2024-04-25T11:22:13.397599+0000","last_active":"2024-04-25T11:22:16.427504+0000","last_peered":"2024-04-25T11:22:16.427504+0000","last_clean":"2024-04-25T11:22:16.427504+0000","last_became_active":"2024-04-25T11:22:13.396748+0000","last_became_peered":"2024-04-25T11:22:13.396748+0000","last_unstale":"2024-04-25T11:22:16.427504+0000","last_undegraded":"2024-04-25T11:22:16.427504+0000","last_fullsized":"2024-04-25T11:22:16.427504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:31.012095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401687+0000","last_change":"2024-04-25T11:22:14.404668+0000","last_active":"2024-04-25T11:22:15.401687+0000","last_peered":"2024-04-25T11:22:15.401687+0000","last_clean":"2024-04-25T11:22:15.401687+0000","last_became_active":"2024-04-25T11:22:14.404306+0000","last_became_peered":"2024-04-25T11:22:14.404306+0000","last_unstale":"2024-04-25T11:22:15.401687+0000","last_undegraded":"2024-04-25T11:22:15.401687+0000","last_fullsized":"2024-04-25T11:22:15.401687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:16.430419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.432362+0000","last_change":"2024-04-25T11:22:13.398240+0000","last_active":"2024-04-25T11:22:16.432362+0000","last_peered":"2024-04-25T11:22:16.432362+0000","last_clean":"2024-04-25T11:22:16.432362+0000","last_became_active":"2024-04-25T11:22:13.397875+0000","last_became_peered":"2024-04-25T11:22:13.397875+0000","last_unstale":"2024-04-25T11:22:16.432362+0000","last_undegraded":"2024-04-25T11:22:16.432362+0000","last_fullsized":"2024-04-25T11:22:16.432362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:29.007270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426414+0000","last_change":"2024-04-25T11:22:14.422075+0000","last_active":"2024-04-25T11:22:16.426414+0000","last_peered":"2024-04-25T11:22:16.426414+0000","last_clean":"2024-04-25T11:22:16.426414+0000","last_became_active":"2024-04-25T11:22:14.421699+0000","last_became_peered":"2024-04-25T11:22:14.421699+0000","last_unstale":"2024-04-25T11:22:16.426414+0000","last_undegraded":"2024-04-25T11:22:16.426414+0000","last_fullsized":"2024-04-25T11:22:16.426414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.392052+0000","last_change":"2024-04-25T11:22:13.398104+0000","last_active":"2024-04-25T11:22:14.392052+0000","last_peered":"2024-04-25T11:22:14.392052+0000","last_clean":"2024-04-25T11:22:14.392052+0000","last_became_active":"2024-04-25T11:22:13.397716+0000","last_became_peered":"2024-04-25T11:22:13.397716+0000","last_unstale":"2024-04-25T11:22:14.392052+0000","last_undegraded":"2024-04-25T11:22:14.392052+0000","last_fullsized":"2024-04-25T11:22:14.392052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.428198+0000","last_change":"2024-04-25T11:22:14.413664+0000","last_active":"2024-04-25T11:22:16.428198+0000","last_peered":"2024-04-25T11:22:16.428198+0000","last_clean":"2024-04-25T11:22:16.428198+0000","last_became_active":"2024-04-25T11:22:14.412621+0000","last_became_peered":"2024-04-25T11:22:14.412621+0000","last_unstale":"2024-04-25T11:22:16.428198+0000","last_undegraded":"2024-04-25T11:22:16.428198+0000","last_fullsized":"2024-04-25T11:22:16.428198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:24.511828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.432104+0000","last_change":"2024-04-25T11:22:13.397141+0000","last_active":"2024-04-25T11:22:16.432104+0000","last_peered":"2024-04-25T11:22:16.432104+0000","last_clean":"2024-04-25T11:22:16.432104+0000","last_became_active":"2024-04-25T11:22:13.396769+0000","last_became_peered":"2024-04-25T11:22:13.396769+0000","last_unstale":"2024-04-25T11:22:16.432104+0000","last_undegraded":"2024-04-25T11:22:16.432104+0000","last_fullsized":"2024-04-25T11:22:16.432104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:40.123906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426773+0000","last_change":"2024-04-25T11:22:14.412279+0000","last_active":"2024-04-25T11:22:16.426773+0000","last_peered":"2024-04-25T11:22:16.426773+0000","last_clean":"2024-04-25T11:22:16.426773+0000","last_became_active":"2024-04-25T11:22:14.410325+0000","last_became_peered":"2024-04-25T11:22:14.410325+0000","last_unstale":"2024-04-25T11:22:16.426773+0000","last_undegraded":"2024-04-25T11:22:16.426773+0000","last_fullsized":"2024-04-25T11:22:16.426773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:03.788349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'8","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.431548+0000","last_change":"2024-04-25T11:22:13.393664+0000","last_active":"2024-04-25T11:22:16.431548+0000","last_peered":"2024-04-25T11:22:16.431548+0000","last_clean":"2024-04-25T11:22:16.431548+0000","last_became_active":"2024-04-25T11:22:13.393279+0000","last_became_peered":"2024-04-25T11:22:13.393279+0000","last_unstale":"2024-04-25T11:22:16.431548+0000","last_undegraded":"2024-04-25T11:22:16.431548+0000","last_fullsized":"2024-04-25T11:22:16.431548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400994+0000","last_change":"2024-04-25T11:22:14.399944+0000","last_active":"2024-04-25T11:22:15.400994+0000","last_peered":"2024-04-25T11:22:15.400994+0000","last_clean":"2024-04-25T11:22:15.400994+0000","last_became_active":"2024-04-25T11:22:14.399592+0000","last_became_peered":"2024-04-25T11:22:14.399592+0000","last_unstale":"2024-04-25T11:22:15.400994+0000","last_undegraded":"2024-04-25T11:22:15.400994+0000","last_fullsized":"2024-04-25T11:22:15.400994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:18.794517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.434000+0000","last_change":"2024-04-25T11:22:13.398651+0000","last_active":"2024-04-25T11:22:17.434000+0000","last_peered":"2024-04-25T11:22:17.434000+0000","last_clean":"2024-04-25T11:22:17.434000+0000","last_became_active":"2024-04-25T11:22:13.398234+0000","last_became_peered":"2024-04-25T11:22:13.398234+0000","last_unstale":"2024-04-25T11:22:17.434000+0000","last_undegraded":"2024-04-25T11:22:17.434000+0000","last_fullsized":"2024-04-25T11:22:17.434000+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:39.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.406263+0000","last_change":"2024-04-25T11:22:14.404684+0000","last_active":"2024-04-25T11:22:14.406263+0000","last_peered":"2024-04-25T11:22:14.406263+0000","last_clean":"2024-04-25T11:22:14.406263+0000","last_became_active":"2024-04-25T11:22:14.404319+0000","last_became_peered":"2024-04-25T11:22:14.404319+0000","last_unstale":"2024-04-25T11:22:14.406263+0000","last_undegraded":"2024-04-25T11:22:14.406263+0000","last_fullsized":"2024-04-25T11:22:14.406263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:30.207870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.431803+0000","last_change":"2024-04-25T11:22:13.397954+0000","last_active":"2024-04-25T11:22:16.431803+0000","last_peered":"2024-04-25T11:22:16.431803+0000","last_clean":"2024-04-25T11:22:16.431803+0000","last_became_active":"2024-04-25T11:22:13.397595+0000","last_became_peered":"2024-04-25T11:22:13.397595+0000","last_unstale":"2024-04-25T11:22:16.431803+0000","last_undegraded":"2024-04-25T11:22:16.431803+0000","last_fullsized":"2024-04-25T11:22:16.431803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:31.912201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.413183+0000","last_change":"2024-04-25T11:22:14.411671+0000","last_active":"2024-04-25T11:22:14.413183+0000","last_peered":"2024-04-25T11:22:14.413183+0000","last_clean":"2024-04-25T11:22:14.413183+0000","last_became_active":"2024-04-25T11:22:14.411034+0000","last_became_peered":"2024-04-25T11:22:14.411034+0000","last_unstale":"2024-04-25T11:22:14.413183+0000","last_undegraded":"2024-04-25T11:22:14.413183+0000","last_fullsized":"2024-04-25T11:22:14.413183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:05.767634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:18.442157+0000","last_change":"2024-04-25T11:22:13.397193+0000","last_active":"2024-04-25T11:22:18.442157+0000","last_peered":"2024-04-25T11:22:18.442157+0000","last_clean":"2024-04-25T11:22:18.442157+0000","last_became_active":"2024-04-25T11:22:13.396319+0000","last_became_peered":"2024-04-25T11:22:13.396319+0000","last_unstale":"2024-04-25T11:22:18.442157+0000","last_undegraded":"2024-04-25T11:22:18.442157+0000","last_fullsized":"2024-04-25T11:22:18.442157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.140114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407594+0000","last_change":"2024-04-25T11:22:14.404123+0000","last_active":"2024-04-25T11:22:14.407594+0000","last_peered":"2024-04-25T11:22:14.407594+0000","last_clean":"2024-04-25T11:22:14.407594+0000","last_became_active":"2024-04-25T11:22:14.403751+0000","last_became_peered":"2024-04-25T11:22:14.403751+0000","last_unstale":"2024-04-25T11:22:14.407594+0000","last_undegraded":"2024-04-25T11:22:14.407594+0000","last_fullsized":"2024-04-25T11:22:14.407594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:45.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.434950+0000","last_change":"2024-04-25T11:22:13.402801+0000","last_active":"2024-04-25T11:22:17.434950+0000","last_peered":"2024-04-25T11:22:17.434950+0000","last_clean":"2024-04-25T11:22:17.434950+0000","last_became_active":"2024-04-25T11:22:13.402417+0000","last_became_peered":"2024-04-25T11:22:13.402417+0000","last_unstale":"2024-04-25T11:22:17.434950+0000","last_undegraded":"2024-04-25T11:22:17.434950+0000","last_fullsized":"2024-04-25T11:22:17.434950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:55.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427464+0000","last_change":"2024-04-25T11:22:14.413947+0000","last_active":"2024-04-25T11:22:16.427464+0000","last_peered":"2024-04-25T11:22:16.427464+0000","last_clean":"2024-04-25T11:22:16.427464+0000","last_became_active":"2024-04-25T11:22:14.413549+0000","last_became_peered":"2024-04-25T11:22:14.413549+0000","last_unstale":"2024-04-25T11:22:16.427464+0000","last_undegraded":"2024-04-25T11:22:16.427464+0000","last_fullsized":"2024-04-25T11:22:16.427464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:42.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400937+0000","last_change":"2024-04-25T11:22:13.406112+0000","last_active":"2024-04-25T11:22:15.400937+0000","last_peered":"2024-04-25T11:22:15.400937+0000","last_clean":"2024-04-25T11:22:15.400937+0000","last_became_active":"2024-04-25T11:22:13.405591+0000","last_became_peered":"2024-04-25T11:22:13.405591+0000","last_unstale":"2024-04-25T11:22:15.400937+0000","last_undegraded":"2024-04-25T11:22:15.400937+0000","last_fullsized":"2024-04-25T11:22:15.400937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:00.177226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.413703+0000","last_change":"2024-04-25T11:22:14.412070+0000","last_active":"2024-04-25T11:22:14.413703+0000","last_peered":"2024-04-25T11:22:14.413703+0000","last_clean":"2024-04-25T11:22:14.413703+0000","last_became_active":"2024-04-25T11:22:14.411715+0000","last_became_peered":"2024-04-25T11:22:14.411715+0000","last_unstale":"2024-04-25T11:22:14.413703+0000","last_undegraded":"2024-04-25T11:22:14.413703+0000","last_fullsized":"2024-04-25T11:22:14.413703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:56.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401814+0000","last_change":"2024-04-25T11:22:13.394583+0000","last_active":"2024-04-25T11:22:15.401814+0000","last_peered":"2024-04-25T11:22:15.401814+0000","last_clean":"2024-04-25T11:22:15.401814+0000","last_became_active":"2024-04-25T11:22:13.394210+0000","last_became_peered":"2024-04-25T11:22:13.394210+0000","last_unstale":"2024-04-25T11:22:15.401814+0000","last_undegraded":"2024-04-25T11:22:15.401814+0000","last_fullsized":"2024-04-25T11:22:15.401814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:34.622567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426336+0000","last_change":"2024-04-25T11:22:14.404487+0000","last_active":"2024-04-25T11:22:16.426336+0000","last_peered":"2024-04-25T11:22:16.426336+0000","last_clean":"2024-04-25T11:22:16.426336+0000","last_became_active":"2024-04-25T11:22:14.404096+0000","last_became_peered":"2024-04-25T11:22:14.404096+0000","last_unstale":"2024-04-25T11:22:16.426336+0000","last_undegraded":"2024-04-25T11:22:16.426336+0000","last_fullsized":"2024-04-25T11:22:16.426336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:55.938011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388048+0000","last_change":"2024-04-25T11:22:13.397273+0000","last_active":"2024-04-25T11:22:14.388048+0000","last_peered":"2024-04-25T11:22:14.388048+0000","last_clean":"2024-04-25T11:22:14.388048+0000","last_became_active":"2024-04-25T11:22:13.396538+0000","last_became_peered":"2024-04-25T11:22:13.396538+0000","last_unstale":"2024-04-25T11:22:14.388048+0000","last_undegraded":"2024-04-25T11:22:14.388048+0000","last_fullsized":"2024-04-25T11:22:14.388048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:04.738107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425350+0000","last_change":"2024-04-25T11:22:14.416686+0000","last_active":"2024-04-25T11:22:16.425350+0000","last_peered":"2024-04-25T11:22:16.425350+0000","last_clean":"2024-04-25T11:22:16.425350+0000","last_became_active":"2024-04-25T11:22:14.415715+0000","last_became_peered":"2024-04-25T11:22:14.415715+0000","last_unstale":"2024-04-25T11:22:16.425350+0000","last_undegraded":"2024-04-25T11:22:16.425350+0000","last_fullsized":"2024-04-25T11:22:16.425350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:55.956708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427654+0000","last_change":"2024-04-25T11:22:14.411786+0000","last_active":"2024-04-25T11:22:16.427654+0000","last_peered":"2024-04-25T11:22:16.427654+0000","last_clean":"2024-04-25T11:22:16.427654+0000","last_became_active":"2024-04-25T11:22:14.411433+0000","last_became_peered":"2024-04-25T11:22:14.411433+0000","last_unstale":"2024-04-25T11:22:16.427654+0000","last_undegraded":"2024-04-25T11:22:16.427654+0000","last_fullsized":"2024-04-25T11:22:16.427654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:28.948581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388506+0000","last_change":"2024-04-25T11:22:13.396834+0000","last_active":"2024-04-25T11:22:14.388506+0000","last_peered":"2024-04-25T11:22:14.388506+0000","last_clean":"2024-04-25T11:22:14.388506+0000","last_became_active":"2024-04-25T11:22:13.396439+0000","last_became_peered":"2024-04-25T11:22:13.396439+0000","last_unstale":"2024-04-25T11:22:14.388506+0000","last_undegraded":"2024-04-25T11:22:14.388506+0000","last_fullsized":"2024-04-25T11:22:14.388506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388656+0000","last_change":"2024-04-25T11:22:14.404784+0000","last_active":"2024-04-25T11:22:16.388656+0000","last_peered":"2024-04-25T11:22:16.388656+0000","last_clean":"2024-04-25T11:22:16.388656+0000","last_became_active":"2024-04-25T11:22:14.404355+0000","last_became_peered":"2024-04-25T11:22:14.404355+0000","last_unstale":"2024-04-25T11:22:16.388656+0000","last_undegraded":"2024-04-25T11:22:16.388656+0000","last_fullsized":"2024-04-25T11:22:16.388656+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:04.698767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:18.437827+0000","last_change":"2024-04-25T11:22:13.389125+0000","last_active":"2024-04-25T11:22:18.437827+0000","last_peered":"2024-04-25T11:22:18.437827+0000","last_clean":"2024-04-25T11:22:18.437827+0000","last_became_active":"2024-04-25T11:22:13.387160+0000","last_became_peered":"2024-04-25T11:22:13.387160+0000","last_unstale":"2024-04-25T11:22:18.437827+0000","last_undegraded":"2024-04-25T11:22:18.437827+0000","last_fullsized":"2024-04-25T11:22:18.437827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:11.839065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":89,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.387940+0000","last_change":"2024-04-25T11:20:53.708987+0000","last_active":"2024-04-25T11:22:14.387940+0000","last_peered":"2024-04-25T11:22:14.387940+0000","last_clean":"2024-04-25T11:22:14.387940+0000","last_became_active":"2024-04-25T11:20:53.704654+0000","last_became_peered":"2024-04-25T11:20:53.704654+0000","last_unstale":"2024-04-25T11:22:14.387940+0000","last_undegraded":"2024-04-25T11:22:14.387940+0000","last_fullsized":"2024-04-25T11:22:14.387940+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_clean_scrub_stamp":"2024-04-25T11:17:24.025142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:24.174044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.416245+0000","last_change":"2024-04-25T11:22:14.413776+0000","last_active":"2024-04-25T11:22:14.416245+0000","last_peered":"2024-04-25T11:22:14.416245+0000","last_clean":"2024-04-25T11:22:14.416245+0000","last_became_active":"2024-04-25T11:22:14.413417+0000","last_became_peered":"2024-04-25T11:22:14.413417+0000","last_unstale":"2024-04-25T11:22:14.416245+0000","last_undegraded":"2024-04-25T11:22:14.416245+0000","last_fullsized":"2024-04-25T11:22:14.416245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:43.635439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388632+0000","last_change":"2024-04-25T11:22:13.404113+0000","last_active":"2024-04-25T11:22:14.388632+0000","last_peered":"2024-04-25T11:22:14.388632+0000","last_clean":"2024-04-25T11:22:14.388632+0000","last_became_active":"2024-04-25T11:22:13.403711+0000","last_became_peered":"2024-04-25T11:22:13.403711+0000","last_unstale":"2024-04-25T11:22:14.388632+0000","last_undegraded":"2024-04-25T11:22:14.388632+0000","last_fullsized":"2024-04-25T11:22:14.388632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:52.618167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400938+0000","last_change":"2024-04-25T11:22:13.404334+0000","last_active":"2024-04-25T11:22:15.400938+0000","last_peered":"2024-04-25T11:22:15.400938+0000","last_clean":"2024-04-25T11:22:15.400938+0000","last_became_active":"2024-04-25T11:22:13.403896+0000","last_became_peered":"2024-04-25T11:22:13.403896+0000","last_unstale":"2024-04-25T11:22:15.400938+0000","last_undegraded":"2024-04-25T11:22:15.400938+0000","last_fullsized":"2024-04-25T11:22:15.400938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:24.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.408541+0000","last_change":"2024-04-25T11:22:14.406921+0000","last_active":"2024-04-25T11:22:14.408541+0000","last_peered":"2024-04-25T11:22:14.408541+0000","last_clean":"2024-04-25T11:22:14.408541+0000","last_became_active":"2024-04-25T11:22:14.406520+0000","last_became_peered":"2024-04-25T11:22:14.406520+0000","last_unstale":"2024-04-25T11:22:14.408541+0000","last_undegraded":"2024-04-25T11:22:14.408541+0000","last_fullsized":"2024-04-25T11:22:14.408541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:02.950225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401944+0000","last_change":"2024-04-25T11:22:13.400870+0000","last_active":"2024-04-25T11:22:15.401944+0000","last_peered":"2024-04-25T11:22:15.401944+0000","last_clean":"2024-04-25T11:22:15.401944+0000","last_became_active":"2024-04-25T11:22:13.400479+0000","last_became_peered":"2024-04-25T11:22:13.400479+0000","last_unstale":"2024-04-25T11:22:15.401944+0000","last_undegraded":"2024-04-25T11:22:15.401944+0000","last_fullsized":"2024-04-25T11:22:15.401944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:12.975205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388930+0000","last_change":"2024-04-25T11:22:14.402782+0000","last_active":"2024-04-25T11:22:16.388930+0000","last_peered":"2024-04-25T11:22:16.388930+0000","last_clean":"2024-04-25T11:22:16.388930+0000","last_became_active":"2024-04-25T11:22:14.402368+0000","last_became_peered":"2024-04-25T11:22:14.402368+0000","last_unstale":"2024-04-25T11:22:16.388930+0000","last_undegraded":"2024-04-25T11:22:16.388930+0000","last_fullsized":"2024-04-25T11:22:16.388930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:49.897015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.424230+0000","last_change":"2024-04-25T11:22:13.390229+0000","last_active":"2024-04-25T11:22:16.424230+0000","last_peered":"2024-04-25T11:22:16.424230+0000","last_clean":"2024-04-25T11:22:16.424230+0000","last_became_active":"2024-04-25T11:22:13.389825+0000","last_became_peered":"2024-04-25T11:22:13.389825+0000","last_unstale":"2024-04-25T11:22:16.424230+0000","last_undegraded":"2024-04-25T11:22:16.424230+0000","last_fullsized":"2024-04-25T11:22:16.424230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:50.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.428040+0000","last_change":"2024-04-25T11:22:14.412066+0000","last_active":"2024-04-25T11:22:16.428040+0000","last_peered":"2024-04-25T11:22:16.428040+0000","last_clean":"2024-04-25T11:22:16.428040+0000","last_became_active":"2024-04-25T11:22:14.411707+0000","last_became_peered":"2024-04-25T11:22:14.411707+0000","last_unstale":"2024-04-25T11:22:16.428040+0000","last_undegraded":"2024-04-25T11:22:16.428040+0000","last_fullsized":"2024-04-25T11:22:16.428040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:13.274928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.430168+0000","last_change":"2024-04-25T11:22:13.397644+0000","last_active":"2024-04-25T11:22:16.430168+0000","last_peered":"2024-04-25T11:22:16.430168+0000","last_clean":"2024-04-25T11:22:16.430168+0000","last_became_active":"2024-04-25T11:22:13.397240+0000","last_became_peered":"2024-04-25T11:22:13.397240+0000","last_unstale":"2024-04-25T11:22:16.430168+0000","last_undegraded":"2024-04-25T11:22:16.430168+0000","last_fullsized":"2024-04-25T11:22:16.430168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.927399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400497+0000","last_change":"2024-04-25T11:22:14.416191+0000","last_active":"2024-04-25T11:22:15.400497+0000","last_peered":"2024-04-25T11:22:15.400497+0000","last_clean":"2024-04-25T11:22:15.400497+0000","last_became_active":"2024-04-25T11:22:14.415537+0000","last_became_peered":"2024-04-25T11:22:14.415537+0000","last_unstale":"2024-04-25T11:22:15.400497+0000","last_undegraded":"2024-04-25T11:22:15.400497+0000","last_fullsized":"2024-04-25T11:22:15.400497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:27.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.429187+0000","last_change":"2024-04-25T11:22:13.390329+0000","last_active":"2024-04-25T11:22:16.429187+0000","last_peered":"2024-04-25T11:22:16.429187+0000","last_clean":"2024-04-25T11:22:16.429187+0000","last_became_active":"2024-04-25T11:22:13.389854+0000","last_became_peered":"2024-04-25T11:22:13.389854+0000","last_unstale":"2024-04-25T11:22:16.429187+0000","last_undegraded":"2024-04-25T11:22:16.429187+0000","last_fullsized":"2024-04-25T11:22:16.429187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:01.238826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.397240+0000","last_change":"2024-04-25T11:22:14.395782+0000","last_active":"2024-04-25T11:22:14.397240+0000","last_peered":"2024-04-25T11:22:14.397240+0000","last_clean":"2024-04-25T11:22:14.397240+0000","last_became_active":"2024-04-25T11:22:14.395321+0000","last_became_peered":"2024-04-25T11:22:14.395321+0000","last_unstale":"2024-04-25T11:22:14.397240+0000","last_undegraded":"2024-04-25T11:22:14.397240+0000","last_fullsized":"2024-04-25T11:22:14.397240+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:23.554206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425566+0000","last_change":"2024-04-25T11:22:13.401087+0000","last_active":"2024-04-25T11:22:16.425566+0000","last_peered":"2024-04-25T11:22:16.425566+0000","last_clean":"2024-04-25T11:22:16.425566+0000","last_became_active":"2024-04-25T11:22:13.400537+0000","last_became_peered":"2024-04-25T11:22:13.400537+0000","last_unstale":"2024-04-25T11:22:16.425566+0000","last_undegraded":"2024-04-25T11:22:16.425566+0000","last_fullsized":"2024-04-25T11:22:16.425566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:24.566260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388520+0000","last_change":"2024-04-25T11:22:14.399436+0000","last_active":"2024-04-25T11:22:16.388520+0000","last_peered":"2024-04-25T11:22:16.388520+0000","last_clean":"2024-04-25T11:22:16.388520+0000","last_became_active":"2024-04-25T11:22:14.398968+0000","last_became_peered":"2024-04-25T11:22:14.398968+0000","last_unstale":"2024-04-25T11:22:16.388520+0000","last_undegraded":"2024-04-25T11:22:16.388520+0000","last_fullsized":"2024-04-25T11:22:16.388520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:52.426381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425939+0000","last_change":"2024-04-25T11:22:13.401785+0000","last_active":"2024-04-25T11:22:16.425939+0000","last_peered":"2024-04-25T11:22:16.425939+0000","last_clean":"2024-04-25T11:22:16.425939+0000","last_became_active":"2024-04-25T11:22:13.401411+0000","last_became_peered":"2024-04-25T11:22:13.401411+0000","last_unstale":"2024-04-25T11:22:16.425939+0000","last_undegraded":"2024-04-25T11:22:16.425939+0000","last_fullsized":"2024-04-25T11:22:16.425939+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:29.640195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407061+0000","last_change":"2024-04-25T11:22:14.403391+0000","last_active":"2024-04-25T11:22:14.407061+0000","last_peered":"2024-04-25T11:22:14.407061+0000","last_clean":"2024-04-25T11:22:14.407061+0000","last_became_active":"2024-04-25T11:22:14.402817+0000","last_became_peered":"2024-04-25T11:22:14.402817+0000","last_unstale":"2024-04-25T11:22:14.407061+0000","last_undegraded":"2024-04-25T11:22:14.407061+0000","last_fullsized":"2024-04-25T11:22:14.407061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:08.687595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.435100+0000","last_change":"2024-04-25T11:22:13.394733+0000","last_active":"2024-04-25T11:22:17.435100+0000","last_peered":"2024-04-25T11:22:17.435100+0000","last_clean":"2024-04-25T11:22:17.435100+0000","last_became_active":"2024-04-25T11:22:13.394389+0000","last_became_peered":"2024-04-25T11:22:13.394389+0000","last_unstale":"2024-04-25T11:22:17.435100+0000","last_undegraded":"2024-04-25T11:22:17.435100+0000","last_fullsized":"2024-04-25T11:22:17.435100+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.751957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.401549+0000","last_change":"2024-04-25T11:22:14.398974+0000","last_active":"2024-04-25T11:22:14.401549+0000","last_peered":"2024-04-25T11:22:14.401549+0000","last_clean":"2024-04-25T11:22:14.401549+0000","last_became_active":"2024-04-25T11:22:14.396317+0000","last_became_peered":"2024-04-25T11:22:14.396317+0000","last_unstale":"2024-04-25T11:22:14.401549+0000","last_undegraded":"2024-04-25T11:22:14.401549+0000","last_fullsized":"2024-04-25T11:22:14.401549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:41.406246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.429714+0000","last_change":"2024-04-25T11:22:13.405081+0000","last_active":"2024-04-25T11:22:16.429714+0000","last_peered":"2024-04-25T11:22:16.429714+0000","last_clean":"2024-04-25T11:22:16.429714+0000","last_became_active":"2024-04-25T11:22:13.404160+0000","last_became_peered":"2024-04-25T11:22:13.404160+0000","last_unstale":"2024-04-25T11:22:16.429714+0000","last_undegraded":"2024-04-25T11:22:16.429714+0000","last_fullsized":"2024-04-25T11:22:16.429714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:33.591987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407896+0000","last_change":"2024-04-25T11:22:14.406014+0000","last_active":"2024-04-25T11:22:14.407896+0000","last_peered":"2024-04-25T11:22:14.407896+0000","last_clean":"2024-04-25T11:22:14.407896+0000","last_became_active":"2024-04-25T11:22:14.405609+0000","last_became_peered":"2024-04-25T11:22:14.405609+0000","last_unstale":"2024-04-25T11:22:14.407896+0000","last_undegraded":"2024-04-25T11:22:14.407896+0000","last_fullsized":"2024-04-25T11:22:14.407896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.263341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.406507+0000","last_change":"2024-04-25T11:22:13.397936+0000","last_active":"2024-04-25T11:22:14.406507+0000","last_peered":"2024-04-25T11:22:14.406507+0000","last_clean":"2024-04-25T11:22:14.406507+0000","last_became_active":"2024-04-25T11:22:13.397616+0000","last_became_peered":"2024-04-25T11:22:13.397616+0000","last_unstale":"2024-04-25T11:22:14.406507+0000","last_undegraded":"2024-04-25T11:22:14.406507+0000","last_fullsized":"2024-04-25T11:22:14.406507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:18.647965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.401435+0000","last_change":"2024-04-25T11:22:14.396359+0000","last_active":"2024-04-25T11:22:14.401435+0000","last_peered":"2024-04-25T11:22:14.401435+0000","last_clean":"2024-04-25T11:22:14.401435+0000","last_became_active":"2024-04-25T11:22:14.395818+0000","last_became_peered":"2024-04-25T11:22:14.395818+0000","last_unstale":"2024-04-25T11:22:14.401435+0000","last_undegraded":"2024-04-25T11:22:14.401435+0000","last_fullsized":"2024-04-25T11:22:14.401435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:10.212817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.397577+0000","last_change":"2024-04-25T11:22:14.396700+0000","last_active":"2024-04-25T11:22:14.397577+0000","last_peered":"2024-04-25T11:22:14.397577+0000","last_clean":"2024-04-25T11:22:14.397577+0000","last_became_active":"2024-04-25T11:22:14.396353+0000","last_became_peered":"2024-04-25T11:22:14.396353+0000","last_unstale":"2024-04-25T11:22:14.397577+0000","last_undegraded":"2024-04-25T11:22:14.397577+0000","last_fullsized":"2024-04-25T11:22:14.397577+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:15.650023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425848+0000","last_change":"2024-04-25T11:22:14.412317+0000","last_active":"2024-04-25T11:22:16.425848+0000","last_peered":"2024-04-25T11:22:16.425848+0000","last_clean":"2024-04-25T11:22:16.425848+0000","last_became_active":"2024-04-25T11:22:14.411940+0000","last_became_peered":"2024-04-25T11:22:14.411940+0000","last_unstale":"2024-04-25T11:22:16.425848+0000","last_undegraded":"2024-04-25T11:22:16.425848+0000","last_fullsized":"2024-04-25T11:22:16.425848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425517+0000","last_change":"2024-04-25T11:22:14.407779+0000","last_active":"2024-04-25T11:22:16.425517+0000","last_peered":"2024-04-25T11:22:16.425517+0000","last_clean":"2024-04-25T11:22:16.425517+0000","last_became_active":"2024-04-25T11:22:14.407443+0000","last_became_peered":"2024-04-25T11:22:14.407443+0000","last_unstale":"2024-04-25T11:22:16.425517+0000","last_undegraded":"2024-04-25T11:22:16.425517+0000","last_fullsized":"2024-04-25T11:22:16.425517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:00.316425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427593+0000","last_change":"2024-04-25T11:22:14.412005+0000","last_active":"2024-04-25T11:22:16.427593+0000","last_peered":"2024-04-25T11:22:16.427593+0000","last_clean":"2024-04-25T11:22:16.427593+0000","last_became_active":"2024-04-25T11:22:14.411626+0000","last_became_peered":"2024-04-25T11:22:14.411626+0000","last_unstale":"2024-04-25T11:22:16.427593+0000","last_undegraded":"2024-04-25T11:22:16.427593+0000","last_fullsized":"2024-04-25T11:22:16.427593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.320505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.416706+0000","last_change":"2024-04-25T11:22:14.415812+0000","last_active":"2024-04-25T11:22:14.416706+0000","last_peered":"2024-04-25T11:22:14.416706+0000","last_clean":"2024-04-25T11:22:14.416706+0000","last_became_active":"2024-04-25T11:22:14.415455+0000","last_became_peered":"2024-04-25T11:22:14.415455+0000","last_unstale":"2024-04-25T11:22:14.416706+0000","last_undegraded":"2024-04-25T11:22:14.416706+0000","last_fullsized":"2024-04-25T11:22:14.416706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:36.426094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.401505+0000","last_change":"2024-04-25T11:22:14.400892+0000","last_active":"2024-04-25T11:22:14.401505+0000","last_peered":"2024-04-25T11:22:14.401505+0000","last_clean":"2024-04-25T11:22:14.401505+0000","last_became_active":"2024-04-25T11:22:14.400526+0000","last_became_peered":"2024-04-25T11:22:14.400526+0000","last_unstale":"2024-04-25T11:22:14.401505+0000","last_undegraded":"2024-04-25T11:22:14.401505+0000","last_fullsized":"2024-04-25T11:22:14.401505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:04.992004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426389+0000","last_change":"2024-04-25T11:22:14.403134+0000","last_active":"2024-04-25T11:22:16.426389+0000","last_peered":"2024-04-25T11:22:16.426389+0000","last_clean":"2024-04-25T11:22:16.426389+0000","last_became_active":"2024-04-25T11:22:14.402795+0000","last_became_peered":"2024-04-25T11:22:14.402795+0000","last_unstale":"2024-04-25T11:22:16.426389+0000","last_undegraded":"2024-04-25T11:22:16.426389+0000","last_fullsized":"2024-04-25T11:22:16.426389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.496135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388790+0000","last_change":"2024-04-25T11:22:14.410963+0000","last_active":"2024-04-25T11:22:16.388790+0000","last_peered":"2024-04-25T11:22:16.388790+0000","last_clean":"2024-04-25T11:22:16.388790+0000","last_became_active":"2024-04-25T11:22:14.410555+0000","last_became_peered":"2024-04-25T11:22:14.410555+0000","last_unstale":"2024-04-25T11:22:16.388790+0000","last_undegraded":"2024-04-25T11:22:16.388790+0000","last_fullsized":"2024-04-25T11:22:16.388790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:56.505717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427367+0000","last_change":"2024-04-25T11:22:14.405094+0000","last_active":"2024-04-25T11:22:16.427367+0000","last_peered":"2024-04-25T11:22:16.427367+0000","last_clean":"2024-04-25T11:22:16.427367+0000","last_became_active":"2024-04-25T11:22:14.404749+0000","last_became_peered":"2024-04-25T11:22:14.404749+0000","last_unstale":"2024-04-25T11:22:16.427367+0000","last_undegraded":"2024-04-25T11:22:16.427367+0000","last_fullsized":"2024-04-25T11:22:16.427367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:44.129648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388623+0000","last_change":"2024-04-25T11:22:14.396868+0000","last_active":"2024-04-25T11:22:16.388623+0000","last_peered":"2024-04-25T11:22:16.388623+0000","last_clean":"2024-04-25T11:22:16.388623+0000","last_became_active":"2024-04-25T11:22:14.396421+0000","last_became_peered":"2024-04-25T11:22:14.396421+0000","last_unstale":"2024-04-25T11:22:16.388623+0000","last_undegraded":"2024-04-25T11:22:16.388623+0000","last_fullsized":"2024-04-25T11:22:16.388623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:24.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425916+0000","last_change":"2024-04-25T11:22:14.400510+0000","last_active":"2024-04-25T11:22:16.425916+0000","last_peered":"2024-04-25T11:22:16.425916+0000","last_clean":"2024-04-25T11:22:16.425916+0000","last_became_active":"2024-04-25T11:22:14.400037+0000","last_became_peered":"2024-04-25T11:22:14.400037+0000","last_unstale":"2024-04-25T11:22:16.425916+0000","last_undegraded":"2024-04-25T11:22:16.425916+0000","last_fullsized":"2024-04-25T11:22:16.425916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.293068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407092+0000","last_change":"2024-04-25T11:22:14.404415+0000","last_active":"2024-04-25T11:22:14.407092+0000","last_peered":"2024-04-25T11:22:14.407092+0000","last_clean":"2024-04-25T11:22:14.407092+0000","last_became_active":"2024-04-25T11:22:14.404032+0000","last_became_peered":"2024-04-25T11:22:14.404032+0000","last_unstale":"2024-04-25T11:22:14.407092+0000","last_undegraded":"2024-04-25T11:22:14.407092+0000","last_fullsized":"2024-04-25T11:22:14.407092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:22.351481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.412280+0000","last_change":"2024-04-25T11:22:14.410650+0000","last_active":"2024-04-25T11:22:14.412280+0000","last_peered":"2024-04-25T11:22:14.412280+0000","last_clean":"2024-04-25T11:22:14.412280+0000","last_became_active":"2024-04-25T11:22:14.410216+0000","last_became_peered":"2024-04-25T11:22:14.410216+0000","last_unstale":"2024-04-25T11:22:14.412280+0000","last_undegraded":"2024-04-25T11:22:14.412280+0000","last_fullsized":"2024-04-25T11:22:14.412280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.636049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246033,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5914,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":13708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645326,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":806912,"data_stored":384033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841555,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":976207,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005080,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":811008,"data_stored":384615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201311,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":839680,"data_stored":393341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430243,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":860160,"data_stored":974983,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":806912,"data_stored":384033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":394215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":847872,"data_stored":394081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":395565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":392797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":831488,"data_stored":393638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":984447,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:22:21.224 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:22:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 -- 172.21.15.80:0/4275470291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 msgr2=0x7f043010be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 --2- 172.21.15.80:0/4275470291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f043010be60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0428009ca0 tx=0x7f042802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 -- 172.21.15.80:0/4275470291 shutdown_connections 2024-04-25T11:22:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 --2- 172.21.15.80:0/4275470291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f043010be60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 --2- 172.21.15.80:0/4275470291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0430104d40 0x7f0430105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 --2- 172.21.15.80:0/4275470291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0430103b00 0x7f0430104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 -- 172.21.15.80:0/4275470291 >> 172.21.15.80:0/4275470291 conn(0x7f04300fed10 msgr2=0x7f04301011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 -- 172.21.15.80:0/4275470291 shutdown_connections 2024-04-25T11:22:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.373+0000 7f04350b6640 1 -- 172.21.15.80:0/4275470291 wait complete. 2024-04-25T11:22:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 Processor -- start 2024-04-25T11:22:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 -- start start 2024-04-25T11:22:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0430103b00 0x7f043019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0430104d40 0x7f043019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f04301a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f043010f630 con 0x7f0430109a40 2024-04-25T11:22:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f043010f4b0 con 0x7f0430103b00 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f04350b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f043010f7b0 con 0x7f0430104d40 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f042f59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f04301a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f042f59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f04301a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39628/0 (socket says 172.21.15.80:39628) 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.374+0000 7f042f59e640 1 -- 172.21.15.80:0/3172070047 learned_addr learned my addr 172.21.15.80:0/3172070047 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042ed9d640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0430103b00 0x7f043019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042659c640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0430104d40 0x7f043019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042f59e640 1 -- 172.21.15.80:0/3172070047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0430104d40 msgr2=0x7f043019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042f59e640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0430104d40 0x7f043019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042f59e640 1 -- 172.21.15.80:0/3172070047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0430103b00 msgr2=0x7f043019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042f59e640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0430103b00 0x7f043019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042f59e640 1 -- 172.21.15.80:0/3172070047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04301a1d40 con 0x7f0430109a40 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042659c640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0430104d40 0x7f043019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042f59e640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f04301a16d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0428005e30 tx=0x7f0428031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042cd99640 1 -- 172.21.15.80:0/3172070047 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428003b70 con 0x7f0430109a40 2024-04-25T11:22:21.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042cd99640 1 -- 172.21.15.80:0/3172070047 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0428003d10 con 0x7f0430109a40 2024-04-25T11:22:21.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04301a1fd0 con 0x7f0430109a40 2024-04-25T11:22:21.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f042cd99640 1 -- 172.21.15.80:0/3172070047 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042802fac0 con 0x7f0430109a40 2024-04-25T11:22:21.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.375+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04301a2430 con 0x7f0430109a40 2024-04-25T11:22:21.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.376+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043006a190 con 0x7f0430109a40 2024-04-25T11:22:21.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.378+0000 7f042cd99640 1 -- 172.21.15.80:0/3172070047 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f042802fc60 con 0x7f0430109a40 2024-04-25T11:22:21.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.379+0000 7f042cd99640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f041c0afb80 0x7f041c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:21.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.379+0000 7f042ed9d640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f041c0afb80 0x7f041c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:21.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.379+0000 7f042cd99640 1 -- 172.21.15.80:0/3172070047 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f0428100140 con 0x7f0430109a40 2024-04-25T11:22:21.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.379+0000 7f042ed9d640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f041c0afb80 0x7f041c0b2090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0430104700 tx=0x7f0420005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:21.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.383+0000 7f042cd99640 1 -- 172.21.15.80:0/3172070047 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f04280c8e80 con 0x7f0430109a40 2024-04-25T11:22:21.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.563+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0430062fe0 con 0x7f041c0afb80 2024-04-25T11:22:21.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.570+0000 7f042cd99640 1 -- 172.21.15.80:0/3172070047 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258891 (secure 0 0 0) 0x7f0430062fe0 con 0x7f041c0afb80 2024-04-25T11:22:21.568 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T11:22:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f041c0afb80 msgr2=0x7f041c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f041c0afb80 0x7f041c0b2090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0430104700 tx=0x7f0420005f90 comp rx=0 tx=0).stop 2024-04-25T11:22:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 msgr2=0x7f04301a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f04301a16d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0428005e30 tx=0x7f0428031840 comp rx=0 tx=0).stop 2024-04-25T11:22:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 shutdown_connections 2024-04-25T11:22:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f041c0afb80 0x7f041c0b2090 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0430109a40 0x7f04301a16d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0430104d40 0x7f043019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 --2- 172.21.15.80:0/3172070047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0430103b00 0x7f043019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:21.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 >> 172.21.15.80:0/3172070047 conn(0x7f04300fed10 msgr2=0x7f0430105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:21.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 shutdown_connections 2024-04-25T11:22:21.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:21.573+0000 7f04350b6640 1 -- 172.21.15.80:0/3172070047 wait complete. 2024-04-25T11:22:21.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:21 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2658371159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:21.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:21 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1861247548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:21.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:21 smithi080 ceph-mon[29126]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:22:21.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:21 smithi080 ceph-mon[29126]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 5.2 KiB/s wr, 16 op/s 2024-04-25T11:22:21.580 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-04-25T11:22:21.289171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596282,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":237,"num_write_kb":2191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":250,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":350772,"kb_used_data":9908,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124591052,"statfs":{"total":1151940427776,"available":1151581237248,"internally_reserved":0,"allocated":10145792,"data_stored":6469913,"data_compressed":106839,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5914,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":114,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.912050"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425432+0000","last_change":"2024-04-25T11:22:14.408035+0000","last_active":"2024-04-25T11:22:16.425432+0000","last_peered":"2024-04-25T11:22:16.425432+0000","last_clean":"2024-04-25T11:22:16.425432+0000","last_became_active":"2024-04-25T11:22:14.407691+0000","last_became_peered":"2024-04-25T11:22:14.407691+0000","last_unstale":"2024-04-25T11:22:16.425432+0000","last_undegraded":"2024-04-25T11:22:16.425432+0000","last_fullsized":"2024-04-25T11:22:16.425432+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:27.388402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427832+0000","last_change":"2024-04-25T11:22:14.415270+0000","last_active":"2024-04-25T11:22:16.427832+0000","last_peered":"2024-04-25T11:22:16.427832+0000","last_clean":"2024-04-25T11:22:16.427832+0000","last_became_active":"2024-04-25T11:22:14.413962+0000","last_became_peered":"2024-04-25T11:22:14.413962+0000","last_unstale":"2024-04-25T11:22:16.427832+0000","last_undegraded":"2024-04-25T11:22:16.427832+0000","last_fullsized":"2024-04-25T11:22:16.427832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:31.160774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427726+0000","last_change":"2024-04-25T11:22:14.402643+0000","last_active":"2024-04-25T11:22:16.427726+0000","last_peered":"2024-04-25T11:22:16.427726+0000","last_clean":"2024-04-25T11:22:16.427726+0000","last_became_active":"2024-04-25T11:22:14.401940+0000","last_became_peered":"2024-04-25T11:22:14.401940+0000","last_unstale":"2024-04-25T11:22:16.427726+0000","last_undegraded":"2024-04-25T11:22:16.427726+0000","last_fullsized":"2024-04-25T11:22:16.427726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:47.270354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400803+0000","last_change":"2024-04-25T11:22:14.413726+0000","last_active":"2024-04-25T11:22:15.400803+0000","last_peered":"2024-04-25T11:22:15.400803+0000","last_clean":"2024-04-25T11:22:15.400803+0000","last_became_active":"2024-04-25T11:22:14.412971+0000","last_became_peered":"2024-04-25T11:22:14.412971+0000","last_unstale":"2024-04-25T11:22:15.400803+0000","last_undegraded":"2024-04-25T11:22:15.400803+0000","last_fullsized":"2024-04-25T11:22:15.400803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:42.017286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400723+0000","last_change":"2024-04-25T11:22:14.403390+0000","last_active":"2024-04-25T11:22:15.400723+0000","last_peered":"2024-04-25T11:22:15.400723+0000","last_clean":"2024-04-25T11:22:15.400723+0000","last_became_active":"2024-04-25T11:22:14.402999+0000","last_became_peered":"2024-04-25T11:22:14.402999+0000","last_unstale":"2024-04-25T11:22:15.400723+0000","last_undegraded":"2024-04-25T11:22:15.400723+0000","last_fullsized":"2024-04-25T11:22:15.400723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:59.283486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425576+0000","last_change":"2024-04-25T11:22:14.416583+0000","last_active":"2024-04-25T11:22:16.425576+0000","last_peered":"2024-04-25T11:22:16.425576+0000","last_clean":"2024-04-25T11:22:16.425576+0000","last_became_active":"2024-04-25T11:22:14.416249+0000","last_became_peered":"2024-04-25T11:22:14.416249+0000","last_unstale":"2024-04-25T11:22:16.425576+0000","last_undegraded":"2024-04-25T11:22:16.425576+0000","last_fullsized":"2024-04-25T11:22:16.425576+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:54.279133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.405368+0000","last_change":"2024-04-25T11:22:14.404800+0000","last_active":"2024-04-25T11:22:14.405368+0000","last_peered":"2024-04-25T11:22:14.405368+0000","last_clean":"2024-04-25T11:22:14.405368+0000","last_became_active":"2024-04-25T11:22:14.404445+0000","last_became_peered":"2024-04-25T11:22:14.404445+0000","last_unstale":"2024-04-25T11:22:14.405368+0000","last_undegraded":"2024-04-25T11:22:14.405368+0000","last_fullsized":"2024-04-25T11:22:14.405368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:04.467809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388191+0000","last_change":"2024-04-25T11:22:14.400669+0000","last_active":"2024-04-25T11:22:16.388191+0000","last_peered":"2024-04-25T11:22:16.388191+0000","last_clean":"2024-04-25T11:22:16.388191+0000","last_became_active":"2024-04-25T11:22:14.400090+0000","last_became_peered":"2024-04-25T11:22:14.400090+0000","last_unstale":"2024-04-25T11:22:16.388191+0000","last_undegraded":"2024-04-25T11:22:16.388191+0000","last_fullsized":"2024-04-25T11:22:16.388191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:24.467550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425767+0000","last_change":"2024-04-25T11:22:14.410119+0000","last_active":"2024-04-25T11:22:16.425767+0000","last_peered":"2024-04-25T11:22:16.425767+0000","last_clean":"2024-04-25T11:22:16.425767+0000","last_became_active":"2024-04-25T11:22:14.409736+0000","last_became_peered":"2024-04-25T11:22:14.409736+0000","last_unstale":"2024-04-25T11:22:16.425767+0000","last_undegraded":"2024-04-25T11:22:16.425767+0000","last_fullsized":"2024-04-25T11:22:16.425767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:57.842921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426148+0000","last_change":"2024-04-25T11:22:14.416368+0000","last_active":"2024-04-25T11:22:16.426148+0000","last_peered":"2024-04-25T11:22:16.426148+0000","last_clean":"2024-04-25T11:22:16.426148+0000","last_became_active":"2024-04-25T11:22:14.415888+0000","last_became_peered":"2024-04-25T11:22:14.415888+0000","last_unstale":"2024-04-25T11:22:16.426148+0000","last_undegraded":"2024-04-25T11:22:16.426148+0000","last_fullsized":"2024-04-25T11:22:16.426148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:00.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.405727+0000","last_change":"2024-04-25T11:22:14.402490+0000","last_active":"2024-04-25T11:22:14.405727+0000","last_peered":"2024-04-25T11:22:14.405727+0000","last_clean":"2024-04-25T11:22:14.405727+0000","last_became_active":"2024-04-25T11:22:14.402115+0000","last_became_peered":"2024-04-25T11:22:14.402115+0000","last_unstale":"2024-04-25T11:22:14.405727+0000","last_undegraded":"2024-04-25T11:22:14.405727+0000","last_fullsized":"2024-04-25T11:22:14.405727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:33.859749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400771+0000","last_change":"2024-04-25T11:22:14.420570+0000","last_active":"2024-04-25T11:22:15.400771+0000","last_peered":"2024-04-25T11:22:15.400771+0000","last_clean":"2024-04-25T11:22:15.400771+0000","last_became_active":"2024-04-25T11:22:14.420187+0000","last_became_peered":"2024-04-25T11:22:14.420187+0000","last_unstale":"2024-04-25T11:22:15.400771+0000","last_undegraded":"2024-04-25T11:22:15.400771+0000","last_fullsized":"2024-04-25T11:22:15.400771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:52.828114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.416545+0000","last_change":"2024-04-25T11:22:14.414789+0000","last_active":"2024-04-25T11:22:14.416545+0000","last_peered":"2024-04-25T11:22:14.416545+0000","last_clean":"2024-04-25T11:22:14.416545+0000","last_became_active":"2024-04-25T11:22:14.414465+0000","last_became_peered":"2024-04-25T11:22:14.414465+0000","last_unstale":"2024-04-25T11:22:14.416545+0000","last_undegraded":"2024-04-25T11:22:14.416545+0000","last_fullsized":"2024-04-25T11:22:14.416545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:44.691472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427101+0000","last_change":"2024-04-25T11:22:14.413268+0000","last_active":"2024-04-25T11:22:16.427101+0000","last_peered":"2024-04-25T11:22:16.427101+0000","last_clean":"2024-04-25T11:22:16.427101+0000","last_became_active":"2024-04-25T11:22:14.412897+0000","last_became_peered":"2024-04-25T11:22:14.412897+0000","last_unstale":"2024-04-25T11:22:16.427101+0000","last_undegraded":"2024-04-25T11:22:16.427101+0000","last_fullsized":"2024-04-25T11:22:16.427101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:49.997236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426889+0000","last_change":"2024-04-25T11:22:14.411114+0000","last_active":"2024-04-25T11:22:16.426889+0000","last_peered":"2024-04-25T11:22:16.426889+0000","last_clean":"2024-04-25T11:22:16.426889+0000","last_became_active":"2024-04-25T11:22:14.410700+0000","last_became_peered":"2024-04-25T11:22:14.410700+0000","last_unstale":"2024-04-25T11:22:16.426889+0000","last_undegraded":"2024-04-25T11:22:16.426889+0000","last_fullsized":"2024-04-25T11:22:16.426889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:38.367214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426462+0000","last_change":"2024-04-25T11:22:14.408073+0000","last_active":"2024-04-25T11:22:16.426462+0000","last_peered":"2024-04-25T11:22:16.426462+0000","last_clean":"2024-04-25T11:22:16.426462+0000","last_became_active":"2024-04-25T11:22:14.406878+0000","last_became_peered":"2024-04-25T11:22:14.406878+0000","last_unstale":"2024-04-25T11:22:16.426462+0000","last_undegraded":"2024-04-25T11:22:16.426462+0000","last_fullsized":"2024-04-25T11:22:16.426462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:00.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425600+0000","last_change":"2024-04-25T11:22:14.406990+0000","last_active":"2024-04-25T11:22:16.425600+0000","last_peered":"2024-04-25T11:22:16.425600+0000","last_clean":"2024-04-25T11:22:16.425600+0000","last_became_active":"2024-04-25T11:22:14.406643+0000","last_became_peered":"2024-04-25T11:22:14.406643+0000","last_unstale":"2024-04-25T11:22:16.425600+0000","last_undegraded":"2024-04-25T11:22:16.425600+0000","last_fullsized":"2024-04-25T11:22:16.425600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:15.226490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401946+0000","last_change":"2024-04-25T11:22:14.410651+0000","last_active":"2024-04-25T11:22:15.401946+0000","last_peered":"2024-04-25T11:22:15.401946+0000","last_clean":"2024-04-25T11:22:15.401946+0000","last_became_active":"2024-04-25T11:22:14.410299+0000","last_became_peered":"2024-04-25T11:22:14.410299+0000","last_unstale":"2024-04-25T11:22:15.401946+0000","last_undegraded":"2024-04-25T11:22:15.401946+0000","last_fullsized":"2024-04-25T11:22:15.401946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:50.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426036+0000","last_change":"2024-04-25T11:22:14.405714+0000","last_active":"2024-04-25T11:22:16.426036+0000","last_peered":"2024-04-25T11:22:16.426036+0000","last_clean":"2024-04-25T11:22:16.426036+0000","last_became_active":"2024-04-25T11:22:14.405376+0000","last_became_peered":"2024-04-25T11:22:14.405376+0000","last_unstale":"2024-04-25T11:22:16.426036+0000","last_undegraded":"2024-04-25T11:22:16.426036+0000","last_fullsized":"2024-04-25T11:22:16.426036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:18.538532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.436737+0000","last_change":"2024-04-25T11:22:13.401334+0000","last_active":"2024-04-25T11:22:17.436737+0000","last_peered":"2024-04-25T11:22:17.436737+0000","last_clean":"2024-04-25T11:22:17.436737+0000","last_became_active":"2024-04-25T11:22:13.400994+0000","last_became_peered":"2024-04-25T11:22:13.400994+0000","last_unstale":"2024-04-25T11:22:17.436737+0000","last_undegraded":"2024-04-25T11:22:17.436737+0000","last_fullsized":"2024-04-25T11:22:17.436737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:22.545839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388649+0000","last_change":"2024-04-25T11:22:14.411893+0000","last_active":"2024-04-25T11:22:16.388649+0000","last_peered":"2024-04-25T11:22:16.388649+0000","last_clean":"2024-04-25T11:22:16.388649+0000","last_became_active":"2024-04-25T11:22:14.409727+0000","last_became_peered":"2024-04-25T11:22:14.409727+0000","last_unstale":"2024-04-25T11:22:16.388649+0000","last_undegraded":"2024-04-25T11:22:16.388649+0000","last_fullsized":"2024-04-25T11:22:16.388649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:41.961790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388853+0000","last_change":"2024-04-25T11:22:13.398983+0000","last_active":"2024-04-25T11:22:16.388853+0000","last_peered":"2024-04-25T11:22:16.388853+0000","last_clean":"2024-04-25T11:22:16.388853+0000","last_became_active":"2024-04-25T11:22:13.397819+0000","last_became_peered":"2024-04-25T11:22:13.397819+0000","last_unstale":"2024-04-25T11:22:16.388853+0000","last_undegraded":"2024-04-25T11:22:16.388853+0000","last_fullsized":"2024-04-25T11:22:16.388853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:19.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.428006+0000","last_change":"2024-04-25T11:22:14.410589+0000","last_active":"2024-04-25T11:22:16.428006+0000","last_peered":"2024-04-25T11:22:16.428006+0000","last_clean":"2024-04-25T11:22:16.428006+0000","last_became_active":"2024-04-25T11:22:14.409921+0000","last_became_peered":"2024-04-25T11:22:14.409921+0000","last_unstale":"2024-04-25T11:22:16.428006+0000","last_undegraded":"2024-04-25T11:22:16.428006+0000","last_fullsized":"2024-04-25T11:22:16.428006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:59.251335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.432809+0000","last_change":"2024-04-25T11:22:13.406244+0000","last_active":"2024-04-25T11:22:17.432809+0000","last_peered":"2024-04-25T11:22:17.432809+0000","last_clean":"2024-04-25T11:22:17.432809+0000","last_became_active":"2024-04-25T11:22:13.405902+0000","last_became_peered":"2024-04-25T11:22:13.405902+0000","last_unstale":"2024-04-25T11:22:17.432809+0000","last_undegraded":"2024-04-25T11:22:17.432809+0000","last_fullsized":"2024-04-25T11:22:17.432809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:05.862922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426563+0000","last_change":"2024-04-25T11:22:14.421110+0000","last_active":"2024-04-25T11:22:16.426563+0000","last_peered":"2024-04-25T11:22:16.426563+0000","last_clean":"2024-04-25T11:22:16.426563+0000","last_became_active":"2024-04-25T11:22:14.420705+0000","last_became_peered":"2024-04-25T11:22:14.420705+0000","last_unstale":"2024-04-25T11:22:16.426563+0000","last_undegraded":"2024-04-25T11:22:16.426563+0000","last_fullsized":"2024-04-25T11:22:16.426563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:57.353467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400930+0000","last_change":"2024-04-25T11:22:13.406063+0000","last_active":"2024-04-25T11:22:15.400930+0000","last_peered":"2024-04-25T11:22:15.400930+0000","last_clean":"2024-04-25T11:22:15.400930+0000","last_became_active":"2024-04-25T11:22:13.405690+0000","last_became_peered":"2024-04-25T11:22:13.405690+0000","last_unstale":"2024-04-25T11:22:15.400930+0000","last_undegraded":"2024-04-25T11:22:15.400930+0000","last_fullsized":"2024-04-25T11:22:15.400930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:34.296298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.429846+0000","last_change":"2024-04-25T11:22:14.413077+0000","last_active":"2024-04-25T11:22:16.429846+0000","last_peered":"2024-04-25T11:22:16.429846+0000","last_clean":"2024-04-25T11:22:16.429846+0000","last_became_active":"2024-04-25T11:22:14.412712+0000","last_became_peered":"2024-04-25T11:22:14.412712+0000","last_unstale":"2024-04-25T11:22:16.429846+0000","last_undegraded":"2024-04-25T11:22:16.429846+0000","last_fullsized":"2024-04-25T11:22:16.429846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:41.683840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:18.441332+0000","last_change":"2024-04-25T11:22:13.396239+0000","last_active":"2024-04-25T11:22:18.441332+0000","last_peered":"2024-04-25T11:22:18.441332+0000","last_clean":"2024-04-25T11:22:18.441332+0000","last_became_active":"2024-04-25T11:22:13.395653+0000","last_became_peered":"2024-04-25T11:22:13.395653+0000","last_unstale":"2024-04-25T11:22:18.441332+0000","last_undegraded":"2024-04-25T11:22:18.441332+0000","last_fullsized":"2024-04-25T11:22:18.441332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:05.218927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400565+0000","last_change":"2024-04-25T11:22:14.409052+0000","last_active":"2024-04-25T11:22:15.400565+0000","last_peered":"2024-04-25T11:22:15.400565+0000","last_clean":"2024-04-25T11:22:15.400565+0000","last_became_active":"2024-04-25T11:22:14.408580+0000","last_became_peered":"2024-04-25T11:22:14.408580+0000","last_unstale":"2024-04-25T11:22:15.400565+0000","last_undegraded":"2024-04-25T11:22:15.400565+0000","last_fullsized":"2024-04-25T11:22:15.400565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:14.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425377+0000","last_change":"2024-04-25T11:22:13.399086+0000","last_active":"2024-04-25T11:22:16.425377+0000","last_peered":"2024-04-25T11:22:16.425377+0000","last_clean":"2024-04-25T11:22:16.425377+0000","last_became_active":"2024-04-25T11:22:13.398559+0000","last_became_peered":"2024-04-25T11:22:13.398559+0000","last_unstale":"2024-04-25T11:22:16.425377+0000","last_undegraded":"2024-04-25T11:22:16.425377+0000","last_fullsized":"2024-04-25T11:22:16.425377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:09.913470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427904+0000","last_change":"2024-04-25T11:22:14.414069+0000","last_active":"2024-04-25T11:22:16.427904+0000","last_peered":"2024-04-25T11:22:16.427904+0000","last_clean":"2024-04-25T11:22:16.427904+0000","last_became_active":"2024-04-25T11:22:14.413576+0000","last_became_peered":"2024-04-25T11:22:14.413576+0000","last_unstale":"2024-04-25T11:22:16.427904+0000","last_undegraded":"2024-04-25T11:22:16.427904+0000","last_fullsized":"2024-04-25T11:22:16.427904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:58.170612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388707+0000","last_change":"2024-04-25T11:22:13.392703+0000","last_active":"2024-04-25T11:22:14.388707+0000","last_peered":"2024-04-25T11:22:14.388707+0000","last_clean":"2024-04-25T11:22:14.388707+0000","last_became_active":"2024-04-25T11:22:13.392337+0000","last_became_peered":"2024-04-25T11:22:13.392337+0000","last_unstale":"2024-04-25T11:22:14.388707+0000","last_undegraded":"2024-04-25T11:22:14.388707+0000","last_fullsized":"2024-04-25T11:22:14.388707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:33.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388392+0000","last_change":"2024-04-25T11:22:14.398526+0000","last_active":"2024-04-25T11:22:16.388392+0000","last_peered":"2024-04-25T11:22:16.388392+0000","last_clean":"2024-04-25T11:22:16.388392+0000","last_became_active":"2024-04-25T11:22:14.398083+0000","last_became_peered":"2024-04-25T11:22:14.398083+0000","last_unstale":"2024-04-25T11:22:16.388392+0000","last_undegraded":"2024-04-25T11:22:16.388392+0000","last_fullsized":"2024-04-25T11:22:16.388392+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:03.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427504+0000","last_change":"2024-04-25T11:22:13.397599+0000","last_active":"2024-04-25T11:22:16.427504+0000","last_peered":"2024-04-25T11:22:16.427504+0000","last_clean":"2024-04-25T11:22:16.427504+0000","last_became_active":"2024-04-25T11:22:13.396748+0000","last_became_peered":"2024-04-25T11:22:13.396748+0000","last_unstale":"2024-04-25T11:22:16.427504+0000","last_undegraded":"2024-04-25T11:22:16.427504+0000","last_fullsized":"2024-04-25T11:22:16.427504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:31.012095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401687+0000","last_change":"2024-04-25T11:22:14.404668+0000","last_active":"2024-04-25T11:22:15.401687+0000","last_peered":"2024-04-25T11:22:15.401687+0000","last_clean":"2024-04-25T11:22:15.401687+0000","last_became_active":"2024-04-25T11:22:14.404306+0000","last_became_peered":"2024-04-25T11:22:14.404306+0000","last_unstale":"2024-04-25T11:22:15.401687+0000","last_undegraded":"2024-04-25T11:22:15.401687+0000","last_fullsized":"2024-04-25T11:22:15.401687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:16.430419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.432362+0000","last_change":"2024-04-25T11:22:13.398240+0000","last_active":"2024-04-25T11:22:16.432362+0000","last_peered":"2024-04-25T11:22:16.432362+0000","last_clean":"2024-04-25T11:22:16.432362+0000","last_became_active":"2024-04-25T11:22:13.397875+0000","last_became_peered":"2024-04-25T11:22:13.397875+0000","last_unstale":"2024-04-25T11:22:16.432362+0000","last_undegraded":"2024-04-25T11:22:16.432362+0000","last_fullsized":"2024-04-25T11:22:16.432362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:29.007270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426414+0000","last_change":"2024-04-25T11:22:14.422075+0000","last_active":"2024-04-25T11:22:16.426414+0000","last_peered":"2024-04-25T11:22:16.426414+0000","last_clean":"2024-04-25T11:22:16.426414+0000","last_became_active":"2024-04-25T11:22:14.421699+0000","last_became_peered":"2024-04-25T11:22:14.421699+0000","last_unstale":"2024-04-25T11:22:16.426414+0000","last_undegraded":"2024-04-25T11:22:16.426414+0000","last_fullsized":"2024-04-25T11:22:16.426414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.392052+0000","last_change":"2024-04-25T11:22:13.398104+0000","last_active":"2024-04-25T11:22:14.392052+0000","last_peered":"2024-04-25T11:22:14.392052+0000","last_clean":"2024-04-25T11:22:14.392052+0000","last_became_active":"2024-04-25T11:22:13.397716+0000","last_became_peered":"2024-04-25T11:22:13.397716+0000","last_unstale":"2024-04-25T11:22:14.392052+0000","last_undegraded":"2024-04-25T11:22:14.392052+0000","last_fullsized":"2024-04-25T11:22:14.392052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.428198+0000","last_change":"2024-04-25T11:22:14.413664+0000","last_active":"2024-04-25T11:22:16.428198+0000","last_peered":"2024-04-25T11:22:16.428198+0000","last_clean":"2024-04-25T11:22:16.428198+0000","last_became_active":"2024-04-25T11:22:14.412621+0000","last_became_peered":"2024-04-25T11:22:14.412621+0000","last_unstale":"2024-04-25T11:22:16.428198+0000","last_undegraded":"2024-04-25T11:22:16.428198+0000","last_fullsized":"2024-04-25T11:22:16.428198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:24.511828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.432104+0000","last_change":"2024-04-25T11:22:13.397141+0000","last_active":"2024-04-25T11:22:16.432104+0000","last_peered":"2024-04-25T11:22:16.432104+0000","last_clean":"2024-04-25T11:22:16.432104+0000","last_became_active":"2024-04-25T11:22:13.396769+0000","last_became_peered":"2024-04-25T11:22:13.396769+0000","last_unstale":"2024-04-25T11:22:16.432104+0000","last_undegraded":"2024-04-25T11:22:16.432104+0000","last_fullsized":"2024-04-25T11:22:16.432104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:40.123906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426773+0000","last_change":"2024-04-25T11:22:14.412279+0000","last_active":"2024-04-25T11:22:16.426773+0000","last_peered":"2024-04-25T11:22:16.426773+0000","last_clean":"2024-04-25T11:22:16.426773+0000","last_became_active":"2024-04-25T11:22:14.410325+0000","last_became_peered":"2024-04-25T11:22:14.410325+0000","last_unstale":"2024-04-25T11:22:16.426773+0000","last_undegraded":"2024-04-25T11:22:16.426773+0000","last_fullsized":"2024-04-25T11:22:16.426773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:03.788349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'8","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.431548+0000","last_change":"2024-04-25T11:22:13.393664+0000","last_active":"2024-04-25T11:22:16.431548+0000","last_peered":"2024-04-25T11:22:16.431548+0000","last_clean":"2024-04-25T11:22:16.431548+0000","last_became_active":"2024-04-25T11:22:13.393279+0000","last_became_peered":"2024-04-25T11:22:13.393279+0000","last_unstale":"2024-04-25T11:22:16.431548+0000","last_undegraded":"2024-04-25T11:22:16.431548+0000","last_fullsized":"2024-04-25T11:22:16.431548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400994+0000","last_change":"2024-04-25T11:22:14.399944+0000","last_active":"2024-04-25T11:22:15.400994+0000","last_peered":"2024-04-25T11:22:15.400994+0000","last_clean":"2024-04-25T11:22:15.400994+0000","last_became_active":"2024-04-25T11:22:14.399592+0000","last_became_peered":"2024-04-25T11:22:14.399592+0000","last_unstale":"2024-04-25T11:22:15.400994+0000","last_undegraded":"2024-04-25T11:22:15.400994+0000","last_fullsized":"2024-04-25T11:22:15.400994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:18.794517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.434000+0000","last_change":"2024-04-25T11:22:13.398651+0000","last_active":"2024-04-25T11:22:17.434000+0000","last_peered":"2024-04-25T11:22:17.434000+0000","last_clean":"2024-04-25T11:22:17.434000+0000","last_became_active":"2024-04-25T11:22:13.398234+0000","last_became_peered":"2024-04-25T11:22:13.398234+0000","last_unstale":"2024-04-25T11:22:17.434000+0000","last_undegraded":"2024-04-25T11:22:17.434000+0000","last_fullsized":"2024-04-25T11:22:17.434000+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:39.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.406263+0000","last_change":"2024-04-25T11:22:14.404684+0000","last_active":"2024-04-25T11:22:14.406263+0000","last_peered":"2024-04-25T11:22:14.406263+0000","last_clean":"2024-04-25T11:22:14.406263+0000","last_became_active":"2024-04-25T11:22:14.404319+0000","last_became_peered":"2024-04-25T11:22:14.404319+0000","last_unstale":"2024-04-25T11:22:14.406263+0000","last_undegraded":"2024-04-25T11:22:14.406263+0000","last_fullsized":"2024-04-25T11:22:14.406263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:30.207870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.431803+0000","last_change":"2024-04-25T11:22:13.397954+0000","last_active":"2024-04-25T11:22:16.431803+0000","last_peered":"2024-04-25T11:22:16.431803+0000","last_clean":"2024-04-25T11:22:16.431803+0000","last_became_active":"2024-04-25T11:22:13.397595+0000","last_became_peered":"2024-04-25T11:22:13.397595+0000","last_unstale":"2024-04-25T11:22:16.431803+0000","last_undegraded":"2024-04-25T11:22:16.431803+0000","last_fullsized":"2024-04-25T11:22:16.431803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:31.912201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.413183+0000","last_change":"2024-04-25T11:22:14.411671+0000","last_active":"2024-04-25T11:22:14.413183+0000","last_peered":"2024-04-25T11:22:14.413183+0000","last_clean":"2024-04-25T11:22:14.413183+0000","last_became_active":"2024-04-25T11:22:14.411034+0000","last_became_peered":"2024-04-25T11:22:14.411034+0000","last_unstale":"2024-04-25T11:22:14.413183+0000","last_undegraded":"2024-04-25T11:22:14.413183+0000","last_fullsized":"2024-04-25T11:22:14.413183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:05.767634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:18.442157+0000","last_change":"2024-04-25T11:22:13.397193+0000","last_active":"2024-04-25T11:22:18.442157+0000","last_peered":"2024-04-25T11:22:18.442157+0000","last_clean":"2024-04-25T11:22:18.442157+0000","last_became_active":"2024-04-25T11:22:13.396319+0000","last_became_peered":"2024-04-25T11:22:13.396319+0000","last_unstale":"2024-04-25T11:22:18.442157+0000","last_undegraded":"2024-04-25T11:22:18.442157+0000","last_fullsized":"2024-04-25T11:22:18.442157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.140114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407594+0000","last_change":"2024-04-25T11:22:14.404123+0000","last_active":"2024-04-25T11:22:14.407594+0000","last_peered":"2024-04-25T11:22:14.407594+0000","last_clean":"2024-04-25T11:22:14.407594+0000","last_became_active":"2024-04-25T11:22:14.403751+0000","last_became_peered":"2024-04-25T11:22:14.403751+0000","last_unstale":"2024-04-25T11:22:14.407594+0000","last_undegraded":"2024-04-25T11:22:14.407594+0000","last_fullsized":"2024-04-25T11:22:14.407594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:45.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.434950+0000","last_change":"2024-04-25T11:22:13.402801+0000","last_active":"2024-04-25T11:22:17.434950+0000","last_peered":"2024-04-25T11:22:17.434950+0000","last_clean":"2024-04-25T11:22:17.434950+0000","last_became_active":"2024-04-25T11:22:13.402417+0000","last_became_peered":"2024-04-25T11:22:13.402417+0000","last_unstale":"2024-04-25T11:22:17.434950+0000","last_undegraded":"2024-04-25T11:22:17.434950+0000","last_fullsized":"2024-04-25T11:22:17.434950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:55.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427464+0000","last_change":"2024-04-25T11:22:14.413947+0000","last_active":"2024-04-25T11:22:16.427464+0000","last_peered":"2024-04-25T11:22:16.427464+0000","last_clean":"2024-04-25T11:22:16.427464+0000","last_became_active":"2024-04-25T11:22:14.413549+0000","last_became_peered":"2024-04-25T11:22:14.413549+0000","last_unstale":"2024-04-25T11:22:16.427464+0000","last_undegraded":"2024-04-25T11:22:16.427464+0000","last_fullsized":"2024-04-25T11:22:16.427464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:42.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400937+0000","last_change":"2024-04-25T11:22:13.406112+0000","last_active":"2024-04-25T11:22:15.400937+0000","last_peered":"2024-04-25T11:22:15.400937+0000","last_clean":"2024-04-25T11:22:15.400937+0000","last_became_active":"2024-04-25T11:22:13.405591+0000","last_became_peered":"2024-04-25T11:22:13.405591+0000","last_unstale":"2024-04-25T11:22:15.400937+0000","last_undegraded":"2024-04-25T11:22:15.400937+0000","last_fullsized":"2024-04-25T11:22:15.400937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:00.177226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426379+0000","last_change":"2024-04-25T11:22:14.412070+0000","last_active":"2024-04-25T11:22:16.426379+0000","last_peered":"2024-04-25T11:22:16.426379+0000","last_clean":"2024-04-25T11:22:16.426379+0000","last_became_active":"2024-04-25T11:22:14.411715+0000","last_became_peered":"2024-04-25T11:22:14.411715+0000","last_unstale":"2024-04-25T11:22:16.426379+0000","last_undegraded":"2024-04-25T11:22:16.426379+0000","last_fullsized":"2024-04-25T11:22:16.426379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:51.939642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.401814+0000","last_change":"2024-04-25T11:22:13.394583+0000","last_active":"2024-04-25T11:22:15.401814+0000","last_peered":"2024-04-25T11:22:15.401814+0000","last_clean":"2024-04-25T11:22:15.401814+0000","last_became_active":"2024-04-25T11:22:13.394210+0000","last_became_peered":"2024-04-25T11:22:13.394210+0000","last_unstale":"2024-04-25T11:22:15.401814+0000","last_undegraded":"2024-04-25T11:22:15.401814+0000","last_fullsized":"2024-04-25T11:22:15.401814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:34.622567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426336+0000","last_change":"2024-04-25T11:22:14.404487+0000","last_active":"2024-04-25T11:22:16.426336+0000","last_peered":"2024-04-25T11:22:16.426336+0000","last_clean":"2024-04-25T11:22:16.426336+0000","last_became_active":"2024-04-25T11:22:14.404096+0000","last_became_peered":"2024-04-25T11:22:14.404096+0000","last_unstale":"2024-04-25T11:22:16.426336+0000","last_undegraded":"2024-04-25T11:22:16.426336+0000","last_fullsized":"2024-04-25T11:22:16.426336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:55.938011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388048+0000","last_change":"2024-04-25T11:22:13.397273+0000","last_active":"2024-04-25T11:22:14.388048+0000","last_peered":"2024-04-25T11:22:14.388048+0000","last_clean":"2024-04-25T11:22:14.388048+0000","last_became_active":"2024-04-25T11:22:13.396538+0000","last_became_peered":"2024-04-25T11:22:13.396538+0000","last_unstale":"2024-04-25T11:22:14.388048+0000","last_undegraded":"2024-04-25T11:22:14.388048+0000","last_fullsized":"2024-04-25T11:22:14.388048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:04.738107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425350+0000","last_change":"2024-04-25T11:22:14.416686+0000","last_active":"2024-04-25T11:22:16.425350+0000","last_peered":"2024-04-25T11:22:16.425350+0000","last_clean":"2024-04-25T11:22:16.425350+0000","last_became_active":"2024-04-25T11:22:14.415715+0000","last_became_peered":"2024-04-25T11:22:14.415715+0000","last_unstale":"2024-04-25T11:22:16.425350+0000","last_undegraded":"2024-04-25T11:22:16.425350+0000","last_fullsized":"2024-04-25T11:22:16.425350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:55.956708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427654+0000","last_change":"2024-04-25T11:22:14.411786+0000","last_active":"2024-04-25T11:22:16.427654+0000","last_peered":"2024-04-25T11:22:16.427654+0000","last_clean":"2024-04-25T11:22:16.427654+0000","last_became_active":"2024-04-25T11:22:14.411433+0000","last_became_peered":"2024-04-25T11:22:14.411433+0000","last_unstale":"2024-04-25T11:22:16.427654+0000","last_undegraded":"2024-04-25T11:22:16.427654+0000","last_fullsized":"2024-04-25T11:22:16.427654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:28.948581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388506+0000","last_change":"2024-04-25T11:22:13.396834+0000","last_active":"2024-04-25T11:22:14.388506+0000","last_peered":"2024-04-25T11:22:14.388506+0000","last_clean":"2024-04-25T11:22:14.388506+0000","last_became_active":"2024-04-25T11:22:13.396439+0000","last_became_peered":"2024-04-25T11:22:13.396439+0000","last_unstale":"2024-04-25T11:22:14.388506+0000","last_undegraded":"2024-04-25T11:22:14.388506+0000","last_fullsized":"2024-04-25T11:22:14.388506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388656+0000","last_change":"2024-04-25T11:22:14.404784+0000","last_active":"2024-04-25T11:22:16.388656+0000","last_peered":"2024-04-25T11:22:16.388656+0000","last_clean":"2024-04-25T11:22:16.388656+0000","last_became_active":"2024-04-25T11:22:14.404355+0000","last_became_peered":"2024-04-25T11:22:14.404355+0000","last_unstale":"2024-04-25T11:22:16.388656+0000","last_undegraded":"2024-04-25T11:22:16.388656+0000","last_fullsized":"2024-04-25T11:22:16.388656+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:04.698767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:18.437827+0000","last_change":"2024-04-25T11:22:13.389125+0000","last_active":"2024-04-25T11:22:18.437827+0000","last_peered":"2024-04-25T11:22:18.437827+0000","last_clean":"2024-04-25T11:22:18.437827+0000","last_became_active":"2024-04-25T11:22:13.387160+0000","last_became_peered":"2024-04-25T11:22:13.387160+0000","last_unstale":"2024-04-25T11:22:18.437827+0000","last_undegraded":"2024-04-25T11:22:18.437827+0000","last_fullsized":"2024-04-25T11:22:18.437827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:11.839065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":89,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.387940+0000","last_change":"2024-04-25T11:20:53.708987+0000","last_active":"2024-04-25T11:22:14.387940+0000","last_peered":"2024-04-25T11:22:14.387940+0000","last_clean":"2024-04-25T11:22:14.387940+0000","last_became_active":"2024-04-25T11:20:53.704654+0000","last_became_peered":"2024-04-25T11:20:53.704654+0000","last_unstale":"2024-04-25T11:22:14.387940+0000","last_undegraded":"2024-04-25T11:22:14.387940+0000","last_fullsized":"2024-04-25T11:22:14.387940+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_clean_scrub_stamp":"2024-04-25T11:17:24.025142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:24.174044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.416245+0000","last_change":"2024-04-25T11:22:14.413776+0000","last_active":"2024-04-25T11:22:14.416245+0000","last_peered":"2024-04-25T11:22:14.416245+0000","last_clean":"2024-04-25T11:22:14.416245+0000","last_became_active":"2024-04-25T11:22:14.413417+0000","last_became_peered":"2024-04-25T11:22:14.413417+0000","last_unstale":"2024-04-25T11:22:14.416245+0000","last_undegraded":"2024-04-25T11:22:14.416245+0000","last_fullsized":"2024-04-25T11:22:14.416245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:43.635439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.388632+0000","last_change":"2024-04-25T11:22:13.404113+0000","last_active":"2024-04-25T11:22:14.388632+0000","last_peered":"2024-04-25T11:22:14.388632+0000","last_clean":"2024-04-25T11:22:14.388632+0000","last_became_active":"2024-04-25T11:22:13.403711+0000","last_became_peered":"2024-04-25T11:22:13.403711+0000","last_unstale":"2024-04-25T11:22:14.388632+0000","last_undegraded":"2024-04-25T11:22:14.388632+0000","last_fullsized":"2024-04-25T11:22:14.388632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:52.618167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400938+0000","last_change":"2024-04-25T11:22:13.404334+0000","last_active":"2024-04-25T11:22:15.400938+0000","last_peered":"2024-04-25T11:22:15.400938+0000","last_clean":"2024-04-25T11:22:15.400938+0000","last_became_active":"2024-04-25T11:22:13.403896+0000","last_became_peered":"2024-04-25T11:22:13.403896+0000","last_unstale":"2024-04-25T11:22:15.400938+0000","last_undegraded":"2024-04-25T11:22:15.400938+0000","last_fullsized":"2024-04-25T11:22:15.400938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:24.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.408541+0000","last_change":"2024-04-25T11:22:14.406921+0000","last_active":"2024-04-25T11:22:14.408541+0000","last_peered":"2024-04-25T11:22:14.408541+0000","last_clean":"2024-04-25T11:22:14.408541+0000","last_became_active":"2024-04-25T11:22:14.406520+0000","last_became_peered":"2024-04-25T11:22:14.406520+0000","last_unstale":"2024-04-25T11:22:14.408541+0000","last_undegraded":"2024-04-25T11:22:14.408541+0000","last_fullsized":"2024-04-25T11:22:14.408541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:02.950225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'5","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:19.388108+0000","last_change":"2024-04-25T11:22:13.400870+0000","last_active":"2024-04-25T11:22:19.388108+0000","last_peered":"2024-04-25T11:22:19.388108+0000","last_clean":"2024-04-25T11:22:19.388108+0000","last_became_active":"2024-04-25T11:22:13.400479+0000","last_became_peered":"2024-04-25T11:22:13.400479+0000","last_unstale":"2024-04-25T11:22:19.388108+0000","last_undegraded":"2024-04-25T11:22:19.388108+0000","last_fullsized":"2024-04-25T11:22:19.388108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:12.975205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388930+0000","last_change":"2024-04-25T11:22:14.402782+0000","last_active":"2024-04-25T11:22:16.388930+0000","last_peered":"2024-04-25T11:22:16.388930+0000","last_clean":"2024-04-25T11:22:16.388930+0000","last_became_active":"2024-04-25T11:22:14.402368+0000","last_became_peered":"2024-04-25T11:22:14.402368+0000","last_unstale":"2024-04-25T11:22:16.388930+0000","last_undegraded":"2024-04-25T11:22:16.388930+0000","last_fullsized":"2024-04-25T11:22:16.388930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:49.897015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.424230+0000","last_change":"2024-04-25T11:22:13.390229+0000","last_active":"2024-04-25T11:22:16.424230+0000","last_peered":"2024-04-25T11:22:16.424230+0000","last_clean":"2024-04-25T11:22:16.424230+0000","last_became_active":"2024-04-25T11:22:13.389825+0000","last_became_peered":"2024-04-25T11:22:13.389825+0000","last_unstale":"2024-04-25T11:22:16.424230+0000","last_undegraded":"2024-04-25T11:22:16.424230+0000","last_fullsized":"2024-04-25T11:22:16.424230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:50.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.428040+0000","last_change":"2024-04-25T11:22:14.412066+0000","last_active":"2024-04-25T11:22:16.428040+0000","last_peered":"2024-04-25T11:22:16.428040+0000","last_clean":"2024-04-25T11:22:16.428040+0000","last_became_active":"2024-04-25T11:22:14.411707+0000","last_became_peered":"2024-04-25T11:22:14.411707+0000","last_unstale":"2024-04-25T11:22:16.428040+0000","last_undegraded":"2024-04-25T11:22:16.428040+0000","last_fullsized":"2024-04-25T11:22:16.428040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:13.274928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.430168+0000","last_change":"2024-04-25T11:22:13.397644+0000","last_active":"2024-04-25T11:22:16.430168+0000","last_peered":"2024-04-25T11:22:16.430168+0000","last_clean":"2024-04-25T11:22:16.430168+0000","last_became_active":"2024-04-25T11:22:13.397240+0000","last_became_peered":"2024-04-25T11:22:13.397240+0000","last_unstale":"2024-04-25T11:22:16.430168+0000","last_undegraded":"2024-04-25T11:22:16.430168+0000","last_fullsized":"2024-04-25T11:22:16.430168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.927399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:15.400497+0000","last_change":"2024-04-25T11:22:14.416191+0000","last_active":"2024-04-25T11:22:15.400497+0000","last_peered":"2024-04-25T11:22:15.400497+0000","last_clean":"2024-04-25T11:22:15.400497+0000","last_became_active":"2024-04-25T11:22:14.415537+0000","last_became_peered":"2024-04-25T11:22:14.415537+0000","last_unstale":"2024-04-25T11:22:15.400497+0000","last_undegraded":"2024-04-25T11:22:15.400497+0000","last_fullsized":"2024-04-25T11:22:15.400497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:27.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.429187+0000","last_change":"2024-04-25T11:22:13.390329+0000","last_active":"2024-04-25T11:22:16.429187+0000","last_peered":"2024-04-25T11:22:16.429187+0000","last_clean":"2024-04-25T11:22:16.429187+0000","last_became_active":"2024-04-25T11:22:13.389854+0000","last_became_peered":"2024-04-25T11:22:13.389854+0000","last_unstale":"2024-04-25T11:22:16.429187+0000","last_undegraded":"2024-04-25T11:22:16.429187+0000","last_fullsized":"2024-04-25T11:22:16.429187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:01.238826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425849+0000","last_change":"2024-04-25T11:22:14.395782+0000","last_active":"2024-04-25T11:22:16.425849+0000","last_peered":"2024-04-25T11:22:16.425849+0000","last_clean":"2024-04-25T11:22:16.425849+0000","last_became_active":"2024-04-25T11:22:14.395321+0000","last_became_peered":"2024-04-25T11:22:14.395321+0000","last_unstale":"2024-04-25T11:22:16.425849+0000","last_undegraded":"2024-04-25T11:22:16.425849+0000","last_fullsized":"2024-04-25T11:22:16.425849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:08.842424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425566+0000","last_change":"2024-04-25T11:22:13.401087+0000","last_active":"2024-04-25T11:22:16.425566+0000","last_peered":"2024-04-25T11:22:16.425566+0000","last_clean":"2024-04-25T11:22:16.425566+0000","last_became_active":"2024-04-25T11:22:13.400537+0000","last_became_peered":"2024-04-25T11:22:13.400537+0000","last_unstale":"2024-04-25T11:22:16.425566+0000","last_undegraded":"2024-04-25T11:22:16.425566+0000","last_fullsized":"2024-04-25T11:22:16.425566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:24.566260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388520+0000","last_change":"2024-04-25T11:22:14.399436+0000","last_active":"2024-04-25T11:22:16.388520+0000","last_peered":"2024-04-25T11:22:16.388520+0000","last_clean":"2024-04-25T11:22:16.388520+0000","last_became_active":"2024-04-25T11:22:14.398968+0000","last_became_peered":"2024-04-25T11:22:14.398968+0000","last_unstale":"2024-04-25T11:22:16.388520+0000","last_undegraded":"2024-04-25T11:22:16.388520+0000","last_fullsized":"2024-04-25T11:22:16.388520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:52.426381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425939+0000","last_change":"2024-04-25T11:22:13.401785+0000","last_active":"2024-04-25T11:22:16.425939+0000","last_peered":"2024-04-25T11:22:16.425939+0000","last_clean":"2024-04-25T11:22:16.425939+0000","last_became_active":"2024-04-25T11:22:13.401411+0000","last_became_peered":"2024-04-25T11:22:13.401411+0000","last_unstale":"2024-04-25T11:22:16.425939+0000","last_undegraded":"2024-04-25T11:22:16.425939+0000","last_fullsized":"2024-04-25T11:22:16.425939+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:29.640195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407061+0000","last_change":"2024-04-25T11:22:14.403391+0000","last_active":"2024-04-25T11:22:14.407061+0000","last_peered":"2024-04-25T11:22:14.407061+0000","last_clean":"2024-04-25T11:22:14.407061+0000","last_became_active":"2024-04-25T11:22:14.402817+0000","last_became_peered":"2024-04-25T11:22:14.402817+0000","last_unstale":"2024-04-25T11:22:14.407061+0000","last_undegraded":"2024-04-25T11:22:14.407061+0000","last_fullsized":"2024-04-25T11:22:14.407061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:08.687595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:17.435100+0000","last_change":"2024-04-25T11:22:13.394733+0000","last_active":"2024-04-25T11:22:17.435100+0000","last_peered":"2024-04-25T11:22:17.435100+0000","last_clean":"2024-04-25T11:22:17.435100+0000","last_became_active":"2024-04-25T11:22:13.394389+0000","last_became_peered":"2024-04-25T11:22:13.394389+0000","last_unstale":"2024-04-25T11:22:17.435100+0000","last_undegraded":"2024-04-25T11:22:17.435100+0000","last_fullsized":"2024-04-25T11:22:17.435100+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.751957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.401549+0000","last_change":"2024-04-25T11:22:14.398974+0000","last_active":"2024-04-25T11:22:14.401549+0000","last_peered":"2024-04-25T11:22:14.401549+0000","last_clean":"2024-04-25T11:22:14.401549+0000","last_became_active":"2024-04-25T11:22:14.396317+0000","last_became_peered":"2024-04-25T11:22:14.396317+0000","last_unstale":"2024-04-25T11:22:14.401549+0000","last_undegraded":"2024-04-25T11:22:14.401549+0000","last_fullsized":"2024-04-25T11:22:14.401549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:41.406246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.429714+0000","last_change":"2024-04-25T11:22:13.405081+0000","last_active":"2024-04-25T11:22:16.429714+0000","last_peered":"2024-04-25T11:22:16.429714+0000","last_clean":"2024-04-25T11:22:16.429714+0000","last_became_active":"2024-04-25T11:22:13.404160+0000","last_became_peered":"2024-04-25T11:22:13.404160+0000","last_unstale":"2024-04-25T11:22:16.429714+0000","last_undegraded":"2024-04-25T11:22:16.429714+0000","last_fullsized":"2024-04-25T11:22:16.429714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:33.591987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407896+0000","last_change":"2024-04-25T11:22:14.406014+0000","last_active":"2024-04-25T11:22:14.407896+0000","last_peered":"2024-04-25T11:22:14.407896+0000","last_clean":"2024-04-25T11:22:14.407896+0000","last_became_active":"2024-04-25T11:22:14.405609+0000","last_became_peered":"2024-04-25T11:22:14.405609+0000","last_unstale":"2024-04-25T11:22:14.407896+0000","last_undegraded":"2024-04-25T11:22:14.407896+0000","last_fullsized":"2024-04-25T11:22:14.407896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.263341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.406507+0000","last_change":"2024-04-25T11:22:13.397936+0000","last_active":"2024-04-25T11:22:14.406507+0000","last_peered":"2024-04-25T11:22:14.406507+0000","last_clean":"2024-04-25T11:22:14.406507+0000","last_became_active":"2024-04-25T11:22:13.397616+0000","last_became_peered":"2024-04-25T11:22:13.397616+0000","last_unstale":"2024-04-25T11:22:14.406507+0000","last_undegraded":"2024-04-25T11:22:14.406507+0000","last_fullsized":"2024-04-25T11:22:14.406507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:18.647965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.401435+0000","last_change":"2024-04-25T11:22:14.396359+0000","last_active":"2024-04-25T11:22:14.401435+0000","last_peered":"2024-04-25T11:22:14.401435+0000","last_clean":"2024-04-25T11:22:14.401435+0000","last_became_active":"2024-04-25T11:22:14.395818+0000","last_became_peered":"2024-04-25T11:22:14.395818+0000","last_unstale":"2024-04-25T11:22:14.401435+0000","last_undegraded":"2024-04-25T11:22:14.401435+0000","last_fullsized":"2024-04-25T11:22:14.401435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:10.212817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426036+0000","last_change":"2024-04-25T11:22:14.396700+0000","last_active":"2024-04-25T11:22:16.426036+0000","last_peered":"2024-04-25T11:22:16.426036+0000","last_clean":"2024-04-25T11:22:16.426036+0000","last_became_active":"2024-04-25T11:22:14.396353+0000","last_became_peered":"2024-04-25T11:22:14.396353+0000","last_unstale":"2024-04-25T11:22:16.426036+0000","last_undegraded":"2024-04-25T11:22:16.426036+0000","last_fullsized":"2024-04-25T11:22:16.426036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:23.570878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425848+0000","last_change":"2024-04-25T11:22:14.412317+0000","last_active":"2024-04-25T11:22:16.425848+0000","last_peered":"2024-04-25T11:22:16.425848+0000","last_clean":"2024-04-25T11:22:16.425848+0000","last_became_active":"2024-04-25T11:22:14.411940+0000","last_became_peered":"2024-04-25T11:22:14.411940+0000","last_unstale":"2024-04-25T11:22:16.425848+0000","last_undegraded":"2024-04-25T11:22:16.425848+0000","last_fullsized":"2024-04-25T11:22:16.425848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425517+0000","last_change":"2024-04-25T11:22:14.407779+0000","last_active":"2024-04-25T11:22:16.425517+0000","last_peered":"2024-04-25T11:22:16.425517+0000","last_clean":"2024-04-25T11:22:16.425517+0000","last_became_active":"2024-04-25T11:22:14.407443+0000","last_became_peered":"2024-04-25T11:22:14.407443+0000","last_unstale":"2024-04-25T11:22:16.425517+0000","last_undegraded":"2024-04-25T11:22:16.425517+0000","last_fullsized":"2024-04-25T11:22:16.425517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:00.316425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427593+0000","last_change":"2024-04-25T11:22:14.412005+0000","last_active":"2024-04-25T11:22:16.427593+0000","last_peered":"2024-04-25T11:22:16.427593+0000","last_clean":"2024-04-25T11:22:16.427593+0000","last_became_active":"2024-04-25T11:22:14.411626+0000","last_became_peered":"2024-04-25T11:22:14.411626+0000","last_unstale":"2024-04-25T11:22:16.427593+0000","last_undegraded":"2024-04-25T11:22:16.427593+0000","last_fullsized":"2024-04-25T11:22:16.427593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.320505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.416706+0000","last_change":"2024-04-25T11:22:14.415812+0000","last_active":"2024-04-25T11:22:14.416706+0000","last_peered":"2024-04-25T11:22:14.416706+0000","last_clean":"2024-04-25T11:22:14.416706+0000","last_became_active":"2024-04-25T11:22:14.415455+0000","last_became_peered":"2024-04-25T11:22:14.415455+0000","last_unstale":"2024-04-25T11:22:14.416706+0000","last_undegraded":"2024-04-25T11:22:14.416706+0000","last_fullsized":"2024-04-25T11:22:14.416706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:36.426094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425553+0000","last_change":"2024-04-25T11:22:14.400892+0000","last_active":"2024-04-25T11:22:16.425553+0000","last_peered":"2024-04-25T11:22:16.425553+0000","last_clean":"2024-04-25T11:22:16.425553+0000","last_became_active":"2024-04-25T11:22:14.400526+0000","last_became_peered":"2024-04-25T11:22:14.400526+0000","last_unstale":"2024-04-25T11:22:16.425553+0000","last_undegraded":"2024-04-25T11:22:16.425553+0000","last_fullsized":"2024-04-25T11:22:16.425553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:20.123680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.426389+0000","last_change":"2024-04-25T11:22:14.403134+0000","last_active":"2024-04-25T11:22:16.426389+0000","last_peered":"2024-04-25T11:22:16.426389+0000","last_clean":"2024-04-25T11:22:16.426389+0000","last_became_active":"2024-04-25T11:22:14.402795+0000","last_became_peered":"2024-04-25T11:22:14.402795+0000","last_unstale":"2024-04-25T11:22:16.426389+0000","last_undegraded":"2024-04-25T11:22:16.426389+0000","last_fullsized":"2024-04-25T11:22:16.426389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.496135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388790+0000","last_change":"2024-04-25T11:22:14.410963+0000","last_active":"2024-04-25T11:22:16.388790+0000","last_peered":"2024-04-25T11:22:16.388790+0000","last_clean":"2024-04-25T11:22:16.388790+0000","last_became_active":"2024-04-25T11:22:14.410555+0000","last_became_peered":"2024-04-25T11:22:14.410555+0000","last_unstale":"2024-04-25T11:22:16.388790+0000","last_undegraded":"2024-04-25T11:22:16.388790+0000","last_fullsized":"2024-04-25T11:22:16.388790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:56.505717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.427367+0000","last_change":"2024-04-25T11:22:14.405094+0000","last_active":"2024-04-25T11:22:16.427367+0000","last_peered":"2024-04-25T11:22:16.427367+0000","last_clean":"2024-04-25T11:22:16.427367+0000","last_became_active":"2024-04-25T11:22:14.404749+0000","last_became_peered":"2024-04-25T11:22:14.404749+0000","last_unstale":"2024-04-25T11:22:16.427367+0000","last_undegraded":"2024-04-25T11:22:16.427367+0000","last_fullsized":"2024-04-25T11:22:16.427367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:44.129648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.388623+0000","last_change":"2024-04-25T11:22:14.396868+0000","last_active":"2024-04-25T11:22:16.388623+0000","last_peered":"2024-04-25T11:22:16.388623+0000","last_clean":"2024-04-25T11:22:16.388623+0000","last_became_active":"2024-04-25T11:22:14.396421+0000","last_became_peered":"2024-04-25T11:22:14.396421+0000","last_unstale":"2024-04-25T11:22:16.388623+0000","last_undegraded":"2024-04-25T11:22:16.388623+0000","last_fullsized":"2024-04-25T11:22:16.388623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:24.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425916+0000","last_change":"2024-04-25T11:22:14.400510+0000","last_active":"2024-04-25T11:22:16.425916+0000","last_peered":"2024-04-25T11:22:16.425916+0000","last_clean":"2024-04-25T11:22:16.425916+0000","last_became_active":"2024-04-25T11:22:14.400037+0000","last_became_peered":"2024-04-25T11:22:14.400037+0000","last_unstale":"2024-04-25T11:22:16.425916+0000","last_undegraded":"2024-04-25T11:22:16.425916+0000","last_fullsized":"2024-04-25T11:22:16.425916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.293068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T11:22:14.407092+0000","last_change":"2024-04-25T11:22:14.404415+0000","last_active":"2024-04-25T11:22:14.407092+0000","last_peered":"2024-04-25T11:22:14.407092+0000","last_clean":"2024-04-25T11:22:14.407092+0000","last_became_active":"2024-04-25T11:22:14.404032+0000","last_became_peered":"2024-04-25T11:22:14.404032+0000","last_unstale":"2024-04-25T11:22:14.407092+0000","last_undegraded":"2024-04-25T11:22:14.407092+0000","last_fullsized":"2024-04-25T11:22:14.407092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:22.351481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T11:22:16.425136+0000","last_change":"2024-04-25T11:22:14.410650+0000","last_active":"2024-04-25T11:22:16.425136+0000","last_peered":"2024-04-25T11:22:16.425136+0000","last_clean":"2024-04-25T11:22:16.425136+0000","last_became_active":"2024-04-25T11:22:14.410216+0000","last_became_peered":"2024-04-25T11:22:14.410216+0000","last_unstale":"2024-04-25T11:22:16.425136+0000","last_undegraded":"2024-04-25T11:22:16.425136+0000","last_fullsized":"2024-04-25T11:22:16.425136+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:28.364279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246033,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5914,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":114,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":14526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645327,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":823296,"data_stored":393185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841555,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":976207,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005081,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":839680,"data_stored":393421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201311,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":839680,"data_stored":393341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430243,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":860160,"data_stored":974983,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":806912,"data_stored":384033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":394215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":847872,"data_stored":394081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":395565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":392797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":831488,"data_stored":393638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":984447,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:22:21.584 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T11:22:21.584 INFO:tasks.cephadm:Setting up client nodes... 2024-04-25T11:22:21.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T11:22:21.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:21 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2658371159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:21.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:21 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1861247548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:21.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:21 smithi196 ceph-mon[32659]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:22:21.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:21 smithi196 ceph-mon[32659]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 5.2 KiB/s wr, 16 op/s 2024-04-25T11:22:21.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:21 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2658371159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:22:21.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:21 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1861247548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:21.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:21 smithi082 ceph-mon[32440]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:22:21.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:21 smithi082 ceph-mon[32440]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 5.2 KiB/s wr, 16 op/s 2024-04-25T11:22:21.851 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:22.630 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:22 smithi080 ceph-mon[29126]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:22:22.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:22 smithi196 ceph-mon[32659]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:22:22.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:22 smithi082 ceph-mon[32440]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:22:23.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:23 smithi080 ceph-mon[29126]: pgmap v291: 97 pgs: 97 active+clean; 618 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.2 KiB/s wr, 19 op/s 2024-04-25T11:22:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 -- 172.21.15.80:0/1318612274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 msgr2=0x7f58c4102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 --2- 172.21.15.80:0/1318612274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c4102600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009990 tx=0x7f58b8009ca0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 -- 172.21.15.80:0/1318612274 shutdown_connections 2024-04-25T11:22:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 --2- 172.21.15.80:0/1318612274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58c4102b40 0x7f58c410c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 --2- 172.21.15.80:0/1318612274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c41057a0 0x7f58c4105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 --2- 172.21.15.80:0/1318612274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c4102600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 -- 172.21.15.80:0/1318612274 >> 172.21.15.80:0/1318612274 conn(0x7f58c40fdee0 msgr2=0x7f58c4100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 -- 172.21.15.80:0/1318612274 shutdown_connections 2024-04-25T11:22:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 -- 172.21.15.80:0/1318612274 wait complete. 2024-04-25T11:22:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.641+0000 7f58c9487700 1 Processor -- start 2024-04-25T11:22:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c9487700 1 -- start start 2024-04-25T11:22:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c9487700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c9487700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c4102b40 0x7f58c419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c9487700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58c41057a0 0x7f58c41a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c9487700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58c410fc60 con 0x7f58c41021f0 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c9487700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58c410fae0 con 0x7f58c4102b40 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c9487700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f58c410fde0 con 0x7f58c41057a0 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39652/0 (socket says 172.21.15.80:39652) 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 -- 172.21.15.80:0/1218956655 learned_addr learned my addr 172.21.15.80:0/1218956655 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c27fc700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c4102b40 0x7f58c419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c37fe700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58c41057a0 0x7f58c41a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 -- 172.21.15.80:0/1218956655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58c41057a0 msgr2=0x7f58c41a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58c41057a0 0x7f58c41a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 -- 172.21.15.80:0/1218956655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c4102b40 msgr2=0x7f58c419ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c4102b40 0x7f58c419ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.642+0000 7f58c2ffd700 1 -- 172.21.15.80:0/1218956655 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c41a2360 con 0x7f58c41021f0 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.643+0000 7f58c2ffd700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c419a800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f58b400d950 tx=0x7f58b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.643+0000 7f58abfff700 1 -- 172.21.15.80:0/1218956655 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4017070 con 0x7f58c41021f0 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.643+0000 7f58abfff700 1 -- 172.21.15.80:0/1218956655 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b400f690 con 0x7f58c41021f0 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.643+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c41a2650 con 0x7f58c41021f0 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.643+0000 7f58abfff700 1 -- 172.21.15.80:0/1218956655 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4003aa0 con 0x7f58c41021f0 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.643+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c41a2b90 con 0x7f58c41021f0 2024-04-25T11:22:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.644+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c4051190 con 0x7f58c41021f0 2024-04-25T11:22:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.645+0000 7f58abfff700 1 -- 172.21.15.80:0/1218956655 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f58b400f840 con 0x7f58c41021f0 2024-04-25T11:22:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.646+0000 7f58abfff700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f58ac0afc10 0x7f58ac0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.646+0000 7f58c27fc700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f58ac0afc10 0x7f58ac0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.646+0000 7f58abfff700 1 -- 172.21.15.80:0/1218956655 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f58b40de6b0 con 0x7f58c41021f0 2024-04-25T11:22:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.646+0000 7f58c27fc700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f58ac0afc10 0x7f58ac0b2120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b5c0 tx=0x7f58b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:23.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.651+0000 7f58abfff700 1 -- 172.21.15.80:0/1218956655 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f58b4020030 con 0x7f58c41021f0 2024-04-25T11:22:23.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:23 smithi082 ceph-mon[32440]: pgmap v291: 97 pgs: 97 active+clean; 618 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.2 KiB/s wr, 19 op/s 2024-04-25T11:22:23.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.931+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f58c402e510 con 0x7f58c41021f0 2024-04-25T11:22:23.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.934+0000 7f58abfff700 1 -- 172.21.15.80:0/1218956655 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f58b40a72e0 con 0x7f58c41021f0 2024-04-25T11:22:23.929 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-25T11:22:23.929 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDvPCpm8A+eNxAAldKiWVM/SMXdsSUMU4cutQ== 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f58ac0afc10 msgr2=0x7f58ac0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f58ac0afc10 0x7f58ac0b2120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b5c0 tx=0x7f58b801a040 comp rx=0 tx=0).stop 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 msgr2=0x7f58c419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c419a800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f58b400d950 tx=0x7f58b400dc60 comp rx=0 tx=0).stop 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 shutdown_connections 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f58ac0afc10 0x7f58ac0b2120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58c41057a0 0x7f58c41a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c41021f0 0x7f58c419a800 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 --2- 172.21.15.80:0/1218956655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c4102b40 0x7f58c419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:23.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 >> 172.21.15.80:0/1218956655 conn(0x7f58c40fdee0 msgr2=0x7f58c4108740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:23.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 shutdown_connections 2024-04-25T11:22:23.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:23.936+0000 7f58c9487700 1 -- 172.21.15.80:0/1218956655 wait complete. 2024-04-25T11:22:23.941 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:23 smithi196 ceph-mon[32659]: pgmap v291: 97 pgs: 97 active+clean; 618 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.2 KiB/s wr, 19 op/s 2024-04-25T11:22:24.612 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:24 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1218956655' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T11:22:24.612 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:24 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1218956655' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T11:22:24.640 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:22:24.641 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-25T11:22:24.641 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T11:22:24.676 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T11:22:24.676 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-25T11:22:24.676 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-25T11:22:24.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:24 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1218956655' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T11:22:24.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:24 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1218956655' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T11:22:24.941 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:24 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1218956655' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T11:22:24.942 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:24 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1218956655' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T11:22:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:25.614 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:25 smithi080 ceph-mon[29126]: pgmap v292: 97 pgs: 97 active+clean; 618 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.2 KiB/s wr, 19 op/s 2024-04-25T11:22:25.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:25 smithi082 ceph-mon[32440]: pgmap v292: 97 pgs: 97 active+clean; 618 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.2 KiB/s wr, 19 op/s 2024-04-25T11:22:25.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:25 smithi196 ceph-mon[32659]: pgmap v292: 97 pgs: 97 active+clean; 618 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.2 KiB/s wr, 19 op/s 2024-04-25T11:22:26.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 -- 172.21.15.80:0/1829150716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 msgr2=0x7f9d14103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 --2- 172.21.15.80:0/1829150716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14103f40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9d040099c0 tx=0x7f9d04009cd0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 -- 172.21.15.80:0/1829150716 shutdown_connections 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 --2- 172.21.15.80:0/1829150716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d14108620 0x7f9d1410ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 --2- 172.21.15.80:0/1829150716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14103f40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 --2- 172.21.15.80:0/1829150716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d14107cd0 0x7f9d141080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 -- 172.21.15.80:0/1829150716 >> 172.21.15.80:0/1829150716 conn(0x7f9d140fe5c0 msgr2=0x7f9d141009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 -- 172.21.15.80:0/1829150716 shutdown_connections 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.658+0000 7f9d19896700 1 -- 172.21.15.80:0/1829150716 wait complete. 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.659+0000 7f9d19896700 1 Processor -- start 2024-04-25T11:22:26.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.659+0000 7f9d19896700 1 -- start start 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.659+0000 7f9d19896700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14110960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d19896700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d14107cd0 0x7f9d14110ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d19896700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d14108620 0x7f9d141113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d19896700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141143a0 con 0x7f9d14103b30 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d19896700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14114220 con 0x7f9d14107cd0 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d19896700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14114520 con 0x7f9d14108620 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14110960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14110960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37892/0 (socket says 172.21.15.80:37892) 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 -- 172.21.15.80:0/4108934456 learned_addr learned my addr 172.21.15.80:0/4108934456 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d137fe700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d14108620 0x7f9d141113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d0a7fc700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d14107cd0 0x7f9d14110ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 -- 172.21.15.80:0/4108934456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d14108620 msgr2=0x7f9d141113e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d14108620 0x7f9d141113e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 -- 172.21.15.80:0/4108934456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d14107cd0 msgr2=0x7f9d14110ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d14107cd0 0x7f9d14110ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 -- 172.21.15.80:0/4108934456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d141a9090 con 0x7f9d14103b30 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d0a7fc700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d14107cd0 0x7f9d14110ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d12ffd700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14110960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400b580 tx=0x7f9d040047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d18894700 1 -- 172.21.15.80:0/4108934456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04027070 con 0x7f9d14103b30 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d141a9320 con 0x7f9d14103b30 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d18894700 1 -- 172.21.15.80:0/4108934456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d04003f20 con 0x7f9d14103b30 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.660+0000 7f9d18894700 1 -- 172.21.15.80:0/4108934456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04022d70 con 0x7f9d14103b30 2024-04-25T11:22:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.661+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d141a9770 con 0x7f9d14103b30 2024-04-25T11:22:26.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.662+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d14051190 con 0x7f9d14103b30 2024-04-25T11:22:26.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.663+0000 7f9d18894700 1 -- 172.21.15.80:0/4108934456 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f9d04022500 con 0x7f9d14103b30 2024-04-25T11:22:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.663+0000 7f9d18894700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9d000afc10 0x7f9d000b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.664+0000 7f9d0a7fc700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9d000afc10 0x7f9d000b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.664+0000 7f9d18894700 1 -- 172.21.15.80:0/4108934456 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f9d040df8e0 con 0x7f9d14103b30 2024-04-25T11:22:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.664+0000 7f9d0a7fc700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9d000afc10 0x7f9d000b2120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc005950 tx=0x7f9cfc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:26.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.668+0000 7f9d18894700 1 -- 172.21.15.80:0/4108934456 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9d04013070 con 0x7f9d14103b30 2024-04-25T11:22:26.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.927+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9d1402e510 con 0x7f9d14103b30 2024-04-25T11:22:26.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.933+0000 7f9d18894700 1 -- 172.21.15.80:0/4108934456 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+284479 (secure 0 0 0) 0x7f9d040a85a0 con 0x7f9d14103b30 2024-04-25T11:22:26.932 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:26.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.935+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9d000afc10 msgr2=0x7f9d000b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.935+0000 7f9d19896700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9d000afc10 0x7f9d000b2120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc005950 tx=0x7f9cfc0058e0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.935+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 msgr2=0x7f9d14110960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.935+0000 7f9d19896700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14110960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400b580 tx=0x7f9d040047b0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 shutdown_connections 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f9d000afc10 0x7f9d000b2120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d14108620 0x7f9d141113e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d14103b30 0x7f9d14110960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 --2- 172.21.15.80:0/4108934456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d14107cd0 0x7f9d14110ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 >> 172.21.15.80:0/4108934456 conn(0x7f9d140fe5c0 msgr2=0x7f9d14107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 shutdown_connections 2024-04-25T11:22:26.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:26.936+0000 7f9d19896700 1 -- 172.21.15.80:0/4108934456 wait complete. 2024-04-25T11:22:27.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:26 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4108934456' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T11:22:27.298 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:26 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4108934456' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T11:22:27.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:26 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4108934456' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T11:22:27.667 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3135257773},{"type":"v1","addr":"172.21.15.80:6801","nonce":3135257773}]},"active_addr":"172.21.15.80:6801/3135257773","active_change":"2024-04-25T11:14:55.185561+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.80:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":4228038844}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1536113811}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":4111395089}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1814218335}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":844801587}]}]} 2024-04-25T11:22:27.675 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-25T11:22:27.675 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-25T11:22:27.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T11:22:27.914 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:28.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:27 smithi082 ceph-mon[32440]: pgmap v293: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2024-04-25T11:22:28.250 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:27 smithi080 ceph-mon[29126]: pgmap v293: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2024-04-25T11:22:28.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:27 smithi196 ceph-mon[32659]: pgmap v293: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2024-04-25T11:22:29.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 -- 172.21.15.80:0/1375310244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48107ce0 msgr2=0x7f0c481080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:29.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 --2- 172.21.15.80:0/1375310244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48107ce0 0x7f0c481080f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0c380099c0 tx=0x7f0c38009cd0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 -- 172.21.15.80:0/1375310244 shutdown_connections 2024-04-25T11:22:29.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 --2- 172.21.15.80:0/1375310244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c48108630 0x7f0c4810ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 --2- 172.21.15.80:0/1375310244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c481033b0 0x7f0c481037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 --2- 172.21.15.80:0/1375310244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48107ce0 0x7f0c481080f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 -- 172.21.15.80:0/1375310244 >> 172.21.15.80:0/1375310244 conn(0x7f0c480fee20 msgr2=0x7f0c48101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:29.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 -- 172.21.15.80:0/1375310244 shutdown_connections 2024-04-25T11:22:29.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.581+0000 7f0c4d254700 1 -- 172.21.15.80:0/1375310244 wait complete. 2024-04-25T11:22:29.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.582+0000 7f0c4d254700 1 Processor -- start 2024-04-25T11:22:29.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.582+0000 7f0c4d254700 1 -- start start 2024-04-25T11:22:29.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4d254700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c481033b0 0x7f0c481a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:29.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4d254700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c48107ce0 0x7f0c481a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:29.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4d254700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48108630 0x7f0c4819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:29.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4d254700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c481143b0 con 0x7f0c48108630 2024-04-25T11:22:29.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4d254700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c48114230 con 0x7f0c48107ce0 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4d254700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0c48114530 con 0x7f0c481033b0 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48108630 0x7f0c4819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48108630 0x7f0c4819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37908/0 (socket says 172.21.15.80:37908) 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 -- 172.21.15.80:0/2652790554 learned_addr learned my addr 172.21.15.80:0/2652790554 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c46d9d700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c481033b0 0x7f0c481a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4659c700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c48107ce0 0x7f0c481a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 -- 172.21.15.80:0/2652790554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c481033b0 msgr2=0x7f0c481a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c481033b0 0x7f0c481a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 -- 172.21.15.80:0/2652790554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c48107ce0 msgr2=0x7f0c481a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c48107ce0 0x7f0c481a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 -- 172.21.15.80:0/2652790554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4819b1f0 con 0x7f0c48108630 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4659c700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c48107ce0 0x7f0c481a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.583+0000 7f0c4759e700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48108630 0x7f0c4819ab50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0c40007d70 tx=0x7f0c4000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:29.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.584+0000 7f0c2ffff700 1 -- 172.21.15.80:0/2652790554 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40016020 con 0x7f0c48108630 2024-04-25T11:22:29.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.584+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4819b4e0 con 0x7f0c48108630 2024-04-25T11:22:29.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.584+0000 7f0c2ffff700 1 -- 172.21.15.80:0/2652790554 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4000ad40 con 0x7f0c48108630 2024-04-25T11:22:29.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.584+0000 7f0c2ffff700 1 -- 172.21.15.80:0/2652790554 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c400115e0 con 0x7f0c48108630 2024-04-25T11:22:29.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.584+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4819b9a0 con 0x7f0c48108630 2024-04-25T11:22:29.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.585+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c48104860 con 0x7f0c48108630 2024-04-25T11:22:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.586+0000 7f0c2ffff700 1 -- 172.21.15.80:0/2652790554 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f0c40019020 con 0x7f0c48108630 2024-04-25T11:22:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.587+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0c300afc10 0x7f0c300b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.587+0000 7f0c46d9d700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0c300afc10 0x7f0c300b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.587+0000 7f0c2ffff700 1 -- 172.21.15.80:0/2652790554 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f0c400dea40 con 0x7f0c48108630 2024-04-25T11:22:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.587+0000 7f0c46d9d700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0c300afc10 0x7f0c300b2120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c005950 tx=0x7f0c3c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:29.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.592+0000 7f0c2ffff700 1 -- 172.21.15.80:0/2652790554 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0c40020020 con 0x7f0c48108630 2024-04-25T11:22:29.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.791+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c4802e510 con 0x7f0c48108630 2024-04-25T11:22:29.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.792+0000 7f0c2ffff700 1 -- 172.21.15.80:0/2652790554 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22183 (secure 0 0 0) 0x7f0c400a7780 con 0x7f0c48108630 2024-04-25T11:22:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:29.788 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":77,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:15.392029+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:22:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0c300afc10 msgr2=0x7f0c300b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0c300afc10 0x7f0c300b2120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c005950 tx=0x7f0c3c00a300 comp rx=0 tx=0).stop 2024-04-25T11:22:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48108630 msgr2=0x7f0c4819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48108630 0x7f0c4819ab50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0c40007d70 tx=0x7f0c4000a340 comp rx=0 tx=0).stop 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 shutdown_connections 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f0c300afc10 0x7f0c300b2120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c48108630 0x7f0c4819ab50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c481033b0 0x7f0c481a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 --2- 172.21.15.80:0/2652790554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c48107ce0 0x7f0c481a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 >> 172.21.15.80:0/2652790554 conn(0x7f0c480fee20 msgr2=0x7f0c48107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 shutdown_connections 2024-04-25T11:22:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:29.795+0000 7f0c4d254700 1 -- 172.21.15.80:0/2652790554 wait complete. 2024-04-25T11:22:30.388 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:30 smithi080 ceph-mon[29126]: pgmap v294: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.0 KiB/s wr, 17 op/s 2024-04-25T11:22:30.388 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:30 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2652790554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:30.421 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-25T11:22:30.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T11:22:30.660 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:30.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:30 smithi196 ceph-mon[32659]: pgmap v294: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.0 KiB/s wr, 17 op/s 2024-04-25T11:22:30.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:30 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2652790554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:30.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:30 smithi082 ceph-mon[32440]: pgmap v294: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.0 KiB/s wr, 17 op/s 2024-04-25T11:22:30.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:30 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2652790554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 -- 172.21.15.80:0/3639359395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 msgr2=0x7feddc104890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 --2- 172.21.15.80:0/3639359395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc104890 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fedd80099c0 tx=0x7fedd8009cd0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 -- 172.21.15.80:0/3639359395 shutdown_connections 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 --2- 172.21.15.80:0/3639359395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feddc109700 0x7feddc111060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 --2- 172.21.15.80:0/3639359395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc104890 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 --2- 172.21.15.80:0/3639359395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc108db0 0x7feddc1091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 -- 172.21.15.80:0/3639359395 >> 172.21.15.80:0/3639359395 conn(0x7feddc0ffd30 msgr2=0x7feddc102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 -- 172.21.15.80:0/3639359395 shutdown_connections 2024-04-25T11:22:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.494+0000 7fede3a5e700 1 -- 172.21.15.80:0/3639359395 wait complete. 2024-04-25T11:22:32.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 Processor -- start 2024-04-25T11:22:32.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 -- start start 2024-04-25T11:22:32.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc1a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:32.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feddc108db0 0x7feddc1a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:32.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc109700 0x7feddc19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:32.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feddc114330 con 0x7feddc104480 2024-04-25T11:22:32.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feddc1141b0 con 0x7feddc109700 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede3a5e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7feddc1144b0 con 0x7feddc108db0 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede17fa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc1a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede17fa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc1a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37930/0 (socket says 172.21.15.80:37930) 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.495+0000 7fede17fa700 1 -- 172.21.15.80:0/424457931 learned_addr learned my addr 172.21.15.80:0/424457931 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede0ff9700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feddc108db0 0x7feddc1a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede17fa700 1 -- 172.21.15.80:0/424457931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feddc108db0 msgr2=0x7feddc1a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede1ffb700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc109700 0x7feddc19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede17fa700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feddc108db0 0x7feddc1a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede17fa700 1 -- 172.21.15.80:0/424457931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc109700 msgr2=0x7feddc19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede17fa700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc109700 0x7feddc19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede17fa700 1 -- 172.21.15.80:0/424457931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc19b1d0 con 0x7feddc104480 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede0ff9700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feddc108db0 0x7feddc1a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede1ffb700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc109700 0x7feddc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:32.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede17fa700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc1a08b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fedd800b580 tx=0x7fedd80037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fedd27fc700 1 -- 172.21.15.80:0/424457931 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8027070 con 0x7feddc104480 2024-04-25T11:22:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fedd27fc700 1 -- 172.21.15.80:0/424457931 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd8004110 con 0x7feddc104480 2024-04-25T11:22:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc19b460 con 0x7feddc104480 2024-04-25T11:22:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fedd27fc700 1 -- 172.21.15.80:0/424457931 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd800f460 con 0x7feddc104480 2024-04-25T11:22:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.496+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc1a7760 con 0x7feddc104480 2024-04-25T11:22:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.497+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc105930 con 0x7feddc104480 2024-04-25T11:22:32.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.498+0000 7fedd27fc700 1 -- 172.21.15.80:0/424457931 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fedd802a070 con 0x7feddc104480 2024-04-25T11:22:32.495 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:32 smithi080 ceph-mon[29126]: pgmap v295: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-04-25T11:22:32.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.499+0000 7fedd27fc700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fedc80afc10 0x7fedc80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:32.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.500+0000 7fede0ff9700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fedc80afc10 0x7fedc80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.500+0000 7fedd27fc700 1 -- 172.21.15.80:0/424457931 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fedd80dfbf0 con 0x7feddc104480 2024-04-25T11:22:32.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.500+0000 7fede0ff9700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fedc80afc10 0x7fedc80b2120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fedcc005fd0 tx=0x7fedcc005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.504+0000 7fedd27fc700 1 -- 172.21.15.80:0/424457931 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fedd8013070 con 0x7feddc104480 2024-04-25T11:22:32.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:32 smithi196 ceph-mon[32659]: pgmap v295: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-04-25T11:22:32.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.702+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feddc19bfe0 con 0x7feddc104480 2024-04-25T11:22:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.704+0000 7fedd27fc700 1 -- 172.21.15.80:0/424457931 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22183 (secure 0 0 0) 0x7fedd80a88b0 con 0x7feddc104480 2024-04-25T11:22:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:22:32.699 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":77,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:15.392029+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:22:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fedc80afc10 msgr2=0x7fedc80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fedc80afc10 0x7fedc80b2120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fedcc005fd0 tx=0x7fedcc005dc0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 msgr2=0x7feddc1a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc1a08b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fedd800b580 tx=0x7fedd80037c0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 shutdown_connections 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fedc80afc10 0x7fedc80b2120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc109700 0x7feddc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feddc104480 0x7feddc1a08b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 --2- 172.21.15.80:0/424457931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feddc108db0 0x7feddc1a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 >> 172.21.15.80:0/424457931 conn(0x7feddc0ffd30 msgr2=0x7feddc102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 shutdown_connections 2024-04-25T11:22:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:32.706+0000 7fede3a5e700 1 -- 172.21.15.80:0/424457931 wait complete. 2024-04-25T11:22:32.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:32 smithi082 ceph-mon[32440]: pgmap v295: 97 pgs: 97 active+clean; 623 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-04-25T11:22:33.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-25T11:22:33.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-25T11:22:33.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-25T11:22:33.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-25T11:22:33.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-25T11:22:33.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-25T11:22:33.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-25T11:22:33.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-25T11:22:33.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-25T11:22:33.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-25T11:22:33.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-25T11:22:33.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-25T11:22:33.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:33 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/424457931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:33.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:33 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/424457931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:33.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:33 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/424457931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:22:34.123 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:34.123 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:34.161 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:34.573 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:34 smithi080 ceph-mon[29126]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-04-25T11:22:34.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:34 smithi196 ceph-mon[32659]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-04-25T11:22:34.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:34 smithi082 ceph-mon[32440]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-04-25T11:22:36.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:36 smithi080 ceph-mon[29126]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-25T11:22:36.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:36 smithi196 ceph-mon[32659]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-25T11:22:36.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:36 smithi082 ceph-mon[32440]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-25T11:22:38.568 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.569 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.569 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.569 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.571 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.571 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.571 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.578 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:38.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:38 smithi080 ceph-mon[29126]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-25T11:22:38.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:38 smithi196 ceph-mon[32659]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-25T11:22:38.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:38 smithi082 ceph-mon[32440]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 -- 172.21.15.80:0/994746491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c1031b0 msgr2=0x7f2b0c10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 --2- 172.21.15.80:0/994746491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c1031b0 0x7f2b0c10f730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400b0a0 tx=0x7f2b0400b3b0 comp rx=0 tx=0).stop 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 -- 172.21.15.80:0/994746491 shutdown_connections 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 --2- 172.21.15.80:0/994746491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c1031b0 0x7f2b0c10f730 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 --2- 172.21.15.80:0/994746491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b0c108890 0x7f2b0c108ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 --2- 172.21.15.80:0/994746491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b0c102860 0x7f2b0c102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 -- 172.21.15.80:0/994746491 >> 172.21.15.80:0/994746491 conn(0x7f2b0c0fe3f0 msgr2=0x7f2b0c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 -- 172.21.15.80:0/994746491 shutdown_connections 2024-04-25T11:22:38.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.815+0000 7f2b1430d700 1 -- 172.21.15.80:0/994746491 wait complete. 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 Processor -- start 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 -- start start 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c102860 0x7f2b0c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b0c1031b0 0x7f2b0c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b0c108890 0x7f2b0c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c112180 con 0x7f2b0c102860 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c112000 con 0x7f2b0c108890 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b1430d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c112300 con 0x7f2b0c1031b0 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b120a9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c102860 0x7f2b0c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b120a9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c102860 0x7f2b0c1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53964/0 (socket says 172.21.15.80:53964) 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b120a9700 1 -- 172.21.15.80:0/694116276 learned_addr learned my addr 172.21.15.80:0/694116276 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b118a8700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b0c1031b0 0x7f2b0c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.816+0000 7f2b128aa700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b0c108890 0x7f2b0c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:38.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b120a9700 1 -- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b0c1031b0 msgr2=0x7f2b0c198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b120a9700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b0c1031b0 0x7f2b0c198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b120a9700 1 -- 172.21.15.80:0/694116276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b0c108890 msgr2=0x7f2b0c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b120a9700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b0c108890 0x7f2b0c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b120a9700 1 -- 172.21.15.80:0/694116276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c1a9060 con 0x7f2b0c102860 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b128aa700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b0c108890 0x7f2b0c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b120a9700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c102860 0x7f2b0c1988e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800ddc0 tx=0x7f2b0800a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800ad40 con 0x7f2b0c102860 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c1a9350 con 0x7f2b0c102860 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b08004ce0 con 0x7f2b0c102860 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800e450 con 0x7f2b0c102860 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.817+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c1a9890 con 0x7f2b0c102860 2024-04-25T11:22:38.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.818+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b0c063da0 con 0x7f2b0c102860 2024-04-25T11:22:38.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.819+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f2b08004750 con 0x7f2b0c102860 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.820+0000 7f2b037fe700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2af80afc10 0x7f2af80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.820+0000 7f2b118a8700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2af80afc10 0x7f2af80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.820+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f2b080df430 con 0x7f2b0c102860 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.820+0000 7f2b037fe700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] conn(0x7f2af80b9440 0x7f2af80bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.820+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 --> [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b0801ce50 con 0x7f2af80b9440 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.820+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f2b080df910 con 0x7f2b0c102860 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.820+0000 7f2b118a8700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2af80afc10 0x7f2af80b2120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c101a70 tx=0x7f2afc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.821+0000 7f2b128aa700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] conn(0x7f2af80b9440 0x7f2af80bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.821+0000 7f2b128aa700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] conn(0x7f2af80b9440 0x7f2af80bb890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:38.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.822+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== osd.5 v2:172.21.15.196:6808/2327068088 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b0801ce50 con 0x7f2af80b9440 2024-04-25T11:22:38.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.843+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 --> [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b0c0641a0 con 0x7f2af80b9440 2024-04-25T11:22:38.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.843+0000 7f2b037fe700 1 -- 172.21.15.80:0/694116276 <== osd.5 v2:172.21.15.196:6808/2327068088 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2b0c0641a0 con 0x7f2af80b9440 2024-04-25T11:22:38.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.843+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] conn(0x7f2af80b9440 msgr2=0x7f2af80bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:38.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] conn(0x7f2af80b9440 0x7f2af80bb890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2af80afc10 msgr2=0x7f2af80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f2af80afc10 0x7f2af80b2120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c101a70 tx=0x7f2afc00b410 comp rx=0 tx=0).stop 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c102860 msgr2=0x7f2b0c1988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 --2- 172.21.15.80:0/694116276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c102860 0x7f2b0c1988e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800ddc0 tx=0x7f2b0800a530 comp rx=0 tx=0).stop 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b128aa700 1 -- 172.21.15.80:0/694116276 reap_dead start 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 shutdown_connections 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 >> 172.21.15.80:0/694116276 conn(0x7f2b0c0fe3f0 msgr2=0x7f2b0c106b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 shutdown_connections 2024-04-25T11:22:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:38.844+0000 7f2b1430d700 1 -- 172.21.15.80:0/694116276 wait complete. 2024-04-25T11:22:40.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:40 smithi080 ceph-mon[29126]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-25T11:22:40.683 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:40 smithi196 ceph-mon[32659]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-25T11:22:40.740 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:40 smithi082 ceph-mon[32440]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-25T11:22:41.337 INFO:teuthology.orchestra.run.smithi080.stdout:158913790002 2024-04-25T11:22:41.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-25T11:22:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 -- 172.21.15.80:0/2071828000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac10e7b0 msgr2=0x7feeac110c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 --2- 172.21.15.80:0/2071828000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac10e7b0 0x7feeac110c90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feea400b0a0 tx=0x7feea400b3b0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 -- 172.21.15.80:0/2071828000 shutdown_connections 2024-04-25T11:22:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 --2- 172.21.15.80:0/2071828000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac10e7b0 0x7feeac110c90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 --2- 172.21.15.80:0/2071828000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac105380 0x7feeac105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 --2- 172.21.15.80:0/2071828000 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feeac105cd0 0x7feeac10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 -- 172.21.15.80:0/2071828000 >> 172.21.15.80:0/2071828000 conn(0x7feeac0fec90 msgr2=0x7feeac1010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:41.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.535+0000 7feeb121e700 1 -- 172.21.15.80:0/2071828000 shutdown_connections 2024-04-25T11:22:41.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.536+0000 7feeb121e700 1 -- 172.21.15.80:0/2071828000 wait complete. 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 Processor -- start 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 -- start start 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac105380 0x7feeac1a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac105cd0 0x7feeac1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feeac10e7b0 0x7feeac19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feeac114360 con 0x7feeac105380 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feeac1141e0 con 0x7feeac105cd0 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeb121e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7feeac1144e0 con 0x7feeac10e7b0 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeaad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac105380 0x7feeac1a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeaad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac105380 0x7feeac1a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53990/0 (socket says 172.21.15.80:53990) 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeaad9d700 1 -- 172.21.15.80:0/2493298861 learned_addr learned my addr 172.21.15.80:0/2493298861 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.537+0000 7feeaa59c700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac105cd0 0x7feeac1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeab59e700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feeac10e7b0 0x7feeac19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeaad9d700 1 -- 172.21.15.80:0/2493298861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feeac10e7b0 msgr2=0x7feeac19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeaad9d700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feeac10e7b0 0x7feeac19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeaad9d700 1 -- 172.21.15.80:0/2493298861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac105cd0 msgr2=0x7feeac1a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeaad9d700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac105cd0 0x7feeac1a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeaad9d700 1 -- 172.21.15.80:0/2493298861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac19b150 con 0x7feeac105380 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeaa59c700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeac105cd0 0x7feeac1a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeaad9d700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac105380 0x7feeac1a08a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c9b0 tx=0x7fee9c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c007b00 con 0x7feeac105380 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac19b440 con 0x7feeac105380 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee9c00ce50 con 0x7feeac105380 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c018660 con 0x7feeac105380 2024-04-25T11:22:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.538+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac1a7750 con 0x7feeac105380 2024-04-25T11:22:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.539+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feeac063e20 con 0x7feeac105380 2024-04-25T11:22:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.542+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fee9c00f450 con 0x7feeac105380 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.542+0000 7fee93fff700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fee940afc10 0x7fee940b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.542+0000 7feeaa59c700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fee940afc10 0x7fee940b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.542+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fee9c0def90 con 0x7feeac105380 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.542+0000 7fee93fff700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] conn(0x7fee940b9440 0x7fee940bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.542+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 --> [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee9c015e70 con 0x7fee940b9440 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.542+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fee9c0df470 con 0x7feeac105380 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.543+0000 7feeab59e700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] conn(0x7fee940b9440 0x7fee940bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.543+0000 7feeaa59c700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fee940afc10 0x7fee940b2120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feeac102140 tx=0x7feea0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:41.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.543+0000 7feeab59e700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] conn(0x7fee940b9440 0x7fee940bb890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:41.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.544+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== osd.9 v2:172.21.15.80:6826/2904539109 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee9c015e70 con 0x7fee940b9440 2024-04-25T11:22:41.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.564+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 --> [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feeac064220 con 0x7fee940b9440 2024-04-25T11:22:41.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7fee93fff700 1 -- 172.21.15.80:0/2493298861 <== osd.9 v2:172.21.15.80:6826/2904539109 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feeac064220 con 0x7fee940b9440 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] conn(0x7fee940b9440 msgr2=0x7fee940bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] conn(0x7fee940b9440 0x7fee940bb890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fee940afc10 msgr2=0x7fee940b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fee940afc10 0x7fee940b2120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feeac102140 tx=0x7feea0009190 comp rx=0 tx=0).stop 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac105380 msgr2=0x7feeac1a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 --2- 172.21.15.80:0/2493298861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeac105380 0x7feeac1a08a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c9b0 tx=0x7fee9c00ccc0 comp rx=0 tx=0).stop 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeab59e700 1 -- 172.21.15.80:0/2493298861 reap_dead start 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 shutdown_connections 2024-04-25T11:22:41.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.565+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 >> 172.21.15.80:0/2493298861 conn(0x7feeac0fec90 msgr2=0x7feeac0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:41.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.566+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 shutdown_connections 2024-04-25T11:22:41.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:41.566+0000 7feeb121e700 1 -- 172.21.15.80:0/2493298861 wait complete. 2024-04-25T11:22:42.479 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:42 smithi080 ceph-mon[29126]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-25T11:22:42.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:42 smithi196 ceph-mon[32659]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-25T11:22:42.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:42 smithi082 ceph-mon[32440]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-25T11:22:44.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:44 smithi080 ceph-mon[29126]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T11:22:44.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:44 smithi196 ceph-mon[32659]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T11:22:44.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:44 smithi082 ceph-mon[32440]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 -- 172.21.15.80:0/2967301411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 msgr2=0x7f44a41037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 --2- 172.21.15.80:0/2967301411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 0x7f44a41037c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f44940099c0 tx=0x7f4494009cd0 comp rx=0 tx=0).stop 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 -- 172.21.15.80:0/2967301411 shutdown_connections 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 --2- 172.21.15.80:0/2967301411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a4108630 0x7f44a410ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 --2- 172.21.15.80:0/2967301411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 0x7f44a41037c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 --2- 172.21.15.80:0/2967301411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a4107ce0 0x7f44a41080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 -- 172.21.15.80:0/2967301411 >> 172.21.15.80:0/2967301411 conn(0x7f44a40fee00 msgr2=0x7f44a4101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 -- 172.21.15.80:0/2967301411 shutdown_connections 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.969+0000 7f44a99e5700 1 -- 172.21.15.80:0/2967301411 wait complete. 2024-04-25T11:22:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.970+0000 7f44a99e5700 1 Processor -- start 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.970+0000 7f44a99e5700 1 -- start start 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a99e5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 0x7f44a419bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a99e5700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a4107ce0 0x7f44a419c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a99e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a4108630 0x7f44a419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a99e5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4113260 con 0x7f44a41033b0 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a99e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44a41130e0 con 0x7f44a4108630 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a99e5700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f44a41133e0 con 0x7f44a4107ce0 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 0x7f44a419bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 0x7f44a419bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54008/0 (socket says 172.21.15.80:54008) 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 -- 172.21.15.80:0/1473196180 learned_addr learned my addr 172.21.15.80:0/1473196180 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a27fc700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a4107ce0 0x7f44a419c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a37fe700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a4108630 0x7f44a419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 -- 172.21.15.80:0/1473196180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a4107ce0 msgr2=0x7f44a419c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a4107ce0 0x7f44a419c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 -- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a4108630 msgr2=0x7f44a419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a4108630 0x7f44a419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 -- 172.21.15.80:0/1473196180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a41a6ed0 con 0x7f44a41033b0 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a2ffd700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 0x7f44a419bc40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44940098e0 tx=0x7f4494005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.971+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494027070 con 0x7f44a41033b0 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.972+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4494003fa0 con 0x7f44a41033b0 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.972+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a41a7160 con 0x7f44a41033b0 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.972+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494022d40 con 0x7f44a41033b0 2024-04-25T11:22:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.972+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a41a75b0 con 0x7f44a41033b0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.973+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44a4063da0 con 0x7f44a41033b0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.974+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f449402a070 con 0x7f44a41033b0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.975+0000 7f44a89e3700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f448c0afc10 0x7f448c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.975+0000 7f44a27fc700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f448c0afc10 0x7f448c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.975+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f44940e0860 con 0x7f44a41033b0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.975+0000 7f44a89e3700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] conn(0x7f448c0b9440 0x7f448c0bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.976+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 --> [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f448c0bbf60 con 0x7f448c0b9440 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.976+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f44940e0c10 con 0x7f44a41033b0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.976+0000 7f44a27fc700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f448c0afc10 0x7f448c0b2120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44a41064f0 tx=0x7f4498005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.976+0000 7f44a37fe700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] conn(0x7f448c0b9440 0x7f448c0bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.976+0000 7f44a37fe700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] conn(0x7f448c0b9440 0x7f448c0bb890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.977+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== osd.4 v2:172.21.15.82:6808/3035622192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f448c0bbf60 con 0x7f448c0b9440 2024-04-25T11:22:45.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 --> [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44a40641a0 con 0x7f448c0b9440 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a89e3700 1 -- 172.21.15.80:0/1473196180 <== osd.4 v2:172.21.15.82:6808/3035622192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f44a40641a0 con 0x7f448c0b9440 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] conn(0x7f448c0b9440 msgr2=0x7f448c0bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a99e5700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] conn(0x7f448c0b9440 0x7f448c0bb890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f448c0afc10 msgr2=0x7f448c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a99e5700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f448c0afc10 0x7f448c0b2120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44a41064f0 tx=0x7f4498005d30 comp rx=0 tx=0).stop 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 msgr2=0x7f44a419bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.994+0000 7f44a99e5700 1 --2- 172.21.15.80:0/1473196180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44a41033b0 0x7f44a419bc40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44940098e0 tx=0x7f4494005e80 comp rx=0 tx=0).stop 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.995+0000 7f44a37fe700 1 -- 172.21.15.80:0/1473196180 reap_dead start 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.995+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 shutdown_connections 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.995+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 >> 172.21.15.80:0/1473196180 conn(0x7f44a40fee00 msgr2=0x7f44a4101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.995+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 shutdown_connections 2024-04-25T11:22:45.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:44.995+0000 7f44a99e5700 1 -- 172.21.15.80:0/1473196180 wait complete. 2024-04-25T11:22:46.607 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:46 smithi080 ceph-mon[29126]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-25T11:22:46.608 INFO:teuthology.orchestra.run.smithi080.stdout:261993005086 2024-04-25T11:22:46.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-25T11:22:46.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:46 smithi196 ceph-mon[32659]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-25T11:22:46.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:46 smithi082 ceph-mon[32440]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-25T11:22:48.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:48 smithi080 ceph-mon[29126]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-25T11:22:48.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:48 smithi196 ceph-mon[32659]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-25T11:22:48.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:48 smithi082 ceph-mon[32440]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-25T11:22:49.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 -- 172.21.15.80:0/2092753210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff010e7b0 msgr2=0x7efff0110c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 --2- 172.21.15.80:0/2092753210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff010e7b0 0x7efff0110c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7effe800b0a0 tx=0x7effe800b3b0 comp rx=0 tx=0).stop 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 -- 172.21.15.80:0/2092753210 shutdown_connections 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 --2- 172.21.15.80:0/2092753210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff010e7b0 0x7efff0110c90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 --2- 172.21.15.80:0/2092753210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efff0105380 0x7efff0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 --2- 172.21.15.80:0/2092753210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efff0105cd0 0x7efff010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 -- 172.21.15.80:0/2092753210 >> 172.21.15.80:0/2092753210 conn(0x7efff00fec90 msgr2=0x7efff01010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 -- 172.21.15.80:0/2092753210 shutdown_connections 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.015+0000 7efff585a700 1 -- 172.21.15.80:0/2092753210 wait complete. 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 Processor -- start 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 -- start start 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efff0105380 0x7efff0103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff0105cd0 0x7efff01035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efff010e7b0 0x7efff0103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efff01142e0 con 0x7efff0105cd0 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efff0114160 con 0x7efff0105380 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7efff585a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efff0114460 con 0x7efff010e7b0 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7effe67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff0105cd0 0x7efff01035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7effe67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff0105cd0 0x7efff01035b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59098/0 (socket says 172.21.15.80:59098) 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7effe67fc700 1 -- 172.21.15.80:0/2684191505 learned_addr learned my addr 172.21.15.80:0/2684191505 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7effeeffd700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efff0105380 0x7efff0103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.016+0000 7effef7fe700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efff010e7b0 0x7efff0103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7effe67fc700 1 -- 172.21.15.80:0/2684191505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efff010e7b0 msgr2=0x7efff0103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7effe67fc700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efff010e7b0 0x7efff0103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7effe67fc700 1 -- 172.21.15.80:0/2684191505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efff0105380 msgr2=0x7efff0103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7effe67fc700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efff0105380 0x7efff0103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7effe67fc700 1 -- 172.21.15.80:0/2684191505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff01a8fd0 con 0x7efff0105cd0 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7effe67fc700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff0105cd0 0x7efff01035b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effd800d950 tx=0x7effd800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8016070 con 0x7efff0105cd0 2024-04-25T11:22:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff01a92c0 con 0x7efff0105cd0 2024-04-25T11:22:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd800fd40 con 0x7efff0105cd0 2024-04-25T11:22:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd800e3b0 con 0x7efff0105cd0 2024-04-25T11:22:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.017+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff01a9800 con 0x7efff0105cd0 2024-04-25T11:22:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.018+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efff0063da0 con 0x7efff0105cd0 2024-04-25T11:22:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.020+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7effd8019070 con 0x7efff0105cd0 2024-04-25T11:22:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.020+0000 7efff4858700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7effdc0afc10 0x7effdc0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.020+0000 7effeeffd700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7effdc0afc10 0x7effdc0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.020+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7effd80deb90 con 0x7efff0105cd0 2024-04-25T11:22:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.021+0000 7efff4858700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] conn(0x7effdc0b9440 0x7effdc0bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.021+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 --> [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effd8019e50 con 0x7effdc0b9440 2024-04-25T11:22:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.021+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7effd80df070 con 0x7efff0105cd0 2024-04-25T11:22:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.021+0000 7effef7fe700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] conn(0x7effdc0b9440 0x7effdc0bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.021+0000 7effeeffd700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7effdc0afc10 0x7effdc0b2120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7effe0005950 tx=0x7effe000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.021+0000 7effef7fe700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] conn(0x7effdc0b9440 0x7effdc0bb890 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.022+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== osd.3 v2:172.21.15.80:6810/1446045179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effd8019e50 con 0x7effdc0b9440 2024-04-25T11:22:49.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 --> [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efff00641a0 con 0x7effdc0b9440 2024-04-25T11:22:49.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff4858700 1 -- 172.21.15.80:0/2684191505 <== osd.3 v2:172.21.15.80:6810/1446045179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efff00641a0 con 0x7effdc0b9440 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] conn(0x7effdc0b9440 msgr2=0x7effdc0bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] conn(0x7effdc0b9440 0x7effdc0bb890 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7effdc0afc10 msgr2=0x7effdc0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7effdc0afc10 0x7effdc0b2120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7effe0005950 tx=0x7effe000b410 comp rx=0 tx=0).stop 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff0105cd0 msgr2=0x7efff01035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 --2- 172.21.15.80:0/2684191505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efff0105cd0 0x7efff01035b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effd800d950 tx=0x7effd800dc60 comp rx=0 tx=0).stop 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7effef7fe700 1 -- 172.21.15.80:0/2684191505 reap_dead start 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 shutdown_connections 2024-04-25T11:22:49.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.038+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 >> 172.21.15.80:0/2684191505 conn(0x7efff00fec90 msgr2=0x7efff00ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.039+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 shutdown_connections 2024-04-25T11:22:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:49.039+0000 7efff585a700 1 -- 172.21.15.80:0/2684191505 wait complete. 2024-04-25T11:22:49.421 INFO:teuthology.orchestra.run.smithi080.stdout:137438953530 2024-04-25T11:22:49.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-25T11:22:50.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:50 smithi196 ceph-mon[32659]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-25T11:22:50.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:50 smithi080 ceph-mon[29126]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-25T11:22:50.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:50 smithi082 ceph-mon[32440]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-25T11:22:51.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 -- 172.21.15.80:0/1985403773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 msgr2=0x7fc3781091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 --2- 172.21.15.80:0/1985403773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 0x7fc3781091b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3680099c0 tx=0x7fc368009cd0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 -- 172.21.15.80:0/1985403773 shutdown_connections 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 --2- 172.21.15.80:0/1985403773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3781096f0 0x7fc378111050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 --2- 172.21.15.80:0/1985403773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc378104470 0x7fc378104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 --2- 172.21.15.80:0/1985403773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 0x7fc3781091b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 -- 172.21.15.80:0/1985403773 >> 172.21.15.80:0/1985403773 conn(0x7fc3780ffd00 msgr2=0x7fc378102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 -- 172.21.15.80:0/1985403773 shutdown_connections 2024-04-25T11:22:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.161+0000 7fc37fd4d700 1 -- 172.21.15.80:0/1985403773 wait complete. 2024-04-25T11:22:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 Processor -- start 2024-04-25T11:22:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 -- start start 2024-04-25T11:22:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc378104470 0x7fc3781a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 0x7fc3781a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3781096f0 0x7fc37819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc378114300 con 0x7fc378108da0 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc378114180 con 0x7fc378104470 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37fd4d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc378114480 con 0x7fc3781096f0 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37d2e8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 0x7fc3781a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37d2e8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 0x7fc3781a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59122/0 (socket says 172.21.15.80:59122) 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37d2e8700 1 -- 172.21.15.80:0/2682872885 learned_addr learned my addr 172.21.15.80:0/2682872885 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.162+0000 7fc37dae9700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc378104470 0x7fc3781a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37e2ea700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3781096f0 0x7fc37819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37d2e8700 1 -- 172.21.15.80:0/2682872885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3781096f0 msgr2=0x7fc37819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37d2e8700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3781096f0 0x7fc37819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37d2e8700 1 -- 172.21.15.80:0/2682872885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc378104470 msgr2=0x7fc3781a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37d2e8700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc378104470 0x7fc3781a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37d2e8700 1 -- 172.21.15.80:0/2682872885 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37819b1e0 con 0x7fc378108da0 2024-04-25T11:22:51.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37d2e8700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 0x7fc3781a0ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc3680098e0 tx=0x7fc3680057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:51.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368027070 con 0x7fc378108da0 2024-04-25T11:22:51.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc368004020 con 0x7fc378108da0 2024-04-25T11:22:51.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37819b470 con 0x7fc378108da0 2024-04-25T11:22:51.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368022e30 con 0x7fc378108da0 2024-04-25T11:22:51.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.163+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37819b950 con 0x7fc378108da0 2024-04-25T11:22:51.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.164+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc378063de0 con 0x7fc378108da0 2024-04-25T11:22:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.166+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fc36802a070 con 0x7fc378108da0 2024-04-25T11:22:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.166+0000 7fc36effd700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc3640afc10 0x7fc3640b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.166+0000 7fc37dae9700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc3640afc10 0x7fc3640b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.167+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fc3680e0340 con 0x7fc378108da0 2024-04-25T11:22:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.167+0000 7fc36effd700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] conn(0x7fc3640b9440 0x7fc3640bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.167+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 --> [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3640bbf60 con 0x7fc3640b9440 2024-04-25T11:22:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.167+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc3680e0820 con 0x7fc378108da0 2024-04-25T11:22:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.167+0000 7fc37e2ea700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] conn(0x7fc3640b9440 0x7fc3640bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.167+0000 7fc37dae9700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc3640afc10 0x7fc3640b2120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc374005950 tx=0x7fc37400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.167+0000 7fc37e2ea700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] conn(0x7fc3640b9440 0x7fc3640bb890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.168+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== osd.6 v2:172.21.15.80:6818/3879298562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3640bbf60 con 0x7fc3640b9440 2024-04-25T11:22:51.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.184+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 --> [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3780641e0 con 0x7fc3640b9440 2024-04-25T11:22:51.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.184+0000 7fc36effd700 1 -- 172.21.15.80:0/2682872885 <== osd.6 v2:172.21.15.80:6818/3879298562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc3780641e0 con 0x7fc3640b9440 2024-04-25T11:22:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] conn(0x7fc3640b9440 msgr2=0x7fc3640bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] conn(0x7fc3640b9440 0x7fc3640bb890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc3640afc10 msgr2=0x7fc3640b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc3640afc10 0x7fc3640b2120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc374005950 tx=0x7fc37400a300 comp rx=0 tx=0).stop 2024-04-25T11:22:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 msgr2=0x7fc3781a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 --2- 172.21.15.80:0/2682872885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc378108da0 0x7fc3781a0ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc3680098e0 tx=0x7fc3680057c0 comp rx=0 tx=0).stop 2024-04-25T11:22:51.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37e2ea700 1 -- 172.21.15.80:0/2682872885 reap_dead start 2024-04-25T11:22:51.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 shutdown_connections 2024-04-25T11:22:51.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 >> 172.21.15.80:0/2682872885 conn(0x7fc3780ffd00 msgr2=0x7fc37810a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:51.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 shutdown_connections 2024-04-25T11:22:51.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:51.185+0000 7fc37fd4d700 1 -- 172.21.15.80:0/2682872885 wait complete. 2024-04-25T11:22:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 -- 172.21.15.80:0/410723117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4103390 msgr2=0x7f34f41037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 --2- 172.21.15.80:0/410723117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4103390 0x7f34f41037a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f34f000b0d0 tx=0x7f34f000b3e0 comp rx=0 tx=0).stop 2024-04-25T11:22:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 -- 172.21.15.80:0/410723117 shutdown_connections 2024-04-25T11:22:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 --2- 172.21.15.80:0/410723117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34f4108610 0x7f34f410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 --2- 172.21.15.80:0/410723117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4103390 0x7f34f41037a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:52.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 --2- 172.21.15.80:0/410723117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f4107cc0 0x7f34f41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 -- 172.21.15.80:0/410723117 >> 172.21.15.80:0/410723117 conn(0x7f34f40fec90 msgr2=0x7f34f41010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 -- 172.21.15.80:0/410723117 shutdown_connections 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.329+0000 7f34fb9cf700 1 -- 172.21.15.80:0/410723117 wait complete. 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 Processor -- start 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 -- start start 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f4103390 0x7f34f40ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4107cc0 0x7f34f41000e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34f4108610 0x7f34f4100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34f4113240 con 0x7f34f4107cc0 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41130c0 con 0x7f34f4108610 2024-04-25T11:22:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34fb9cf700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41133c0 con 0x7f34f4103390 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34f8f6a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4107cc0 0x7f34f41000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34f8f6a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4107cc0 0x7f34f41000e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59146/0 (socket says 172.21.15.80:59146) 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.330+0000 7f34f8f6a700 1 -- 172.21.15.80:0/405448632 learned_addr learned my addr 172.21.15.80:0/405448632 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34f976b700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f4103390 0x7f34f40ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34f8f6a700 1 -- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f4103390 msgr2=0x7f34f40ffba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34f8f6a700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f4103390 0x7f34f40ffba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34f8f6a700 1 -- 172.21.15.80:0/405448632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34f4108610 msgr2=0x7f34f4100620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34f8f6a700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34f4108610 0x7f34f4100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34f8f6a700 1 -- 172.21.15.80:0/405448632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f41a9090 con 0x7f34f4107cc0 2024-04-25T11:22:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34f8f6a700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4107cc0 0x7f34f41000e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f34e400d980 tx=0x7f34e400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4017070 con 0x7f34f4107cc0 2024-04-25T11:22:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f41a9380 con 0x7f34f4107cc0 2024-04-25T11:22:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34e4010460 con 0x7f34f4107cc0 2024-04-25T11:22:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e400de60 con 0x7f34f4107cc0 2024-04-25T11:22:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.331+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f41a9910 con 0x7f34f4107cc0 2024-04-25T11:22:52.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.332+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34f4063da0 con 0x7f34f4107cc0 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.334+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f34e4010610 con 0x7f34f4107cc0 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.334+0000 7f34ea7fc700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f34e00afc10 0x7f34e00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.334+0000 7f34f976b700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f34e00afc10 0x7f34e00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.334+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f34e40dec00 con 0x7f34f4107cc0 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.335+0000 7f34ea7fc700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] conn(0x7f34e00b9440 0x7f34e00bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.335+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 --> [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34e4016ec0 con 0x7f34e00b9440 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.335+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f34e40df0e0 con 0x7f34f4107cc0 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.335+0000 7f34f976b700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f34e00afc10 0x7f34e00b2120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009fd0 tx=0x7f34f000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.335+0000 7f34f9f6c700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] conn(0x7f34e00b9440 0x7f34e00bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:52.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.335+0000 7f34f9f6c700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] conn(0x7f34e00b9440 0x7f34e00bb890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.336+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== osd.2 v2:172.21.15.196:6800/700082321 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34e4016ec0 con 0x7f34e00b9440 2024-04-25T11:22:52.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.352+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 --> [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34f40641a0 con 0x7f34e00b9440 2024-04-25T11:22:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.353+0000 7f34ea7fc700 1 -- 172.21.15.80:0/405448632 <== osd.2 v2:172.21.15.196:6800/700082321 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f34f40641a0 con 0x7f34e00b9440 2024-04-25T11:22:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] conn(0x7f34e00b9440 msgr2=0x7f34e00bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] conn(0x7f34e00b9440 0x7f34e00bb890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f34e00afc10 msgr2=0x7f34e00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f34e00afc10 0x7f34e00b2120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009fd0 tx=0x7f34f000b040 comp rx=0 tx=0).stop 2024-04-25T11:22:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4107cc0 msgr2=0x7f34f41000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 --2- 172.21.15.80:0/405448632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34f4107cc0 0x7f34f41000e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f34e400d980 tx=0x7f34e400dd40 comp rx=0 tx=0).stop 2024-04-25T11:22:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34f9f6c700 1 -- 172.21.15.80:0/405448632 reap_dead start 2024-04-25T11:22:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 shutdown_connections 2024-04-25T11:22:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 >> 172.21.15.80:0/405448632 conn(0x7f34f40fec90 msgr2=0x7f34f4101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 shutdown_connections 2024-04-25T11:22:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:52.354+0000 7f34fb9cf700 1 -- 172.21.15.80:0/405448632 wait complete. 2024-04-25T11:22:52.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:52 smithi080 ceph-mon[29126]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-25T11:22:52.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:52 smithi196 ceph-mon[32659]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-25T11:22:52.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:52 smithi082 ceph-mon[32440]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-25T11:22:53.215 INFO:teuthology.orchestra.run.smithi080.stdout:77309411397 2024-04-25T11:22:53.216 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-25T11:22:53.879 INFO:teuthology.orchestra.run.smithi080.stdout:184683593776 2024-04-25T11:22:53.879 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.107+0000 7fd5dc02b700 1 -- 172.21.15.80:0/3153927756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d41053b0 msgr2=0x7fd5d41057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.107+0000 7fd5dc02b700 1 --2- 172.21.15.80:0/3153927756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d41053b0 0x7fd5d41057c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009990 tx=0x7fd5d0009ca0 comp rx=0 tx=0).stop 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.107+0000 7fd5dc02b700 1 -- 172.21.15.80:0/3153927756 shutdown_connections 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.107+0000 7fd5dc02b700 1 --2- 172.21.15.80:0/3153927756 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5d410e7e0 0x7fd5d4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.107+0000 7fd5dc02b700 1 --2- 172.21.15.80:0/3153927756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d41053b0 0x7fd5d41057c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.107+0000 7fd5dc02b700 1 --2- 172.21.15.80:0/3153927756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d4105d00 0x7fd5d410e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.107+0000 7fd5dc02b700 1 -- 172.21.15.80:0/3153927756 >> 172.21.15.80:0/3153927756 conn(0x7fd5d40fec90 msgr2=0x7fd5d41010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.108+0000 7fd5dc02b700 1 -- 172.21.15.80:0/3153927756 shutdown_connections 2024-04-25T11:22:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.108+0000 7fd5dc02b700 1 -- 172.21.15.80:0/3153927756 wait complete. 2024-04-25T11:22:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.108+0000 7fd5dc02b700 1 Processor -- start 2024-04-25T11:22:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.108+0000 7fd5dc02b700 1 -- start start 2024-04-25T11:22:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.108+0000 7fd5dc02b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5d41053b0 0x7fd5d41a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.108+0000 7fd5dc02b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d4105d00 0x7fd5d41a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5dc02b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d410e7e0 0x7fd5d419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5dc02b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4114300 con 0x7fd5d4105d00 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5dc02b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4114180 con 0x7fd5d410e7e0 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5dc02b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4114480 con 0x7fd5d41053b0 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d4105d00 0x7fd5d41a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d4105d00 0x7fd5d41a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59160/0 (socket says 172.21.15.80:59160) 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 -- 172.21.15.80:0/1224438402 learned_addr learned my addr 172.21.15.80:0/1224438402 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d9dc7700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5d41053b0 0x7fd5d41a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5da5c8700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d410e7e0 0x7fd5d419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 -- 172.21.15.80:0/1224438402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5d41053b0 msgr2=0x7fd5d41a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5d41053b0 0x7fd5d41a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 -- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d410e7e0 msgr2=0x7fd5d419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d410e7e0 0x7fd5d419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 -- 172.21.15.80:0/1224438402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d419b170 con 0x7fd5d4105d00 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d9dc7700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5d41053b0 0x7fd5d41a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5d95c6700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d4105d00 0x7fd5d41a0e20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400d950 tx=0x7fd5c400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4016070 con 0x7fd5d4105d00 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5c4010460 con 0x7fd5d4105d00 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400f620 con 0x7fd5d4105d00 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d419b460 con 0x7fd5d4105d00 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.109+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d4102fd0 con 0x7fd5d4105d00 2024-04-25T11:22:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.110+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5d4063e20 con 0x7fd5d4105d00 2024-04-25T11:22:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.112+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fd5c4019070 con 0x7fd5d4105d00 2024-04-25T11:22:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.112+0000 7fd5caffd700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd5c00afc10 0x7fd5c00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.113+0000 7fd5d9dc7700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd5c00afc10 0x7fd5c00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.113+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fd5c40dee70 con 0x7fd5d4105d00 2024-04-25T11:22:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.113+0000 7fd5caffd700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] conn(0x7fd5c00b9440 0x7fd5c00bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.113+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 --> [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5c00bbf60 con 0x7fd5c00b9440 2024-04-25T11:22:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.113+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd5c40df350 con 0x7fd5d4105d00 2024-04-25T11:22:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.113+0000 7fd5d9dc7700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd5c00afc10 0x7fd5c00b2120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0003800 tx=0x7fd5d001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.113+0000 7fd5da5c8700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] conn(0x7fd5c00b9440 0x7fd5c00bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.114+0000 7fd5da5c8700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] conn(0x7fd5c00b9440 0x7fd5c00bb890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.115+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== osd.1 v2:172.21.15.82:6800/3913713373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5c00bbf60 con 0x7fd5c00b9440 2024-04-25T11:22:54.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.131+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 --> [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5d4064220 con 0x7fd5c00b9440 2024-04-25T11:22:54.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.131+0000 7fd5caffd700 1 -- 172.21.15.80:0/1224438402 <== osd.1 v2:172.21.15.82:6800/3913713373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd5d4064220 con 0x7fd5c00b9440 2024-04-25T11:22:54.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.131+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] conn(0x7fd5c00b9440 msgr2=0x7fd5c00bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:54.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.131+0000 7fd5dc02b700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] conn(0x7fd5c00b9440 0x7fd5c00bb890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:54.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd5c00afc10 msgr2=0x7fd5c00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:54.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd5c00afc10 0x7fd5c00b2120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0003800 tx=0x7fd5d001a040 comp rx=0 tx=0).stop 2024-04-25T11:22:54.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d4105d00 msgr2=0x7fd5d41a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 --2- 172.21.15.80:0/1224438402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5d4105d00 0x7fd5d41a0e20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400d950 tx=0x7fd5c400dd10 comp rx=0 tx=0).stop 2024-04-25T11:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5da5c8700 1 -- 172.21.15.80:0/1224438402 reap_dead start 2024-04-25T11:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 shutdown_connections 2024-04-25T11:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 >> 172.21.15.80:0/1224438402 conn(0x7fd5d40fec90 msgr2=0x7fd5d40ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 shutdown_connections 2024-04-25T11:22:54.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.132+0000 7fd5dc02b700 1 -- 172.21.15.80:0/1224438402 wait complete. 2024-04-25T11:22:54.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:54 smithi080 ceph-mon[29126]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:22:54.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:54 smithi196 ceph-mon[32659]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:22:54.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:54 smithi082 ceph-mon[32440]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 3, 8]}]: dispatch 2024-04-25T11:22:55.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-04-25T11:22:55.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:55 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-04-25T11:22:55.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-04-25T11:22:55.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-25T11:22:55.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-04-25T11:22:55.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-04-25T11:22:55.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T11:22:55.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-04-25T11:22:55.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 3, 8]}]: dispatch 2024-04-25T11:22:55.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-04-25T11:22:55.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:55 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-04-25T11:22:55.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 3, 8]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-04-25T11:22:55.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:55 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-04-25T11:22:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 -- 172.21.15.80:0/1051540760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 msgr2=0x7f25dc1091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 --2- 172.21.15.80:0/1051540760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 0x7f25dc1091d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0099c0 tx=0x7f25cc009cd0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 -- 172.21.15.80:0/1051540760 shutdown_connections 2024-04-25T11:22:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 --2- 172.21.15.80:0/1051540760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25dc109710 0x7f25dc111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 --2- 172.21.15.80:0/1051540760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25dc104490 0x7f25dc1048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 --2- 172.21.15.80:0/1051540760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 0x7f25dc1091d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 -- 172.21.15.80:0/1051540760 >> 172.21.15.80:0/1051540760 conn(0x7f25dc0ffd60 msgr2=0x7f25dc1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 -- 172.21.15.80:0/1051540760 shutdown_connections 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.801+0000 7f25e0c10700 1 -- 172.21.15.80:0/1051540760 wait complete. 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 Processor -- start 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 -- start start 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25dc104490 0x7f25dc1a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 0x7f25dc1a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25dc109710 0x7f25dc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc114320 con 0x7f25dc108dc0 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1141a0 con 0x7f25dc109710 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25e0c10700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1144a0 con 0x7f25dc104490 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25d9d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 0x7f25dc1a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25d9d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 0x7f25dc1a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59182/0 (socket says 172.21.15.80:59182) 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25d9d9b700 1 -- 172.21.15.80:0/3577618385 learned_addr learned my addr 172.21.15.80:0/3577618385 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25da59c700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25dc104490 0x7f25dc1a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.802+0000 7f25dad9d700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25dc109710 0x7f25dc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25d9d9b700 1 -- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25dc104490 msgr2=0x7f25dc1a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25d9d9b700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25dc104490 0x7f25dc1a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25d9d9b700 1 -- 172.21.15.80:0/3577618385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25dc109710 msgr2=0x7f25dc19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25d9d9b700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25dc109710 0x7f25dc19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25d9d9b700 1 -- 172.21.15.80:0/3577618385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25dc19b170 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25d9d9b700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 0x7f25dc1a0de0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098e0 tx=0x7f25cc0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc027070 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25dc19b400 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25cc003f20 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc022c70 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.803+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25dc19b8e0 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.804+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25dc063de0 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.806+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f25cc02a070 con 0x7f25dc108dc0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.806+0000 7f25cb7fe700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25c40afc10 0x7f25c40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.806+0000 7f25da59c700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25c40afc10 0x7f25c40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.806+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f25cc0e04c0 con 0x7f25dc108dc0 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.806+0000 7f25cb7fe700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] conn(0x7f25c40b9440 0x7f25c40bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.806+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 --> [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25c40bbf60 con 0x7f25c40b9440 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.806+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f25cc0e09a0 con 0x7f25dc108dc0 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.807+0000 7f25da59c700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25c40afc10 0x7f25c40b2120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f25dc19bc00 tx=0x7f25d00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.807+0000 7f25dad9d700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] conn(0x7f25c40b9440 0x7f25c40bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.807+0000 7f25dad9d700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] conn(0x7f25c40b9440 0x7f25c40bb890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.808+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== osd.8 v2:172.21.15.196:6816/2100656217 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25c40bbf60 con 0x7f25c40b9440 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.824+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 --> [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25dc064210 con 0x7f25c40b9440 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25cb7fe700 1 -- 172.21.15.80:0/3577618385 <== osd.8 v2:172.21.15.196:6816/2100656217 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f25dc064210 con 0x7f25c40b9440 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] conn(0x7f25c40b9440 msgr2=0x7f25c40bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] conn(0x7f25c40b9440 0x7f25c40bb890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25c40afc10 msgr2=0x7f25c40b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f25c40afc10 0x7f25c40b2120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f25dc19bc00 tx=0x7f25d00073d0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 msgr2=0x7f25dc1a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 --2- 172.21.15.80:0/3577618385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc108dc0 0x7f25dc1a0de0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098e0 tx=0x7f25cc0057c0 comp rx=0 tx=0).stop 2024-04-25T11:22:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25dad9d700 1 -- 172.21.15.80:0/3577618385 reap_dead start 2024-04-25T11:22:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 shutdown_connections 2024-04-25T11:22:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 >> 172.21.15.80:0/3577618385 conn(0x7f25dc0ffd60 msgr2=0x7f25dc10a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 shutdown_connections 2024-04-25T11:22:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:54.825+0000 7f25e0c10700 1 -- 172.21.15.80:0/3577618385 wait complete. 2024-04-25T11:22:56.450 INFO:teuthology.orchestra.run.smithi080.stdout:236223201319 2024-04-25T11:22:56.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-25T11:22:56.657 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:22:56.658 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-04-25T11:22:56.658 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-25T11:22:56.658 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-04-25T11:22:56.658 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-04-25T11:22:56.658 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T11:22:56.658 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-04-25T11:22:56.659 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 3, 8]}]': finished 2024-04-25T11:22:56.659 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-04-25T11:22:56.659 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-04-25T11:22:56.659 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:56 smithi080 ceph-mon[29126]: osdmap e78: 12 total, 12 up, 12 in 2024-04-25T11:22:56.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.674+0000 7fa45e321700 1 -- 172.21.15.80:0/844508095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 msgr2=0x7fa458111010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:56.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.674+0000 7fa45e321700 1 --2- 172.21.15.80:0/844508095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 0x7fa458111010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa45000b0a0 tx=0x7fa45000b3b0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 -- 172.21.15.80:0/844508095 shutdown_connections 2024-04-25T11:22:56.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 --2- 172.21.15.80:0/844508095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 0x7fa458111010 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 --2- 172.21.15.80:0/844508095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4581091a0 0x7fa4581095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 --2- 172.21.15.80:0/844508095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa458102630 0x7fa458102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 -- 172.21.15.80:0/844508095 >> 172.21.15.80:0/844508095 conn(0x7fa4580fe3f0 msgr2=0x7fa458100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:56.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 -- 172.21.15.80:0/844508095 shutdown_connections 2024-04-25T11:22:56.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 -- 172.21.15.80:0/844508095 wait complete. 2024-04-25T11:22:56.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 Processor -- start 2024-04-25T11:22:56.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.675+0000 7fa45e321700 1 -- start start 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa45e321700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458102630 0x7fa458103810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa45e321700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 0x7fa458103d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa45e321700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4581091a0 0x7fa458104290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa45e321700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa458114440 con 0x7fa458102f80 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa45e321700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4581142c0 con 0x7fa458102630 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa45e321700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa4581145c0 con 0x7fa4581091a0 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa4577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 0x7fa458103d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa45c8be700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4581091a0 0x7fa458104290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa4577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 0x7fa458103d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34380/0 (socket says 172.21.15.80:34380) 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa4577fe700 1 -- 172.21.15.80:0/1948047248 learned_addr learned my addr 172.21.15.80:0/1948047248 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa457fff700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458102630 0x7fa458103810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa4577fe700 1 -- 172.21.15.80:0/1948047248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4581091a0 msgr2=0x7fa458104290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa4577fe700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4581091a0 0x7fa458104290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa4577fe700 1 -- 172.21.15.80:0/1948047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458102630 msgr2=0x7fa458103810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.676+0000 7fa4577fe700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458102630 0x7fa458103810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa4577fe700 1 -- 172.21.15.80:0/1948047248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4581a9040 con 0x7fa458102f80 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa457fff700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458102630 0x7fa458103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa4577fe700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 0x7fa458103d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c9e0 tx=0x7fa44800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448007aa0 con 0x7fa458102f80 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa448007c40 con 0x7fa458102f80 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448018660 con 0x7fa458102f80 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4581a9330 con 0x7fa458102f80 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.677+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4581a9820 con 0x7fa458102f80 2024-04-25T11:22:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.678+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa458063da0 con 0x7fa458102f80 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.680+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fa448018800 con 0x7fa458102f80 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.680+0000 7fa4557fa700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4400afc10 0x7fa4400b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.681+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fa4480df3a0 con 0x7fa458102f80 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.681+0000 7fa457fff700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4400afc10 0x7fa4400b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.681+0000 7fa4557fa700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] conn(0x7fa4400b9820 0x7fa4400bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.681+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 --> [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa44801fe50 con 0x7fa4400b9820 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.681+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fa4480df7f0 con 0x7fa458102f80 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.681+0000 7fa45c8be700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] conn(0x7fa4400b9820 0x7fa4400bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:56.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.681+0000 7fa457fff700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4400afc10 0x7fa4400b2120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa458076150 tx=0x7fa44c00b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:56.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.682+0000 7fa45c8be700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] conn(0x7fa4400b9820 0x7fa4400bbd10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:56.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.683+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== osd.11 v2:172.21.15.196:6824/3938310451 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa44801fe50 con 0x7fa4400b9820 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 3, 8]}]': finished 2024-04-25T11:22:56.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-04-25T11:22:56.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-04-25T11:22:56.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:56 smithi196 ceph-mon[32659]: osdmap e78: 12 total, 12 up, 12 in 2024-04-25T11:22:56.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.699+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 --> [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4580641a0 con 0x7fa4400b9820 2024-04-25T11:22:56.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.699+0000 7fa4557fa700 1 -- 172.21.15.80:0/1948047248 <== osd.11 v2:172.21.15.196:6824/3938310451 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa4580641a0 con 0x7fa4400b9820 2024-04-25T11:22:56.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 >> [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] conn(0x7fa4400b9820 msgr2=0x7fa4400bbd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:56.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] conn(0x7fa4400b9820 0x7fa4400bbd10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4400afc10 msgr2=0x7fa4400b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:56.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4400afc10 0x7fa4400b2120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa458076150 tx=0x7fa44c00b5f0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 msgr2=0x7fa458103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:56.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 --2- 172.21.15.80:0/1948047248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa458102f80 0x7fa458103d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c9e0 tx=0x7fa44800ccf0 comp rx=0 tx=0).stop 2024-04-25T11:22:56.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45c8be700 1 -- 172.21.15.80:0/1948047248 reap_dead start 2024-04-25T11:22:56.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 shutdown_connections 2024-04-25T11:22:56.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 >> 172.21.15.80:0/1948047248 conn(0x7fa4580fe3f0 msgr2=0x7fa45810a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:56.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 shutdown_connections 2024-04-25T11:22:56.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:56.700+0000 7fa45e321700 1 -- 172.21.15.80:0/1948047248 wait complete. 2024-04-25T11:22:56.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 3, 8]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-04-25T11:22:56.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:56 smithi082 ceph-mon[32440]: osdmap e78: 12 total, 12 up, 12 in 2024-04-25T11:22:57.111 INFO:teuthology.orchestra.run.smithi080.stdout:55834574923 2024-04-25T11:22:57.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-25T11:22:57.525 INFO:teuthology.orchestra.run.smithi080.stdout:111669149759 2024-04-25T11:22:57.525 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-25T11:22:57.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:57 smithi196 ceph-mon[32659]: osdmap e79: 12 total, 12 up, 12 in 2024-04-25T11:22:57.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:22:57 smithi196 ceph-mon[32659]: pgmap v310: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-04-25T11:22:57.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:57 smithi080 ceph-mon[29126]: osdmap e79: 12 total, 12 up, 12 in 2024-04-25T11:22:57.716 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:22:57 smithi080 ceph-mon[29126]: pgmap v310: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-04-25T11:22:57.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:57 smithi082 ceph-mon[32440]: osdmap e79: 12 total, 12 up, 12 in 2024-04-25T11:22:57.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:22:57 smithi082 ceph-mon[32440]: pgmap v310: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 -- 172.21.15.80:0/2361096934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 msgr2=0x7f04141037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 --2- 172.21.15.80:0/2361096934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 0x7f04141037a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04040099c0 tx=0x7f0404009cd0 comp rx=0 tx=0).stop 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 -- 172.21.15.80:0/2361096934 shutdown_connections 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 --2- 172.21.15.80:0/2361096934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0414108610 0x7f041410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 --2- 172.21.15.80:0/2361096934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 0x7f04141037a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 --2- 172.21.15.80:0/2361096934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0414107cc0 0x7f04141080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 -- 172.21.15.80:0/2361096934 >> 172.21.15.80:0/2361096934 conn(0x7f04140fec90 msgr2=0x7f04141010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 -- 172.21.15.80:0/2361096934 shutdown_connections 2024-04-25T11:22:57.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.996+0000 7f041a87a700 1 -- 172.21.15.80:0/2361096934 wait complete. 2024-04-25T11:22:57.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.997+0000 7f041a87a700 1 Processor -- start 2024-04-25T11:22:57.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.997+0000 7f041a87a700 1 -- start start 2024-04-25T11:22:57.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f041a87a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 0x7f041419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:57.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f041a87a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0414107cc0 0x7f041419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f041a87a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0414108610 0x7f0414199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f041a87a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0414113300 con 0x7f0414103390 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f041a87a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0414113180 con 0x7f0414108610 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f041a87a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0414113480 con 0x7f0414107cc0 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 0x7f041419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 0x7f041419f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34398/0 (socket says 172.21.15.80:34398) 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 -- 172.21.15.80:0/2131854012 learned_addr learned my addr 172.21.15.80:0/2131854012 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f04137fe700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0414107cc0 0x7f041419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 -- 172.21.15.80:0/2131854012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0414107cc0 msgr2=0x7f041419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0414107cc0 0x7f041419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 -- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0414108610 msgr2=0x7f0414199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0418e17700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0414108610 0x7f0414199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:57.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0414108610 0x7f0414199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 -- 172.21.15.80:0/2131854012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041419a170 con 0x7f0414103390 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0418e17700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0414108610 0x7f0414199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f0413fff700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 0x7f041419f8a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0404009990 tx=0x7f04040047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.998+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404027070 con 0x7f0414103390 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.999+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041419a400 con 0x7f0414103390 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.999+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0404004190 con 0x7f0414103390 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.999+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04141a6730 con 0x7f0414103390 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.999+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040400f460 con 0x7f0414103390 2024-04-25T11:22:57.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:57.999+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f041406b7b0 con 0x7f0414103390 2024-04-25T11:22:57.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.001+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f040402a070 con 0x7f0414103390 2024-04-25T11:22:57.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f04117fa700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f03fc0afc90 0x7f03fc0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:57.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f04137fe700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f03fc0afc90 0x7f03fc0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:57.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f04040e0570 con 0x7f0414103390 2024-04-25T11:22:57.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f04117fa700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] conn(0x7f03fc0b98a0 0x7f03fc0bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:22:57.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 --> [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03fc0bc460 con 0x7f03fc0b98a0 2024-04-25T11:22:57.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f04040e09c0 con 0x7f0414103390 2024-04-25T11:22:57.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f04137fe700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f03fc0afc90 0x7f03fc0b21a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0408006fd0 tx=0x7f0408008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:57.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.002+0000 7f0418e17700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] conn(0x7f03fc0b98a0 0x7f03fc0bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:22:57.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.003+0000 7f0418e17700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] conn(0x7f03fc0b98a0 0x7f03fc0bbd90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:22:57.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.004+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== osd.10 v2:172.21.15.82:6824/247644031 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03fc0bc460 con 0x7f03fc0b98a0 2024-04-25T11:22:58.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.020+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 --> [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f041406bbe0 con 0x7f03fc0b98a0 2024-04-25T11:22:58.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f04117fa700 1 -- 172.21.15.80:0/2131854012 <== osd.10 v2:172.21.15.82:6824/247644031 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f041406bbe0 con 0x7f03fc0b98a0 2024-04-25T11:22:58.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] conn(0x7f03fc0b98a0 msgr2=0x7f03fc0bbd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] conn(0x7f03fc0b98a0 0x7f03fc0bbd90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f03fc0afc90 msgr2=0x7f03fc0b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f03fc0afc90 0x7f03fc0b21a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0408006fd0 tx=0x7f0408008040 comp rx=0 tx=0).stop 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 msgr2=0x7f041419f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 --2- 172.21.15.80:0/2131854012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0414103390 0x7f041419f8a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0404009990 tx=0x7f04040047b0 comp rx=0 tx=0).stop 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f0418e17700 1 -- 172.21.15.80:0/2131854012 reap_dead start 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 shutdown_connections 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 >> 172.21.15.80:0/2131854012 conn(0x7f04140fec90 msgr2=0x7f04141010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 shutdown_connections 2024-04-25T11:22:58.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:22:58.021+0000 7f041a87a700 1 -- 172.21.15.80:0/2131854012 wait complete. 2024-04-25T11:22:58.388 INFO:teuthology.orchestra.run.smithi080.stdout:309237645335 2024-04-25T11:22:58.389 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-25T11:22:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:22:59.325 INFO:teuthology.orchestra.run.smithi080.stdout:283467841564 2024-04-25T11:22:59.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-25T11:23:00.348 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:00 smithi080 ceph-mon[29126]: pgmap v311: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-04-25T11:23:00.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:00 smithi196 ceph-mon[32659]: pgmap v311: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-04-25T11:23:00.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:00 smithi082 ceph-mon[32440]: pgmap v311: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 -- 172.21.15.80:0/3505224606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0108dc0 msgr2=0x7f92e01091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 --2- 172.21.15.80:0/3505224606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0108dc0 0x7f92e01091d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92d00099c0 tx=0x7f92d0009cd0 comp rx=0 tx=0).stop 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 -- 172.21.15.80:0/3505224606 shutdown_connections 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 --2- 172.21.15.80:0/3505224606 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92e0109710 0x7f92e0111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 --2- 172.21.15.80:0/3505224606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92e0104490 0x7f92e01048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 --2- 172.21.15.80:0/3505224606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0108dc0 0x7f92e01091d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 -- 172.21.15.80:0/3505224606 >> 172.21.15.80:0/3505224606 conn(0x7f92e00ffda0 msgr2=0x7f92e01021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 -- 172.21.15.80:0/3505224606 shutdown_connections 2024-04-25T11:23:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.054+0000 7f92e73fd700 1 -- 172.21.15.80:0/3505224606 wait complete. 2024-04-25T11:23:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 Processor -- start 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 -- start start 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0104490 0x7f92e019ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92e0108dc0 0x7f92e019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92e0109710 0x7f92e019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0114390 con 0x7f92e0104490 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0114210 con 0x7f92e0109710 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e73fd700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0114510 con 0x7f92e0108dc0 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0104490 0x7f92e019ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0104490 0x7f92e019ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34418/0 (socket says 172.21.15.80:34418) 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 -- 172.21.15.80:0/1487998391 learned_addr learned my addr 172.21.15.80:0/1487998391 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e4998700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92e0108dc0 0x7f92e019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 -- 172.21.15.80:0/1487998391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92e0108dc0 msgr2=0x7f92e019b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92e0108dc0 0x7f92e019b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 -- 172.21.15.80:0/1487998391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92e0109710 msgr2=0x7f92e019f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e599a700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92e0109710 0x7f92e019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92e0109710 0x7f92e019f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 -- 172.21.15.80:0/1487998391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e019fbf0 con 0x7f92e0104490 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e599a700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92e0109710 0x7f92e019f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.055+0000 7f92e5199700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0104490 0x7f92e019ad20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00d950 tx=0x7f92dc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.056+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc016070 con 0x7f92e0104490 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.056+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e019fee0 con 0x7f92e0104490 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.056+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92dc010460 con 0x7f92e0104490 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.056+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00f620 con 0x7f92e0104490 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.056+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e01a7800 con 0x7f92e0104490 2024-04-25T11:23:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.057+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92e0063e20 con 0x7f92e0104490 2024-04-25T11:23:01.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.058+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f92dc019070 con 0x7f92e0104490 2024-04-25T11:23:01.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92d67fc700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92cc0afc10 0x7f92cc0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92e4998700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92cc0afc10 0x7f92cc0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f92dc0df0b0 con 0x7f92e0104490 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92d67fc700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] conn(0x7f92cc0b9820 0x7f92cc0bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 --> [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92dc020e70 con 0x7f92cc0b9820 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f92dc0df500 con 0x7f92e0104490 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92e599a700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] conn(0x7f92cc0b9820 0x7f92cc0bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92e4998700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92cc0afc10 0x7f92cc0b2120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f92d0000c00 tx=0x7f92d001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.059+0000 7f92e599a700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] conn(0x7f92cc0b9820 0x7f92cc0bbd10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:01.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.060+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== osd.0 v2:172.21.15.80:6802/1124765688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92dc020e70 con 0x7f92cc0b9820 2024-04-25T11:23:01.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 --> [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92e0064220 con 0x7f92cc0b9820 2024-04-25T11:23:01.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92d67fc700 1 -- 172.21.15.80:0/1487998391 <== osd.0 v2:172.21.15.80:6802/1124765688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f92e0064220 con 0x7f92cc0b9820 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] conn(0x7f92cc0b9820 msgr2=0x7f92cc0bbd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] conn(0x7f92cc0b9820 0x7f92cc0bbd10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92cc0afc10 msgr2=0x7f92cc0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f92cc0afc10 0x7f92cc0b2120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f92d0000c00 tx=0x7f92d001a040 comp rx=0 tx=0).stop 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0104490 msgr2=0x7f92e019ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 --2- 172.21.15.80:0/1487998391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92e0104490 0x7f92e019ad20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00d950 tx=0x7f92dc00dd10 comp rx=0 tx=0).stop 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e599a700 1 -- 172.21.15.80:0/1487998391 reap_dead start 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 shutdown_connections 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 >> 172.21.15.80:0/1487998391 conn(0x7f92e00ffda0 msgr2=0x7f92e010a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 shutdown_connections 2024-04-25T11:23:01.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:01.077+0000 7f92e73fd700 1 -- 172.21.15.80:0/1487998391 wait complete. 2024-04-25T11:23:01.780 INFO:teuthology.orchestra.run.smithi080.stdout:34359738449 2024-04-25T11:23:01.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-25T11:23:02.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.313+0000 7fea971c9700 1 -- 172.21.15.80:0/1369228352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea90102870 msgr2=0x7fea90102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:02.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.313+0000 7fea971c9700 1 --2- 172.21.15.80:0/1369228352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea90102870 0x7fea90102c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00aaa0 tx=0x7fea7c00adb0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.313+0000 7fea971c9700 1 -- 172.21.15.80:0/1369228352 shutdown_connections 2024-04-25T11:23:02.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.313+0000 7fea971c9700 1 --2- 172.21.15.80:0/1369228352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea901031c0 0x7fea9010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.313+0000 7fea971c9700 1 --2- 172.21.15.80:0/1369228352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea901088a0 0x7fea90108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.313+0000 7fea971c9700 1 --2- 172.21.15.80:0/1369228352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea90102870 0x7fea90102c80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.313+0000 7fea971c9700 1 -- 172.21.15.80:0/1369228352 >> 172.21.15.80:0/1369228352 conn(0x7fea900fe370 msgr2=0x7fea901007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.314+0000 7fea971c9700 1 -- 172.21.15.80:0/1369228352 shutdown_connections 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.314+0000 7fea971c9700 1 -- 172.21.15.80:0/1369228352 wait complete. 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.314+0000 7fea971c9700 1 Processor -- start 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.314+0000 7fea971c9700 1 -- start start 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea971c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea90102870 0x7fea9019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea971c9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea901031c0 0x7fea9019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea971c9700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea901088a0 0x7fea9019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea971c9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea90112210 con 0x7fea901031c0 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea971c9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea90112090 con 0x7fea90102870 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea971c9700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fea90112390 con 0x7fea901088a0 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea901031c0 0x7fea9019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea901031c0 0x7fea9019b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34422/0 (socket says 172.21.15.80:34422) 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 -- 172.21.15.80:0/3302620338 learned_addr learned my addr 172.21.15.80:0/3302620338 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea95766700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea901088a0 0x7fea9019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea94f65700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea90102870 0x7fea9019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 -- 172.21.15.80:0/3302620338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea901088a0 msgr2=0x7fea9019f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea901088a0 0x7fea9019f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 -- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea90102870 msgr2=0x7fea9019ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea90102870 0x7fea9019ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 -- 172.21.15.80:0/3302620338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9019fcb0 con 0x7fea901031c0 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea94f65700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea90102870 0x7fea9019ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8ffff700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea901031c0 0x7fea9019b380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea7c003a70 tx=0x7fea7c003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c023030 con 0x7fea901031c0 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea7c004830 con 0x7fea901031c0 2024-04-25T11:23:02.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9019ff40 con 0x7fea901031c0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.315+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0053f0 con 0x7fea901031c0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.316+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea901a0420 con 0x7fea901031c0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.316+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea90063da0 con 0x7fea901031c0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.318+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fea7c026070 con 0x7fea901031c0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea8dffb700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fea800afc10 0x7fea800b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea94f65700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fea800afc10 0x7fea800b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fea7c0e0cf0 con 0x7fea901031c0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea8dffb700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] conn(0x7fea800b9820 0x7fea800bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 --> [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea7c00c1c0 con 0x7fea800b9820 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fea7c0e1140 con 0x7fea901031c0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea94f65700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fea800afc10 0x7fea800b2120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fea901039b0 tx=0x7fea84008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.319+0000 7fea95766700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] conn(0x7fea800b9820 0x7fea800bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.320+0000 7fea95766700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] conn(0x7fea800b9820 0x7fea800bbd10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:02.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.321+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== osd.7 v2:172.21.15.82:6816/2941501012 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea7c00c1c0 con 0x7fea800b9820 2024-04-25T11:23:02.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.337+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 --> [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fea900641a0 con 0x7fea800b9820 2024-04-25T11:23:02.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.337+0000 7fea8dffb700 1 -- 172.21.15.80:0/3302620338 <== osd.7 v2:172.21.15.82:6816/2941501012 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fea900641a0 con 0x7fea800b9820 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.337+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] conn(0x7fea800b9820 msgr2=0x7fea800bbd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.337+0000 7fea971c9700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] conn(0x7fea800b9820 0x7fea800bbd10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fea800afc10 msgr2=0x7fea800b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fea800afc10 0x7fea800b2120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fea901039b0 tx=0x7fea84008040 comp rx=0 tx=0).stop 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea901031c0 msgr2=0x7fea9019b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 --2- 172.21.15.80:0/3302620338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea901031c0 0x7fea9019b380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea7c003a70 tx=0x7fea7c003aa0 comp rx=0 tx=0).stop 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea95766700 1 -- 172.21.15.80:0/3302620338 reap_dead start 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 shutdown_connections 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 >> 172.21.15.80:0/3302620338 conn(0x7fea900fe370 msgr2=0x7fea90105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:02.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 shutdown_connections 2024-04-25T11:23:02.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:02.338+0000 7fea971c9700 1 -- 172.21.15.80:0/3302620338 wait complete. 2024-04-25T11:23:02.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:02 smithi080 ceph-mon[29126]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 75 B/s, 0 objects/s recovering 2024-04-25T11:23:02.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:02 smithi196 ceph-mon[32659]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 75 B/s, 0 objects/s recovering 2024-04-25T11:23:02.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:02 smithi082 ceph-mon[32440]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 75 B/s, 0 objects/s recovering 2024-04-25T11:23:03.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 -- 172.21.15.80:0/656495580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41080d0 msgr2=0x7f21f41084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:03.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/656495580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41080d0 0x7f21f41084e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009990 tx=0x7f21f0009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 -- 172.21.15.80:0/656495580 shutdown_connections 2024-04-25T11:23:03.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/656495580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f4104110 0x7f21f410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/656495580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41080d0 0x7f21f41084e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/656495580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f41037c0 0x7f21f4103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 -- 172.21.15.80:0/656495580 >> 172.21.15.80:0/656495580 conn(0x7f21f40fe5c0 msgr2=0x7f21f41009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 -- 172.21.15.80:0/656495580 shutdown_connections 2024-04-25T11:23:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 -- 172.21.15.80:0/656495580 wait complete. 2024-04-25T11:23:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 Processor -- start 2024-04-25T11:23:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.103+0000 7f21fbe4c700 1 -- start start 2024-04-25T11:23:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21fbe4c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41037c0 0x7f21f4199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21fbe4c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f4104110 0x7f21f419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21fbe4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f41080d0 0x7f21f419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21fbe4c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4113330 con 0x7f21f41037c0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21fbe4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41131b0 con 0x7f21f41080d0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21fbe4c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41134b0 con 0x7f21f4104110 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41037c0 0x7f21f4199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41037c0 0x7f21f4199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34444/0 (socket says 172.21.15.80:34444) 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 -- 172.21.15.80:0/1576907052 learned_addr learned my addr 172.21.15.80:0/1576907052 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f93e7700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f4104110 0x7f21f419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21fa3e9700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f41080d0 0x7f21f419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 -- 172.21.15.80:0/1576907052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f4104110 msgr2=0x7f21f419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f4104110 0x7f21f419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 -- 172.21.15.80:0/1576907052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f41080d0 msgr2=0x7f21f419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f41080d0 0x7f21f419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 -- 172.21.15.80:0/1576907052 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f419ec10 con 0x7f21f41037c0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21f9be8700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41037c0 0x7f21f4199d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21f0006010 tx=0x7f21f0003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.104+0000 7f21eaffd700 1 -- 172.21.15.80:0/1576907052 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0027070 con 0x7f21f41037c0 2024-04-25T11:23:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.105+0000 7f21eaffd700 1 -- 172.21.15.80:0/1576907052 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21f0004110 con 0x7f21f41037c0 2024-04-25T11:23:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.105+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f419eea0 con 0x7f21f41037c0 2024-04-25T11:23:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.105+0000 7f21eaffd700 1 -- 172.21.15.80:0/1576907052 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0022e60 con 0x7f21f41037c0 2024-04-25T11:23:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.105+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f41026b0 con 0x7f21f41037c0 2024-04-25T11:23:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.105+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f41049e0 con 0x7f21f41037c0 2024-04-25T11:23:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.107+0000 7f21eaffd700 1 -- 172.21.15.80:0/1576907052 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f21f002a070 con 0x7f21f41037c0 2024-04-25T11:23:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.108+0000 7f21eaffd700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21e00afc10 0x7f21e00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.108+0000 7f21f93e7700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21e00afc10 0x7f21e00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.108+0000 7f21eaffd700 1 -- 172.21.15.80:0/1576907052 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f21f00e07b0 con 0x7f21f41037c0 2024-04-25T11:23:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.109+0000 7f21f93e7700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21e00afc10 0x7f21e00b2120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f21e4006fd0 tx=0x7f21e4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.112+0000 7f21eaffd700 1 -- 172.21.15.80:0/1576907052 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f21f0031070 con 0x7f21f41037c0 2024-04-25T11:23:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:03.128 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:03.134 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:03.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.343+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f21f419b0a0 con 0x7f21f41037c0 2024-04-25T11:23:03.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.344+0000 7f21eaffd700 1 -- 172.21.15.80:0/1576907052 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f21f0013070 con 0x7f21f41037c0 2024-04-25T11:23:03.339 INFO:teuthology.orchestra.run.smithi080.stdout:261993005090 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21e00afc10 msgr2=0x7f21e00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21e00afc10 0x7f21e00b2120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f21e4006fd0 tx=0x7f21e4008040 comp rx=0 tx=0).stop 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41037c0 msgr2=0x7f21f4199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41037c0 0x7f21f4199d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21f0006010 tx=0x7f21f0003730 comp rx=0 tx=0).stop 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 shutdown_connections 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21e00afc10 0x7f21e00b2120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f41080d0 0x7f21f419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21f41037c0 0x7f21f4199d40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 --2- 172.21.15.80:0/1576907052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21f4104110 0x7f21f419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:03.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 >> 172.21.15.80:0/1576907052 conn(0x7f21f40fe5c0 msgr2=0x7f21f4109560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:03.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 shutdown_connections 2024-04-25T11:23:03.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:03.346+0000 7f21fbe4c700 1 -- 172.21.15.80:0/1576907052 wait complete. 2024-04-25T11:23:03.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:03 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1576907052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T11:23:03.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:03 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1576907052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T11:23:03.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:03 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1576907052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T11:23:04.506 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:04 smithi080 ceph-mon[29126]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 75 B/s, 1 objects/s recovering 2024-04-25T11:23:04.539 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005086 got 261993005090 for osd.9 2024-04-25T11:23:04.539 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:04.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:04 smithi196 ceph-mon[32659]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 75 B/s, 1 objects/s recovering 2024-04-25T11:23:04.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:04 smithi082 ceph-mon[32440]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 75 B/s, 1 objects/s recovering 2024-04-25T11:23:06.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:06 smithi080 ceph-mon[29126]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 60 B/s, 0 objects/s recovering 2024-04-25T11:23:06.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:06 smithi196 ceph-mon[32659]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 60 B/s, 0 objects/s recovering 2024-04-25T11:23:06.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:06 smithi082 ceph-mon[32440]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 60 B/s, 0 objects/s recovering 2024-04-25T11:23:07.712 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:08.188 INFO:teuthology.orchestra.run.smithi080.stdout:206158430253 2024-04-25T11:23:08.188 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-25T11:23:08.575 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:08 smithi080 ceph-mon[29126]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 55 B/s, 0 objects/s recovering 2024-04-25T11:23:08.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:08 smithi196 ceph-mon[32659]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 55 B/s, 0 objects/s recovering 2024-04-25T11:23:08.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:08 smithi082 ceph-mon[32440]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 55 B/s, 0 objects/s recovering 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1224689223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db01085e0 msgr2=0x7f8db010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1224689223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db01085e0 0x7f8db010ff40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8d980099c0 tx=0x7f8d98009cd0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1224689223 shutdown_connections 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1224689223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db01085e0 0x7f8db010ff40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1224689223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8db0103360 0x7f8db0103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1224689223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db0107c90 0x7f8db01080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1224689223 >> 172.21.15.80:0/1224689223 conn(0x7f8db00fec90 msgr2=0x7f8db01010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1224689223 shutdown_connections 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.538+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1224689223 wait complete. 2024-04-25T11:23:09.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 Processor -- start 2024-04-25T11:23:09.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 -- start start 2024-04-25T11:23:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db0103360 0x7f8db00ff170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8db0107c90 0x7f8db00ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db01085e0 0x7f8db00ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0113210 con 0x7f8db0103360 2024-04-25T11:23:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0113090 con 0x7f8db01085e0 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.539+0000 7f8db6fb7700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0113390 con 0x7f8db0107c90 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db0103360 0x7f8db00ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db0103360 0x7f8db00ff170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39478/0 (socket says 172.21.15.80:39478) 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 -- 172.21.15.80:0/1781472191 learned_addr learned my addr 172.21.15.80:0/1781472191 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db5554700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db01085e0 0x7f8db00ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8daffff700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8db0107c90 0x7f8db00ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 -- 172.21.15.80:0/1781472191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8db0107c90 msgr2=0x7f8db00ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8db0107c90 0x7f8db00ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 -- 172.21.15.80:0/1781472191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db01085e0 msgr2=0x7f8db00ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db01085e0 0x7f8db00ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 -- 172.21.15.80:0/1781472191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db01a9010 con 0x7f8db0103360 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db5554700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db01085e0 0x7f8db00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:23:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db4d53700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db0103360 0x7f8db00ff170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8da800ada0 tx=0x7f8da800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8dadffb700 1 -- 172.21.15.80:0/1781472191 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8017020 con 0x7f8db0103360 2024-04-25T11:23:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db01a9300 con 0x7f8db0103360 2024-04-25T11:23:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8dadffb700 1 -- 172.21.15.80:0/1781472191 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da800cd80 con 0x7f8db0103360 2024-04-25T11:23:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.540+0000 7f8dadffb700 1 -- 172.21.15.80:0/1781472191 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80052a0 con 0x7f8db0103360 2024-04-25T11:23:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.541+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db01a9840 con 0x7f8db0103360 2024-04-25T11:23:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.541+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db0051190 con 0x7f8db0103360 2024-04-25T11:23:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.543+0000 7f8dadffb700 1 -- 172.21.15.80:0/1781472191 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f8da800c8d0 con 0x7f8db0103360 2024-04-25T11:23:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.543+0000 7f8dadffb700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f8d9c0afc10 0x7f8d9c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.544+0000 7f8daffff700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f8d9c0afc10 0x7f8d9c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.544+0000 7f8dadffb700 1 -- 172.21.15.80:0/1781472191 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f8da80deac0 con 0x7f8db0103360 2024-04-25T11:23:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.544+0000 7f8daffff700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f8d9c0afc10 0x7f8d9c0b2120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8db0109760 tx=0x7f8da0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:09.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.547+0000 7f8dadffb700 1 -- 172.21.15.80:0/1781472191 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8da8021020 con 0x7f8db0103360 2024-04-25T11:23:09.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.752+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8db002e510 con 0x7f8db0103360 2024-04-25T11:23:09.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.752+0000 7f8dadffb700 1 -- 172.21.15.80:0/1781472191 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8da80a75c0 con 0x7f8db0103360 2024-04-25T11:23:09.748 INFO:teuthology.orchestra.run.smithi080.stdout:77309411401 2024-04-25T11:23:09.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.754+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f8d9c0afc10 msgr2=0x7f8d9c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f8d9c0afc10 0x7f8d9c0b2120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8db0109760 tx=0x7f8da0009260 comp rx=0 tx=0).stop 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db0103360 msgr2=0x7f8db00ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db0103360 0x7f8db00ff170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8da800ada0 tx=0x7f8da800c330 comp rx=0 tx=0).stop 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 shutdown_connections 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f8d9c0afc10 0x7f8d9c0b2120 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db01085e0 0x7f8db00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8db0103360 0x7f8db00ff170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 --2- 172.21.15.80:0/1781472191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8db0107c90 0x7f8db00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 >> 172.21.15.80:0/1781472191 conn(0x7f8db00fec90 msgr2=0x7f8db006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 shutdown_connections 2024-04-25T11:23:09.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:09.755+0000 7f8db6fb7700 1 -- 172.21.15.80:0/1781472191 wait complete. 2024-04-25T11:23:10.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:10 smithi196 ceph-mon[32659]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T11:23:10.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:10 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1781472191' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T11:23:10.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:10 smithi082 ceph-mon[32440]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T11:23:10.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:10 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1781472191' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T11:23:10.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:10 smithi080 ceph-mon[29126]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T11:23:10.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:10 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1781472191' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T11:23:10.830 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:10.830 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:10.831 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:11.031 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 -- 172.21.15.80:0/2492476662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc650108890 msgr2=0x7fc650108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:11.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 --2- 172.21.15.80:0/2492476662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc650108890 0x7fc650108ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009990 tx=0x7fc64c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 -- 172.21.15.80:0/2492476662 shutdown_connections 2024-04-25T11:23:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 --2- 172.21.15.80:0/2492476662 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6501031b0 0x7fc65010f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 --2- 172.21.15.80:0/2492476662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc650108890 0x7fc650108ca0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 --2- 172.21.15.80:0/2492476662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc650102860 0x7fc650102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 -- 172.21.15.80:0/2492476662 >> 172.21.15.80:0/2492476662 conn(0x7fc6500fe3f0 msgr2=0x7fc650100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 -- 172.21.15.80:0/2492476662 shutdown_connections 2024-04-25T11:23:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.052+0000 7fc6580ae700 1 -- 172.21.15.80:0/2492476662 wait complete. 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.054+0000 7fc6580ae700 1 Processor -- start 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.054+0000 7fc6580ae700 1 -- start start 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.054+0000 7fc6580ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc650102860 0x7fc6501a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.054+0000 7fc6580ae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6501031b0 0x7fc6501a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc6580ae700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc650108890 0x7fc65019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc6580ae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc650114390 con 0x7fc6501031b0 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc6580ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc650114210 con 0x7fc650102860 2024-04-25T11:23:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc6580ae700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc650114510 con 0x7fc650108890 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc655649700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6501031b0 0x7fc6501a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc65664b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc650108890 0x7fc65019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc655649700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6501031b0 0x7fc6501a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39510/0 (socket says 172.21.15.80:39510) 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.055+0000 7fc655649700 1 -- 172.21.15.80:0/4267683453 learned_addr learned my addr 172.21.15.80:0/4267683453 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.056+0000 7fc655e4a700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc650102860 0x7fc6501a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.056+0000 7fc655649700 1 -- 172.21.15.80:0/4267683453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc650108890 msgr2=0x7fc65019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.056+0000 7fc655649700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc650108890 0x7fc65019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.056+0000 7fc655649700 1 -- 172.21.15.80:0/4267683453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc650102860 msgr2=0x7fc6501a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.056+0000 7fc655649700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc650102860 0x7fc6501a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.056+0000 7fc655649700 1 -- 172.21.15.80:0/4267683453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65019afb0 con 0x7fc6501031b0 2024-04-25T11:23:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.056+0000 7fc655649700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6501031b0 0x7fc6501a0c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c9e0 tx=0x7fc64000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.057+0000 7fc646ffd700 1 -- 172.21.15.80:0/4267683453 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640007aa0 con 0x7fc6501031b0 2024-04-25T11:23:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.057+0000 7fc646ffd700 1 -- 172.21.15.80:0/4267683453 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc640007c40 con 0x7fc6501031b0 2024-04-25T11:23:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.057+0000 7fc646ffd700 1 -- 172.21.15.80:0/4267683453 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640018660 con 0x7fc6501031b0 2024-04-25T11:23:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.057+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65019b2a0 con 0x7fc6501031b0 2024-04-25T11:23:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.057+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65019b790 con 0x7fc6501031b0 2024-04-25T11:23:11.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.058+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc650051190 con 0x7fc6501031b0 2024-04-25T11:23:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.062+0000 7fc646ffd700 1 -- 172.21.15.80:0/4267683453 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fc640018800 con 0x7fc6501031b0 2024-04-25T11:23:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.063+0000 7fc646ffd700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc63c0afd10 0x7fc63c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.064+0000 7fc655e4a700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc63c0afd10 0x7fc63c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.064+0000 7fc646ffd700 1 -- 172.21.15.80:0/4267683453 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fc6400def80 con 0x7fc6501031b0 2024-04-25T11:23:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.064+0000 7fc655e4a700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc63c0afd10 0x7fc63c0b2220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009350 tx=0x7fc64c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.068+0000 7fc646ffd700 1 -- 172.21.15.80:0/4267683453 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc640053ff0 con 0x7fc6501031b0 2024-04-25T11:23:11.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.273+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc65019be50 con 0x7fc6501031b0 2024-04-25T11:23:11.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.274+0000 7fc646ffd700 1 -- 172.21.15.80:0/4267683453 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc640014030 con 0x7fc6501031b0 2024-04-25T11:23:11.269 INFO:teuthology.orchestra.run.smithi080.stdout:137438953535 2024-04-25T11:23:11.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc63c0afd10 msgr2=0x7fc63c0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:11.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc63c0afd10 0x7fc63c0b2220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009350 tx=0x7fc64c005fd0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6501031b0 msgr2=0x7fc6501a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:11.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6501031b0 0x7fc6501a0c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c9e0 tx=0x7fc64000cda0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 shutdown_connections 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc63c0afd10 0x7fc63c0b2220 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc650108890 0x7fc65019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc650102860 0x7fc6501a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 --2- 172.21.15.80:0/4267683453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6501031b0 0x7fc6501a0c40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 >> 172.21.15.80:0/4267683453 conn(0x7fc6500fe3f0 msgr2=0x7fc650109750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 shutdown_connections 2024-04-25T11:23:11.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:11.276+0000 7fc6580ae700 1 -- 172.21.15.80:0/4267683453 wait complete. 2024-04-25T11:23:11.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:11 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4267683453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T11:23:11.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:11 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4267683453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T11:23:11.741 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411397 got 77309411401 for osd.2 2024-04-25T11:23:11.741 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:11.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:11 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4267683453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T11:23:12.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 -- 172.21.15.80:0/45556788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35010e590 msgr2=0x7fc350110a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:12.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 --2- 172.21.15.80:0/45556788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35010e590 0x7fc350110a70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc348009990 tx=0x7fc348009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 -- 172.21.15.80:0/45556788 shutdown_connections 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 --2- 172.21.15.80:0/45556788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35010e590 0x7fc350110a70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 --2- 172.21.15.80:0/45556788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc350105120 0x7fc350105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 --2- 172.21.15.80:0/45556788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc350105a70 0x7fc35010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 -- 172.21.15.80:0/45556788 >> 172.21.15.80:0/45556788 conn(0x7fc3500feb60 msgr2=0x7fc350100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 -- 172.21.15.80:0/45556788 shutdown_connections 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.484+0000 7fc34f59e700 1 -- 172.21.15.80:0/45556788 wait complete. 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 Processor -- start 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 -- start start 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc350105120 0x7fc3501a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc350105a70 0x7fc3501a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35010e590 0x7fc35019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501140f0 con 0x7fc350105a70 2024-04-25T11:23:12.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc350113f70 con 0x7fc35010e590 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34f59e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114270 con 0x7fc350105120 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc350105a70 0x7fc3501a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc350105a70 0x7fc3501a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39526/0 (socket says 172.21.15.80:39526) 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34e59c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc350105120 0x7fc3501a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34dd9b700 1 -- 172.21.15.80:0/1496547457 learned_addr learned my addr 172.21.15.80:0/1496547457 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.485+0000 7fc34ed9d700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35010e590 0x7fc35019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34dd9b700 1 -- 172.21.15.80:0/1496547457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc350105120 msgr2=0x7fc3501a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34dd9b700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc350105120 0x7fc3501a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34dd9b700 1 -- 172.21.15.80:0/1496547457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35010e590 msgr2=0x7fc35019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34dd9b700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35010e590 0x7fc35019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34dd9b700 1 -- 172.21.15.80:0/1496547457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35019af60 con 0x7fc350105a70 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34dd9b700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc350105a70 0x7fc3501a0b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc34000ef10 tx=0x7fc34000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:12.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc3477fe700 1 -- 172.21.15.80:0/1496547457 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34000c9c0 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc3477fe700 1 -- 172.21.15.80:0/1496547457 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc340019070 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35019b1f0 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc3477fe700 1 -- 172.21.15.80:0/1496547457 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340014480 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.486+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3501a7450 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.487+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35006c820 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.488+0000 7fc3477fe700 1 -- 172.21.15.80:0/1496547457 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fc340012050 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.489+0000 7fc3477fe700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc33c0afc10 0x7fc33c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.489+0000 7fc34e59c700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc33c0afc10 0x7fc33c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.490+0000 7fc3477fe700 1 -- 172.21.15.80:0/1496547457 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fc3400df380 con 0x7fc350105a70 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.490+0000 7fc34e59c700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc33c0afc10 0x7fc33c0b2120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc35019bb60 tx=0x7fc338009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:12.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.493+0000 7fc3477fe700 1 -- 172.21.15.80:0/1496547457 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc340010040 con 0x7fc350105a70 2024-04-25T11:23:12.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:12 smithi080 ceph-mon[29126]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T11:23:12.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:12 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:23:12.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:12 smithi196 ceph-mon[32659]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T11:23:12.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:12 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:23:12.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.704+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc35002e510 con 0x7fc350105a70 2024-04-25T11:23:12.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.704+0000 7fc3477fe700 1 -- 172.21.15.80:0/1496547457 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3400a1e20 con 0x7fc350105a70 2024-04-25T11:23:12.699 INFO:teuthology.orchestra.run.smithi080.stdout:55834574926 2024-04-25T11:23:12.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.706+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc33c0afc10 msgr2=0x7fc33c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:12.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.706+0000 7fc34f59e700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc33c0afc10 0x7fc33c0b2120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc35019bb60 tx=0x7fc338009260 comp rx=0 tx=0).stop 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.706+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc350105a70 msgr2=0x7fc3501a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.706+0000 7fc34f59e700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc350105a70 0x7fc3501a0b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc34000ef10 tx=0x7fc34000c3a0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 shutdown_connections 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc33c0afc10 0x7fc33c0b2120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc35010e590 0x7fc35019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc350105120 0x7fc3501a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 --2- 172.21.15.80:0/1496547457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc350105a70 0x7fc3501a0b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 >> 172.21.15.80:0/1496547457 conn(0x7fc3500feb60 msgr2=0x7fc3500ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 shutdown_connections 2024-04-25T11:23:12.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:12.707+0000 7fc34f59e700 1 -- 172.21.15.80:0/1496547457 wait complete. 2024-04-25T11:23:12.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:12 smithi082 ceph-mon[32440]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T11:23:12.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:12 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:23:13.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1496547457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T11:23:13.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1496547457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T11:23:13.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1496547457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T11:23:14.021 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953530 got 137438953535 for osd.4 2024-04-25T11:23:14.021 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:14.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:14 smithi080 ceph-mon[29126]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T11:23:14.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:14 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:14 smithi196 ceph-mon[32659]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T11:23:14.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.692 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:14 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:14 smithi082 ceph-mon[32440]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T11:23:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:14.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:14 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:15.474 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:15 smithi080 ceph-mon[29126]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:15.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 -- 172.21.15.80:0/438278282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 msgr2=0x7f31d4109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 --2- 172.21.15.80:0/438278282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4109220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31c00099c0 tx=0x7f31c0009cd0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 -- 172.21.15.80:0/438278282 shutdown_connections 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 --2- 172.21.15.80:0/438278282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31d4109760 0x7f31d41110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 --2- 172.21.15.80:0/438278282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31d41029f0 0x7f31d4102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 --2- 172.21.15.80:0/438278282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4109220 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 -- 172.21.15.80:0/438278282 >> 172.21.15.80:0/438278282 conn(0x7f31d40fe3f0 msgr2=0x7f31d4100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 -- 172.21.15.80:0/438278282 shutdown_connections 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 -- 172.21.15.80:0/438278282 wait complete. 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.592+0000 7f31db06d700 1 Processor -- start 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31db06d700 1 -- start start 2024-04-25T11:23:15.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31db06d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31d41029f0 0x7f31d4103940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31db06d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31db06d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31d4109760 0x7f31d41043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31db06d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f31d41143e0 con 0x7f31d4108e10 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31db06d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4114260 con 0x7f31d41029f0 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31db06d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4114560 con 0x7f31d4109760 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4103e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39556/0 (socket says 172.21.15.80:39556) 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 -- 172.21.15.80:0/3274460962 learned_addr learned my addr 172.21.15.80:0/3274460962 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d8e09700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31d41029f0 0x7f31d4103940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d960a700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31d4109760 0x7f31d41043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 -- 172.21.15.80:0/3274460962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31d4109760 msgr2=0x7f31d41043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31d4109760 0x7f31d41043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 -- 172.21.15.80:0/3274460962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31d41029f0 msgr2=0x7f31d4103940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31d41029f0 0x7f31d4103940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 -- 172.21.15.80:0/3274460962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d41a9040 con 0x7f31d4108e10 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d8e09700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31d41029f0 0x7f31d4103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d3fff700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4103e80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009f50 tx=0x7f31c00037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.593+0000 7f31d1ffb700 1 -- 172.21.15.80:0/3274460962 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0027070 con 0x7f31d4108e10 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.594+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d41a92d0 con 0x7f31d4108e10 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.594+0000 7f31d1ffb700 1 -- 172.21.15.80:0/3274460962 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c0004140 con 0x7f31d4108e10 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.594+0000 7f31d1ffb700 1 -- 172.21.15.80:0/3274460962 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c000f460 con 0x7f31d4108e10 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.594+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d41a9780 con 0x7f31d4108e10 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.595+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d4051190 con 0x7f31d4108e10 2024-04-25T11:23:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.596+0000 7f31d1ffb700 1 -- 172.21.15.80:0/3274460962 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f31c002a070 con 0x7f31d4108e10 2024-04-25T11:23:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.597+0000 7f31d1ffb700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31c40afc10 0x7f31c40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.597+0000 7f31d8e09700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31c40afc10 0x7f31c40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.597+0000 7f31d1ffb700 1 -- 172.21.15.80:0/3274460962 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f31c00e0200 con 0x7f31d4108e10 2024-04-25T11:23:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.597+0000 7f31d8e09700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31c40afc10 0x7f31c40b2120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31d406bb00 tx=0x7f31c800a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.600+0000 7f31d1ffb700 1 -- 172.21.15.80:0/3274460962 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f31c0031080 con 0x7f31d4108e10 2024-04-25T11:23:15.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:15 smithi196 ceph-mon[32659]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:15.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:15 smithi082 ceph-mon[32440]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.806+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f31d402e510 con 0x7f31d4108e10 2024-04-25T11:23:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.807+0000 7f31d1ffb700 1 -- 172.21.15.80:0/3274460962 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f31c0013070 con 0x7f31d4108e10 2024-04-25T11:23:15.802 INFO:teuthology.orchestra.run.smithi080.stdout:158913790010 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31c40afc10 msgr2=0x7f31c40b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31c40afc10 0x7f31c40b2120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31d406bb00 tx=0x7f31c800a680 comp rx=0 tx=0).stop 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 msgr2=0x7f31d4103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4103e80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009f50 tx=0x7f31c00037c0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 shutdown_connections 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f31c40afc10 0x7f31c40b2120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31d4109760 0x7f31d41043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31d41029f0 0x7f31d4103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 --2- 172.21.15.80:0/3274460962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31d4108e10 0x7f31d4103e80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:15.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 >> 172.21.15.80:0/3274460962 conn(0x7f31d40fe3f0 msgr2=0x7f31d4108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:15.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 shutdown_connections 2024-04-25T11:23:15.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:15.809+0000 7f31db06d700 1 -- 172.21.15.80:0/3274460962 wait complete. 2024-04-25T11:23:16.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:16 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3274460962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T11:23:16.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:16 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3274460962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T11:23:16.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:16 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3274460962' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T11:23:17.477 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:17 smithi080 ceph-mon[29126]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:17.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 -- 172.21.15.80:0/3467405808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360108dc0 msgr2=0x7f83601091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 --2- 172.21.15.80:0/3467405808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360108dc0 0x7f83601091d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83500099c0 tx=0x7f8350009cd0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 -- 172.21.15.80:0/3467405808 shutdown_connections 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 --2- 172.21.15.80:0/3467405808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8360109710 0x7f8360111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 --2- 172.21.15.80:0/3467405808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8360104490 0x7f83601048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 --2- 172.21.15.80:0/3467405808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360108dc0 0x7f83601091d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 -- 172.21.15.80:0/3467405808 >> 172.21.15.80:0/3467405808 conn(0x7f83600ffda0 msgr2=0x7f83601021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 -- 172.21.15.80:0/3467405808 shutdown_connections 2024-04-25T11:23:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 -- 172.21.15.80:0/3467405808 wait complete. 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 Processor -- start 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.495+0000 7f83683fe700 1 -- start start 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83683fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360104490 0x7f836019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83683fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8360108dc0 0x7f836019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83683fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8360109710 0x7f836019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83683fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8360114410 con 0x7f8360104490 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83683fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8360114290 con 0x7f8360109710 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83683fe700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8360114590 con 0x7f8360108dc0 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360104490 0x7f836019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:17.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360104490 0x7f836019ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42052/0 (socket says 172.21.15.80:42052) 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 -- 172.21.15.80:0/976312290 learned_addr learned my addr 172.21.15.80:0/976312290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836699b700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8360109710 0x7f836019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f8365999700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8360108dc0 0x7f836019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 -- 172.21.15.80:0/976312290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8360108dc0 msgr2=0x7f836019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8360108dc0 0x7f836019b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 -- 172.21.15.80:0/976312290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8360109710 msgr2=0x7f836019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8360109710 0x7f836019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 -- 172.21.15.80:0/976312290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836019fcd0 con 0x7f8360104490 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836699b700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8360109710 0x7f836019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f836619a700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360104490 0x7f836019ae00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f835c00b530 tx=0x7f835c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83577fe700 1 -- 172.21.15.80:0/976312290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c015020 con 0x7f8360104490 2024-04-25T11:23:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836019ffc0 con 0x7f8360104490 2024-04-25T11:23:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83577fe700 1 -- 172.21.15.80:0/976312290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f835c011ce0 con 0x7f8360104490 2024-04-25T11:23:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.496+0000 7f83577fe700 1 -- 172.21.15.80:0/976312290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c010d20 con 0x7f8360104490 2024-04-25T11:23:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.497+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83601a78e0 con 0x7f8360104490 2024-04-25T11:23:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.498+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8360051190 con 0x7f8360104490 2024-04-25T11:23:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.499+0000 7f83577fe700 1 -- 172.21.15.80:0/976312290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f835c018020 con 0x7f8360104490 2024-04-25T11:23:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.499+0000 7f83577fe700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f834c0afc10 0x7f834c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.500+0000 7f8365999700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f834c0afc10 0x7f834c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.500+0000 7f83577fe700 1 -- 172.21.15.80:0/976312290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f835c0de540 con 0x7f8360104490 2024-04-25T11:23:17.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.500+0000 7f8365999700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f834c0afc10 0x7f834c0b2120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8350006010 tx=0x7f8350000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.504+0000 7f83577fe700 1 -- 172.21.15.80:0/976312290 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f835c01f020 con 0x7f8360104490 2024-04-25T11:23:17.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:17 smithi196 ceph-mon[32659]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:17.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.711+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f836019c160 con 0x7f8360104490 2024-04-25T11:23:17.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.712+0000 7f83577fe700 1 -- 172.21.15.80:0/976312290 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f835c0a70c0 con 0x7f8360104490 2024-04-25T11:23:17.706 INFO:teuthology.orchestra.run.smithi080.stdout:111669149764 2024-04-25T11:23:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f834c0afc10 msgr2=0x7f834c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f834c0afc10 0x7f834c0b2120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8350006010 tx=0x7f8350000bc0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360104490 msgr2=0x7f836019ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360104490 0x7f836019ae00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f835c00b530 tx=0x7f835c00b8f0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 shutdown_connections 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f834c0afc10 0x7f834c0b2120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8360109710 0x7f836019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8360104490 0x7f836019ae00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 --2- 172.21.15.80:0/976312290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8360108dc0 0x7f836019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 >> 172.21.15.80:0/976312290 conn(0x7f83600ffda0 msgr2=0x7f8360108560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 shutdown_connections 2024-04-25T11:23:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.714+0000 7f83683fe700 1 -- 172.21.15.80:0/976312290 wait complete. 2024-04-25T11:23:17.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:17 smithi082 ceph-mon[32440]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:18.084 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790002 got 158913790010 for osd.5 2024-04-25T11:23:18.085 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:18.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:18 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/976312290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T11:23:18.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:18 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1457866279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 -- 172.21.15.80:0/4277472922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 msgr2=0x7fe354111040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 --2- 172.21.15.80:0/4277472922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe354111040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00b0a0 tx=0x7fe34c00b3b0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 -- 172.21.15.80:0/4277472922 shutdown_connections 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 --2- 172.21.15.80:0/4277472922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe354111040 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 --2- 172.21.15.80:0/4277472922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3541091d0 0x7fe3541095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 --2- 172.21.15.80:0/4277472922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe354102660 0x7fe354102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 -- 172.21.15.80:0/4277472922 >> 172.21.15.80:0/4277472922 conn(0x7fe3540fe3b0 msgr2=0x7fe354100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:18.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 -- 172.21.15.80:0/4277472922 shutdown_connections 2024-04-25T11:23:18.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 -- 172.21.15.80:0/4277472922 wait complete. 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.628+0000 7fe359a20700 1 Processor -- start 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe359a20700 1 -- start start 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe359a20700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe354102660 0x7fe35419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe359a20700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe35419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe359a20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3541091d0 0x7fe35419f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe359a20700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe354114470 con 0x7fe354102fb0 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe359a20700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3541142f0 con 0x7fe3541091d0 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe359a20700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe3541145f0 con 0x7fe354102660 2024-04-25T11:23:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe35419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe35419b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42082/0 (socket says 172.21.15.80:42082) 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 -- 172.21.15.80:0/780605282 learned_addr learned my addr 172.21.15.80:0/780605282 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe352ffd700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe354102660 0x7fe35419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3537fe700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3541091d0 0x7fe35419f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 -- 172.21.15.80:0/780605282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe354102660 msgr2=0x7fe35419ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe354102660 0x7fe35419ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 -- 172.21.15.80:0/780605282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3541091d0 msgr2=0x7fe35419f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3541091d0 0x7fe35419f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.629+0000 7fe3527fc700 1 -- 172.21.15.80:0/780605282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35419fc30 con 0x7fe354102fb0 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.630+0000 7fe3527fc700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe35419b300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe34800e970 tx=0x7fe34800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.630+0000 7fe358a1e700 1 -- 172.21.15.80:0/780605282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348004a30 con 0x7fe354102fb0 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.630+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35419ff20 con 0x7fe354102fb0 2024-04-25T11:23:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.630+0000 7fe358a1e700 1 -- 172.21.15.80:0/780605282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe34800cc90 con 0x7fe354102fb0 2024-04-25T11:23:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.630+0000 7fe358a1e700 1 -- 172.21.15.80:0/780605282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348005610 con 0x7fe354102fb0 2024-04-25T11:23:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.630+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3541a7840 con 0x7fe354102fb0 2024-04-25T11:23:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.631+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe354051190 con 0x7fe354102fb0 2024-04-25T11:23:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.632+0000 7fe358a1e700 1 -- 172.21.15.80:0/780605282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fe34800c7e0 con 0x7fe354102fb0 2024-04-25T11:23:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.633+0000 7fe358a1e700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe33c0afc10 0x7fe33c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.633+0000 7fe352ffd700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe33c0afc10 0x7fe33c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.633+0000 7fe358a1e700 1 -- 172.21.15.80:0/780605282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fe3480df140 con 0x7fe354102fb0 2024-04-25T11:23:18.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.633+0000 7fe352ffd700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe33c0afc10 0x7fe33c0b2120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe35406c960 tx=0x7fe344009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:18.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.637+0000 7fe358a1e700 1 -- 172.21.15.80:0/780605282 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe348053ff0 con 0x7fe354102fb0 2024-04-25T11:23:18.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:18 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/976312290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T11:23:18.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:18 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1457866279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T11:23:18.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:18 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/976312290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T11:23:18.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:18 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1457866279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T11:23:18.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 -- 172.21.15.80:0/341364135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b50109730 msgr2=0x7f4b50111090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 --2- 172.21.15.80:0/341364135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b50109730 0x7f4b50111090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800b0d0 tx=0x7f4b4800b3e0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 -- 172.21.15.80:0/341364135 shutdown_connections 2024-04-25T11:23:18.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 --2- 172.21.15.80:0/341364135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b50109730 0x7f4b50111090 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 --2- 172.21.15.80:0/341364135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b501029c0 0x7f4b50102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 --2- 172.21.15.80:0/341364135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b50108de0 0x7f4b501091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 -- 172.21.15.80:0/341364135 >> 172.21.15.80:0/341364135 conn(0x7f4b500fe3f0 msgr2=0x7f4b50100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 -- 172.21.15.80:0/341364135 shutdown_connections 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.720+0000 7f4b561c0700 1 -- 172.21.15.80:0/341364135 wait complete. 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 Processor -- start 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 -- start start 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b501029c0 0x7f4b501a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b50108de0 0x7f4b501a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b50109730 0x7f4b5019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4b50114370 con 0x7f4b501029c0 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b501141f0 con 0x7f4b50108de0 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b561c0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4b501144f0 con 0x7f4b50109730 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b4f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b501029c0 0x7f4b501a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b4f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b501029c0 0x7f4b501a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42066/0 (socket says 172.21.15.80:42066) 2024-04-25T11:23:18.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b4f7fe700 1 -- 172.21.15.80:0/1457866279 learned_addr learned my addr 172.21.15.80:0/1457866279 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:18.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b4ffff700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b50109730 0x7f4b5019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.721+0000 7f4b4effd700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b50108de0 0x7f4b501a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.832 INFO:teuthology.orchestra.run.smithi080.stdout:283467841568 2024-04-25T11:23:18.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4f7fe700 1 -- 172.21.15.80:0/1457866279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b50109730 msgr2=0x7f4b5019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4f7fe700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b50109730 0x7f4b5019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4f7fe700 1 -- 172.21.15.80:0/1457866279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b50108de0 msgr2=0x7f4b501a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4f7fe700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b50108de0 0x7f4b501a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4f7fe700 1 -- 172.21.15.80:0/1457866279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5019b1b0 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4f7fe700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b501029c0 0x7f4b501a0890 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000d980 tx=0x7f4b4000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4cff9700 1 -- 172.21.15.80:0/1457866279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40017030 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4cff9700 1 -- 172.21.15.80:0/1457866279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b400044d0 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5019b4a0 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b4cff9700 1 -- 172.21.15.80:0/1457866279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40003970 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.722+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b501a7740 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.723+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b50051190 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.725+0000 7f4b4cff9700 1 -- 172.21.15.80:0/1457866279 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f4b4001a070 con 0x7f4b501029c0 2024-04-25T11:23:18.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.726+0000 7f4b4cff9700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b380afc90 0x7f4b380b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.726+0000 7f4b4effd700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b380afc90 0x7f4b380b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.726+0000 7f4b4cff9700 1 -- 172.21.15.80:0/1457866279 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f4b400dea00 con 0x7f4b501029c0 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.726+0000 7f4b4effd700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b380afc90 0x7f4b380b21a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b50101990 tx=0x7f4b4400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.729+0000 7f4b4cff9700 1 -- 172.21.15.80:0/1457866279 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b400a7490 con 0x7f4b501029c0 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.937+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f4b5019bfc0 con 0x7f4b501029c0 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.937+0000 7f4b4cff9700 1 -- 172.21.15.80:0/1457866279 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4b400a6d90 con 0x7f4b501029c0 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.939+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b380afc90 msgr2=0x7f4b380b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.939+0000 7f4b561c0700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b380afc90 0x7f4b380b21a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b50101990 tx=0x7f4b4400a300 comp rx=0 tx=0).stop 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.939+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b501029c0 msgr2=0x7f4b501a0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.939+0000 7f4b561c0700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b501029c0 0x7f4b501a0890 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000d980 tx=0x7f4b4000dc90 comp rx=0 tx=0).stop 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 shutdown_connections 2024-04-25T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b380afc90 0x7f4b380b21a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b50109730 0x7f4b5019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b501029c0 0x7f4b501a0890 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 --2- 172.21.15.80:0/1457866279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b50108de0 0x7f4b501a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 >> 172.21.15.80:0/1457866279 conn(0x7f4b500fe3f0 msgr2=0x7f4b501085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:18.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 shutdown_connections 2024-04-25T11:23:18.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:17.940+0000 7f4b561c0700 1 -- 172.21.15.80:0/1457866279 wait complete. 2024-04-25T11:23:18.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.856+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe35419c0c0 con 0x7fe354102fb0 2024-04-25T11:23:18.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.857+0000 7fe358a1e700 1 -- 172.21.15.80:0/780605282 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe3480a7bb0 con 0x7fe354102fb0 2024-04-25T11:23:18.852 INFO:teuthology.orchestra.run.smithi080.stdout:309237645339 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe33c0afc10 msgr2=0x7fe33c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe33c0afc10 0x7fe33c0b2120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe35406c960 tx=0x7fe344009260 comp rx=0 tx=0).stop 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 msgr2=0x7fe35419b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe35419b300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe34800e970 tx=0x7fe34800ec80 comp rx=0 tx=0).stop 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 shutdown_connections 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe33c0afc10 0x7fe33c0b2120 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3541091d0 0x7fe35419f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe354102660 0x7fe35419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 --2- 172.21.15.80:0/780605282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe354102fb0 0x7fe35419b300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 >> 172.21.15.80:0/780605282 conn(0x7fe3540fe3b0 msgr2=0x7fe354106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 shutdown_connections 2024-04-25T11:23:18.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:18.859+0000 7fe359a20700 1 -- 172.21.15.80:0/780605282 wait complete. 2024-04-25T11:23:19.448 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841564 got 283467841568 for osd.10 2024-04-25T11:23:19.448 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:19.686 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/780605282' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T11:23:19.687 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:19 smithi080 ceph-mon[29126]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:19.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/780605282' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T11:23:19.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:19 smithi196 ceph-mon[32659]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:19.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/780605282' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T11:23:19.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:19 smithi082 ceph-mon[32440]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:20.234 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:20.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 -- 172.21.15.80:0/3300684267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18103360 msgr2=0x7f7f18103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:20.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/3300684267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18103360 0x7f7f18103770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009a40 tx=0x7f7f08009d50 comp rx=0 tx=0).stop 2024-04-25T11:23:20.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 -- 172.21.15.80:0/3300684267 shutdown_connections 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/3300684267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f181085e0 0x7f7f1810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/3300684267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18103360 0x7f7f18103770 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/3300684267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f18107c90 0x7f7f181080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 -- 172.21.15.80:0/3300684267 >> 172.21.15.80:0/3300684267 conn(0x7f7f180fec90 msgr2=0x7f7f181010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 -- 172.21.15.80:0/3300684267 shutdown_connections 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.349+0000 7f7f1e84b700 1 -- 172.21.15.80:0/3300684267 wait complete. 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 Processor -- start 2024-04-25T11:23:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 -- start start 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f18103360 0x7f7f1819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18107c90 0x7f7f1819d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f181085e0 0x7f7f181a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7f18112170 con 0x7f7f18107c90 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f18111ff0 con 0x7f7f181085e0 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1e84b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7f181122f0 con 0x7f7f18103360 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18107c90 0x7f7f1819d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18107c90 0x7f7f1819d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42100/0 (socket says 172.21.15.80:42100) 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f0ffff700 1 -- 172.21.15.80:0/17589592 learned_addr learned my addr 172.21.15.80:0/17589592 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f1cde8700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f181085e0 0x7f7f181a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.350+0000 7f7f17fff700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f18103360 0x7f7f1819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f0ffff700 1 -- 172.21.15.80:0/17589592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f18103360 msgr2=0x7f7f1819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f0ffff700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f18103360 0x7f7f1819cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f0ffff700 1 -- 172.21.15.80:0/17589592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f181085e0 msgr2=0x7f7f181a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f0ffff700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f181085e0 0x7f7f181a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f0ffff700 1 -- 172.21.15.80:0/17589592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f181a1db0 con 0x7f7f18107c90 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f0ffff700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18107c90 0x7f7f1819d4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000d980 tx=0x7f7f0000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f15ffb700 1 -- 172.21.15.80:0/17589592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00017070 con 0x7f7f18107c90 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f181a20a0 con 0x7f7f18107c90 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f15ffb700 1 -- 172.21.15.80:0/17589592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f00009de0 con 0x7f7f18107c90 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f15ffb700 1 -- 172.21.15.80:0/17589592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000f3c0 con 0x7f7f18107c90 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.351+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f181a99c0 con 0x7f7f18107c90 2024-04-25T11:23:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.352+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f18051190 con 0x7f7f18107c90 2024-04-25T11:23:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.353+0000 7f7f15ffb700 1 -- 172.21.15.80:0/17589592 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f7f00009930 con 0x7f7f18107c90 2024-04-25T11:23:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.354+0000 7f7f15ffb700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7f040afc10 0x7f7f040b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.354+0000 7f7f17fff700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7f040afc10 0x7f7f040b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.354+0000 7f7f15ffb700 1 -- 172.21.15.80:0/17589592 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f7f000de8c0 con 0x7f7f18107c90 2024-04-25T11:23:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.355+0000 7f7f17fff700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7f040afc10 0x7f7f040b2120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000c00 tx=0x7f7f08009f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.358+0000 7f7f15ffb700 1 -- 172.21.15.80:0/17589592 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7f000a7330 con 0x7f7f18107c90 2024-04-25T11:23:20.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.563+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f7f1802e510 con 0x7f7f18107c90 2024-04-25T11:23:20.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.564+0000 7f7f15ffb700 1 -- 172.21.15.80:0/17589592 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7f000a6c30 con 0x7f7f18107c90 2024-04-25T11:23:20.559 INFO:teuthology.orchestra.run.smithi080.stdout:236223201324 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7f040afc10 msgr2=0x7f7f040b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7f040afc10 0x7f7f040b2120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000c00 tx=0x7f7f08009f90 comp rx=0 tx=0).stop 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18107c90 msgr2=0x7f7f1819d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18107c90 0x7f7f1819d4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000d980 tx=0x7f7f0000dc90 comp rx=0 tx=0).stop 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 shutdown_connections 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f7f040afc10 0x7f7f040b2120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f181085e0 0x7f7f181a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f18103360 0x7f7f1819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 --2- 172.21.15.80:0/17589592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18107c90 0x7f7f1819d4d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 >> 172.21.15.80:0/17589592 conn(0x7f7f180fec90 msgr2=0x7f7f181010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 shutdown_connections 2024-04-25T11:23:20.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:20.566+0000 7f7f1e84b700 1 -- 172.21.15.80:0/17589592 wait complete. 2024-04-25T11:23:20.879 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/17589592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T11:23:20.940 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/17589592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T11:23:20.994 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/17589592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T11:23:21.785 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:21 smithi080 ceph-mon[29126]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:21.940 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:21 smithi196 ceph-mon[32659]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:21.994 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:21 smithi082 ceph-mon[32440]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:22.117 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645335 got 309237645339 for osd.11 2024-04-25T11:23:22.117 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:22.356 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149759 got 111669149764 for osd.3 2024-04-25T11:23:22.356 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:23.437 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574926 for osd.1 2024-04-25T11:23:23.437 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:24.390 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:24 smithi080 ceph-mon[29126]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:24.390 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:24 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4093405478' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T11:23:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.085+0000 7fe620f31700 1 -- 172.21.15.80:0/1691906622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c1096f0 msgr2=0x7fe61c111050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.085+0000 7fe620f31700 1 --2- 172.21.15.80:0/1691906622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c1096f0 0x7fe61c111050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe61400b0d0 tx=0x7fe61400b3e0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.085+0000 7fe620f31700 1 -- 172.21.15.80:0/1691906622 shutdown_connections 2024-04-25T11:23:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.085+0000 7fe620f31700 1 --2- 172.21.15.80:0/1691906622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c1096f0 0x7fe61c111050 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.085+0000 7fe620f31700 1 --2- 172.21.15.80:0/1691906622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe61c104470 0x7fe61c104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.085+0000 7fe620f31700 1 --2- 172.21.15.80:0/1691906622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe61c108da0 0x7fe61c1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.085+0000 7fe620f31700 1 -- 172.21.15.80:0/1691906622 >> 172.21.15.80:0/1691906622 conn(0x7fe61c0ffd00 msgr2=0x7fe61c102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.086+0000 7fe620f31700 1 -- 172.21.15.80:0/1691906622 shutdown_connections 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.086+0000 7fe620f31700 1 -- 172.21.15.80:0/1691906622 wait complete. 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.086+0000 7fe620f31700 1 Processor -- start 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.086+0000 7fe620f31700 1 -- start start 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe61c104470 0x7fe61c1a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c108da0 0x7fe61c1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe61c1096f0 0x7fe61c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c114320 con 0x7fe61c108da0 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c1141a0 con 0x7fe61c104470 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c1144a0 con 0x7fe61c1096f0 2024-04-25T11:23:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c108da0 0x7fe61c1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c108da0 0x7fe61c1a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42128/0 (socket says 172.21.15.80:42128) 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 -- 172.21.15.80:0/4093405478 learned_addr learned my addr 172.21.15.80:0/4093405478 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe61a59c700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe61c104470 0x7fe61c1a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe61ad9d700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe61c1096f0 0x7fe61c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 -- 172.21.15.80:0/4093405478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe61c1096f0 msgr2=0x7fe61c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe61c1096f0 0x7fe61c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 -- 172.21.15.80:0/4093405478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe61c104470 msgr2=0x7fe61c1a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe61c104470 0x7fe61c1a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 -- 172.21.15.80:0/4093405478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c19b0c0 con 0x7fe61c108da0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe619d9b700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c108da0 0x7fe61c1a0da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c9e0 tx=0x7fe61000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe60b7fe700 1 -- 172.21.15.80:0/4093405478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610007aa0 con 0x7fe61c108da0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61c19b3b0 con 0x7fe61c108da0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe60b7fe700 1 -- 172.21.15.80:0/4093405478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe610007c40 con 0x7fe61c108da0 2024-04-25T11:23:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe60b7fe700 1 -- 172.21.15.80:0/4093405478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610018660 con 0x7fe61c108da0 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.087+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61c1a76f0 con 0x7fe61c108da0 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.088+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61c051190 con 0x7fe61c108da0 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.090+0000 7fe60b7fe700 1 -- 172.21.15.80:0/4093405478 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fe610018800 con 0x7fe61c108da0 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.090+0000 7fe60b7fe700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe6040afc10 0x7fe6040b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.090+0000 7fe61a59c700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe6040afc10 0x7fe6040b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stdout:34359738453 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.091+0000 7fe60b7fe700 1 -- 172.21.15.80:0/4093405478 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fe6100defa0 con 0x7fe61c108da0 2024-04-25T11:23:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.091+0000 7fe61a59c700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe6040afc10 0x7fe6040b2120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe60c005950 tx=0x7fe60c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.094+0000 7fe60b7fe700 1 -- 172.21.15.80:0/4093405478 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe610014030 con 0x7fe61c108da0 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.299+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe61c19bfb0 con 0x7fe61c108da0 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.299+0000 7fe60b7fe700 1 -- 172.21.15.80:0/4093405478 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe6100a7aa0 con 0x7fe61c108da0 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe6040afc10 msgr2=0x7fe6040b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe6040afc10 0x7fe6040b2120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe60c005950 tx=0x7fe60c00a300 comp rx=0 tx=0).stop 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c108da0 msgr2=0x7fe61c1a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c108da0 0x7fe61c1a0da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c9e0 tx=0x7fe61000ccf0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 shutdown_connections 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe6040afc10 0x7fe6040b2120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe61c1096f0 0x7fe61c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe61c104470 0x7fe61c1a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 --2- 172.21.15.80:0/4093405478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe61c108da0 0x7fe61c1a0da0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 >> 172.21.15.80:0/4093405478 conn(0x7fe61c0ffd00 msgr2=0x7fe61c1084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:24.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 shutdown_connections 2024-04-25T11:23:24.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:24.301+0000 7fe620f31700 1 -- 172.21.15.80:0/4093405478 wait complete. 2024-04-25T11:23:24.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:24 smithi196 ceph-mon[32659]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:24.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:24 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4093405478' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T11:23:24.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:24 smithi082 ceph-mon[32440]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:24.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:24 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4093405478' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T11:23:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 -- 172.21.15.80:0/2226524116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 msgr2=0x7fb138105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 --2- 172.21.15.80:0/2226524116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138105700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009990 tx=0x7fb12c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 -- 172.21.15.80:0/2226524116 shutdown_connections 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 --2- 172.21.15.80:0/2226524116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb13810e760 0x7fb138110c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 --2- 172.21.15.80:0/2226524116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138105700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 --2- 172.21.15.80:0/2226524116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb138105c40 0x7fb13810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 -- 172.21.15.80:0/2226524116 >> 172.21.15.80:0/2226524116 conn(0x7fb1380fec30 msgr2=0x7fb138101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 -- 172.21.15.80:0/2226524116 shutdown_connections 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.174+0000 7fb13ef45700 1 -- 172.21.15.80:0/2226524116 wait complete. 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.175+0000 7fb13ef45700 1 Processor -- start 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.175+0000 7fb13ef45700 1 -- start start 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13ef45700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13ef45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb138105c40 0x7fb138103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13ef45700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb13810e760 0x7fb138103a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13ef45700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb1381142e0 con 0x7fb1381052f0 2024-04-25T11:23:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13ef45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb138114160 con 0x7fb138105c40 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13ef45700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb138114460 con 0x7fb13810e760 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138102fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42148/0 (socket says 172.21.15.80:42148) 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 -- 172.21.15.80:0/1623399458 learned_addr learned my addr 172.21.15.80:0/1623399458 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb137fff700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb138105c40 0x7fb138103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13d4e2700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb13810e760 0x7fb138103a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 -- 172.21.15.80:0/1623399458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb13810e760 msgr2=0x7fb138103a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb13810e760 0x7fb138103a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 -- 172.21.15.80:0/1623399458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb138105c40 msgr2=0x7fb138103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb138105c40 0x7fb138103520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.176+0000 7fb13cce1700 1 -- 172.21.15.80:0/1623399458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1381a9010 con 0x7fb1381052f0 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.177+0000 7fb13cce1700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138102fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb12c000c00 tx=0x7fb12c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.177+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c027070 con 0x7fb1381052f0 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.177+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1381a92a0 con 0x7fb1381052f0 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.177+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb12c003f20 con 0x7fb1381052f0 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.177+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c022cf0 con 0x7fb1381052f0 2024-04-25T11:23:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.177+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1381a9700 con 0x7fb1381052f0 2024-04-25T11:23:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.178+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb138051190 con 0x7fb1381052f0 2024-04-25T11:23:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.180+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fb12c02a070 con 0x7fb1381052f0 2024-04-25T11:23:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.181+0000 7fb135ffb700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb1280afc10 0x7fb1280b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.181+0000 7fb137fff700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb1280afc10 0x7fb1280b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.181+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fb12c0dff50 con 0x7fb1381052f0 2024-04-25T11:23:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.181+0000 7fb137fff700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb1280afc10 0x7fb1280b2120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb138102270 tx=0x7fb12400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:25.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.189+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb12c013070 con 0x7fb1381052f0 2024-04-25T11:23:25.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.378+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fb12c0a45e0 con 0x7fb1381052f0 2024-04-25T11:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.436+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb13802e510 con 0x7fb1381052f0 2024-04-25T11:23:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.436+0000 7fb135ffb700 1 -- 172.21.15.80:0/1623399458 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb12c0d0e20 con 0x7fb1381052f0 2024-04-25T11:23:25.430 INFO:teuthology.orchestra.run.smithi080.stdout:184683593783 2024-04-25T11:23:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.438+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb1280afc10 msgr2=0x7fb1280b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.438+0000 7fb13ef45700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb1280afc10 0x7fb1280b2120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb138102270 tx=0x7fb12400b3c0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.438+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 msgr2=0x7fb138102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.438+0000 7fb13ef45700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138102fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb12c000c00 tx=0x7fb12c0047b0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 shutdown_connections 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb1280afc10 0x7fb1280b2120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb13810e760 0x7fb138103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1381052f0 0x7fb138102fe0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 --2- 172.21.15.80:0/1623399458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb138105c40 0x7fb138103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 >> 172.21.15.80:0/1623399458 conn(0x7fb1380fec30 msgr2=0x7fb1380ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 shutdown_connections 2024-04-25T11:23:25.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:25.439+0000 7fb13ef45700 1 -- 172.21.15.80:0/1623399458 wait complete. 2024-04-25T11:23:25.653 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738453 for osd.0 2024-04-25T11:23:25.653 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:26.344 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593776 got 184683593783 for osd.6 2024-04-25T11:23:26.344 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:26.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:26 smithi080 ceph-mon[29126]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:26.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:26 smithi080 ceph-mon[29126]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-25T11:23:26.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:26 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1623399458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T11:23:26.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:26 smithi196 ceph-mon[32659]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:26.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:26 smithi196 ceph-mon[32659]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-25T11:23:26.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:26 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1623399458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T11:23:26.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:26 smithi082 ceph-mon[32440]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:26.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:26 smithi082 ceph-mon[32440]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-25T11:23:26.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:26 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1623399458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T11:23:27.367 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201319 got 236223201324 for osd.8 2024-04-25T11:23:27.367 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:27.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 -- 172.21.15.80:0/656636538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50103890 msgr2=0x7fbe50103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 --2- 172.21.15.80:0/656636538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50103890 0x7fbe50103ca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009990 tx=0x7fbe44009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 -- 172.21.15.80:0/656636538 shutdown_connections 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 --2- 172.21.15.80:0/656636538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe501041e0 0x7fbe5010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 --2- 172.21.15.80:0/656636538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe50109180 0x7fbe50109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 --2- 172.21.15.80:0/656636538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50103890 0x7fbe50103ca0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 -- 172.21.15.80:0/656636538 >> 172.21.15.80:0/656636538 conn(0x7fbe500fe370 msgr2=0x7fbe501007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 -- 172.21.15.80:0/656636538 shutdown_connections 2024-04-25T11:23:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 -- 172.21.15.80:0/656636538 wait complete. 2024-04-25T11:23:27.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.577+0000 7fbe557fd700 1 Processor -- start 2024-04-25T11:23:27.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe557fd700 1 -- start start 2024-04-25T11:23:27.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe557fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe50103890 0x7fbe5019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:27.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe557fd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe501041e0 0x7fbe5019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:27.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe557fd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50109180 0x7fbe5019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:27.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe557fd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50113270 con 0x7fbe50109180 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe557fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501130f0 con 0x7fbe50103890 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe557fd700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501133f0 con 0x7fbe501041e0 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50109180 0x7fbe5019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50109180 0x7fbe5019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37330/0 (socket says 172.21.15.80:37330) 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 -- 172.21.15.80:0/653839974 learned_addr learned my addr 172.21.15.80:0/653839974 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4effd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe50103890 0x7fbe5019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4e7fc700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe501041e0 0x7fbe5019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 -- 172.21.15.80:0/653839974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe501041e0 msgr2=0x7fbe5019c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe501041e0 0x7fbe5019c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 -- 172.21.15.80:0/653839974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe50103890 msgr2=0x7fbe5019bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe50103890 0x7fbe5019bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4f7fe700 1 -- 172.21.15.80:0/653839974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe501a6e50 con 0x7fbe50109180 2024-04-25T11:23:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.578+0000 7fbe4effd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe50103890 0x7fbe5019bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.579+0000 7fbe4f7fe700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50109180 0x7fbe5019c630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbe48007d70 tx=0x7fbe4800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.579+0000 7fbe37fff700 1 -- 172.21.15.80:0/653839974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48016020 con 0x7fbe50109180 2024-04-25T11:23:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.579+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe501a7140 con 0x7fbe50109180 2024-04-25T11:23:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.579+0000 7fbe37fff700 1 -- 172.21.15.80:0/653839974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe4800ad40 con 0x7fbe50109180 2024-04-25T11:23:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.579+0000 7fbe37fff700 1 -- 172.21.15.80:0/653839974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe480115e0 con 0x7fbe50109180 2024-04-25T11:23:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.579+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe501a7680 con 0x7fbe50109180 2024-04-25T11:23:27.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.580+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5010b5f0 con 0x7fbe50109180 2024-04-25T11:23:27.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.581+0000 7fbe37fff700 1 -- 172.21.15.80:0/653839974 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fbe48019020 con 0x7fbe50109180 2024-04-25T11:23:27.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.582+0000 7fbe37fff700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe380afb80 0x7fbe380b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:27.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.582+0000 7fbe4effd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe380afb80 0x7fbe380b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:27.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.582+0000 7fbe37fff700 1 -- 172.21.15.80:0/653839974 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fbe480deff0 con 0x7fbe50109180 2024-04-25T11:23:27.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.582+0000 7fbe4effd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe380afb80 0x7fbe380b2090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe400099d0 tx=0x7fbe40008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:27.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.586+0000 7fbe37fff700 1 -- 172.21.15.80:0/653839974 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbe48020020 con 0x7fbe50109180 2024-04-25T11:23:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.788+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbe5010afd0 con 0x7fbe50109180 2024-04-25T11:23:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.788+0000 7fbe37fff700 1 -- 172.21.15.80:0/653839974 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbe480a7c60 con 0x7fbe50109180 2024-04-25T11:23:27.782 INFO:teuthology.orchestra.run.smithi080.stdout:206158430258 2024-04-25T11:23:27.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe380afb80 msgr2=0x7fbe380b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:27.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe380afb80 0x7fbe380b2090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe400099d0 tx=0x7fbe40008040 comp rx=0 tx=0).stop 2024-04-25T11:23:27.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50109180 msgr2=0x7fbe5019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:27.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50109180 0x7fbe5019c630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbe48007d70 tx=0x7fbe4800a340 comp rx=0 tx=0).stop 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 shutdown_connections 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe380afb80 0x7fbe380b2090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe50109180 0x7fbe5019c630 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe50103890 0x7fbe5019bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 --2- 172.21.15.80:0/653839974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe501041e0 0x7fbe5019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 >> 172.21.15.80:0/653839974 conn(0x7fbe500fe370 msgr2=0x7fbe500ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 shutdown_connections 2024-04-25T11:23:27.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:27.791+0000 7fbe557fd700 1 -- 172.21.15.80:0/653839974 wait complete. 2024-04-25T11:23:28.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:28 smithi080 ceph-mon[29126]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-25T11:23:28.492 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:28 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/653839974' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T11:23:28.519 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430253 got 206158430258 for osd.7 2024-04-25T11:23:28.520 DEBUG:teuthology.parallel:result is None 2024-04-25T11:23:28.520 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T11:23:28.520 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T11:23:28.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:28 smithi196 ceph-mon[32659]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-25T11:23:28.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:28 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/653839974' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T11:23:28.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:28 smithi082 ceph-mon[32440]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-25T11:23:28.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:28 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/653839974' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T11:23:28.783 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:30.532 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:30 smithi080 ceph-mon[29126]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:23:30.532 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:30 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.538+0000 7fcc3ef10700 1 -- 172.21.15.80:0/4027414059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 msgr2=0x7fcc38108cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.538+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/4027414059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc38108cb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009990 tx=0x7fcc2c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.539+0000 7fcc3ef10700 1 -- 172.21.15.80:0/4027414059 shutdown_connections 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.539+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/4027414059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc381031c0 0x7fcc3810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.539+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/4027414059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc38108cb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.539+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/4027414059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc38102870 0x7fcc38102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.539+0000 7fcc3ef10700 1 -- 172.21.15.80:0/4027414059 >> 172.21.15.80:0/4027414059 conn(0x7fcc380fe370 msgr2=0x7fcc381007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.539+0000 7fcc3ef10700 1 -- 172.21.15.80:0/4027414059 shutdown_connections 2024-04-25T11:23:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.539+0000 7fcc3ef10700 1 -- 172.21.15.80:0/4027414059 wait complete. 2024-04-25T11:23:30.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 Processor -- start 2024-04-25T11:23:30.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 -- start start 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc38102870 0x7fcc3819bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc381031c0 0x7fcc3819c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc3819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38112a20 con 0x7fcc381088a0 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc381128a0 con 0x7fcc38102870 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ef10700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38112ba0 con 0x7fcc381031c0 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3d4ad700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc3819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3d4ad700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc3819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37340/0 (socket says 172.21.15.80:37340) 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3d4ad700 1 -- 172.21.15.80:0/3427894353 learned_addr learned my addr 172.21.15.80:0/3427894353 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc37fff700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc381031c0 0x7fcc3819c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.540+0000 7fcc3ccac700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc38102870 0x7fcc3819bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3d4ad700 1 -- 172.21.15.80:0/3427894353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc381031c0 msgr2=0x7fcc3819c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:30.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3d4ad700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc381031c0 0x7fcc3819c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3d4ad700 1 -- 172.21.15.80:0/3427894353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc38102870 msgr2=0x7fcc3819bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3d4ad700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc38102870 0x7fcc3819bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3d4ad700 1 -- 172.21.15.80:0/3427894353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc381a6f20 con 0x7fcc381088a0 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3d4ad700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc3819c670 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000ada0 tx=0x7fcc3000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc35ffb700 1 -- 172.21.15.80:0/3427894353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30017020 con 0x7fcc381088a0 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc35ffb700 1 -- 172.21.15.80:0/3427894353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc3000cd80 con 0x7fcc381088a0 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc381a7210 con 0x7fcc381088a0 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc35ffb700 1 -- 172.21.15.80:0/3427894353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30005260 con 0x7fcc381088a0 2024-04-25T11:23:30.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.541+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc381a7700 con 0x7fcc381088a0 2024-04-25T11:23:30.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.542+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc38051190 con 0x7fcc381088a0 2024-04-25T11:23:30.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.544+0000 7fcc35ffb700 1 -- 172.21.15.80:0/3427894353 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fcc3000c8d0 con 0x7fcc381088a0 2024-04-25T11:23:30.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.544+0000 7fcc35ffb700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcc280afb80 0x7fcc280b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:30.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.544+0000 7fcc3ccac700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcc280afb80 0x7fcc280b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:30.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.544+0000 7fcc35ffb700 1 -- 172.21.15.80:0/3427894353 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fcc300de370 con 0x7fcc381088a0 2024-04-25T11:23:30.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.545+0000 7fcc3ccac700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcc280afb80 0x7fcc280b2090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00b5c0 tx=0x7fcc2c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:30.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.549+0000 7fcc35ffb700 1 -- 172.21.15.80:0/3427894353 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcc30021020 con 0x7fcc381088a0 2024-04-25T11:23:30.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:30 smithi196 ceph-mon[32659]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:23:30.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:30 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:30.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:30 smithi082 ceph-mon[32440]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:23:30.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:30 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:30.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.751+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc381074c0 con 0x7fcc280afb80 2024-04-25T11:23:30.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.758+0000 7fcc35ffb700 1 -- 172.21.15.80:0/3427894353 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259241 (secure 0 0 0) 0x7fcc2c0674c0 con 0x7fcc280afb80 2024-04-25T11:23:30.756 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:30.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcc280afb80 msgr2=0x7fcc280b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:30.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcc280afb80 0x7fcc280b2090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00b5c0 tx=0x7fcc2c005960 comp rx=0 tx=0).stop 2024-04-25T11:23:30.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 msgr2=0x7fcc3819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc3819c670 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000ada0 tx=0x7fcc3000c330 comp rx=0 tx=0).stop 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 shutdown_connections 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fcc280afb80 0x7fcc280b2090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc381088a0 0x7fcc3819c670 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc38102870 0x7fcc3819bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 --2- 172.21.15.80:0/3427894353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc381031c0 0x7fcc3819c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.762+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 >> 172.21.15.80:0/3427894353 conn(0x7fcc380fe370 msgr2=0x7fcc38106db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.763+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 shutdown_connections 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:30.763+0000 7fcc3ef10700 1 -- 172.21.15.80:0/3427894353 wait complete. 2024-04-25T11:23:30.759 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T11:23:31.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:31 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:31.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:31 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:23:31.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:31 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:23:31.549 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:31 smithi080 ceph-mon[29126]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:31.577 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-04-25T11:23:29.309024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656571,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":525,"num_read_kb":358,"num_write":291,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":738,"ondisk_log_size":738,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351288,"kb_used_data":10452,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590536,"statfs":{"total":1151940427776,"available":1151580708864,"internally_reserved":0,"allocated":10702848,"data_stored":6887409,"data_compressed":182196,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":531,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":33,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004185"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318363+0000","last_change":"2024-04-25T11:22:14.408035+0000","last_active":"2024-04-25T11:23:25.318363+0000","last_peered":"2024-04-25T11:23:25.318363+0000","last_clean":"2024-04-25T11:23:25.318363+0000","last_became_active":"2024-04-25T11:22:14.407691+0000","last_became_peered":"2024-04-25T11:22:14.407691+0000","last_unstale":"2024-04-25T11:23:25.318363+0000","last_undegraded":"2024-04-25T11:23:25.318363+0000","last_fullsized":"2024-04-25T11:23:25.318363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:27.388402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316108+0000","last_change":"2024-04-25T11:22:14.415270+0000","last_active":"2024-04-25T11:23:25.316108+0000","last_peered":"2024-04-25T11:23:25.316108+0000","last_clean":"2024-04-25T11:23:25.316108+0000","last_became_active":"2024-04-25T11:22:14.413962+0000","last_became_peered":"2024-04-25T11:22:14.413962+0000","last_unstale":"2024-04-25T11:23:25.316108+0000","last_undegraded":"2024-04-25T11:23:25.316108+0000","last_fullsized":"2024-04-25T11:23:25.316108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:31.160774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316261+0000","last_change":"2024-04-25T11:22:14.402643+0000","last_active":"2024-04-25T11:23:25.316261+0000","last_peered":"2024-04-25T11:23:25.316261+0000","last_clean":"2024-04-25T11:23:25.316261+0000","last_became_active":"2024-04-25T11:22:14.401940+0000","last_became_peered":"2024-04-25T11:22:14.401940+0000","last_unstale":"2024-04-25T11:23:25.316261+0000","last_undegraded":"2024-04-25T11:23:25.316261+0000","last_fullsized":"2024-04-25T11:23:25.316261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:47.270354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306709+0000","last_change":"2024-04-25T11:22:14.413726+0000","last_active":"2024-04-25T11:23:25.306709+0000","last_peered":"2024-04-25T11:23:25.306709+0000","last_clean":"2024-04-25T11:23:25.306709+0000","last_became_active":"2024-04-25T11:22:14.412971+0000","last_became_peered":"2024-04-25T11:22:14.412971+0000","last_unstale":"2024-04-25T11:23:25.306709+0000","last_undegraded":"2024-04-25T11:23:25.306709+0000","last_fullsized":"2024-04-25T11:23:25.306709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:42.017286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.292642+0000","last_change":"2024-04-25T11:22:14.403390+0000","last_active":"2024-04-25T11:23:25.292642+0000","last_peered":"2024-04-25T11:23:25.292642+0000","last_clean":"2024-04-25T11:23:25.292642+0000","last_became_active":"2024-04-25T11:22:14.402999+0000","last_became_peered":"2024-04-25T11:22:14.402999+0000","last_unstale":"2024-04-25T11:23:25.292642+0000","last_undegraded":"2024-04-25T11:23:25.292642+0000","last_fullsized":"2024-04-25T11:23:25.292642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:59.283486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306774+0000","last_change":"2024-04-25T11:22:56.415548+0000","last_active":"2024-04-25T11:23:25.306774+0000","last_peered":"2024-04-25T11:23:25.306774+0000","last_clean":"2024-04-25T11:23:25.306774+0000","last_became_active":"2024-04-25T11:22:56.414819+0000","last_became_peered":"2024-04-25T11:22:56.414819+0000","last_unstale":"2024-04-25T11:23:25.306774+0000","last_undegraded":"2024-04-25T11:23:25.306774+0000","last_fullsized":"2024-04-25T11:23:25.306774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:32.599336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313452+0000","last_change":"2024-04-25T11:22:14.404800+0000","last_active":"2024-04-25T11:23:25.313452+0000","last_peered":"2024-04-25T11:23:25.313452+0000","last_clean":"2024-04-25T11:23:25.313452+0000","last_became_active":"2024-04-25T11:22:14.404445+0000","last_became_peered":"2024-04-25T11:22:14.404445+0000","last_unstale":"2024-04-25T11:23:25.313452+0000","last_undegraded":"2024-04-25T11:23:25.313452+0000","last_fullsized":"2024-04-25T11:23:25.313452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:51.498081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.302906+0000","last_change":"2024-04-25T11:22:56.415367+0000","last_active":"2024-04-25T11:23:25.302906+0000","last_peered":"2024-04-25T11:23:25.302906+0000","last_clean":"2024-04-25T11:23:25.302906+0000","last_became_active":"2024-04-25T11:22:56.414982+0000","last_became_peered":"2024-04-25T11:22:56.414982+0000","last_unstale":"2024-04-25T11:23:25.302906+0000","last_undegraded":"2024-04-25T11:23:25.302906+0000","last_fullsized":"2024-04-25T11:23:25.302906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:23.069726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317149+0000","last_change":"2024-04-25T11:22:14.410119+0000","last_active":"2024-04-25T11:23:25.317149+0000","last_peered":"2024-04-25T11:23:25.317149+0000","last_clean":"2024-04-25T11:23:25.317149+0000","last_became_active":"2024-04-25T11:22:14.409736+0000","last_became_peered":"2024-04-25T11:22:14.409736+0000","last_unstale":"2024-04-25T11:23:25.317149+0000","last_undegraded":"2024-04-25T11:23:25.317149+0000","last_fullsized":"2024-04-25T11:23:25.317149+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:57.842921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309023+0000","last_change":"2024-04-25T11:22:14.416368+0000","last_active":"2024-04-25T11:23:25.309023+0000","last_peered":"2024-04-25T11:23:25.309023+0000","last_clean":"2024-04-25T11:23:25.309023+0000","last_became_active":"2024-04-25T11:22:14.415888+0000","last_became_peered":"2024-04-25T11:22:14.415888+0000","last_unstale":"2024-04-25T11:23:25.309023+0000","last_undegraded":"2024-04-25T11:23:25.309023+0000","last_fullsized":"2024-04-25T11:23:25.309023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:00.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317732+0000","last_change":"2024-04-25T11:22:14.402490+0000","last_active":"2024-04-25T11:23:25.317732+0000","last_peered":"2024-04-25T11:23:25.317732+0000","last_clean":"2024-04-25T11:23:25.317732+0000","last_became_active":"2024-04-25T11:22:14.402115+0000","last_became_peered":"2024-04-25T11:22:14.402115+0000","last_unstale":"2024-04-25T11:23:25.317732+0000","last_undegraded":"2024-04-25T11:23:25.317732+0000","last_fullsized":"2024-04-25T11:23:25.317732+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:34.783230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.307752+0000","last_change":"2024-04-25T11:22:14.420570+0000","last_active":"2024-04-25T11:23:25.307752+0000","last_peered":"2024-04-25T11:23:25.307752+0000","last_clean":"2024-04-25T11:23:25.307752+0000","last_became_active":"2024-04-25T11:22:14.420187+0000","last_became_peered":"2024-04-25T11:22:14.420187+0000","last_unstale":"2024-04-25T11:23:25.307752+0000","last_undegraded":"2024-04-25T11:23:25.307752+0000","last_fullsized":"2024-04-25T11:23:25.307752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:52.828114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.311932+0000","last_change":"2024-04-25T11:22:14.414789+0000","last_active":"2024-04-25T11:23:25.311932+0000","last_peered":"2024-04-25T11:23:25.311932+0000","last_clean":"2024-04-25T11:23:25.311932+0000","last_became_active":"2024-04-25T11:22:14.414465+0000","last_became_peered":"2024-04-25T11:22:14.414465+0000","last_unstale":"2024-04-25T11:23:25.311932+0000","last_undegraded":"2024-04-25T11:23:25.311932+0000","last_fullsized":"2024-04-25T11:23:25.311932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:37.748045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.307488+0000","last_change":"2024-04-25T11:22:14.413268+0000","last_active":"2024-04-25T11:23:25.307488+0000","last_peered":"2024-04-25T11:23:25.307488+0000","last_clean":"2024-04-25T11:23:25.307488+0000","last_became_active":"2024-04-25T11:22:14.412897+0000","last_became_peered":"2024-04-25T11:22:14.412897+0000","last_unstale":"2024-04-25T11:23:25.307488+0000","last_undegraded":"2024-04-25T11:23:25.307488+0000","last_fullsized":"2024-04-25T11:23:25.307488+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:49.997236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.308481+0000","last_change":"2024-04-25T11:22:14.411114+0000","last_active":"2024-04-25T11:23:25.308481+0000","last_peered":"2024-04-25T11:23:25.308481+0000","last_clean":"2024-04-25T11:23:25.308481+0000","last_became_active":"2024-04-25T11:22:14.410700+0000","last_became_peered":"2024-04-25T11:22:14.410700+0000","last_unstale":"2024-04-25T11:23:25.308481+0000","last_undegraded":"2024-04-25T11:23:25.308481+0000","last_fullsized":"2024-04-25T11:23:25.308481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:38.367214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.315077+0000","last_change":"2024-04-25T11:22:14.408073+0000","last_active":"2024-04-25T11:23:25.315077+0000","last_peered":"2024-04-25T11:23:25.315077+0000","last_clean":"2024-04-25T11:23:25.315077+0000","last_became_active":"2024-04-25T11:22:14.406878+0000","last_became_peered":"2024-04-25T11:22:14.406878+0000","last_unstale":"2024-04-25T11:23:25.315077+0000","last_undegraded":"2024-04-25T11:23:25.315077+0000","last_fullsized":"2024-04-25T11:23:25.315077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:00.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318593+0000","last_change":"2024-04-25T11:22:14.406990+0000","last_active":"2024-04-25T11:23:25.318593+0000","last_peered":"2024-04-25T11:23:25.318593+0000","last_clean":"2024-04-25T11:23:25.318593+0000","last_became_active":"2024-04-25T11:22:14.406643+0000","last_became_peered":"2024-04-25T11:22:14.406643+0000","last_unstale":"2024-04-25T11:23:25.318593+0000","last_undegraded":"2024-04-25T11:23:25.318593+0000","last_fullsized":"2024-04-25T11:23:25.318593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:15.226490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.301176+0000","last_change":"2024-04-25T11:22:14.410651+0000","last_active":"2024-04-25T11:23:25.301176+0000","last_peered":"2024-04-25T11:23:25.301176+0000","last_clean":"2024-04-25T11:23:25.301176+0000","last_became_active":"2024-04-25T11:22:14.410299+0000","last_became_peered":"2024-04-25T11:22:14.410299+0000","last_unstale":"2024-04-25T11:23:25.301176+0000","last_undegraded":"2024-04-25T11:23:25.301176+0000","last_fullsized":"2024-04-25T11:23:25.301176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:50.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.300107+0000","last_change":"2024-04-25T11:22:14.405714+0000","last_active":"2024-04-25T11:23:25.300107+0000","last_peered":"2024-04-25T11:23:25.300107+0000","last_clean":"2024-04-25T11:23:25.300107+0000","last_became_active":"2024-04-25T11:22:14.405376+0000","last_became_peered":"2024-04-25T11:22:14.405376+0000","last_unstale":"2024-04-25T11:23:25.300107+0000","last_undegraded":"2024-04-25T11:23:25.300107+0000","last_fullsized":"2024-04-25T11:23:25.300107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:18.538532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":45,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.421708+0000","last_change":"2024-04-25T11:22:56.421708+0000","last_active":"2024-04-25T11:22:56.421708+0000","last_peered":"2024-04-25T11:22:56.421708+0000","last_clean":"2024-04-25T11:22:56.421708+0000","last_became_active":"2024-04-25T11:22:56.413182+0000","last_became_peered":"2024-04-25T11:22:56.413182+0000","last_unstale":"2024-04-25T11:22:56.421708+0000","last_undegraded":"2024-04-25T11:22:56.421708+0000","last_fullsized":"2024-04-25T11:22:56.421708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:30.235026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306088+0000","last_change":"2024-04-25T11:22:14.411893+0000","last_active":"2024-04-25T11:23:25.306088+0000","last_peered":"2024-04-25T11:23:25.306088+0000","last_clean":"2024-04-25T11:23:25.306088+0000","last_became_active":"2024-04-25T11:22:14.409727+0000","last_became_peered":"2024-04-25T11:22:14.409727+0000","last_unstale":"2024-04-25T11:23:25.306088+0000","last_undegraded":"2024-04-25T11:23:25.306088+0000","last_fullsized":"2024-04-25T11:23:25.306088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:41.961790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.411095+0000","last_change":"2024-04-25T11:22:13.398983+0000","last_active":"2024-04-25T11:22:56.411095+0000","last_peered":"2024-04-25T11:22:56.411095+0000","last_clean":"2024-04-25T11:22:56.411095+0000","last_became_active":"2024-04-25T11:22:13.397819+0000","last_became_peered":"2024-04-25T11:22:13.397819+0000","last_unstale":"2024-04-25T11:22:56.411095+0000","last_undegraded":"2024-04-25T11:22:56.411095+0000","last_fullsized":"2024-04-25T11:22:56.411095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:19.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317389+0000","last_change":"2024-04-25T11:22:14.410589+0000","last_active":"2024-04-25T11:23:25.317389+0000","last_peered":"2024-04-25T11:23:25.317389+0000","last_clean":"2024-04-25T11:23:25.317389+0000","last_became_active":"2024-04-25T11:22:14.409921+0000","last_became_peered":"2024-04-25T11:22:14.409921+0000","last_unstale":"2024-04-25T11:23:25.317389+0000","last_undegraded":"2024-04-25T11:23:25.317389+0000","last_fullsized":"2024-04-25T11:23:25.317389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:59.251335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406591+0000","last_change":"2024-04-25T11:22:13.406244+0000","last_active":"2024-04-25T11:22:56.406591+0000","last_peered":"2024-04-25T11:22:56.406591+0000","last_clean":"2024-04-25T11:22:56.406591+0000","last_became_active":"2024-04-25T11:22:13.405902+0000","last_became_peered":"2024-04-25T11:22:13.405902+0000","last_unstale":"2024-04-25T11:22:56.406591+0000","last_undegraded":"2024-04-25T11:22:56.406591+0000","last_fullsized":"2024-04-25T11:22:56.406591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:05.862922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.310535+0000","last_change":"2024-04-25T11:22:14.421110+0000","last_active":"2024-04-25T11:23:25.310535+0000","last_peered":"2024-04-25T11:23:25.310535+0000","last_clean":"2024-04-25T11:23:25.310535+0000","last_became_active":"2024-04-25T11:22:14.420705+0000","last_became_peered":"2024-04-25T11:22:14.420705+0000","last_unstale":"2024-04-25T11:23:25.310535+0000","last_undegraded":"2024-04-25T11:23:25.310535+0000","last_fullsized":"2024-04-25T11:23:25.310535+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:57.353467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406617+0000","last_change":"2024-04-25T11:22:13.406063+0000","last_active":"2024-04-25T11:22:56.406617+0000","last_peered":"2024-04-25T11:22:56.406617+0000","last_clean":"2024-04-25T11:22:56.406617+0000","last_became_active":"2024-04-25T11:22:13.405690+0000","last_became_peered":"2024-04-25T11:22:13.405690+0000","last_unstale":"2024-04-25T11:22:56.406617+0000","last_undegraded":"2024-04-25T11:22:56.406617+0000","last_fullsized":"2024-04-25T11:22:56.406617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:34.296298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317405+0000","last_change":"2024-04-25T11:22:14.413077+0000","last_active":"2024-04-25T11:23:25.317405+0000","last_peered":"2024-04-25T11:23:25.317405+0000","last_clean":"2024-04-25T11:23:25.317405+0000","last_became_active":"2024-04-25T11:22:14.412712+0000","last_became_peered":"2024-04-25T11:22:14.412712+0000","last_unstale":"2024-04-25T11:23:25.317405+0000","last_undegraded":"2024-04-25T11:23:25.317405+0000","last_fullsized":"2024-04-25T11:23:25.317405+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:41.683840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'7","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:27.549940+0000","last_change":"2024-04-25T11:22:13.396239+0000","last_active":"2024-04-25T11:23:27.549940+0000","last_peered":"2024-04-25T11:23:27.549940+0000","last_clean":"2024-04-25T11:23:27.549940+0000","last_became_active":"2024-04-25T11:22:13.395653+0000","last_became_peered":"2024-04-25T11:22:13.395653+0000","last_unstale":"2024-04-25T11:23:27.549940+0000","last_undegraded":"2024-04-25T11:23:27.549940+0000","last_fullsized":"2024-04-25T11:23:27.549940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:05.218927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.293635+0000","last_change":"2024-04-25T11:22:14.409052+0000","last_active":"2024-04-25T11:23:25.293635+0000","last_peered":"2024-04-25T11:23:25.293635+0000","last_clean":"2024-04-25T11:23:25.293635+0000","last_became_active":"2024-04-25T11:22:14.408580+0000","last_became_peered":"2024-04-25T11:22:14.408580+0000","last_unstale":"2024-04-25T11:23:25.293635+0000","last_undegraded":"2024-04-25T11:23:25.293635+0000","last_fullsized":"2024-04-25T11:23:25.293635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:14.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.412556+0000","last_change":"2024-04-25T11:22:13.399086+0000","last_active":"2024-04-25T11:22:56.412556+0000","last_peered":"2024-04-25T11:22:56.412556+0000","last_clean":"2024-04-25T11:22:56.412556+0000","last_became_active":"2024-04-25T11:22:13.398559+0000","last_became_peered":"2024-04-25T11:22:13.398559+0000","last_unstale":"2024-04-25T11:22:56.412556+0000","last_undegraded":"2024-04-25T11:22:56.412556+0000","last_fullsized":"2024-04-25T11:22:56.412556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:09.913470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.290613+0000","last_change":"2024-04-25T11:22:56.416426+0000","last_active":"2024-04-25T11:23:25.290613+0000","last_peered":"2024-04-25T11:23:25.290613+0000","last_clean":"2024-04-25T11:23:25.290613+0000","last_became_active":"2024-04-25T11:22:56.415792+0000","last_became_peered":"2024-04-25T11:22:56.415792+0000","last_unstale":"2024-04-25T11:23:25.290613+0000","last_undegraded":"2024-04-25T11:23:25.290613+0000","last_fullsized":"2024-04-25T11:23:25.290613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:24.421846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,8],"acting":[9,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.407668+0000","last_change":"2024-04-25T11:22:13.392703+0000","last_active":"2024-04-25T11:22:56.407668+0000","last_peered":"2024-04-25T11:22:56.407668+0000","last_clean":"2024-04-25T11:22:56.407668+0000","last_became_active":"2024-04-25T11:22:13.392337+0000","last_became_peered":"2024-04-25T11:22:13.392337+0000","last_unstale":"2024-04-25T11:22:56.407668+0000","last_undegraded":"2024-04-25T11:22:56.407668+0000","last_fullsized":"2024-04-25T11:22:56.407668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:33.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316599+0000","last_change":"2024-04-25T11:22:14.398526+0000","last_active":"2024-04-25T11:23:25.316599+0000","last_peered":"2024-04-25T11:23:25.316599+0000","last_clean":"2024-04-25T11:23:25.316599+0000","last_became_active":"2024-04-25T11:22:14.398083+0000","last_became_peered":"2024-04-25T11:22:14.398083+0000","last_unstale":"2024-04-25T11:23:25.316599+0000","last_undegraded":"2024-04-25T11:23:25.316599+0000","last_fullsized":"2024-04-25T11:23:25.316599+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:03.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.413042+0000","last_change":"2024-04-25T11:22:13.397599+0000","last_active":"2024-04-25T11:22:56.413042+0000","last_peered":"2024-04-25T11:22:56.413042+0000","last_clean":"2024-04-25T11:22:56.413042+0000","last_became_active":"2024-04-25T11:22:13.396748+0000","last_became_peered":"2024-04-25T11:22:13.396748+0000","last_unstale":"2024-04-25T11:22:56.413042+0000","last_undegraded":"2024-04-25T11:22:56.413042+0000","last_fullsized":"2024-04-25T11:22:56.413042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:31.012095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.311093+0000","last_change":"2024-04-25T11:22:14.404668+0000","last_active":"2024-04-25T11:23:25.311093+0000","last_peered":"2024-04-25T11:23:25.311093+0000","last_clean":"2024-04-25T11:23:25.311093+0000","last_became_active":"2024-04-25T11:22:14.404306+0000","last_became_peered":"2024-04-25T11:22:14.404306+0000","last_unstale":"2024-04-25T11:23:25.311093+0000","last_undegraded":"2024-04-25T11:23:25.311093+0000","last_fullsized":"2024-04-25T11:23:25.311093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:16.430419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":91,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.257017+0000","last_change":"2024-04-25T11:22:13.398240+0000","last_active":"2024-04-25T11:23:25.257017+0000","last_peered":"2024-04-25T11:23:25.257017+0000","last_clean":"2024-04-25T11:23:25.257017+0000","last_became_active":"2024-04-25T11:22:13.397875+0000","last_became_peered":"2024-04-25T11:22:13.397875+0000","last_unstale":"2024-04-25T11:23:25.257017+0000","last_undegraded":"2024-04-25T11:23:25.257017+0000","last_fullsized":"2024-04-25T11:23:25.257017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:29.007270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.310077+0000","last_change":"2024-04-25T11:22:14.422075+0000","last_active":"2024-04-25T11:23:25.310077+0000","last_peered":"2024-04-25T11:23:25.310077+0000","last_clean":"2024-04-25T11:23:25.310077+0000","last_became_active":"2024-04-25T11:22:14.421699+0000","last_became_peered":"2024-04-25T11:22:14.421699+0000","last_unstale":"2024-04-25T11:23:25.310077+0000","last_undegraded":"2024-04-25T11:23:25.310077+0000","last_fullsized":"2024-04-25T11:23:25.310077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409827+0000","last_change":"2024-04-25T11:22:13.398104+0000","last_active":"2024-04-25T11:22:56.409827+0000","last_peered":"2024-04-25T11:22:56.409827+0000","last_clean":"2024-04-25T11:22:56.409827+0000","last_became_active":"2024-04-25T11:22:13.397716+0000","last_became_peered":"2024-04-25T11:22:13.397716+0000","last_unstale":"2024-04-25T11:22:56.409827+0000","last_undegraded":"2024-04-25T11:22:56.409827+0000","last_fullsized":"2024-04-25T11:22:56.409827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313477+0000","last_change":"2024-04-25T11:22:14.413664+0000","last_active":"2024-04-25T11:23:25.313477+0000","last_peered":"2024-04-25T11:23:25.313477+0000","last_clean":"2024-04-25T11:23:25.313477+0000","last_became_active":"2024-04-25T11:22:14.412621+0000","last_became_peered":"2024-04-25T11:22:14.412621+0000","last_unstale":"2024-04-25T11:23:25.313477+0000","last_undegraded":"2024-04-25T11:23:25.313477+0000","last_fullsized":"2024-04-25T11:23:25.313477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:24.511828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.413683+0000","last_change":"2024-04-25T11:22:13.397141+0000","last_active":"2024-04-25T11:22:56.413683+0000","last_peered":"2024-04-25T11:22:56.413683+0000","last_clean":"2024-04-25T11:22:56.413683+0000","last_became_active":"2024-04-25T11:22:13.396769+0000","last_became_peered":"2024-04-25T11:22:13.396769+0000","last_unstale":"2024-04-25T11:22:56.413683+0000","last_undegraded":"2024-04-25T11:22:56.413683+0000","last_fullsized":"2024-04-25T11:22:56.413683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:40.123906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317016+0000","last_change":"2024-04-25T11:22:14.412279+0000","last_active":"2024-04-25T11:23:25.317016+0000","last_peered":"2024-04-25T11:23:25.317016+0000","last_clean":"2024-04-25T11:23:25.317016+0000","last_became_active":"2024-04-25T11:22:14.410325+0000","last_became_peered":"2024-04-25T11:22:14.410325+0000","last_unstale":"2024-04-25T11:23:25.317016+0000","last_undegraded":"2024-04-25T11:23:25.317016+0000","last_fullsized":"2024-04-25T11:23:25.317016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:03.788349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'31","reported_seq":195,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.556729+0000","last_change":"2024-04-25T11:22:13.393664+0000","last_active":"2024-04-25T11:23:25.556729+0000","last_peered":"2024-04-25T11:23:25.556729+0000","last_clean":"2024-04-25T11:23:25.556729+0000","last_became_active":"2024-04-25T11:22:13.393279+0000","last_became_peered":"2024-04-25T11:22:13.393279+0000","last_unstale":"2024-04-25T11:23:25.556729+0000","last_undegraded":"2024-04-25T11:23:25.556729+0000","last_fullsized":"2024-04-25T11:23:25.556729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61295,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":132,"num_write":32,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.300816+0000","last_change":"2024-04-25T11:22:14.399944+0000","last_active":"2024-04-25T11:23:25.300816+0000","last_peered":"2024-04-25T11:23:25.300816+0000","last_clean":"2024-04-25T11:23:25.300816+0000","last_became_active":"2024-04-25T11:22:14.399592+0000","last_became_peered":"2024-04-25T11:22:14.399592+0000","last_unstale":"2024-04-25T11:23:25.300816+0000","last_undegraded":"2024-04-25T11:23:25.300816+0000","last_fullsized":"2024-04-25T11:23:25.300816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:18.794517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409780+0000","last_change":"2024-04-25T11:22:13.398651+0000","last_active":"2024-04-25T11:22:56.409780+0000","last_peered":"2024-04-25T11:22:56.409780+0000","last_clean":"2024-04-25T11:22:56.409780+0000","last_became_active":"2024-04-25T11:22:13.398234+0000","last_became_peered":"2024-04-25T11:22:13.398234+0000","last_unstale":"2024-04-25T11:22:56.409780+0000","last_undegraded":"2024-04-25T11:22:56.409780+0000","last_fullsized":"2024-04-25T11:22:56.409780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:39.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318642+0000","last_change":"2024-04-25T11:22:14.404684+0000","last_active":"2024-04-25T11:23:25.318642+0000","last_peered":"2024-04-25T11:23:25.318642+0000","last_clean":"2024-04-25T11:23:25.318642+0000","last_became_active":"2024-04-25T11:22:14.404319+0000","last_became_peered":"2024-04-25T11:22:14.404319+0000","last_unstale":"2024-04-25T11:23:25.318642+0000","last_undegraded":"2024-04-25T11:23:25.318642+0000","last_fullsized":"2024-04-25T11:23:25.318642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:40.388670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.412557+0000","last_change":"2024-04-25T11:22:13.397954+0000","last_active":"2024-04-25T11:22:56.412557+0000","last_peered":"2024-04-25T11:22:56.412557+0000","last_clean":"2024-04-25T11:22:56.412557+0000","last_became_active":"2024-04-25T11:22:13.397595+0000","last_became_peered":"2024-04-25T11:22:13.397595+0000","last_unstale":"2024-04-25T11:22:56.412557+0000","last_undegraded":"2024-04-25T11:22:56.412557+0000","last_fullsized":"2024-04-25T11:22:56.412557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:31.912201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.314262+0000","last_change":"2024-04-25T11:22:14.411671+0000","last_active":"2024-04-25T11:23:25.314262+0000","last_peered":"2024-04-25T11:23:25.314262+0000","last_clean":"2024-04-25T11:23:25.314262+0000","last_became_active":"2024-04-25T11:22:14.411034+0000","last_became_peered":"2024-04-25T11:22:14.411034+0000","last_unstale":"2024-04-25T11:23:25.314262+0000","last_undegraded":"2024-04-25T11:23:25.314262+0000","last_fullsized":"2024-04-25T11:23:25.314262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:23.614652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'5","reported_seq":99,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:27.549206+0000","last_change":"2024-04-25T11:22:13.397193+0000","last_active":"2024-04-25T11:23:27.549206+0000","last_peered":"2024-04-25T11:23:27.549206+0000","last_clean":"2024-04-25T11:23:27.549206+0000","last_became_active":"2024-04-25T11:22:13.396319+0000","last_became_peered":"2024-04-25T11:22:13.396319+0000","last_unstale":"2024-04-25T11:23:27.549206+0000","last_undegraded":"2024-04-25T11:23:27.549206+0000","last_fullsized":"2024-04-25T11:23:27.549206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.140114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.312149+0000","last_change":"2024-04-25T11:22:14.404123+0000","last_active":"2024-04-25T11:23:25.312149+0000","last_peered":"2024-04-25T11:23:25.312149+0000","last_clean":"2024-04-25T11:23:25.312149+0000","last_became_active":"2024-04-25T11:22:14.403751+0000","last_became_peered":"2024-04-25T11:22:14.403751+0000","last_unstale":"2024-04-25T11:23:25.312149+0000","last_undegraded":"2024-04-25T11:23:25.312149+0000","last_fullsized":"2024-04-25T11:23:25.312149+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:22.361257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406237+0000","last_change":"2024-04-25T11:22:13.402801+0000","last_active":"2024-04-25T11:22:56.406237+0000","last_peered":"2024-04-25T11:22:56.406237+0000","last_clean":"2024-04-25T11:22:56.406237+0000","last_became_active":"2024-04-25T11:22:13.402417+0000","last_became_peered":"2024-04-25T11:22:13.402417+0000","last_unstale":"2024-04-25T11:22:56.406237+0000","last_undegraded":"2024-04-25T11:22:56.406237+0000","last_fullsized":"2024-04-25T11:22:56.406237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:55.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316718+0000","last_change":"2024-04-25T11:22:14.413947+0000","last_active":"2024-04-25T11:23:25.316718+0000","last_peered":"2024-04-25T11:23:25.316718+0000","last_clean":"2024-04-25T11:23:25.316718+0000","last_became_active":"2024-04-25T11:22:14.413549+0000","last_became_peered":"2024-04-25T11:22:14.413549+0000","last_unstale":"2024-04-25T11:23:25.316718+0000","last_undegraded":"2024-04-25T11:23:25.316718+0000","last_fullsized":"2024-04-25T11:23:25.316718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:42.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.421596+0000","last_change":"2024-04-25T11:22:56.420875+0000","last_active":"2024-04-25T11:22:56.421596+0000","last_peered":"2024-04-25T11:22:56.421596+0000","last_clean":"2024-04-25T11:22:56.421596+0000","last_became_active":"2024-04-25T11:22:56.415615+0000","last_became_peered":"2024-04-25T11:22:56.415615+0000","last_unstale":"2024-04-25T11:22:56.421596+0000","last_undegraded":"2024-04-25T11:22:56.421596+0000","last_fullsized":"2024-04-25T11:22:56.421596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:55.053238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.299904+0000","last_change":"2024-04-25T11:22:56.413403+0000","last_active":"2024-04-25T11:23:25.299904+0000","last_peered":"2024-04-25T11:23:25.299904+0000","last_clean":"2024-04-25T11:23:25.299904+0000","last_became_active":"2024-04-25T11:22:56.413002+0000","last_became_peered":"2024-04-25T11:22:56.413002+0000","last_unstale":"2024-04-25T11:23:25.299904+0000","last_undegraded":"2024-04-25T11:23:25.299904+0000","last_fullsized":"2024-04-25T11:23:25.299904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:42.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.408825+0000","last_change":"2024-04-25T11:22:13.394583+0000","last_active":"2024-04-25T11:22:56.408825+0000","last_peered":"2024-04-25T11:22:56.408825+0000","last_clean":"2024-04-25T11:22:56.408825+0000","last_became_active":"2024-04-25T11:22:13.394210+0000","last_became_peered":"2024-04-25T11:22:13.394210+0000","last_unstale":"2024-04-25T11:22:56.408825+0000","last_undegraded":"2024-04-25T11:22:56.408825+0000","last_fullsized":"2024-04-25T11:22:56.408825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:34.622567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309131+0000","last_change":"2024-04-25T11:22:14.404487+0000","last_active":"2024-04-25T11:23:25.309131+0000","last_peered":"2024-04-25T11:23:25.309131+0000","last_clean":"2024-04-25T11:23:25.309131+0000","last_became_active":"2024-04-25T11:22:14.404096+0000","last_became_peered":"2024-04-25T11:22:14.404096+0000","last_unstale":"2024-04-25T11:23:25.309131+0000","last_undegraded":"2024-04-25T11:23:25.309131+0000","last_fullsized":"2024-04-25T11:23:25.309131+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:55.938011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.410176+0000","last_change":"2024-04-25T11:22:13.397273+0000","last_active":"2024-04-25T11:22:56.410176+0000","last_peered":"2024-04-25T11:22:56.410176+0000","last_clean":"2024-04-25T11:22:56.410176+0000","last_became_active":"2024-04-25T11:22:13.396538+0000","last_became_peered":"2024-04-25T11:22:13.396538+0000","last_unstale":"2024-04-25T11:22:56.410176+0000","last_undegraded":"2024-04-25T11:22:56.410176+0000","last_fullsized":"2024-04-25T11:22:56.410176+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:04.738107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.307767+0000","last_change":"2024-04-25T11:22:56.454081+0000","last_active":"2024-04-25T11:23:25.307767+0000","last_peered":"2024-04-25T11:23:25.307767+0000","last_clean":"2024-04-25T11:23:25.307767+0000","last_became_active":"2024-04-25T11:22:56.453729+0000","last_became_peered":"2024-04-25T11:22:56.453729+0000","last_unstale":"2024-04-25T11:23:25.307767+0000","last_undegraded":"2024-04-25T11:23:25.307767+0000","last_fullsized":"2024-04-25T11:23:25.307767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:55.124699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.299070+0000","last_change":"2024-04-25T11:22:14.411786+0000","last_active":"2024-04-25T11:23:25.299070+0000","last_peered":"2024-04-25T11:23:25.299070+0000","last_clean":"2024-04-25T11:23:25.299070+0000","last_became_active":"2024-04-25T11:22:14.411433+0000","last_became_peered":"2024-04-25T11:22:14.411433+0000","last_unstale":"2024-04-25T11:23:25.299070+0000","last_undegraded":"2024-04-25T11:23:25.299070+0000","last_fullsized":"2024-04-25T11:23:25.299070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:28.948581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.256416+0000","last_change":"2024-04-25T11:22:13.396834+0000","last_active":"2024-04-25T11:23:25.256416+0000","last_peered":"2024-04-25T11:23:25.256416+0000","last_clean":"2024-04-25T11:23:25.256416+0000","last_became_active":"2024-04-25T11:22:13.396439+0000","last_became_peered":"2024-04-25T11:22:13.396439+0000","last_unstale":"2024-04-25T11:23:25.256416+0000","last_undegraded":"2024-04-25T11:23:25.256416+0000","last_fullsized":"2024-04-25T11:23:25.256416+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313719+0000","last_change":"2024-04-25T11:22:14.404784+0000","last_active":"2024-04-25T11:23:25.313719+0000","last_peered":"2024-04-25T11:23:25.313719+0000","last_clean":"2024-04-25T11:23:25.313719+0000","last_became_active":"2024-04-25T11:22:14.404355+0000","last_became_peered":"2024-04-25T11:22:14.404355+0000","last_unstale":"2024-04-25T11:23:25.313719+0000","last_undegraded":"2024-04-25T11:23:25.313719+0000","last_fullsized":"2024-04-25T11:23:25.313719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:04.698767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.414792+0000","last_change":"2024-04-25T11:22:13.389125+0000","last_active":"2024-04-25T11:22:56.414792+0000","last_peered":"2024-04-25T11:22:56.414792+0000","last_clean":"2024-04-25T11:22:56.414792+0000","last_became_active":"2024-04-25T11:22:13.387160+0000","last_became_peered":"2024-04-25T11:22:13.387160+0000","last_unstale":"2024-04-25T11:22:56.414792+0000","last_undegraded":"2024-04-25T11:22:56.414792+0000","last_fullsized":"2024-04-25T11:22:56.414792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:11.839065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409521+0000","last_change":"2024-04-25T11:20:53.708987+0000","last_active":"2024-04-25T11:22:56.409521+0000","last_peered":"2024-04-25T11:22:56.409521+0000","last_clean":"2024-04-25T11:22:56.409521+0000","last_became_active":"2024-04-25T11:20:53.704654+0000","last_became_peered":"2024-04-25T11:20:53.704654+0000","last_unstale":"2024-04-25T11:22:56.409521+0000","last_undegraded":"2024-04-25T11:22:56.409521+0000","last_fullsized":"2024-04-25T11:22:56.409521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_clean_scrub_stamp":"2024-04-25T11:17:24.025142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:24.174044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.292063+0000","last_change":"2024-04-25T11:22:14.413776+0000","last_active":"2024-04-25T11:23:25.292063+0000","last_peered":"2024-04-25T11:23:25.292063+0000","last_clean":"2024-04-25T11:23:25.292063+0000","last_became_active":"2024-04-25T11:22:14.413417+0000","last_became_peered":"2024-04-25T11:22:14.413417+0000","last_unstale":"2024-04-25T11:23:25.292063+0000","last_undegraded":"2024-04-25T11:23:25.292063+0000","last_fullsized":"2024-04-25T11:23:25.292063+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:15.393246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409829+0000","last_change":"2024-04-25T11:22:13.404113+0000","last_active":"2024-04-25T11:22:56.409829+0000","last_peered":"2024-04-25T11:22:56.409829+0000","last_clean":"2024-04-25T11:22:56.409829+0000","last_became_active":"2024-04-25T11:22:13.403711+0000","last_became_peered":"2024-04-25T11:22:13.403711+0000","last_unstale":"2024-04-25T11:22:56.409829+0000","last_undegraded":"2024-04-25T11:22:56.409829+0000","last_fullsized":"2024-04-25T11:22:56.409829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:52.618167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406705+0000","last_change":"2024-04-25T11:22:13.404334+0000","last_active":"2024-04-25T11:22:56.406705+0000","last_peered":"2024-04-25T11:22:56.406705+0000","last_clean":"2024-04-25T11:22:56.406705+0000","last_became_active":"2024-04-25T11:22:13.403896+0000","last_became_peered":"2024-04-25T11:22:13.403896+0000","last_unstale":"2024-04-25T11:22:56.406705+0000","last_undegraded":"2024-04-25T11:22:56.406705+0000","last_fullsized":"2024-04-25T11:22:56.406705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:24.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.295477+0000","last_change":"2024-04-25T11:22:14.406921+0000","last_active":"2024-04-25T11:23:25.295477+0000","last_peered":"2024-04-25T11:23:25.295477+0000","last_clean":"2024-04-25T11:23:25.295477+0000","last_became_active":"2024-04-25T11:22:14.406520+0000","last_became_peered":"2024-04-25T11:22:14.406520+0000","last_unstale":"2024-04-25T11:23:25.295477+0000","last_undegraded":"2024-04-25T11:23:25.295477+0000","last_fullsized":"2024-04-25T11:23:25.295477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:24.127805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'9","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409123+0000","last_change":"2024-04-25T11:22:13.400870+0000","last_active":"2024-04-25T11:22:56.409123+0000","last_peered":"2024-04-25T11:22:56.409123+0000","last_clean":"2024-04-25T11:22:56.409123+0000","last_became_active":"2024-04-25T11:22:13.400479+0000","last_became_peered":"2024-04-25T11:22:13.400479+0000","last_unstale":"2024-04-25T11:22:56.409123+0000","last_undegraded":"2024-04-25T11:22:56.409123+0000","last_fullsized":"2024-04-25T11:22:56.409123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:12.975205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317888+0000","last_change":"2024-04-25T11:22:14.402782+0000","last_active":"2024-04-25T11:23:25.317888+0000","last_peered":"2024-04-25T11:23:25.317888+0000","last_clean":"2024-04-25T11:23:25.317888+0000","last_became_active":"2024-04-25T11:22:14.402368+0000","last_became_peered":"2024-04-25T11:22:14.402368+0000","last_unstale":"2024-04-25T11:23:25.317888+0000","last_undegraded":"2024-04-25T11:23:25.317888+0000","last_fullsized":"2024-04-25T11:23:25.317888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:49.897015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.414263+0000","last_change":"2024-04-25T11:22:13.390229+0000","last_active":"2024-04-25T11:22:56.414263+0000","last_peered":"2024-04-25T11:22:56.414263+0000","last_clean":"2024-04-25T11:22:56.414263+0000","last_became_active":"2024-04-25T11:22:13.389825+0000","last_became_peered":"2024-04-25T11:22:13.389825+0000","last_unstale":"2024-04-25T11:22:56.414263+0000","last_undegraded":"2024-04-25T11:22:56.414263+0000","last_fullsized":"2024-04-25T11:22:56.414263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:50.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.315176+0000","last_change":"2024-04-25T11:22:14.412066+0000","last_active":"2024-04-25T11:23:25.315176+0000","last_peered":"2024-04-25T11:23:25.315176+0000","last_clean":"2024-04-25T11:23:25.315176+0000","last_became_active":"2024-04-25T11:22:14.411707+0000","last_became_peered":"2024-04-25T11:22:14.411707+0000","last_unstale":"2024-04-25T11:23:25.315176+0000","last_undegraded":"2024-04-25T11:23:25.315176+0000","last_fullsized":"2024-04-25T11:23:25.315176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:13.274928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.412234+0000","last_change":"2024-04-25T11:22:13.397644+0000","last_active":"2024-04-25T11:22:56.412234+0000","last_peered":"2024-04-25T11:22:56.412234+0000","last_clean":"2024-04-25T11:22:56.412234+0000","last_became_active":"2024-04-25T11:22:13.397240+0000","last_became_peered":"2024-04-25T11:22:13.397240+0000","last_unstale":"2024-04-25T11:22:56.412234+0000","last_undegraded":"2024-04-25T11:22:56.412234+0000","last_fullsized":"2024-04-25T11:22:56.412234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.927399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.267630+0000","last_change":"2024-04-25T11:22:14.416191+0000","last_active":"2024-04-25T11:23:25.267630+0000","last_peered":"2024-04-25T11:23:25.267630+0000","last_clean":"2024-04-25T11:23:25.267630+0000","last_became_active":"2024-04-25T11:22:14.415537+0000","last_became_peered":"2024-04-25T11:22:14.415537+0000","last_unstale":"2024-04-25T11:23:25.267630+0000","last_undegraded":"2024-04-25T11:23:25.267630+0000","last_fullsized":"2024-04-25T11:23:25.267630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:27.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.410690+0000","last_change":"2024-04-25T11:22:13.390329+0000","last_active":"2024-04-25T11:22:56.410690+0000","last_peered":"2024-04-25T11:22:56.410690+0000","last_clean":"2024-04-25T11:22:56.410690+0000","last_became_active":"2024-04-25T11:22:13.389854+0000","last_became_peered":"2024-04-25T11:22:13.389854+0000","last_unstale":"2024-04-25T11:22:56.410690+0000","last_undegraded":"2024-04-25T11:22:56.410690+0000","last_fullsized":"2024-04-25T11:22:56.410690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:01.238826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317939+0000","last_change":"2024-04-25T11:22:14.395782+0000","last_active":"2024-04-25T11:23:25.317939+0000","last_peered":"2024-04-25T11:23:25.317939+0000","last_clean":"2024-04-25T11:23:25.317939+0000","last_became_active":"2024-04-25T11:22:14.395321+0000","last_became_peered":"2024-04-25T11:22:14.395321+0000","last_unstale":"2024-04-25T11:23:25.317939+0000","last_undegraded":"2024-04-25T11:23:25.317939+0000","last_fullsized":"2024-04-25T11:23:25.317939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:08.842424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409263+0000","last_change":"2024-04-25T11:22:13.401087+0000","last_active":"2024-04-25T11:22:56.409263+0000","last_peered":"2024-04-25T11:22:56.409263+0000","last_clean":"2024-04-25T11:22:56.409263+0000","last_became_active":"2024-04-25T11:22:13.400537+0000","last_became_peered":"2024-04-25T11:22:13.400537+0000","last_unstale":"2024-04-25T11:22:56.409263+0000","last_undegraded":"2024-04-25T11:22:56.409263+0000","last_fullsized":"2024-04-25T11:22:56.409263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:24.566260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309671+0000","last_change":"2024-04-25T11:22:14.399436+0000","last_active":"2024-04-25T11:23:25.309671+0000","last_peered":"2024-04-25T11:23:25.309671+0000","last_clean":"2024-04-25T11:23:25.309671+0000","last_became_active":"2024-04-25T11:22:14.398968+0000","last_became_peered":"2024-04-25T11:22:14.398968+0000","last_unstale":"2024-04-25T11:23:25.309671+0000","last_undegraded":"2024-04-25T11:23:25.309671+0000","last_fullsized":"2024-04-25T11:23:25.309671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:52.426381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.420115+0000","last_change":"2024-04-25T11:22:56.420115+0000","last_active":"2024-04-25T11:22:56.420115+0000","last_peered":"2024-04-25T11:22:56.420115+0000","last_clean":"2024-04-25T11:22:56.420115+0000","last_became_active":"2024-04-25T11:22:56.414491+0000","last_became_peered":"2024-04-25T11:22:56.414491+0000","last_unstale":"2024-04-25T11:22:56.420115+0000","last_undegraded":"2024-04-25T11:22:56.420115+0000","last_fullsized":"2024-04-25T11:22:56.420115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:36.180143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317665+0000","last_change":"2024-04-25T11:22:14.403391+0000","last_active":"2024-04-25T11:23:25.317665+0000","last_peered":"2024-04-25T11:23:25.317665+0000","last_clean":"2024-04-25T11:23:25.317665+0000","last_became_active":"2024-04-25T11:22:14.402817+0000","last_became_peered":"2024-04-25T11:22:14.402817+0000","last_unstale":"2024-04-25T11:23:25.317665+0000","last_undegraded":"2024-04-25T11:23:25.317665+0000","last_fullsized":"2024-04-25T11:23:25.317665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:34.190216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409932+0000","last_change":"2024-04-25T11:22:13.394733+0000","last_active":"2024-04-25T11:22:56.409932+0000","last_peered":"2024-04-25T11:22:56.409932+0000","last_clean":"2024-04-25T11:22:56.409932+0000","last_became_active":"2024-04-25T11:22:13.394389+0000","last_became_peered":"2024-04-25T11:22:13.394389+0000","last_unstale":"2024-04-25T11:22:56.409932+0000","last_undegraded":"2024-04-25T11:22:56.409932+0000","last_fullsized":"2024-04-25T11:22:56.409932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.751957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317795+0000","last_change":"2024-04-25T11:22:14.398974+0000","last_active":"2024-04-25T11:23:25.317795+0000","last_peered":"2024-04-25T11:23:25.317795+0000","last_clean":"2024-04-25T11:23:25.317795+0000","last_became_active":"2024-04-25T11:22:14.396317+0000","last_became_peered":"2024-04-25T11:22:14.396317+0000","last_unstale":"2024-04-25T11:23:25.317795+0000","last_undegraded":"2024-04-25T11:23:25.317795+0000","last_fullsized":"2024-04-25T11:23:25.317795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:43.173266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.413544+0000","last_change":"2024-04-25T11:22:13.405081+0000","last_active":"2024-04-25T11:22:56.413544+0000","last_peered":"2024-04-25T11:22:56.413544+0000","last_clean":"2024-04-25T11:22:56.413544+0000","last_became_active":"2024-04-25T11:22:13.404160+0000","last_became_peered":"2024-04-25T11:22:13.404160+0000","last_unstale":"2024-04-25T11:22:56.413544+0000","last_undegraded":"2024-04-25T11:22:56.413544+0000","last_fullsized":"2024-04-25T11:22:56.413544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:33.591987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309382+0000","last_change":"2024-04-25T11:22:14.406014+0000","last_active":"2024-04-25T11:23:25.309382+0000","last_peered":"2024-04-25T11:23:25.309382+0000","last_clean":"2024-04-25T11:23:25.309382+0000","last_became_active":"2024-04-25T11:22:14.405609+0000","last_became_peered":"2024-04-25T11:22:14.405609+0000","last_unstale":"2024-04-25T11:23:25.309382+0000","last_undegraded":"2024-04-25T11:23:25.309382+0000","last_fullsized":"2024-04-25T11:23:25.309382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:55.357497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.422584+0000","last_change":"2024-04-25T11:22:56.422584+0000","last_active":"2024-04-25T11:22:56.422584+0000","last_peered":"2024-04-25T11:22:56.422584+0000","last_clean":"2024-04-25T11:22:56.422584+0000","last_became_active":"2024-04-25T11:22:56.415765+0000","last_became_peered":"2024-04-25T11:22:56.415765+0000","last_unstale":"2024-04-25T11:22:56.422584+0000","last_undegraded":"2024-04-25T11:22:56.422584+0000","last_fullsized":"2024-04-25T11:22:56.422584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:31.321372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313108+0000","last_change":"2024-04-25T11:22:14.396359+0000","last_active":"2024-04-25T11:23:25.313108+0000","last_peered":"2024-04-25T11:23:25.313108+0000","last_clean":"2024-04-25T11:23:25.313108+0000","last_became_active":"2024-04-25T11:22:14.395818+0000","last_became_peered":"2024-04-25T11:22:14.395818+0000","last_unstale":"2024-04-25T11:23:25.313108+0000","last_undegraded":"2024-04-25T11:23:25.313108+0000","last_fullsized":"2024-04-25T11:23:25.313108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.964366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.304695+0000","last_change":"2024-04-25T11:22:14.396700+0000","last_active":"2024-04-25T11:23:25.304695+0000","last_peered":"2024-04-25T11:23:25.304695+0000","last_clean":"2024-04-25T11:23:25.304695+0000","last_became_active":"2024-04-25T11:22:14.396353+0000","last_became_peered":"2024-04-25T11:22:14.396353+0000","last_unstale":"2024-04-25T11:23:25.304695+0000","last_undegraded":"2024-04-25T11:23:25.304695+0000","last_fullsized":"2024-04-25T11:23:25.304695+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:23.570878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.304134+0000","last_change":"2024-04-25T11:22:14.412317+0000","last_active":"2024-04-25T11:23:25.304134+0000","last_peered":"2024-04-25T11:23:25.304134+0000","last_clean":"2024-04-25T11:23:25.304134+0000","last_became_active":"2024-04-25T11:22:14.411940+0000","last_became_peered":"2024-04-25T11:22:14.411940+0000","last_unstale":"2024-04-25T11:23:25.304134+0000","last_undegraded":"2024-04-25T11:23:25.304134+0000","last_fullsized":"2024-04-25T11:23:25.304134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306390+0000","last_change":"2024-04-25T11:22:14.407779+0000","last_active":"2024-04-25T11:23:25.306390+0000","last_peered":"2024-04-25T11:23:25.306390+0000","last_clean":"2024-04-25T11:23:25.306390+0000","last_became_active":"2024-04-25T11:22:14.407443+0000","last_became_peered":"2024-04-25T11:22:14.407443+0000","last_unstale":"2024-04-25T11:23:25.306390+0000","last_undegraded":"2024-04-25T11:23:25.306390+0000","last_fullsized":"2024-04-25T11:23:25.306390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:00.316425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317259+0000","last_change":"2024-04-25T11:22:14.412005+0000","last_active":"2024-04-25T11:23:25.317259+0000","last_peered":"2024-04-25T11:23:25.317259+0000","last_clean":"2024-04-25T11:23:25.317259+0000","last_became_active":"2024-04-25T11:22:14.411626+0000","last_became_peered":"2024-04-25T11:22:14.411626+0000","last_unstale":"2024-04-25T11:23:25.317259+0000","last_undegraded":"2024-04-25T11:23:25.317259+0000","last_fullsized":"2024-04-25T11:23:25.317259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.320505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318641+0000","last_change":"2024-04-25T11:22:14.415812+0000","last_active":"2024-04-25T11:23:25.318641+0000","last_peered":"2024-04-25T11:23:25.318641+0000","last_clean":"2024-04-25T11:23:25.318641+0000","last_became_active":"2024-04-25T11:22:14.415455+0000","last_became_peered":"2024-04-25T11:22:14.415455+0000","last_unstale":"2024-04-25T11:23:25.318641+0000","last_undegraded":"2024-04-25T11:23:25.318641+0000","last_fullsized":"2024-04-25T11:23:25.318641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:55.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.304851+0000","last_change":"2024-04-25T11:22:14.400892+0000","last_active":"2024-04-25T11:23:25.304851+0000","last_peered":"2024-04-25T11:23:25.304851+0000","last_clean":"2024-04-25T11:23:25.304851+0000","last_became_active":"2024-04-25T11:22:14.400526+0000","last_became_peered":"2024-04-25T11:22:14.400526+0000","last_unstale":"2024-04-25T11:23:25.304851+0000","last_undegraded":"2024-04-25T11:23:25.304851+0000","last_fullsized":"2024-04-25T11:23:25.304851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:20.123680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.305434+0000","last_change":"2024-04-25T11:22:14.403134+0000","last_active":"2024-04-25T11:23:25.305434+0000","last_peered":"2024-04-25T11:23:25.305434+0000","last_clean":"2024-04-25T11:23:25.305434+0000","last_became_active":"2024-04-25T11:22:14.402795+0000","last_became_peered":"2024-04-25T11:22:14.402795+0000","last_unstale":"2024-04-25T11:23:25.305434+0000","last_undegraded":"2024-04-25T11:23:25.305434+0000","last_fullsized":"2024-04-25T11:23:25.305434+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.496135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309920+0000","last_change":"2024-04-25T11:22:14.410963+0000","last_active":"2024-04-25T11:23:25.309920+0000","last_peered":"2024-04-25T11:23:25.309920+0000","last_clean":"2024-04-25T11:23:25.309920+0000","last_became_active":"2024-04-25T11:22:14.410555+0000","last_became_peered":"2024-04-25T11:22:14.410555+0000","last_unstale":"2024-04-25T11:23:25.309920+0000","last_undegraded":"2024-04-25T11:23:25.309920+0000","last_fullsized":"2024-04-25T11:23:25.309920+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:56.505717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.300448+0000","last_change":"2024-04-25T11:22:14.405094+0000","last_active":"2024-04-25T11:23:25.300448+0000","last_peered":"2024-04-25T11:23:25.300448+0000","last_clean":"2024-04-25T11:23:25.300448+0000","last_became_active":"2024-04-25T11:22:14.404749+0000","last_became_peered":"2024-04-25T11:22:14.404749+0000","last_unstale":"2024-04-25T11:23:25.300448+0000","last_undegraded":"2024-04-25T11:23:25.300448+0000","last_fullsized":"2024-04-25T11:23:25.300448+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:44.129648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316952+0000","last_change":"2024-04-25T11:22:14.396868+0000","last_active":"2024-04-25T11:23:25.316952+0000","last_peered":"2024-04-25T11:23:25.316952+0000","last_clean":"2024-04-25T11:23:25.316952+0000","last_became_active":"2024-04-25T11:22:14.396421+0000","last_became_peered":"2024-04-25T11:22:14.396421+0000","last_unstale":"2024-04-25T11:23:25.316952+0000","last_undegraded":"2024-04-25T11:23:25.316952+0000","last_fullsized":"2024-04-25T11:23:25.316952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:24.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.319637+0000","last_change":"2024-04-25T11:22:14.400510+0000","last_active":"2024-04-25T11:23:25.319637+0000","last_peered":"2024-04-25T11:23:25.319637+0000","last_clean":"2024-04-25T11:23:25.319637+0000","last_became_active":"2024-04-25T11:22:14.400037+0000","last_became_peered":"2024-04-25T11:22:14.400037+0000","last_unstale":"2024-04-25T11:23:25.319637+0000","last_undegraded":"2024-04-25T11:23:25.319637+0000","last_fullsized":"2024-04-25T11:23:25.319637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.293068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318833+0000","last_change":"2024-04-25T11:22:14.404415+0000","last_active":"2024-04-25T11:23:25.318833+0000","last_peered":"2024-04-25T11:23:25.318833+0000","last_clean":"2024-04-25T11:23:25.318833+0000","last_became_active":"2024-04-25T11:22:14.404032+0000","last_became_peered":"2024-04-25T11:22:14.404032+0000","last_unstale":"2024-04-25T11:23:25.318833+0000","last_undegraded":"2024-04-25T11:23:25.318833+0000","last_fullsized":"2024-04-25T11:23:25.318833+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:03.318304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.305532+0000","last_change":"2024-04-25T11:22:14.410650+0000","last_active":"2024-04-25T11:23:25.305532+0000","last_peered":"2024-04-25T11:23:25.305532+0000","last_clean":"2024-04-25T11:23:25.305532+0000","last_became_active":"2024-04-25T11:22:14.410216+0000","last_became_peered":"2024-04-25T11:22:14.410216+0000","last_unstale":"2024-04-25T11:23:25.305532+0000","last_undegraded":"2024-04-25T11:23:25.305532+0000","last_fullsized":"2024-04-25T11:23:25.305532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:28.364279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246033,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65969,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":166,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":197907,"data_compressed":5577,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645341,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":856064,"data_stored":410994,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841570,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1063698,"data_compressed":43287,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005095,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":410626,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201326,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":860160,"data_stored":410524,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430258,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":909312,"data_stored":1002567,"data_compressed":41428,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":851968,"data_stored":410015,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":471103,"data_compressed":7674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":411286,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":472985,"data_compressed":7674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149767,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":868352,"data_stored":410326,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953539,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":410984,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790013,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":1002301,"data_compressed":41428,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61295,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":63177,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63405,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:23:31.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T11:23:31.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:31 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:31.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:31 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:23:31.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:31 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:23:31.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:31 smithi196 ceph-mon[32659]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:31.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:31 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:31.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:31 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:23:31.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:31 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:23:31.745 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:31 smithi082 ceph-mon[32440]: from='mgr.14152 172.21.15.80:0/108290447' entity='mgr.x' 2024-04-25T11:23:31.819 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:32.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:32 smithi080 ceph-mon[29126]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:23:32.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:32 smithi080 ceph-mon[29126]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:23:32.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:32 smithi196 ceph-mon[32659]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:23:32.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:32 smithi196 ceph-mon[32659]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:23:32.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:32 smithi082 ceph-mon[32440]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:23:32.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:32 smithi082 ceph-mon[32440]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:23:33.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 -- 172.21.15.80:0/3656588176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 msgr2=0x7ffaa0109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/3656588176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa0109200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffa900099c0 tx=0x7ffa90009cd0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 -- 172.21.15.80:0/3656588176 shutdown_connections 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/3656588176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa0109740 0x7ffaa01110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/3656588176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaa01044c0 0x7ffaa01048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/3656588176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa0109200 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 -- 172.21.15.80:0/3656588176 >> 172.21.15.80:0/3656588176 conn(0x7ffaa00ffeb0 msgr2=0x7ffaa01022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 -- 172.21.15.80:0/3656588176 shutdown_connections 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.481+0000 7ffaa53e2700 1 -- 172.21.15.80:0/3656588176 wait complete. 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.482+0000 7ffaa53e2700 1 Processor -- start 2024-04-25T11:23:33.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.482+0000 7ffaa53e2700 1 -- start start 2024-04-25T11:23:33.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaa01044c0 0x7ffaa01a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:33.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa01a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa0109740 0x7ffaa019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0114350 con 0x7ffaa0108df0 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01141d0 con 0x7ffaa01044c0 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01144d0 con 0x7ffaa0109740 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa01a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa01a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37366/0 (socket says 172.21.15.80:37366) 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 -- 172.21.15.80:0/2898712565 learned_addr learned my addr 172.21.15.80:0/2898712565 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9effd700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaa01044c0 0x7ffaa01a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9f7fe700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa0109740 0x7ffaa019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 -- 172.21.15.80:0/2898712565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa0109740 msgr2=0x7ffaa019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa0109740 0x7ffaa019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 -- 172.21.15.80:0/2898712565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaa01044c0 msgr2=0x7ffaa01a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:33.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaa01044c0 0x7ffaa01a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 -- 172.21.15.80:0/2898712565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa019b1d0 con 0x7ffaa0108df0 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa9e7fc700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa01a0e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffa90006010 tx=0x7ffa900047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa97fff700 1 -- 172.21.15.80:0/2898712565 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90027070 con 0x7ffaa0108df0 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa019b460 con 0x7ffaa0108df0 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa97fff700 1 -- 172.21.15.80:0/2898712565 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa90003f20 con 0x7ffaa0108df0 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffa97fff700 1 -- 172.21.15.80:0/2898712565 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90022c60 con 0x7ffaa0108df0 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.483+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa01a7760 con 0x7ffaa0108df0 2024-04-25T11:23:33.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.484+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa0105970 con 0x7ffaa0108df0 2024-04-25T11:23:33.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.486+0000 7ffa97fff700 1 -- 172.21.15.80:0/2898712565 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7ffa9002a070 con 0x7ffaa0108df0 2024-04-25T11:23:33.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.486+0000 7ffa97fff700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa8c0afb80 0x7ffa8c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:33.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.486+0000 7ffa9effd700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa8c0afb80 0x7ffa8c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:33.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.487+0000 7ffa97fff700 1 -- 172.21.15.80:0/2898712565 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ffa90022e00 con 0x7ffaa0108df0 2024-04-25T11:23:33.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.487+0000 7ffa9effd700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa8c0afb80 0x7ffa8c0b2090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa88005950 tx=0x7ffa8800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:33.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.490+0000 7ffa97fff700 1 -- 172.21.15.80:0/2898712565 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffa90031080 con 0x7ffaa0108df0 2024-04-25T11:23:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.686+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffaa019bfe0 con 0x7ffa8c0afb80 2024-04-25T11:23:33.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.693+0000 7ffa97fff700 1 -- 172.21.15.80:0/2898712565 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259157 (secure 0 0 0) 0x7ffaa019bfe0 con 0x7ffa8c0afb80 2024-04-25T11:23:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:33.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa8c0afb80 msgr2=0x7ffa8c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa8c0afb80 0x7ffa8c0b2090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa88005950 tx=0x7ffa8800a300 comp rx=0 tx=0).stop 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 msgr2=0x7ffaa01a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa01a0e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffa90006010 tx=0x7ffa900047b0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 shutdown_connections 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ffa8c0afb80 0x7ffa8c0b2090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa0109740 0x7ffaa019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaa01044c0 0x7ffaa01a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 --2- 172.21.15.80:0/2898712565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa0108df0 0x7ffaa01a0e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.696+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 >> 172.21.15.80:0/2898712565 conn(0x7ffaa00ffeb0 msgr2=0x7ffaa0108560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.697+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 shutdown_connections 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:33.697+0000 7ffaa53e2700 1 -- 172.21.15.80:0/2898712565 wait complete. 2024-04-25T11:23:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T11:23:34.370 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-04-25T11:23:33.310013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656571,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":545,"num_read_kb":373,"num_write":291,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":738,"ondisk_log_size":738,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351284,"kb_used_data":10452,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590540,"statfs":{"total":1151940427776,"available":1151580712960,"internally_reserved":0,"allocated":10702848,"data_stored":6887409,"data_compressed":182196,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":531,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":48,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004130"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318363+0000","last_change":"2024-04-25T11:22:14.408035+0000","last_active":"2024-04-25T11:23:25.318363+0000","last_peered":"2024-04-25T11:23:25.318363+0000","last_clean":"2024-04-25T11:23:25.318363+0000","last_became_active":"2024-04-25T11:22:14.407691+0000","last_became_peered":"2024-04-25T11:22:14.407691+0000","last_unstale":"2024-04-25T11:23:25.318363+0000","last_undegraded":"2024-04-25T11:23:25.318363+0000","last_fullsized":"2024-04-25T11:23:25.318363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:27.388402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316108+0000","last_change":"2024-04-25T11:22:14.415270+0000","last_active":"2024-04-25T11:23:25.316108+0000","last_peered":"2024-04-25T11:23:25.316108+0000","last_clean":"2024-04-25T11:23:25.316108+0000","last_became_active":"2024-04-25T11:22:14.413962+0000","last_became_peered":"2024-04-25T11:22:14.413962+0000","last_unstale":"2024-04-25T11:23:25.316108+0000","last_undegraded":"2024-04-25T11:23:25.316108+0000","last_fullsized":"2024-04-25T11:23:25.316108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:31.160774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316261+0000","last_change":"2024-04-25T11:22:14.402643+0000","last_active":"2024-04-25T11:23:25.316261+0000","last_peered":"2024-04-25T11:23:25.316261+0000","last_clean":"2024-04-25T11:23:25.316261+0000","last_became_active":"2024-04-25T11:22:14.401940+0000","last_became_peered":"2024-04-25T11:22:14.401940+0000","last_unstale":"2024-04-25T11:23:25.316261+0000","last_undegraded":"2024-04-25T11:23:25.316261+0000","last_fullsized":"2024-04-25T11:23:25.316261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:47.270354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306709+0000","last_change":"2024-04-25T11:22:14.413726+0000","last_active":"2024-04-25T11:23:25.306709+0000","last_peered":"2024-04-25T11:23:25.306709+0000","last_clean":"2024-04-25T11:23:25.306709+0000","last_became_active":"2024-04-25T11:22:14.412971+0000","last_became_peered":"2024-04-25T11:22:14.412971+0000","last_unstale":"2024-04-25T11:23:25.306709+0000","last_undegraded":"2024-04-25T11:23:25.306709+0000","last_fullsized":"2024-04-25T11:23:25.306709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:42.017286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.292642+0000","last_change":"2024-04-25T11:22:14.403390+0000","last_active":"2024-04-25T11:23:25.292642+0000","last_peered":"2024-04-25T11:23:25.292642+0000","last_clean":"2024-04-25T11:23:25.292642+0000","last_became_active":"2024-04-25T11:22:14.402999+0000","last_became_peered":"2024-04-25T11:22:14.402999+0000","last_unstale":"2024-04-25T11:23:25.292642+0000","last_undegraded":"2024-04-25T11:23:25.292642+0000","last_fullsized":"2024-04-25T11:23:25.292642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:59.283486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306774+0000","last_change":"2024-04-25T11:22:56.415548+0000","last_active":"2024-04-25T11:23:25.306774+0000","last_peered":"2024-04-25T11:23:25.306774+0000","last_clean":"2024-04-25T11:23:25.306774+0000","last_became_active":"2024-04-25T11:22:56.414819+0000","last_became_peered":"2024-04-25T11:22:56.414819+0000","last_unstale":"2024-04-25T11:23:25.306774+0000","last_undegraded":"2024-04-25T11:23:25.306774+0000","last_fullsized":"2024-04-25T11:23:25.306774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:32.599336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313452+0000","last_change":"2024-04-25T11:22:14.404800+0000","last_active":"2024-04-25T11:23:25.313452+0000","last_peered":"2024-04-25T11:23:25.313452+0000","last_clean":"2024-04-25T11:23:25.313452+0000","last_became_active":"2024-04-25T11:22:14.404445+0000","last_became_peered":"2024-04-25T11:22:14.404445+0000","last_unstale":"2024-04-25T11:23:25.313452+0000","last_undegraded":"2024-04-25T11:23:25.313452+0000","last_fullsized":"2024-04-25T11:23:25.313452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:51.498081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.302906+0000","last_change":"2024-04-25T11:22:56.415367+0000","last_active":"2024-04-25T11:23:25.302906+0000","last_peered":"2024-04-25T11:23:25.302906+0000","last_clean":"2024-04-25T11:23:25.302906+0000","last_became_active":"2024-04-25T11:22:56.414982+0000","last_became_peered":"2024-04-25T11:22:56.414982+0000","last_unstale":"2024-04-25T11:23:25.302906+0000","last_undegraded":"2024-04-25T11:23:25.302906+0000","last_fullsized":"2024-04-25T11:23:25.302906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:23.069726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317149+0000","last_change":"2024-04-25T11:22:14.410119+0000","last_active":"2024-04-25T11:23:25.317149+0000","last_peered":"2024-04-25T11:23:25.317149+0000","last_clean":"2024-04-25T11:23:25.317149+0000","last_became_active":"2024-04-25T11:22:14.409736+0000","last_became_peered":"2024-04-25T11:22:14.409736+0000","last_unstale":"2024-04-25T11:23:25.317149+0000","last_undegraded":"2024-04-25T11:23:25.317149+0000","last_fullsized":"2024-04-25T11:23:25.317149+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:57.842921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309023+0000","last_change":"2024-04-25T11:22:14.416368+0000","last_active":"2024-04-25T11:23:25.309023+0000","last_peered":"2024-04-25T11:23:25.309023+0000","last_clean":"2024-04-25T11:23:25.309023+0000","last_became_active":"2024-04-25T11:22:14.415888+0000","last_became_peered":"2024-04-25T11:22:14.415888+0000","last_unstale":"2024-04-25T11:23:25.309023+0000","last_undegraded":"2024-04-25T11:23:25.309023+0000","last_fullsized":"2024-04-25T11:23:25.309023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:00.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317732+0000","last_change":"2024-04-25T11:22:14.402490+0000","last_active":"2024-04-25T11:23:25.317732+0000","last_peered":"2024-04-25T11:23:25.317732+0000","last_clean":"2024-04-25T11:23:25.317732+0000","last_became_active":"2024-04-25T11:22:14.402115+0000","last_became_peered":"2024-04-25T11:22:14.402115+0000","last_unstale":"2024-04-25T11:23:25.317732+0000","last_undegraded":"2024-04-25T11:23:25.317732+0000","last_fullsized":"2024-04-25T11:23:25.317732+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:34.783230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.307752+0000","last_change":"2024-04-25T11:22:14.420570+0000","last_active":"2024-04-25T11:23:25.307752+0000","last_peered":"2024-04-25T11:23:25.307752+0000","last_clean":"2024-04-25T11:23:25.307752+0000","last_became_active":"2024-04-25T11:22:14.420187+0000","last_became_peered":"2024-04-25T11:22:14.420187+0000","last_unstale":"2024-04-25T11:23:25.307752+0000","last_undegraded":"2024-04-25T11:23:25.307752+0000","last_fullsized":"2024-04-25T11:23:25.307752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:52.828114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.311932+0000","last_change":"2024-04-25T11:22:14.414789+0000","last_active":"2024-04-25T11:23:25.311932+0000","last_peered":"2024-04-25T11:23:25.311932+0000","last_clean":"2024-04-25T11:23:25.311932+0000","last_became_active":"2024-04-25T11:22:14.414465+0000","last_became_peered":"2024-04-25T11:22:14.414465+0000","last_unstale":"2024-04-25T11:23:25.311932+0000","last_undegraded":"2024-04-25T11:23:25.311932+0000","last_fullsized":"2024-04-25T11:23:25.311932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:37.748045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.307488+0000","last_change":"2024-04-25T11:22:14.413268+0000","last_active":"2024-04-25T11:23:25.307488+0000","last_peered":"2024-04-25T11:23:25.307488+0000","last_clean":"2024-04-25T11:23:25.307488+0000","last_became_active":"2024-04-25T11:22:14.412897+0000","last_became_peered":"2024-04-25T11:22:14.412897+0000","last_unstale":"2024-04-25T11:23:25.307488+0000","last_undegraded":"2024-04-25T11:23:25.307488+0000","last_fullsized":"2024-04-25T11:23:25.307488+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:49.997236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.308481+0000","last_change":"2024-04-25T11:22:14.411114+0000","last_active":"2024-04-25T11:23:25.308481+0000","last_peered":"2024-04-25T11:23:25.308481+0000","last_clean":"2024-04-25T11:23:25.308481+0000","last_became_active":"2024-04-25T11:22:14.410700+0000","last_became_peered":"2024-04-25T11:22:14.410700+0000","last_unstale":"2024-04-25T11:23:25.308481+0000","last_undegraded":"2024-04-25T11:23:25.308481+0000","last_fullsized":"2024-04-25T11:23:25.308481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:38.367214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.315077+0000","last_change":"2024-04-25T11:22:14.408073+0000","last_active":"2024-04-25T11:23:25.315077+0000","last_peered":"2024-04-25T11:23:25.315077+0000","last_clean":"2024-04-25T11:23:25.315077+0000","last_became_active":"2024-04-25T11:22:14.406878+0000","last_became_peered":"2024-04-25T11:22:14.406878+0000","last_unstale":"2024-04-25T11:23:25.315077+0000","last_undegraded":"2024-04-25T11:23:25.315077+0000","last_fullsized":"2024-04-25T11:23:25.315077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:00.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318593+0000","last_change":"2024-04-25T11:22:14.406990+0000","last_active":"2024-04-25T11:23:25.318593+0000","last_peered":"2024-04-25T11:23:25.318593+0000","last_clean":"2024-04-25T11:23:25.318593+0000","last_became_active":"2024-04-25T11:22:14.406643+0000","last_became_peered":"2024-04-25T11:22:14.406643+0000","last_unstale":"2024-04-25T11:23:25.318593+0000","last_undegraded":"2024-04-25T11:23:25.318593+0000","last_fullsized":"2024-04-25T11:23:25.318593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:15.226490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.301176+0000","last_change":"2024-04-25T11:22:14.410651+0000","last_active":"2024-04-25T11:23:25.301176+0000","last_peered":"2024-04-25T11:23:25.301176+0000","last_clean":"2024-04-25T11:23:25.301176+0000","last_became_active":"2024-04-25T11:22:14.410299+0000","last_became_peered":"2024-04-25T11:22:14.410299+0000","last_unstale":"2024-04-25T11:23:25.301176+0000","last_undegraded":"2024-04-25T11:23:25.301176+0000","last_fullsized":"2024-04-25T11:23:25.301176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:50.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.300107+0000","last_change":"2024-04-25T11:22:14.405714+0000","last_active":"2024-04-25T11:23:25.300107+0000","last_peered":"2024-04-25T11:23:25.300107+0000","last_clean":"2024-04-25T11:23:25.300107+0000","last_became_active":"2024-04-25T11:22:14.405376+0000","last_became_peered":"2024-04-25T11:22:14.405376+0000","last_unstale":"2024-04-25T11:23:25.300107+0000","last_undegraded":"2024-04-25T11:23:25.300107+0000","last_fullsized":"2024-04-25T11:23:25.300107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:18.538532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":45,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.421708+0000","last_change":"2024-04-25T11:22:56.421708+0000","last_active":"2024-04-25T11:22:56.421708+0000","last_peered":"2024-04-25T11:22:56.421708+0000","last_clean":"2024-04-25T11:22:56.421708+0000","last_became_active":"2024-04-25T11:22:56.413182+0000","last_became_peered":"2024-04-25T11:22:56.413182+0000","last_unstale":"2024-04-25T11:22:56.421708+0000","last_undegraded":"2024-04-25T11:22:56.421708+0000","last_fullsized":"2024-04-25T11:22:56.421708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:30.235026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306088+0000","last_change":"2024-04-25T11:22:14.411893+0000","last_active":"2024-04-25T11:23:25.306088+0000","last_peered":"2024-04-25T11:23:25.306088+0000","last_clean":"2024-04-25T11:23:25.306088+0000","last_became_active":"2024-04-25T11:22:14.409727+0000","last_became_peered":"2024-04-25T11:22:14.409727+0000","last_unstale":"2024-04-25T11:23:25.306088+0000","last_undegraded":"2024-04-25T11:23:25.306088+0000","last_fullsized":"2024-04-25T11:23:25.306088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:41.961790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.411095+0000","last_change":"2024-04-25T11:22:13.398983+0000","last_active":"2024-04-25T11:22:56.411095+0000","last_peered":"2024-04-25T11:22:56.411095+0000","last_clean":"2024-04-25T11:22:56.411095+0000","last_became_active":"2024-04-25T11:22:13.397819+0000","last_became_peered":"2024-04-25T11:22:13.397819+0000","last_unstale":"2024-04-25T11:22:56.411095+0000","last_undegraded":"2024-04-25T11:22:56.411095+0000","last_fullsized":"2024-04-25T11:22:56.411095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:19.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317389+0000","last_change":"2024-04-25T11:22:14.410589+0000","last_active":"2024-04-25T11:23:25.317389+0000","last_peered":"2024-04-25T11:23:25.317389+0000","last_clean":"2024-04-25T11:23:25.317389+0000","last_became_active":"2024-04-25T11:22:14.409921+0000","last_became_peered":"2024-04-25T11:22:14.409921+0000","last_unstale":"2024-04-25T11:23:25.317389+0000","last_undegraded":"2024-04-25T11:23:25.317389+0000","last_fullsized":"2024-04-25T11:23:25.317389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:59.251335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406591+0000","last_change":"2024-04-25T11:22:13.406244+0000","last_active":"2024-04-25T11:22:56.406591+0000","last_peered":"2024-04-25T11:22:56.406591+0000","last_clean":"2024-04-25T11:22:56.406591+0000","last_became_active":"2024-04-25T11:22:13.405902+0000","last_became_peered":"2024-04-25T11:22:13.405902+0000","last_unstale":"2024-04-25T11:22:56.406591+0000","last_undegraded":"2024-04-25T11:22:56.406591+0000","last_fullsized":"2024-04-25T11:22:56.406591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:05.862922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.310535+0000","last_change":"2024-04-25T11:22:14.421110+0000","last_active":"2024-04-25T11:23:25.310535+0000","last_peered":"2024-04-25T11:23:25.310535+0000","last_clean":"2024-04-25T11:23:25.310535+0000","last_became_active":"2024-04-25T11:22:14.420705+0000","last_became_peered":"2024-04-25T11:22:14.420705+0000","last_unstale":"2024-04-25T11:23:25.310535+0000","last_undegraded":"2024-04-25T11:23:25.310535+0000","last_fullsized":"2024-04-25T11:23:25.310535+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:57.353467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406617+0000","last_change":"2024-04-25T11:22:13.406063+0000","last_active":"2024-04-25T11:22:56.406617+0000","last_peered":"2024-04-25T11:22:56.406617+0000","last_clean":"2024-04-25T11:22:56.406617+0000","last_became_active":"2024-04-25T11:22:13.405690+0000","last_became_peered":"2024-04-25T11:22:13.405690+0000","last_unstale":"2024-04-25T11:22:56.406617+0000","last_undegraded":"2024-04-25T11:22:56.406617+0000","last_fullsized":"2024-04-25T11:22:56.406617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:34.296298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317405+0000","last_change":"2024-04-25T11:22:14.413077+0000","last_active":"2024-04-25T11:23:25.317405+0000","last_peered":"2024-04-25T11:23:25.317405+0000","last_clean":"2024-04-25T11:23:25.317405+0000","last_became_active":"2024-04-25T11:22:14.412712+0000","last_became_peered":"2024-04-25T11:22:14.412712+0000","last_unstale":"2024-04-25T11:23:25.317405+0000","last_undegraded":"2024-04-25T11:23:25.317405+0000","last_fullsized":"2024-04-25T11:23:25.317405+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:41.683840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'7","reported_seq":101,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:27.549940+0000","last_change":"2024-04-25T11:22:13.396239+0000","last_active":"2024-04-25T11:23:27.549940+0000","last_peered":"2024-04-25T11:23:27.549940+0000","last_clean":"2024-04-25T11:23:27.549940+0000","last_became_active":"2024-04-25T11:22:13.395653+0000","last_became_peered":"2024-04-25T11:22:13.395653+0000","last_unstale":"2024-04-25T11:23:27.549940+0000","last_undegraded":"2024-04-25T11:23:27.549940+0000","last_fullsized":"2024-04-25T11:23:27.549940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:05.218927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.293635+0000","last_change":"2024-04-25T11:22:14.409052+0000","last_active":"2024-04-25T11:23:25.293635+0000","last_peered":"2024-04-25T11:23:25.293635+0000","last_clean":"2024-04-25T11:23:25.293635+0000","last_became_active":"2024-04-25T11:22:14.408580+0000","last_became_peered":"2024-04-25T11:22:14.408580+0000","last_unstale":"2024-04-25T11:23:25.293635+0000","last_undegraded":"2024-04-25T11:23:25.293635+0000","last_fullsized":"2024-04-25T11:23:25.293635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:14.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.412556+0000","last_change":"2024-04-25T11:22:13.399086+0000","last_active":"2024-04-25T11:22:56.412556+0000","last_peered":"2024-04-25T11:22:56.412556+0000","last_clean":"2024-04-25T11:22:56.412556+0000","last_became_active":"2024-04-25T11:22:13.398559+0000","last_became_peered":"2024-04-25T11:22:13.398559+0000","last_unstale":"2024-04-25T11:22:56.412556+0000","last_undegraded":"2024-04-25T11:22:56.412556+0000","last_fullsized":"2024-04-25T11:22:56.412556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:09.913470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.290613+0000","last_change":"2024-04-25T11:22:56.416426+0000","last_active":"2024-04-25T11:23:25.290613+0000","last_peered":"2024-04-25T11:23:25.290613+0000","last_clean":"2024-04-25T11:23:25.290613+0000","last_became_active":"2024-04-25T11:22:56.415792+0000","last_became_peered":"2024-04-25T11:22:56.415792+0000","last_unstale":"2024-04-25T11:23:25.290613+0000","last_undegraded":"2024-04-25T11:23:25.290613+0000","last_fullsized":"2024-04-25T11:23:25.290613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:24.421846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,8],"acting":[9,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.407668+0000","last_change":"2024-04-25T11:22:13.392703+0000","last_active":"2024-04-25T11:22:56.407668+0000","last_peered":"2024-04-25T11:22:56.407668+0000","last_clean":"2024-04-25T11:22:56.407668+0000","last_became_active":"2024-04-25T11:22:13.392337+0000","last_became_peered":"2024-04-25T11:22:13.392337+0000","last_unstale":"2024-04-25T11:22:56.407668+0000","last_undegraded":"2024-04-25T11:22:56.407668+0000","last_fullsized":"2024-04-25T11:22:56.407668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:33.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316599+0000","last_change":"2024-04-25T11:22:14.398526+0000","last_active":"2024-04-25T11:23:25.316599+0000","last_peered":"2024-04-25T11:23:25.316599+0000","last_clean":"2024-04-25T11:23:25.316599+0000","last_became_active":"2024-04-25T11:22:14.398083+0000","last_became_peered":"2024-04-25T11:22:14.398083+0000","last_unstale":"2024-04-25T11:23:25.316599+0000","last_undegraded":"2024-04-25T11:23:25.316599+0000","last_fullsized":"2024-04-25T11:23:25.316599+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:03.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.413042+0000","last_change":"2024-04-25T11:22:13.397599+0000","last_active":"2024-04-25T11:22:56.413042+0000","last_peered":"2024-04-25T11:22:56.413042+0000","last_clean":"2024-04-25T11:22:56.413042+0000","last_became_active":"2024-04-25T11:22:13.396748+0000","last_became_peered":"2024-04-25T11:22:13.396748+0000","last_unstale":"2024-04-25T11:22:56.413042+0000","last_undegraded":"2024-04-25T11:22:56.413042+0000","last_fullsized":"2024-04-25T11:22:56.413042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:31.012095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.311093+0000","last_change":"2024-04-25T11:22:14.404668+0000","last_active":"2024-04-25T11:23:25.311093+0000","last_peered":"2024-04-25T11:23:25.311093+0000","last_clean":"2024-04-25T11:23:25.311093+0000","last_became_active":"2024-04-25T11:22:14.404306+0000","last_became_peered":"2024-04-25T11:22:14.404306+0000","last_unstale":"2024-04-25T11:23:25.311093+0000","last_undegraded":"2024-04-25T11:23:25.311093+0000","last_fullsized":"2024-04-25T11:23:25.311093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:16.430419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":96,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:29.552397+0000","last_change":"2024-04-25T11:22:13.398240+0000","last_active":"2024-04-25T11:23:29.552397+0000","last_peered":"2024-04-25T11:23:29.552397+0000","last_clean":"2024-04-25T11:23:29.552397+0000","last_became_active":"2024-04-25T11:22:13.397875+0000","last_became_peered":"2024-04-25T11:22:13.397875+0000","last_unstale":"2024-04-25T11:23:29.552397+0000","last_undegraded":"2024-04-25T11:23:29.552397+0000","last_fullsized":"2024-04-25T11:23:29.552397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:29.007270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.310077+0000","last_change":"2024-04-25T11:22:14.422075+0000","last_active":"2024-04-25T11:23:25.310077+0000","last_peered":"2024-04-25T11:23:25.310077+0000","last_clean":"2024-04-25T11:23:25.310077+0000","last_became_active":"2024-04-25T11:22:14.421699+0000","last_became_peered":"2024-04-25T11:22:14.421699+0000","last_unstale":"2024-04-25T11:23:25.310077+0000","last_undegraded":"2024-04-25T11:23:25.310077+0000","last_fullsized":"2024-04-25T11:23:25.310077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409827+0000","last_change":"2024-04-25T11:22:13.398104+0000","last_active":"2024-04-25T11:22:56.409827+0000","last_peered":"2024-04-25T11:22:56.409827+0000","last_clean":"2024-04-25T11:22:56.409827+0000","last_became_active":"2024-04-25T11:22:13.397716+0000","last_became_peered":"2024-04-25T11:22:13.397716+0000","last_unstale":"2024-04-25T11:22:56.409827+0000","last_undegraded":"2024-04-25T11:22:56.409827+0000","last_fullsized":"2024-04-25T11:22:56.409827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313477+0000","last_change":"2024-04-25T11:22:14.413664+0000","last_active":"2024-04-25T11:23:25.313477+0000","last_peered":"2024-04-25T11:23:25.313477+0000","last_clean":"2024-04-25T11:23:25.313477+0000","last_became_active":"2024-04-25T11:22:14.412621+0000","last_became_peered":"2024-04-25T11:22:14.412621+0000","last_unstale":"2024-04-25T11:23:25.313477+0000","last_undegraded":"2024-04-25T11:23:25.313477+0000","last_fullsized":"2024-04-25T11:23:25.313477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:24.511828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.413683+0000","last_change":"2024-04-25T11:22:13.397141+0000","last_active":"2024-04-25T11:22:56.413683+0000","last_peered":"2024-04-25T11:22:56.413683+0000","last_clean":"2024-04-25T11:22:56.413683+0000","last_became_active":"2024-04-25T11:22:13.396769+0000","last_became_peered":"2024-04-25T11:22:13.396769+0000","last_unstale":"2024-04-25T11:22:56.413683+0000","last_undegraded":"2024-04-25T11:22:56.413683+0000","last_fullsized":"2024-04-25T11:22:56.413683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:40.123906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317016+0000","last_change":"2024-04-25T11:22:14.412279+0000","last_active":"2024-04-25T11:23:25.317016+0000","last_peered":"2024-04-25T11:23:25.317016+0000","last_clean":"2024-04-25T11:23:25.317016+0000","last_became_active":"2024-04-25T11:22:14.410325+0000","last_became_peered":"2024-04-25T11:22:14.410325+0000","last_unstale":"2024-04-25T11:23:25.317016+0000","last_undegraded":"2024-04-25T11:23:25.317016+0000","last_fullsized":"2024-04-25T11:23:25.317016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:03.788349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'31","reported_seq":205,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:30.564328+0000","last_change":"2024-04-25T11:22:13.393664+0000","last_active":"2024-04-25T11:23:30.564328+0000","last_peered":"2024-04-25T11:23:30.564328+0000","last_clean":"2024-04-25T11:23:30.564328+0000","last_became_active":"2024-04-25T11:22:13.393279+0000","last_became_peered":"2024-04-25T11:22:13.393279+0000","last_unstale":"2024-04-25T11:23:30.564328+0000","last_undegraded":"2024-04-25T11:23:30.564328+0000","last_fullsized":"2024-04-25T11:23:30.564328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61295,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":137,"num_write":32,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.300816+0000","last_change":"2024-04-25T11:22:14.399944+0000","last_active":"2024-04-25T11:23:25.300816+0000","last_peered":"2024-04-25T11:23:25.300816+0000","last_clean":"2024-04-25T11:23:25.300816+0000","last_became_active":"2024-04-25T11:22:14.399592+0000","last_became_peered":"2024-04-25T11:22:14.399592+0000","last_unstale":"2024-04-25T11:23:25.300816+0000","last_undegraded":"2024-04-25T11:23:25.300816+0000","last_fullsized":"2024-04-25T11:23:25.300816+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:18.794517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409780+0000","last_change":"2024-04-25T11:22:13.398651+0000","last_active":"2024-04-25T11:22:56.409780+0000","last_peered":"2024-04-25T11:22:56.409780+0000","last_clean":"2024-04-25T11:22:56.409780+0000","last_became_active":"2024-04-25T11:22:13.398234+0000","last_became_peered":"2024-04-25T11:22:13.398234+0000","last_unstale":"2024-04-25T11:22:56.409780+0000","last_undegraded":"2024-04-25T11:22:56.409780+0000","last_fullsized":"2024-04-25T11:22:56.409780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:39.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318642+0000","last_change":"2024-04-25T11:22:14.404684+0000","last_active":"2024-04-25T11:23:25.318642+0000","last_peered":"2024-04-25T11:23:25.318642+0000","last_clean":"2024-04-25T11:23:25.318642+0000","last_became_active":"2024-04-25T11:22:14.404319+0000","last_became_peered":"2024-04-25T11:22:14.404319+0000","last_unstale":"2024-04-25T11:23:25.318642+0000","last_undegraded":"2024-04-25T11:23:25.318642+0000","last_fullsized":"2024-04-25T11:23:25.318642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:40.388670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.412557+0000","last_change":"2024-04-25T11:22:13.397954+0000","last_active":"2024-04-25T11:22:56.412557+0000","last_peered":"2024-04-25T11:22:56.412557+0000","last_clean":"2024-04-25T11:22:56.412557+0000","last_became_active":"2024-04-25T11:22:13.397595+0000","last_became_peered":"2024-04-25T11:22:13.397595+0000","last_unstale":"2024-04-25T11:22:56.412557+0000","last_undegraded":"2024-04-25T11:22:56.412557+0000","last_fullsized":"2024-04-25T11:22:56.412557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:31.912201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.314262+0000","last_change":"2024-04-25T11:22:14.411671+0000","last_active":"2024-04-25T11:23:25.314262+0000","last_peered":"2024-04-25T11:23:25.314262+0000","last_clean":"2024-04-25T11:23:25.314262+0000","last_became_active":"2024-04-25T11:22:14.411034+0000","last_became_peered":"2024-04-25T11:22:14.411034+0000","last_unstale":"2024-04-25T11:23:25.314262+0000","last_undegraded":"2024-04-25T11:23:25.314262+0000","last_fullsized":"2024-04-25T11:23:25.314262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:23.614652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'5","reported_seq":99,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:27.549206+0000","last_change":"2024-04-25T11:22:13.397193+0000","last_active":"2024-04-25T11:23:27.549206+0000","last_peered":"2024-04-25T11:23:27.549206+0000","last_clean":"2024-04-25T11:23:27.549206+0000","last_became_active":"2024-04-25T11:22:13.396319+0000","last_became_peered":"2024-04-25T11:22:13.396319+0000","last_unstale":"2024-04-25T11:23:27.549206+0000","last_undegraded":"2024-04-25T11:23:27.549206+0000","last_fullsized":"2024-04-25T11:23:27.549206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.140114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.312149+0000","last_change":"2024-04-25T11:22:14.404123+0000","last_active":"2024-04-25T11:23:25.312149+0000","last_peered":"2024-04-25T11:23:25.312149+0000","last_clean":"2024-04-25T11:23:25.312149+0000","last_became_active":"2024-04-25T11:22:14.403751+0000","last_became_peered":"2024-04-25T11:22:14.403751+0000","last_unstale":"2024-04-25T11:23:25.312149+0000","last_undegraded":"2024-04-25T11:23:25.312149+0000","last_fullsized":"2024-04-25T11:23:25.312149+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:22.361257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406237+0000","last_change":"2024-04-25T11:22:13.402801+0000","last_active":"2024-04-25T11:22:56.406237+0000","last_peered":"2024-04-25T11:22:56.406237+0000","last_clean":"2024-04-25T11:22:56.406237+0000","last_became_active":"2024-04-25T11:22:13.402417+0000","last_became_peered":"2024-04-25T11:22:13.402417+0000","last_unstale":"2024-04-25T11:22:56.406237+0000","last_undegraded":"2024-04-25T11:22:56.406237+0000","last_fullsized":"2024-04-25T11:22:56.406237+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:55.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316718+0000","last_change":"2024-04-25T11:22:14.413947+0000","last_active":"2024-04-25T11:23:25.316718+0000","last_peered":"2024-04-25T11:23:25.316718+0000","last_clean":"2024-04-25T11:23:25.316718+0000","last_became_active":"2024-04-25T11:22:14.413549+0000","last_became_peered":"2024-04-25T11:22:14.413549+0000","last_unstale":"2024-04-25T11:23:25.316718+0000","last_undegraded":"2024-04-25T11:23:25.316718+0000","last_fullsized":"2024-04-25T11:23:25.316718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:42.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.421596+0000","last_change":"2024-04-25T11:22:56.420875+0000","last_active":"2024-04-25T11:22:56.421596+0000","last_peered":"2024-04-25T11:22:56.421596+0000","last_clean":"2024-04-25T11:22:56.421596+0000","last_became_active":"2024-04-25T11:22:56.415615+0000","last_became_peered":"2024-04-25T11:22:56.415615+0000","last_unstale":"2024-04-25T11:22:56.421596+0000","last_undegraded":"2024-04-25T11:22:56.421596+0000","last_fullsized":"2024-04-25T11:22:56.421596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:55.053238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.299904+0000","last_change":"2024-04-25T11:22:56.413403+0000","last_active":"2024-04-25T11:23:25.299904+0000","last_peered":"2024-04-25T11:23:25.299904+0000","last_clean":"2024-04-25T11:23:25.299904+0000","last_became_active":"2024-04-25T11:22:56.413002+0000","last_became_peered":"2024-04-25T11:22:56.413002+0000","last_unstale":"2024-04-25T11:23:25.299904+0000","last_undegraded":"2024-04-25T11:23:25.299904+0000","last_fullsized":"2024-04-25T11:23:25.299904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:42.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.408825+0000","last_change":"2024-04-25T11:22:13.394583+0000","last_active":"2024-04-25T11:22:56.408825+0000","last_peered":"2024-04-25T11:22:56.408825+0000","last_clean":"2024-04-25T11:22:56.408825+0000","last_became_active":"2024-04-25T11:22:13.394210+0000","last_became_peered":"2024-04-25T11:22:13.394210+0000","last_unstale":"2024-04-25T11:22:56.408825+0000","last_undegraded":"2024-04-25T11:22:56.408825+0000","last_fullsized":"2024-04-25T11:22:56.408825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:34.622567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309131+0000","last_change":"2024-04-25T11:22:14.404487+0000","last_active":"2024-04-25T11:23:25.309131+0000","last_peered":"2024-04-25T11:23:25.309131+0000","last_clean":"2024-04-25T11:23:25.309131+0000","last_became_active":"2024-04-25T11:22:14.404096+0000","last_became_peered":"2024-04-25T11:22:14.404096+0000","last_unstale":"2024-04-25T11:23:25.309131+0000","last_undegraded":"2024-04-25T11:23:25.309131+0000","last_fullsized":"2024-04-25T11:23:25.309131+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:55.938011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.410176+0000","last_change":"2024-04-25T11:22:13.397273+0000","last_active":"2024-04-25T11:22:56.410176+0000","last_peered":"2024-04-25T11:22:56.410176+0000","last_clean":"2024-04-25T11:22:56.410176+0000","last_became_active":"2024-04-25T11:22:13.396538+0000","last_became_peered":"2024-04-25T11:22:13.396538+0000","last_unstale":"2024-04-25T11:22:56.410176+0000","last_undegraded":"2024-04-25T11:22:56.410176+0000","last_fullsized":"2024-04-25T11:22:56.410176+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:04.738107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.307767+0000","last_change":"2024-04-25T11:22:56.454081+0000","last_active":"2024-04-25T11:23:25.307767+0000","last_peered":"2024-04-25T11:23:25.307767+0000","last_clean":"2024-04-25T11:23:25.307767+0000","last_became_active":"2024-04-25T11:22:56.453729+0000","last_became_peered":"2024-04-25T11:22:56.453729+0000","last_unstale":"2024-04-25T11:23:25.307767+0000","last_undegraded":"2024-04-25T11:23:25.307767+0000","last_fullsized":"2024-04-25T11:23:25.307767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:55.124699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.299070+0000","last_change":"2024-04-25T11:22:14.411786+0000","last_active":"2024-04-25T11:23:25.299070+0000","last_peered":"2024-04-25T11:23:25.299070+0000","last_clean":"2024-04-25T11:23:25.299070+0000","last_became_active":"2024-04-25T11:22:14.411433+0000","last_became_peered":"2024-04-25T11:22:14.411433+0000","last_unstale":"2024-04-25T11:23:25.299070+0000","last_undegraded":"2024-04-25T11:23:25.299070+0000","last_fullsized":"2024-04-25T11:23:25.299070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:28.948581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:29.551657+0000","last_change":"2024-04-25T11:22:13.396834+0000","last_active":"2024-04-25T11:23:29.551657+0000","last_peered":"2024-04-25T11:23:29.551657+0000","last_clean":"2024-04-25T11:23:29.551657+0000","last_became_active":"2024-04-25T11:22:13.396439+0000","last_became_peered":"2024-04-25T11:22:13.396439+0000","last_unstale":"2024-04-25T11:23:29.551657+0000","last_undegraded":"2024-04-25T11:23:29.551657+0000","last_fullsized":"2024-04-25T11:23:29.551657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313719+0000","last_change":"2024-04-25T11:22:14.404784+0000","last_active":"2024-04-25T11:23:25.313719+0000","last_peered":"2024-04-25T11:23:25.313719+0000","last_clean":"2024-04-25T11:23:25.313719+0000","last_became_active":"2024-04-25T11:22:14.404355+0000","last_became_peered":"2024-04-25T11:22:14.404355+0000","last_unstale":"2024-04-25T11:23:25.313719+0000","last_undegraded":"2024-04-25T11:23:25.313719+0000","last_fullsized":"2024-04-25T11:23:25.313719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:04.698767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.414792+0000","last_change":"2024-04-25T11:22:13.389125+0000","last_active":"2024-04-25T11:22:56.414792+0000","last_peered":"2024-04-25T11:22:56.414792+0000","last_clean":"2024-04-25T11:22:56.414792+0000","last_became_active":"2024-04-25T11:22:13.387160+0000","last_became_peered":"2024-04-25T11:22:13.387160+0000","last_unstale":"2024-04-25T11:22:56.414792+0000","last_undegraded":"2024-04-25T11:22:56.414792+0000","last_fullsized":"2024-04-25T11:22:56.414792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:11.839065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409521+0000","last_change":"2024-04-25T11:20:53.708987+0000","last_active":"2024-04-25T11:22:56.409521+0000","last_peered":"2024-04-25T11:22:56.409521+0000","last_clean":"2024-04-25T11:22:56.409521+0000","last_became_active":"2024-04-25T11:20:53.704654+0000","last_became_peered":"2024-04-25T11:20:53.704654+0000","last_unstale":"2024-04-25T11:22:56.409521+0000","last_undegraded":"2024-04-25T11:22:56.409521+0000","last_fullsized":"2024-04-25T11:22:56.409521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_clean_scrub_stamp":"2024-04-25T11:17:24.025142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:24.174044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.292063+0000","last_change":"2024-04-25T11:22:14.413776+0000","last_active":"2024-04-25T11:23:25.292063+0000","last_peered":"2024-04-25T11:23:25.292063+0000","last_clean":"2024-04-25T11:23:25.292063+0000","last_became_active":"2024-04-25T11:22:14.413417+0000","last_became_peered":"2024-04-25T11:22:14.413417+0000","last_unstale":"2024-04-25T11:23:25.292063+0000","last_undegraded":"2024-04-25T11:23:25.292063+0000","last_fullsized":"2024-04-25T11:23:25.292063+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:15.393246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409829+0000","last_change":"2024-04-25T11:22:13.404113+0000","last_active":"2024-04-25T11:22:56.409829+0000","last_peered":"2024-04-25T11:22:56.409829+0000","last_clean":"2024-04-25T11:22:56.409829+0000","last_became_active":"2024-04-25T11:22:13.403711+0000","last_became_peered":"2024-04-25T11:22:13.403711+0000","last_unstale":"2024-04-25T11:22:56.409829+0000","last_undegraded":"2024-04-25T11:22:56.409829+0000","last_fullsized":"2024-04-25T11:22:56.409829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:52.618167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.406705+0000","last_change":"2024-04-25T11:22:13.404334+0000","last_active":"2024-04-25T11:22:56.406705+0000","last_peered":"2024-04-25T11:22:56.406705+0000","last_clean":"2024-04-25T11:22:56.406705+0000","last_became_active":"2024-04-25T11:22:13.403896+0000","last_became_peered":"2024-04-25T11:22:13.403896+0000","last_unstale":"2024-04-25T11:22:56.406705+0000","last_undegraded":"2024-04-25T11:22:56.406705+0000","last_fullsized":"2024-04-25T11:22:56.406705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:24.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.295477+0000","last_change":"2024-04-25T11:22:14.406921+0000","last_active":"2024-04-25T11:23:25.295477+0000","last_peered":"2024-04-25T11:23:25.295477+0000","last_clean":"2024-04-25T11:23:25.295477+0000","last_became_active":"2024-04-25T11:22:14.406520+0000","last_became_peered":"2024-04-25T11:22:14.406520+0000","last_unstale":"2024-04-25T11:23:25.295477+0000","last_undegraded":"2024-04-25T11:23:25.295477+0000","last_fullsized":"2024-04-25T11:23:25.295477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:24.127805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'9","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409123+0000","last_change":"2024-04-25T11:22:13.400870+0000","last_active":"2024-04-25T11:22:56.409123+0000","last_peered":"2024-04-25T11:22:56.409123+0000","last_clean":"2024-04-25T11:22:56.409123+0000","last_became_active":"2024-04-25T11:22:13.400479+0000","last_became_peered":"2024-04-25T11:22:13.400479+0000","last_unstale":"2024-04-25T11:22:56.409123+0000","last_undegraded":"2024-04-25T11:22:56.409123+0000","last_fullsized":"2024-04-25T11:22:56.409123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:12.975205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317888+0000","last_change":"2024-04-25T11:22:14.402782+0000","last_active":"2024-04-25T11:23:25.317888+0000","last_peered":"2024-04-25T11:23:25.317888+0000","last_clean":"2024-04-25T11:23:25.317888+0000","last_became_active":"2024-04-25T11:22:14.402368+0000","last_became_peered":"2024-04-25T11:22:14.402368+0000","last_unstale":"2024-04-25T11:23:25.317888+0000","last_undegraded":"2024-04-25T11:23:25.317888+0000","last_fullsized":"2024-04-25T11:23:25.317888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:49.897015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.414263+0000","last_change":"2024-04-25T11:22:13.390229+0000","last_active":"2024-04-25T11:22:56.414263+0000","last_peered":"2024-04-25T11:22:56.414263+0000","last_clean":"2024-04-25T11:22:56.414263+0000","last_became_active":"2024-04-25T11:22:13.389825+0000","last_became_peered":"2024-04-25T11:22:13.389825+0000","last_unstale":"2024-04-25T11:22:56.414263+0000","last_undegraded":"2024-04-25T11:22:56.414263+0000","last_fullsized":"2024-04-25T11:22:56.414263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:50.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.315176+0000","last_change":"2024-04-25T11:22:14.412066+0000","last_active":"2024-04-25T11:23:25.315176+0000","last_peered":"2024-04-25T11:23:25.315176+0000","last_clean":"2024-04-25T11:23:25.315176+0000","last_became_active":"2024-04-25T11:22:14.411707+0000","last_became_peered":"2024-04-25T11:22:14.411707+0000","last_unstale":"2024-04-25T11:23:25.315176+0000","last_undegraded":"2024-04-25T11:23:25.315176+0000","last_fullsized":"2024-04-25T11:23:25.315176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:13.274928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.412234+0000","last_change":"2024-04-25T11:22:13.397644+0000","last_active":"2024-04-25T11:22:56.412234+0000","last_peered":"2024-04-25T11:22:56.412234+0000","last_clean":"2024-04-25T11:22:56.412234+0000","last_became_active":"2024-04-25T11:22:13.397240+0000","last_became_peered":"2024-04-25T11:22:13.397240+0000","last_unstale":"2024-04-25T11:22:56.412234+0000","last_undegraded":"2024-04-25T11:22:56.412234+0000","last_fullsized":"2024-04-25T11:22:56.412234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.927399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.267630+0000","last_change":"2024-04-25T11:22:14.416191+0000","last_active":"2024-04-25T11:23:25.267630+0000","last_peered":"2024-04-25T11:23:25.267630+0000","last_clean":"2024-04-25T11:23:25.267630+0000","last_became_active":"2024-04-25T11:22:14.415537+0000","last_became_peered":"2024-04-25T11:22:14.415537+0000","last_unstale":"2024-04-25T11:23:25.267630+0000","last_undegraded":"2024-04-25T11:23:25.267630+0000","last_fullsized":"2024-04-25T11:23:25.267630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:27.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.410690+0000","last_change":"2024-04-25T11:22:13.390329+0000","last_active":"2024-04-25T11:22:56.410690+0000","last_peered":"2024-04-25T11:22:56.410690+0000","last_clean":"2024-04-25T11:22:56.410690+0000","last_became_active":"2024-04-25T11:22:13.389854+0000","last_became_peered":"2024-04-25T11:22:13.389854+0000","last_unstale":"2024-04-25T11:22:56.410690+0000","last_undegraded":"2024-04-25T11:22:56.410690+0000","last_fullsized":"2024-04-25T11:22:56.410690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:01.238826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317939+0000","last_change":"2024-04-25T11:22:14.395782+0000","last_active":"2024-04-25T11:23:25.317939+0000","last_peered":"2024-04-25T11:23:25.317939+0000","last_clean":"2024-04-25T11:23:25.317939+0000","last_became_active":"2024-04-25T11:22:14.395321+0000","last_became_peered":"2024-04-25T11:22:14.395321+0000","last_unstale":"2024-04-25T11:23:25.317939+0000","last_undegraded":"2024-04-25T11:23:25.317939+0000","last_fullsized":"2024-04-25T11:23:25.317939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:08.842424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409263+0000","last_change":"2024-04-25T11:22:13.401087+0000","last_active":"2024-04-25T11:22:56.409263+0000","last_peered":"2024-04-25T11:22:56.409263+0000","last_clean":"2024-04-25T11:22:56.409263+0000","last_became_active":"2024-04-25T11:22:13.400537+0000","last_became_peered":"2024-04-25T11:22:13.400537+0000","last_unstale":"2024-04-25T11:22:56.409263+0000","last_undegraded":"2024-04-25T11:22:56.409263+0000","last_fullsized":"2024-04-25T11:22:56.409263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:24.566260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309671+0000","last_change":"2024-04-25T11:22:14.399436+0000","last_active":"2024-04-25T11:23:25.309671+0000","last_peered":"2024-04-25T11:23:25.309671+0000","last_clean":"2024-04-25T11:23:25.309671+0000","last_became_active":"2024-04-25T11:22:14.398968+0000","last_became_peered":"2024-04-25T11:22:14.398968+0000","last_unstale":"2024-04-25T11:23:25.309671+0000","last_undegraded":"2024-04-25T11:23:25.309671+0000","last_fullsized":"2024-04-25T11:23:25.309671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:52.426381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.420115+0000","last_change":"2024-04-25T11:22:56.420115+0000","last_active":"2024-04-25T11:22:56.420115+0000","last_peered":"2024-04-25T11:22:56.420115+0000","last_clean":"2024-04-25T11:22:56.420115+0000","last_became_active":"2024-04-25T11:22:56.414491+0000","last_became_peered":"2024-04-25T11:22:56.414491+0000","last_unstale":"2024-04-25T11:22:56.420115+0000","last_undegraded":"2024-04-25T11:22:56.420115+0000","last_fullsized":"2024-04-25T11:22:56.420115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:36.180143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317665+0000","last_change":"2024-04-25T11:22:14.403391+0000","last_active":"2024-04-25T11:23:25.317665+0000","last_peered":"2024-04-25T11:23:25.317665+0000","last_clean":"2024-04-25T11:23:25.317665+0000","last_became_active":"2024-04-25T11:22:14.402817+0000","last_became_peered":"2024-04-25T11:22:14.402817+0000","last_unstale":"2024-04-25T11:23:25.317665+0000","last_undegraded":"2024-04-25T11:23:25.317665+0000","last_fullsized":"2024-04-25T11:23:25.317665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:34.190216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.409932+0000","last_change":"2024-04-25T11:22:13.394733+0000","last_active":"2024-04-25T11:22:56.409932+0000","last_peered":"2024-04-25T11:22:56.409932+0000","last_clean":"2024-04-25T11:22:56.409932+0000","last_became_active":"2024-04-25T11:22:13.394389+0000","last_became_peered":"2024-04-25T11:22:13.394389+0000","last_unstale":"2024-04-25T11:22:56.409932+0000","last_undegraded":"2024-04-25T11:22:56.409932+0000","last_fullsized":"2024-04-25T11:22:56.409932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.751957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317795+0000","last_change":"2024-04-25T11:22:14.398974+0000","last_active":"2024-04-25T11:23:25.317795+0000","last_peered":"2024-04-25T11:23:25.317795+0000","last_clean":"2024-04-25T11:23:25.317795+0000","last_became_active":"2024-04-25T11:22:14.396317+0000","last_became_peered":"2024-04-25T11:22:14.396317+0000","last_unstale":"2024-04-25T11:23:25.317795+0000","last_undegraded":"2024-04-25T11:23:25.317795+0000","last_fullsized":"2024-04-25T11:23:25.317795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:43.173266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.413544+0000","last_change":"2024-04-25T11:22:13.405081+0000","last_active":"2024-04-25T11:22:56.413544+0000","last_peered":"2024-04-25T11:22:56.413544+0000","last_clean":"2024-04-25T11:22:56.413544+0000","last_became_active":"2024-04-25T11:22:13.404160+0000","last_became_peered":"2024-04-25T11:22:13.404160+0000","last_unstale":"2024-04-25T11:22:56.413544+0000","last_undegraded":"2024-04-25T11:22:56.413544+0000","last_fullsized":"2024-04-25T11:22:56.413544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:33.591987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309382+0000","last_change":"2024-04-25T11:22:14.406014+0000","last_active":"2024-04-25T11:23:25.309382+0000","last_peered":"2024-04-25T11:23:25.309382+0000","last_clean":"2024-04-25T11:23:25.309382+0000","last_became_active":"2024-04-25T11:22:14.405609+0000","last_became_peered":"2024-04-25T11:22:14.405609+0000","last_unstale":"2024-04-25T11:23:25.309382+0000","last_undegraded":"2024-04-25T11:23:25.309382+0000","last_fullsized":"2024-04-25T11:23:25.309382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:55.357497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:22:56.422584+0000","last_change":"2024-04-25T11:22:56.422584+0000","last_active":"2024-04-25T11:22:56.422584+0000","last_peered":"2024-04-25T11:22:56.422584+0000","last_clean":"2024-04-25T11:22:56.422584+0000","last_became_active":"2024-04-25T11:22:56.415765+0000","last_became_peered":"2024-04-25T11:22:56.415765+0000","last_unstale":"2024-04-25T11:22:56.422584+0000","last_undegraded":"2024-04-25T11:22:56.422584+0000","last_fullsized":"2024-04-25T11:22:56.422584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:31.321372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.313108+0000","last_change":"2024-04-25T11:22:14.396359+0000","last_active":"2024-04-25T11:23:25.313108+0000","last_peered":"2024-04-25T11:23:25.313108+0000","last_clean":"2024-04-25T11:23:25.313108+0000","last_became_active":"2024-04-25T11:22:14.395818+0000","last_became_peered":"2024-04-25T11:22:14.395818+0000","last_unstale":"2024-04-25T11:23:25.313108+0000","last_undegraded":"2024-04-25T11:23:25.313108+0000","last_fullsized":"2024-04-25T11:23:25.313108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.964366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.304695+0000","last_change":"2024-04-25T11:22:14.396700+0000","last_active":"2024-04-25T11:23:25.304695+0000","last_peered":"2024-04-25T11:23:25.304695+0000","last_clean":"2024-04-25T11:23:25.304695+0000","last_became_active":"2024-04-25T11:22:14.396353+0000","last_became_peered":"2024-04-25T11:22:14.396353+0000","last_unstale":"2024-04-25T11:23:25.304695+0000","last_undegraded":"2024-04-25T11:23:25.304695+0000","last_fullsized":"2024-04-25T11:23:25.304695+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:23.570878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.304134+0000","last_change":"2024-04-25T11:22:14.412317+0000","last_active":"2024-04-25T11:23:25.304134+0000","last_peered":"2024-04-25T11:23:25.304134+0000","last_clean":"2024-04-25T11:23:25.304134+0000","last_became_active":"2024-04-25T11:22:14.411940+0000","last_became_peered":"2024-04-25T11:22:14.411940+0000","last_unstale":"2024-04-25T11:23:25.304134+0000","last_undegraded":"2024-04-25T11:23:25.304134+0000","last_fullsized":"2024-04-25T11:23:25.304134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.306390+0000","last_change":"2024-04-25T11:22:14.407779+0000","last_active":"2024-04-25T11:23:25.306390+0000","last_peered":"2024-04-25T11:23:25.306390+0000","last_clean":"2024-04-25T11:23:25.306390+0000","last_became_active":"2024-04-25T11:22:14.407443+0000","last_became_peered":"2024-04-25T11:22:14.407443+0000","last_unstale":"2024-04-25T11:23:25.306390+0000","last_undegraded":"2024-04-25T11:23:25.306390+0000","last_fullsized":"2024-04-25T11:23:25.306390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:00.316425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.317259+0000","last_change":"2024-04-25T11:22:14.412005+0000","last_active":"2024-04-25T11:23:25.317259+0000","last_peered":"2024-04-25T11:23:25.317259+0000","last_clean":"2024-04-25T11:23:25.317259+0000","last_became_active":"2024-04-25T11:22:14.411626+0000","last_became_peered":"2024-04-25T11:22:14.411626+0000","last_unstale":"2024-04-25T11:23:25.317259+0000","last_undegraded":"2024-04-25T11:23:25.317259+0000","last_fullsized":"2024-04-25T11:23:25.317259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.320505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318641+0000","last_change":"2024-04-25T11:22:14.415812+0000","last_active":"2024-04-25T11:23:25.318641+0000","last_peered":"2024-04-25T11:23:25.318641+0000","last_clean":"2024-04-25T11:23:25.318641+0000","last_became_active":"2024-04-25T11:22:14.415455+0000","last_became_peered":"2024-04-25T11:22:14.415455+0000","last_unstale":"2024-04-25T11:23:25.318641+0000","last_undegraded":"2024-04-25T11:23:25.318641+0000","last_fullsized":"2024-04-25T11:23:25.318641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:55.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.304851+0000","last_change":"2024-04-25T11:22:14.400892+0000","last_active":"2024-04-25T11:23:25.304851+0000","last_peered":"2024-04-25T11:23:25.304851+0000","last_clean":"2024-04-25T11:23:25.304851+0000","last_became_active":"2024-04-25T11:22:14.400526+0000","last_became_peered":"2024-04-25T11:22:14.400526+0000","last_unstale":"2024-04-25T11:23:25.304851+0000","last_undegraded":"2024-04-25T11:23:25.304851+0000","last_fullsized":"2024-04-25T11:23:25.304851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:20.123680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.305434+0000","last_change":"2024-04-25T11:22:14.403134+0000","last_active":"2024-04-25T11:23:25.305434+0000","last_peered":"2024-04-25T11:23:25.305434+0000","last_clean":"2024-04-25T11:23:25.305434+0000","last_became_active":"2024-04-25T11:22:14.402795+0000","last_became_peered":"2024-04-25T11:22:14.402795+0000","last_unstale":"2024-04-25T11:23:25.305434+0000","last_undegraded":"2024-04-25T11:23:25.305434+0000","last_fullsized":"2024-04-25T11:23:25.305434+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.496135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.309920+0000","last_change":"2024-04-25T11:22:14.410963+0000","last_active":"2024-04-25T11:23:25.309920+0000","last_peered":"2024-04-25T11:23:25.309920+0000","last_clean":"2024-04-25T11:23:25.309920+0000","last_became_active":"2024-04-25T11:22:14.410555+0000","last_became_peered":"2024-04-25T11:22:14.410555+0000","last_unstale":"2024-04-25T11:23:25.309920+0000","last_undegraded":"2024-04-25T11:23:25.309920+0000","last_fullsized":"2024-04-25T11:23:25.309920+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:56.505717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.300448+0000","last_change":"2024-04-25T11:22:14.405094+0000","last_active":"2024-04-25T11:23:25.300448+0000","last_peered":"2024-04-25T11:23:25.300448+0000","last_clean":"2024-04-25T11:23:25.300448+0000","last_became_active":"2024-04-25T11:22:14.404749+0000","last_became_peered":"2024-04-25T11:22:14.404749+0000","last_unstale":"2024-04-25T11:23:25.300448+0000","last_undegraded":"2024-04-25T11:23:25.300448+0000","last_fullsized":"2024-04-25T11:23:25.300448+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:44.129648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.316952+0000","last_change":"2024-04-25T11:22:14.396868+0000","last_active":"2024-04-25T11:23:25.316952+0000","last_peered":"2024-04-25T11:23:25.316952+0000","last_clean":"2024-04-25T11:23:25.316952+0000","last_became_active":"2024-04-25T11:22:14.396421+0000","last_became_peered":"2024-04-25T11:22:14.396421+0000","last_unstale":"2024-04-25T11:23:25.316952+0000","last_undegraded":"2024-04-25T11:23:25.316952+0000","last_fullsized":"2024-04-25T11:23:25.316952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:24.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.319637+0000","last_change":"2024-04-25T11:22:14.400510+0000","last_active":"2024-04-25T11:23:25.319637+0000","last_peered":"2024-04-25T11:23:25.319637+0000","last_clean":"2024-04-25T11:23:25.319637+0000","last_became_active":"2024-04-25T11:22:14.400037+0000","last_became_peered":"2024-04-25T11:22:14.400037+0000","last_unstale":"2024-04-25T11:23:25.319637+0000","last_undegraded":"2024-04-25T11:23:25.319637+0000","last_fullsized":"2024-04-25T11:23:25.319637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.293068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.318833+0000","last_change":"2024-04-25T11:22:14.404415+0000","last_active":"2024-04-25T11:23:25.318833+0000","last_peered":"2024-04-25T11:23:25.318833+0000","last_clean":"2024-04-25T11:23:25.318833+0000","last_became_active":"2024-04-25T11:22:14.404032+0000","last_became_peered":"2024-04-25T11:22:14.404032+0000","last_unstale":"2024-04-25T11:23:25.318833+0000","last_undegraded":"2024-04-25T11:23:25.318833+0000","last_fullsized":"2024-04-25T11:23:25.318833+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:03.318304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T11:23:25.305532+0000","last_change":"2024-04-25T11:22:14.410650+0000","last_active":"2024-04-25T11:23:25.305532+0000","last_peered":"2024-04-25T11:23:25.305532+0000","last_clean":"2024-04-25T11:23:25.305532+0000","last_became_active":"2024-04-25T11:22:14.410216+0000","last_became_peered":"2024-04-25T11:22:14.410216+0000","last_unstale":"2024-04-25T11:23:25.305532+0000","last_undegraded":"2024-04-25T11:23:25.305532+0000","last_fullsized":"2024-04-25T11:23:25.305532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:28.364279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246033,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65969,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":464,"num_read_kb":304,"num_write":166,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":197907,"data_compressed":5577,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645342,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":856064,"data_stored":410994,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841571,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":1063698,"data_compressed":43287,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005096,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":410626,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201326,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":860160,"data_stored":410524,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430259,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":909312,"data_stored":1002567,"data_compressed":41428,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":851968,"data_stored":410015,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":471103,"data_compressed":7674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":411286,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":472985,"data_compressed":7674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":868352,"data_stored":410326,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953539,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":410984,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790013,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":1002301,"data_compressed":41428,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33984,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61295,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":63177,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63405,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:23:34.374 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T11:23:34.374 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T11:23:34.375 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-25T11:23:34.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-25T11:23:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:34.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:34 smithi080 ceph-mon[29126]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:23:34.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:34 smithi196 ceph-mon[32659]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:23:34.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:34 smithi082 ceph-mon[32440]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:23:35.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:35 smithi196 ceph-mon[32659]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:23:35.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:35 smithi082 ceph-mon[32440]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:23:35.751 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:35 smithi080 ceph-mon[29126]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 -- 172.21.15.80:0/764184779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148108650 msgr2=0x7f214810ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 --2- 172.21.15.80:0/764184779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148108650 0x7f214810ffb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f214000b0d0 tx=0x7f214000b3e0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 -- 172.21.15.80:0/764184779 shutdown_connections 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 --2- 172.21.15.80:0/764184779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148108650 0x7f214810ffb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 --2- 172.21.15.80:0/764184779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2148103420 0x7f2148103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 --2- 172.21.15.80:0/764184779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2148107d00 0x7f2148108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 -- 172.21.15.80:0/764184779 >> 172.21.15.80:0/764184779 conn(0x7f2148078cd0 msgr2=0x7f2148079110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 -- 172.21.15.80:0/764184779 shutdown_connections 2024-04-25T11:23:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.297+0000 7f2150437700 1 -- 172.21.15.80:0/764184779 wait complete. 2024-04-25T11:23:36.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 Processor -- start 2024-04-25T11:23:36.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 -- start start 2024-04-25T11:23:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148103420 0x7f21481a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2148107d00 0x7f21481a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2148108650 0x7f214819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21481132f0 con 0x7f2148103420 2024-04-25T11:23:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2148113170 con 0x7f2148108650 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f2150437700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2148113470 con 0x7f2148107d00 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148103420 0x7f21481a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148103420 0x7f21481a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37376/0 (socket says 172.21.15.80:37376) 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 -- 172.21.15.80:0/3252846307 learned_addr learned my addr 172.21.15.80:0/3252846307 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 -- 172.21.15.80:0/3252846307 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2148107d00 msgr2=0x7f21481a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214d9d2700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2148107d00 0x7f21481a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2148107d00 0x7f21481a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 -- 172.21.15.80:0/3252846307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2148108650 msgr2=0x7f214819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e9d4700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2148108650 0x7f214819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2148108650 0x7f214819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.298+0000 7f214e1d3700 1 -- 172.21.15.80:0/3252846307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214819b270 con 0x7f2148103420 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.299+0000 7f214e1d3700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148103420 0x7f21481a09b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f213800d950 tx=0x7f213800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.299+0000 7f213f7fe700 1 -- 172.21.15.80:0/3252846307 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138016070 con 0x7f2148103420 2024-04-25T11:23:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.299+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214819b560 con 0x7f2148103420 2024-04-25T11:23:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.299+0000 7f213f7fe700 1 -- 172.21.15.80:0/3252846307 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2138010460 con 0x7f2148103420 2024-04-25T11:23:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.299+0000 7f213f7fe700 1 -- 172.21.15.80:0/3252846307 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213800f620 con 0x7f2148103420 2024-04-25T11:23:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.299+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21481a7760 con 0x7f2148103420 2024-04-25T11:23:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.300+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2148104880 con 0x7f2148103420 2024-04-25T11:23:36.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.301+0000 7f213f7fe700 1 -- 172.21.15.80:0/3252846307 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f2138019070 con 0x7f2148103420 2024-04-25T11:23:36.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.302+0000 7f213f7fe700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21340afb80 0x7f21340b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:36.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.302+0000 7f214d9d2700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21340afb80 0x7f21340b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:36.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.302+0000 7f213f7fe700 1 -- 172.21.15.80:0/3252846307 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f21380dec10 con 0x7f2148103420 2024-04-25T11:23:36.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.302+0000 7f214d9d2700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21340afb80 0x7f21340b2090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f214819c270 tx=0x7f2144008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:36.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.305+0000 7f213f7fe700 1 -- 172.21.15.80:0/3252846307 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f21380a77e0 con 0x7f2148103420 2024-04-25T11:23:36.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.553+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2148051190 con 0x7f2148103420 2024-04-25T11:23:36.548 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:36 smithi080 ceph-mon[29126]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:23:36.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.553+0000 7f213f7fe700 1 -- 172.21.15.80:0/3252846307 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f21380a70e0 con 0x7f2148103420 2024-04-25T11:23:36.548 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:36.549 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21340afb80 msgr2=0x7f21340b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21340afb80 0x7f21340b2090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f214819c270 tx=0x7f2144008040 comp rx=0 tx=0).stop 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148103420 msgr2=0x7f21481a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148103420 0x7f21481a09b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f213800d950 tx=0x7f213800dd10 comp rx=0 tx=0).stop 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 shutdown_connections 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f21340afb80 0x7f21340b2090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2148108650 0x7f214819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2148103420 0x7f21481a09b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 --2- 172.21.15.80:0/3252846307 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2148107d00 0x7f21481a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 >> 172.21.15.80:0/3252846307 conn(0x7f2148078cd0 msgr2=0x7f2148106ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 shutdown_connections 2024-04-25T11:23:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:36.555+0000 7f2150437700 1 -- 172.21.15.80:0/3252846307 wait complete. 2024-04-25T11:23:36.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:36 smithi196 ceph-mon[32659]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:23:36.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:36 smithi082 ceph-mon[32440]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T11:23:37.232 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-25T11:23:37.233 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:23:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 -- 172.21.15.80:0/1139276138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8103c40 msgr2=0x7f27c8104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 --2- 172.21.15.80:0/1139276138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8103c40 0x7f27c8104050 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009900 tx=0x7f27bc02a410 comp rx=0 tx=0).stop 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 -- 172.21.15.80:0/1139276138 shutdown_connections 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 --2- 172.21.15.80:0/1139276138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8103c40 0x7f27c8104050 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 --2- 172.21.15.80:0/1139276138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c8108940 0x7f27c810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 --2- 172.21.15.80:0/1139276138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c8102a00 0x7f27c8103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 -- 172.21.15.80:0/1139276138 >> 172.21.15.80:0/1139276138 conn(0x7f27c80fdbf0 msgr2=0x7f27c81000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 -- 172.21.15.80:0/1139276138 shutdown_connections 2024-04-25T11:23:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.351+0000 7f27cd51f640 1 -- 172.21.15.80:0/1139276138 wait complete. 2024-04-25T11:23:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 Processor -- start 2024-04-25T11:23:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 -- start start 2024-04-25T11:23:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8102a00 0x7f27c819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c8103c40 0x7f27c819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c8108940 0x7f27c81a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f27c810e500 con 0x7f27c8102a00 2024-04-25T11:23:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27c810e380 con 0x7f27c8108940 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27cd51f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27c810e680 con 0x7f27c8103c40 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8102a00 0x7f27c819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8102a00 0x7f27c819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56068/0 (socket says 172.21.15.80:56068) 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 -- 172.21.15.80:0/23503341 learned_addr learned my addr 172.21.15.80:0/23503341 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c67fc640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c8103c40 0x7f27c819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c77fe640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c8108940 0x7f27c81a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 -- 172.21.15.80:0/23503341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c8103c40 msgr2=0x7f27c819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c8103c40 0x7f27c819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 -- 172.21.15.80:0/23503341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c8108940 msgr2=0x7f27c81a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c8108940 0x7f27c81a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.352+0000 7f27c6ffd640 1 -- 172.21.15.80:0/23503341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c81a1dc0 con 0x7f27c8102a00 2024-04-25T11:23:37.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.353+0000 7f27c6ffd640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8102a00 0x7f27c819a280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f27b800ea50 tx=0x7f27b800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:37.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.353+0000 7f27affff640 1 -- 172.21.15.80:0/23503341 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b800cdc0 con 0x7f27c8102a00 2024-04-25T11:23:37.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.353+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c81a20b0 con 0x7f27c8102a00 2024-04-25T11:23:37.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.353+0000 7f27affff640 1 -- 172.21.15.80:0/23503341 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b8011920 con 0x7f27c8102a00 2024-04-25T11:23:37.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.353+0000 7f27affff640 1 -- 172.21.15.80:0/23503341 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b801aae0 con 0x7f27c8102a00 2024-04-25T11:23:37.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.353+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c81a2600 con 0x7f27c8102a00 2024-04-25T11:23:37.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.354+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c81a28c0 con 0x7f27c8102a00 2024-04-25T11:23:37.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.356+0000 7f27affff640 1 -- 172.21.15.80:0/23503341 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f27b801ac80 con 0x7f27c8102a00 2024-04-25T11:23:37.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.356+0000 7f27affff640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27b00afaf0 0x7f27b00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.357+0000 7f27c67fc640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27b00afaf0 0x7f27b00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.357+0000 7f27affff640 1 -- 172.21.15.80:0/23503341 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f27b80df400 con 0x7f27c8102a00 2024-04-25T11:23:37.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.357+0000 7f27c67fc640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27b00afaf0 0x7f27b00b2000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f27bc000c00 tx=0x7f27bc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:37.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.360+0000 7f27affff640 1 -- 172.21.15.80:0/23503341 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f27b8055ff0 con 0x7f27c8102a00 2024-04-25T11:23:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.544+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27c81a2a90 con 0x7f27c8102a00 2024-04-25T11:23:37.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.545+0000 7f27affff640 1 -- 172.21.15.80:0/23503341 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7f27b8016030 con 0x7f27c8102a00 2024-04-25T11:23:37.540 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:37.541 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:23:37.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.547+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27b00afaf0 msgr2=0x7f27b00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.547+0000 7f27cd51f640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27b00afaf0 0x7f27b00b2000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f27bc000c00 tx=0x7f27bc031400 comp rx=0 tx=0).stop 2024-04-25T11:23:37.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.547+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8102a00 msgr2=0x7f27c819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.547+0000 7f27cd51f640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8102a00 0x7f27c819a280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f27b800ea50 tx=0x7f27b800ef10 comp rx=0 tx=0).stop 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 shutdown_connections 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f27b00afaf0 0x7f27b00b2000 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c8108940 0x7f27c81a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c8103c40 0x7f27c819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 --2- 172.21.15.80:0/23503341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27c8102a00 0x7f27c819a280 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 >> 172.21.15.80:0/23503341 conn(0x7f27c80fdbf0 msgr2=0x7f27c8109e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 shutdown_connections 2024-04-25T11:23:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.548+0000 7f27cd51f640 1 -- 172.21.15.80:0/23503341 wait complete. 2024-04-25T11:23:37.552 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:37 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3252846307' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T11:23:37.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:23:37.555 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.670+0000 7f08d1ce0640 1 -- 172.21.15.80:0/508222789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc103940 msgr2=0x7f08cc103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.670+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/508222789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc103940 0x7f08cc103df0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009900 tx=0x7f08b402a410 comp rx=0 tx=0).stop 2024-04-25T11:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- 172.21.15.80:0/508222789 shutdown_connections 2024-04-25T11:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/508222789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc103940 0x7f08cc103df0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/508222789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08cc104480 0x7f08cc10abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/508222789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08cc102f60 0x7f08cc103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- 172.21.15.80:0/508222789 >> 172.21.15.80:0/508222789 conn(0x7f08cc0fd380 msgr2=0x7f08cc0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- 172.21.15.80:0/508222789 shutdown_connections 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- 172.21.15.80:0/508222789 wait complete. 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 Processor -- start 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- start start 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc102f60 0x7f08cc102200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08cc103940 0x7f08cc19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08cc104480 0x7f08cc1a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc10e550 con 0x7f08cc102f60 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc10e3d0 con 0x7f08cc104480 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08d1ce0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc10e6d0 con 0x7f08cc103940 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc102f60 0x7f08cc102200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc102f60 0x7f08cc102200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56086/0 (socket says 172.21.15.80:56086) 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.671+0000 7f08cb7fe640 1 -- 172.21.15.80:0/3641211985 learned_addr learned my addr 172.21.15.80:0/3641211985 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08cbfff640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08cc104480 0x7f08cc1a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08c3fff640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08cc103940 0x7f08cc19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08cb7fe640 1 -- 172.21.15.80:0/3641211985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08cc103940 msgr2=0x7f08cc19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08cb7fe640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08cc103940 0x7f08cc19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08cb7fe640 1 -- 172.21.15.80:0/3641211985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08cc104480 msgr2=0x7f08cc1a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08cb7fe640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08cc104480 0x7f08cc1a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08cb7fe640 1 -- 172.21.15.80:0/3641211985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc1a1d10 con 0x7f08cc102f60 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08cb7fe640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc102f60 0x7f08cc102200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00d950 tx=0x7f08bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08c97fa640 1 -- 172.21.15.80:0/3641211985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc017070 con 0x7f08cc102f60 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc1a1fa0 con 0x7f08cc102f60 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08c97fa640 1 -- 172.21.15.80:0/3641211985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08bc009c30 con 0x7f08cc102f60 2024-04-25T11:23:37.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08c97fa640 1 -- 172.21.15.80:0/3641211985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0047a0 con 0x7f08cc102f60 2024-04-25T11:23:37.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.672+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc1a2460 con 0x7f08cc102f60 2024-04-25T11:23:37.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.673+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08cc107900 con 0x7f08cc102f60 2024-04-25T11:23:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.674+0000 7f08c97fa640 1 -- 172.21.15.80:0/3641211985 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f08bc004020 con 0x7f08cc102f60 2024-04-25T11:23:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.675+0000 7f08c97fa640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f08b80afaf0 0x7f08b80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.675+0000 7f08c3fff640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f08b80afaf0 0x7f08b80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.675+0000 7f08c97fa640 1 -- 172.21.15.80:0/3641211985 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f08bc0dedc0 con 0x7f08cc102f60 2024-04-25T11:23:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.676+0000 7f08c3fff640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f08b80afaf0 0x7f08b80b2000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f08b402a930 tx=0x7f08b4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.679+0000 7f08c97fa640 1 -- 172.21.15.80:0/3641211985 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f08bc020020 con 0x7f08cc102f60 2024-04-25T11:23:37.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:37 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3252846307' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T11:23:37.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:37 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3252846307' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T11:23:37.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.857+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08cc0637a0 con 0x7f08cc102f60 2024-04-25T11:23:37.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.857+0000 7f08c97fa640 1 -- 172.21.15.80:0/3641211985 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f08bc0a7990 con 0x7f08cc102f60 2024-04-25T11:23:37.852 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f08b80afaf0 msgr2=0x7f08b80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f08b80afaf0 0x7f08b80b2000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f08b402a930 tx=0x7f08b4000bc0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc102f60 msgr2=0x7f08cc102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc102f60 0x7f08cc102200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00d950 tx=0x7f08bc00de10 comp rx=0 tx=0).stop 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 shutdown_connections 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f08b80afaf0 0x7f08b80b2000 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08cc104480 0x7f08cc1a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08cc103940 0x7f08cc19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 --2- 172.21.15.80:0/3641211985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08cc102f60 0x7f08cc102200 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 >> 172.21.15.80:0/3641211985 conn(0x7f08cc0fd380 msgr2=0x7f08cc104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:37.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 shutdown_connections 2024-04-25T11:23:37.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.859+0000 7f08d1ce0640 1 -- 172.21.15.80:0/3641211985 wait complete. 2024-04-25T11:23:37.866 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:23:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.981+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/873424572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4105090 msgr2=0x7f4cc41054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.981+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/873424572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4105090 0x7f4cc41054a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009ca0 tx=0x7f4cbc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/873424572 shutdown_connections 2024-04-25T11:23:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/873424572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cc4102240 0x7f4cc410bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/873424572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc4101740 0x7f4cc4101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/873424572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4105090 0x7f4cc41054a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/873424572 >> 172.21.15.80:0/873424572 conn(0x7f4cc40fd340 msgr2=0x7f4cc40ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/873424572 shutdown_connections 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/873424572 wait complete. 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 Processor -- start 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 -- start start 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4101740 0x7f4cc419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc4102240 0x7f4cc419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cc4105090 0x7f4cc41a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc410f5e0 con 0x7f4cc4101740 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.982+0000 7f4ccc4b1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc410f460 con 0x7f4cc4102240 2024-04-25T11:23:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4ccc4b1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc410f760 con 0x7f4cc4105090 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4101740 0x7f4cc419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4101740 0x7f4cc419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56108/0 (socket says 172.21.15.80:56108) 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 -- 172.21.15.80:0/3351458524 learned_addr learned my addr 172.21.15.80:0/3351458524 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cc9a4c640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc4102240 0x7f4cc419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 -- 172.21.15.80:0/3351458524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cc4105090 msgr2=0x7f4cc41a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cc4105090 0x7f4cc41a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 -- 172.21.15.80:0/3351458524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc4102240 msgr2=0x7f4cc419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc4102240 0x7f4cc419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 -- 172.21.15.80:0/3351458524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc41a1d10 con 0x7f4cc4101740 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cca24d640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4101740 0x7f4cc419a280 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0098d0 tx=0x7f4cbc031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cbb7fe640 1 -- 172.21.15.80:0/3351458524 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc003cb0 con 0x7f4cc4101740 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cbb7fe640 1 -- 172.21.15.80:0/3351458524 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cbc003e50 con 0x7f4cc4101740 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc41a1fa0 con 0x7f4cc4101740 2024-04-25T11:23:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4cbb7fe640 1 -- 172.21.15.80:0/3351458524 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc02fc60 con 0x7f4cc4101740 2024-04-25T11:23:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.983+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41a2400 con 0x7f4cc4101740 2024-04-25T11:23:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.984+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc4108a20 con 0x7f4cc4101740 2024-04-25T11:23:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.986+0000 7f4cbb7fe640 1 -- 172.21.15.80:0/3351458524 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f4cbc004710 con 0x7f4cc4101740 2024-04-25T11:23:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.986+0000 7f4cbb7fe640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4cb00afaf0 0x7f4cb00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.986+0000 7f4cc9a4c640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4cb00afaf0 0x7f4cb00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.986+0000 7f4cbb7fe640 1 -- 172.21.15.80:0/3351458524 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f4cbc100420 con 0x7f4cc4101740 2024-04-25T11:23:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.987+0000 7f4cc9a4c640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4cb00afaf0 0x7f4cb00b2000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cc419b320 tx=0x7f4cb400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:37.990+0000 7f4cbb7fe640 1 -- 172.21.15.80:0/3351458524 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4cbc0c9080 con 0x7f4cc4101740 2024-04-25T11:23:38.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.167+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4cc402de00 con 0x7f4cc4101740 2024-04-25T11:23:38.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.168+0000 7f4cbb7fe640 1 -- 172.21.15.80:0/3351458524 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) ==== 104+0+11 (secure 0 0 0) 0x7f4cbc0d1070 con 0x7f4cc4101740 2024-04-25T11:23:38.163 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:23:38.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4cb00afaf0 msgr2=0x7f4cb00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4cb00afaf0 0x7f4cb00b2000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cc419b320 tx=0x7f4cb400b390 comp rx=0 tx=0).stop 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4101740 msgr2=0x7f4cc419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4101740 0x7f4cc419a280 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0098d0 tx=0x7f4cbc031840 comp rx=0 tx=0).stop 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 shutdown_connections 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4cb00afaf0 0x7f4cb00b2000 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cc4105090 0x7f4cc41a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc4102240 0x7f4cc419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 --2- 172.21.15.80:0/3351458524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cc4101740 0x7f4cc419a280 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 >> 172.21.15.80:0/3351458524 conn(0x7f4cc40fd340 msgr2=0x7f4cc4105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 shutdown_connections 2024-04-25T11:23:38.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.170+0000 7f4ccc4b1640 1 -- 172.21.15.80:0/3351458524 wait complete. 2024-04-25T11:23:38.176 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:23:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 -- 172.21.15.80:0/1154717486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a0101760 msgr2=0x7fe8a0101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/1154717486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a0101760 0x7fe8a0101bd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe890009900 tx=0x7fe89002a3f0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 -- 172.21.15.80:0/1154717486 shutdown_connections 2024-04-25T11:23:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/1154717486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a0101760 0x7fe8a0101bd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/1154717486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a0102260 0x7fe8a010bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/1154717486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8a01050b0 0x7fe8a01054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 -- 172.21.15.80:0/1154717486 >> 172.21.15.80:0/1154717486 conn(0x7fe8a00fd380 msgr2=0x7fe8a00ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 -- 172.21.15.80:0/1154717486 shutdown_connections 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.292+0000 7fe8a85f3640 1 -- 172.21.15.80:0/1154717486 wait complete. 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 Processor -- start 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 -- start start 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a0101760 0x7fe8a019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8a0102260 0x7fe8a019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a01050b0 0x7fe8a01a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a010f620 con 0x7fe8a01050b0 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a010f4a0 con 0x7fe8a0101760 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a85f3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a010f7a0 con 0x7fe8a0102260 2024-04-25T11:23:38.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a6b90640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a01050b0 0x7fe8a01a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a6b90640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a01050b0 0x7fe8a01a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56124/0 (socket says 172.21.15.80:56124) 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a6b90640 1 -- 172.21.15.80:0/175602114 learned_addr learned my addr 172.21.15.80:0/175602114 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.293+0000 7fe8a5b8e640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8a0102260 0x7fe8a019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a638f640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a0101760 0x7fe8a019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a6b90640 1 -- 172.21.15.80:0/175602114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8a0102260 msgr2=0x7fe8a019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a6b90640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8a0102260 0x7fe8a019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a6b90640 1 -- 172.21.15.80:0/175602114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a0101760 msgr2=0x7fe8a019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a6b90640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a0101760 0x7fe8a019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a6b90640 1 -- 172.21.15.80:0/175602114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a01a1c70 con 0x7fe8a01050b0 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a6b90640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a01050b0 0x7fe8a01a16b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe89800cce0 tx=0x7fe89800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8977fe640 1 -- 172.21.15.80:0/175602114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89800f450 con 0x7fe8a01050b0 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8977fe640 1 -- 172.21.15.80:0/175602114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe89800faa0 con 0x7fe8a01050b0 2024-04-25T11:23:38.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a01a1f60 con 0x7fe8a01050b0 2024-04-25T11:23:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8977fe640 1 -- 172.21.15.80:0/175602114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898018b70 con 0x7fe8a01050b0 2024-04-25T11:23:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.294+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a01a23c0 con 0x7fe8a01050b0 2024-04-25T11:23:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.295+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a006a160 con 0x7fe8a01050b0 2024-04-25T11:23:38.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.296+0000 7fe8977fe640 1 -- 172.21.15.80:0/175602114 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fe898018d10 con 0x7fe8a01050b0 2024-04-25T11:23:38.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.297+0000 7fe8977fe640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe88c0afb70 0x7fe88c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.297+0000 7fe8a638f640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe88c0afb70 0x7fe88c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.297+0000 7fe8977fe640 1 -- 172.21.15.80:0/175602114 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fe8980df0d0 con 0x7fe8a01050b0 2024-04-25T11:23:38.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.298+0000 7fe8a638f640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe88c0afb70 0x7fe88c0b2080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0058c0 tx=0x7fe89c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:38.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.301+0000 7fe8977fe640 1 -- 172.21.15.80:0/175602114 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe898014030 con 0x7fe8a01050b0 2024-04-25T11:23:38.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.479+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8a002dbd0 con 0x7fe8a01050b0 2024-04-25T11:23:38.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.479+0000 7fe8977fe640 1 -- 172.21.15.80:0/175602114 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) ==== 100+0+11 (secure 0 0 0) 0x7fe8980a7db0 con 0x7fe8a01050b0 2024-04-25T11:23:38.474 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:23:38.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe88c0afb70 msgr2=0x7fe88c0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe88c0afb70 0x7fe88c0b2080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0058c0 tx=0x7fe89c005850 comp rx=0 tx=0).stop 2024-04-25T11:23:38.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a01050b0 msgr2=0x7fe8a01a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a01050b0 0x7fe8a01a16b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe89800cce0 tx=0x7fe89800a620 comp rx=0 tx=0).stop 2024-04-25T11:23:38.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 shutdown_connections 2024-04-25T11:23:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe88c0afb70 0x7fe88c0b2080 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8a01050b0 0x7fe8a01a16b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8a0102260 0x7fe8a019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 --2- 172.21.15.80:0/175602114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a0101760 0x7fe8a019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.481+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 >> 172.21.15.80:0/175602114 conn(0x7fe8a00fd380 msgr2=0x7fe8a0105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.482+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 shutdown_connections 2024-04-25T11:23:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.482+0000 7fe8a85f3640 1 -- 172.21.15.80:0/175602114 wait complete. 2024-04-25T11:23:38.486 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:38 smithi080 ceph-mon[29126]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:23:38.486 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/23503341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:38.486 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3641211985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:23:38.486 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3351458524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:23:38.487 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:23:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 -- 172.21.15.80:0/1659274951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc109a10 msgr2=0x7f96dc10be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1659274951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc109a10 0x7f96dc10be30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009900 tx=0x7f96d402a410 comp rx=0 tx=0).stop 2024-04-25T11:23:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 -- 172.21.15.80:0/1659274951 shutdown_connections 2024-04-25T11:23:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1659274951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc109a10 0x7f96dc10be30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1659274951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96dc104d10 0x7f96dc105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1659274951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc103ad0 0x7f96dc1047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 -- 172.21.15.80:0/1659274951 >> 172.21.15.80:0/1659274951 conn(0x7f96dc0fecc0 msgr2=0x7f96dc101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:38.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 -- 172.21.15.80:0/1659274951 shutdown_connections 2024-04-25T11:23:38.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 -- 172.21.15.80:0/1659274951 wait complete. 2024-04-25T11:23:38.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.601+0000 7f96e1a42640 1 Processor -- start 2024-04-25T11:23:38.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96e1a42640 1 -- start start 2024-04-25T11:23:38.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96e1a42640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc103ad0 0x7f96dc19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96e1a42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc104d10 0x7f96dc19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96e1a42640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96dc109a10 0x7f96dc1a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96e1a42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc0758c0 con 0x7f96dc104d10 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96e1a42640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc075740 con 0x7f96dc109a10 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96e1a42640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc075a40 con 0x7f96dc103ad0 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc104d10 0x7f96dc19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc104d10 0x7f96dc19c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56134/0 (socket says 172.21.15.80:56134) 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 -- 172.21.15.80:0/1441532155 learned_addr learned my addr 172.21.15.80:0/1441532155 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96db7fe640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96dc109a10 0x7f96dc1a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96daffd640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc103ad0 0x7f96dc19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 -- 172.21.15.80:0/1441532155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc103ad0 msgr2=0x7f96dc19c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc103ad0 0x7f96dc19c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 -- 172.21.15.80:0/1441532155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96dc109a10 msgr2=0x7f96dc1a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96dc109a10 0x7f96dc1a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 -- 172.21.15.80:0/1441532155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc1a3ee0 con 0x7f96dc104d10 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96daffd640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc103ad0 0x7f96dc19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.602+0000 7f96da7fc640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc104d10 0x7f96dc19c8e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f96d000d950 tx=0x7f96d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.603+0000 7f96e0a40640 1 -- 172.21.15.80:0/1441532155 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0017070 con 0x7f96dc104d10 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.603+0000 7f96e0a40640 1 -- 172.21.15.80:0/1441532155 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96d0009c30 con 0x7f96dc104d10 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.603+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc1a41d0 con 0x7f96dc104d10 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.603+0000 7f96e0a40640 1 -- 172.21.15.80:0/1441532155 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d000f620 con 0x7f96dc104d10 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.603+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc1a4720 con 0x7f96dc104d10 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.604+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc1a4980 con 0x7f96dc104d10 2024-04-25T11:23:38.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.605+0000 7f96e0a40640 1 -- 172.21.15.80:0/1441532155 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f96d0010460 con 0x7f96dc104d10 2024-04-25T11:23:38.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.606+0000 7f96e0a40640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f96c40afaf0 0x7f96c40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.606+0000 7f96daffd640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f96c40afaf0 0x7f96c40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.606+0000 7f96e0a40640 1 -- 172.21.15.80:0/1441532155 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f96d00de8c0 con 0x7f96dc104d10 2024-04-25T11:23:38.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.607+0000 7f96daffd640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f96c40afaf0 0x7f96c40b2000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96dc1046d0 tx=0x7f96cc009400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:38.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.610+0000 7f96e0a40640 1 -- 172.21.15.80:0/1441532155 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96d00a7490 con 0x7f96dc104d10 2024-04-25T11:23:38.645 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:38 smithi082 ceph-mon[32440]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:23:38.645 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/23503341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:38.646 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3641211985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:23:38.646 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3351458524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:23:38.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:38 smithi196 ceph-mon[32659]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:23:38.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/23503341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:38.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3641211985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:23:38.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3351458524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:23:38.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.827+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96dc1a4b50 con 0x7f96dc104d10 2024-04-25T11:23:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.828+0000 7f96e0a40640 1 -- 172.21.15.80:0/1441532155 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f96d0009de0 con 0x7f96dc104d10 2024-04-25T11:23:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:38.823 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:22:18.430262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:23:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f96c40afaf0 msgr2=0x7f96c40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f96c40afaf0 0x7f96c40b2000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96dc1046d0 tx=0x7f96cc009400 comp rx=0 tx=0).stop 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc104d10 msgr2=0x7f96dc19c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc104d10 0x7f96dc19c8e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f96d000d950 tx=0x7f96d000de10 comp rx=0 tx=0).stop 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 shutdown_connections 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f96c40afaf0 0x7f96c40b2000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96dc104d10 0x7f96dc19c8e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96dc109a10 0x7f96dc1a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 --2- 172.21.15.80:0/1441532155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc103ad0 0x7f96dc19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 >> 172.21.15.80:0/1441532155 conn(0x7f96dc0fecc0 msgr2=0x7f96dc1010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 shutdown_connections 2024-04-25T11:23:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.830+0000 7f96e1a42640 1 -- 172.21.15.80:0/1441532155 wait complete. 2024-04-25T11:23:38.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:23:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 -- 172.21.15.80:0/1156167293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244106be0 msgr2=0x7fe2441090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 --2- 172.21.15.80:0/1156167293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244106be0 0x7fe2441090c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe238009900 tx=0x7fe23802a410 comp rx=0 tx=0).stop 2024-04-25T11:23:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 -- 172.21.15.80:0/1156167293 shutdown_connections 2024-04-25T11:23:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 --2- 172.21.15.80:0/1156167293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244106be0 0x7fe2441090c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 --2- 172.21.15.80:0/1156167293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe244109750 0x7fe24410bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 --2- 172.21.15.80:0/1156167293 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe2441041f0 0x7fe244106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 -- 172.21.15.80:0/1156167293 >> 172.21.15.80:0/1156167293 conn(0x7fe2440fdbd0 msgr2=0x7fe244100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 -- 172.21.15.80:0/1156167293 shutdown_connections 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.949+0000 7fe249a97640 1 -- 172.21.15.80:0/1156167293 wait complete. 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 Processor -- start 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 -- start start 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2441041f0 0x7fe24419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe244106be0 0x7fe24419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244109750 0x7fe2441a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe24410f5c0 con 0x7fe244109750 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe24410f440 con 0x7fe2441041f0 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe249a97640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe24410f740 con 0x7fe244106be0 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244109750 0x7fe2441a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244109750 0x7fe2441a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56146/0 (socket says 172.21.15.80:56146) 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 -- 172.21.15.80:0/344881098 learned_addr learned my addr 172.21.15.80:0/344881098 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe242ffd640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe244106be0 0x7fe24419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe2437fe640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2441041f0 0x7fe24419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 -- 172.21.15.80:0/344881098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe244106be0 msgr2=0x7fe24419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe244106be0 0x7fe24419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 -- 172.21.15.80:0/344881098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2441041f0 msgr2=0x7fe24419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2441041f0 0x7fe24419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe243fff640 1 -- 172.21.15.80:0/344881098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2441a1cb0 con 0x7fe244109750 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.950+0000 7fe242ffd640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe244106be0 0x7fe24419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.951+0000 7fe243fff640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244109750 0x7fe2441a16f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00cce0 tx=0x7fe23c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.951+0000 7fe240ff9640 1 -- 172.21.15.80:0/344881098 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00f450 con 0x7fe244109750 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.951+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2441a1fa0 con 0x7fe244109750 2024-04-25T11:23:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.951+0000 7fe240ff9640 1 -- 172.21.15.80:0/344881098 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe23c00faa0 con 0x7fe244109750 2024-04-25T11:23:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.951+0000 7fe240ff9640 1 -- 172.21.15.80:0/344881098 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c018b70 con 0x7fe244109750 2024-04-25T11:23:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.951+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2441a2400 con 0x7fe244109750 2024-04-25T11:23:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.952+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2440ff6f0 con 0x7fe244109750 2024-04-25T11:23:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.953+0000 7fe240ff9640 1 -- 172.21.15.80:0/344881098 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fe23c018d10 con 0x7fe244109750 2024-04-25T11:23:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.954+0000 7fe240ff9640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe22c0afaf0 0x7fe22c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.954+0000 7fe2437fe640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe22c0afaf0 0x7fe22c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.954+0000 7fe240ff9640 1 -- 172.21.15.80:0/344881098 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fe23c0df1c0 con 0x7fe244109750 2024-04-25T11:23:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.954+0000 7fe2437fe640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe22c0afaf0 0x7fe22c0b2000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe234005fd0 tx=0x7fe234005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:38.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:38.957+0000 7fe240ff9640 1 -- 172.21.15.80:0/344881098 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe23c014030 con 0x7fe244109750 2024-04-25T11:23:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.135+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe24402dda0 con 0x7fe244109750 2024-04-25T11:23:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.137+0000 7fe240ff9640 1 -- 172.21.15.80:0/344881098 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7fe23c0a7e20 con 0x7fe244109750 2024-04-25T11:23:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:39.132 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:23:39.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe22c0afaf0 msgr2=0x7fe22c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe22c0afaf0 0x7fe22c0b2000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe234005fd0 tx=0x7fe234005850 comp rx=0 tx=0).stop 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244109750 msgr2=0x7fe2441a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244109750 0x7fe2441a16f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00cce0 tx=0x7fe23c00a620 comp rx=0 tx=0).stop 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 shutdown_connections 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe22c0afaf0 0x7fe22c0b2000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe244109750 0x7fe2441a16f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe244106be0 0x7fe24419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 --2- 172.21.15.80:0/344881098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2441041f0 0x7fe24419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 >> 172.21.15.80:0/344881098 conn(0x7fe2440fdbd0 msgr2=0x7fe244104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 shutdown_connections 2024-04-25T11:23:39.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.139+0000 7fe249a97640 1 -- 172.21.15.80:0/344881098 wait complete. 2024-04-25T11:23:39.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:23:39.145 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.261+0000 7f83718e7640 1 -- 172.21.15.80:0/3287825678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c104d20 msgr2=0x7f836c105130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.261+0000 7f83718e7640 1 --2- 172.21.15.80:0/3287825678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c104d20 0x7f836c105130 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8354009900 tx=0x7f835402a410 comp rx=0 tx=0).stop 2024-04-25T11:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- 172.21.15.80:0/3287825678 shutdown_connections 2024-04-25T11:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 --2- 172.21.15.80:0/3287825678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c104d20 0x7f836c105130 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 --2- 172.21.15.80:0/3287825678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c109a20 0x7f836c10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 --2- 172.21.15.80:0/3287825678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c103ae0 0x7f836c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- 172.21.15.80:0/3287825678 >> 172.21.15.80:0/3287825678 conn(0x7f836c0fed10 msgr2=0x7f836c101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- 172.21.15.80:0/3287825678 shutdown_connections 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- 172.21.15.80:0/3287825678 wait complete. 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 Processor -- start 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- start start 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c103ae0 0x7f836c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c104d20 0x7f836c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c109a20 0x7f836c1a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f836c10f5e0 con 0x7f836c109a20 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f836c10f460 con 0x7f836c103ae0 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f83718e7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f836c10f760 con 0x7f836c104d20 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.262+0000 7f836b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c109a20 0x7f836c1a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c109a20 0x7f836c1a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56156/0 (socket says 172.21.15.80:56156) 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 -- 172.21.15.80:0/885222258 learned_addr learned my addr 172.21.15.80:0/885222258 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:39.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836affd640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c103ae0 0x7f836c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f8363fff640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c104d20 0x7f836c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 -- 172.21.15.80:0/885222258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c104d20 msgr2=0x7f836c19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c104d20 0x7f836c19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 -- 172.21.15.80:0/885222258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c103ae0 msgr2=0x7f836c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c103ae0 0x7f836c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 -- 172.21.15.80:0/885222258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c1a1cd0 con 0x7f836c109a20 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836affd640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c103ae0 0x7f836c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f836b7fe640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c109a20 0x7f836c1a1710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f836400cce0 tx=0x7f836400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f83708e5640 1 -- 172.21.15.80:0/885222258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836400f450 con 0x7f836c109a20 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c1a1fc0 con 0x7f836c109a20 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f83708e5640 1 -- 172.21.15.80:0/885222258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f836400faa0 con 0x7f836c109a20 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f83708e5640 1 -- 172.21.15.80:0/885222258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364018b70 con 0x7f836c109a20 2024-04-25T11:23:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.263+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c1a2420 con 0x7f836c109a20 2024-04-25T11:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.264+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836c06a190 con 0x7f836c109a20 2024-04-25T11:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.265+0000 7f83708e5640 1 -- 172.21.15.80:0/885222258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f8364018d10 con 0x7f836c109a20 2024-04-25T11:23:39.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.266+0000 7f83708e5640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f83580afaf0 0x7f83580b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.266+0000 7f836affd640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f83580afaf0 0x7f83580b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.266+0000 7f83708e5640 1 -- 172.21.15.80:0/885222258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f83640df200 con 0x7f836c109a20 2024-04-25T11:23:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.266+0000 7f836affd640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f83580afaf0 0x7f83580b2000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f836c1046e0 tx=0x7f835c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:39.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.270+0000 7f83708e5640 1 -- 172.21.15.80:0/885222258 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f836c06a190 con 0x7f836c109a20 2024-04-25T11:23:39.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.451+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f836c02dbf0 con 0x7f836c109a20 2024-04-25T11:23:39.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.452+0000 7f83708e5640 1 -- 172.21.15.80:0/885222258 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f8364014030 con 0x7f836c109a20 2024-04-25T11:23:39.446 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:23:39.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f83580afaf0 msgr2=0x7f83580b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f83580afaf0 0x7f83580b2000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f836c1046e0 tx=0x7f835c005f90 comp rx=0 tx=0).stop 2024-04-25T11:23:39.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c109a20 msgr2=0x7f836c1a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c109a20 0x7f836c1a1710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f836400cce0 tx=0x7f836400a620 comp rx=0 tx=0).stop 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 shutdown_connections 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f83580afaf0 0x7f83580b2000 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f836c109a20 0x7f836c1a1710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f836c104d20 0x7f836c19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 --2- 172.21.15.80:0/885222258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c103ae0 0x7f836c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 >> 172.21.15.80:0/885222258 conn(0x7f836c0fed10 msgr2=0x7f836c105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 shutdown_connections 2024-04-25T11:23:39.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.454+0000 7f83718e7640 1 -- 172.21.15.80:0/885222258 wait complete. 2024-04-25T11:23:39.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:39 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/175602114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:23:39.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:39 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1441532155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:39.459 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:39 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/344881098' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:39.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 -- 172.21.15.80:0/2258915372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 msgr2=0x7f6d141036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2258915372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d141036e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009900 tx=0x7f6d0402a410 comp rx=0 tx=0).stop 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 -- 172.21.15.80:0/2258915372 shutdown_connections 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2258915372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d14108920 0x7f6d1410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2258915372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14103c20 0x7f6d14104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2258915372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d141036e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 -- 172.21.15.80:0/2258915372 >> 172.21.15.80:0/2258915372 conn(0x7f6d140fdbd0 msgr2=0x7f6d14100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:39.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 -- 172.21.15.80:0/2258915372 shutdown_connections 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.575+0000 7f6d199fe640 1 -- 172.21.15.80:0/2258915372 wait complete. 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 Processor -- start 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 -- start start 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d14199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14103c20 0x7f6d141997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d14108920 0x7f6d141a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1410e4e0 con 0x7f6d141029e0 2024-04-25T11:23:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1410e360 con 0x7f6d14103c20 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d199fe640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1410e660 con 0x7f6d14108920 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d12ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d14199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d12ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d14199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56176/0 (socket says 172.21.15.80:56176) 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d12ffd640 1 -- 172.21.15.80:0/2442319220 learned_addr learned my addr 172.21.15.80:0/2442319220 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d137fe640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d14108920 0x7f6d141a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.576+0000 7f6d0bfff640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14103c20 0x7f6d141997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d12ffd640 1 -- 172.21.15.80:0/2442319220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d14108920 msgr2=0x7f6d141a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d12ffd640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d14108920 0x7f6d141a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d12ffd640 1 -- 172.21.15.80:0/2442319220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14103c20 msgr2=0x7f6d141997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d12ffd640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14103c20 0x7f6d141997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d12ffd640 1 -- 172.21.15.80:0/2442319220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d141a0cf0 con 0x7f6d141029e0 2024-04-25T11:23:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d12ffd640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d14199270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d04006010 tx=0x7f6d04031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:39.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d189fc640 1 -- 172.21.15.80:0/2442319220 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0403f030 con 0x7f6d141029e0 2024-04-25T11:23:39.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d189fc640 1 -- 172.21.15.80:0/2442319220 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d04003aa0 con 0x7f6d141029e0 2024-04-25T11:23:39.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d141a0f80 con 0x7f6d141029e0 2024-04-25T11:23:39.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d189fc640 1 -- 172.21.15.80:0/2442319220 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04035070 con 0x7f6d141029e0 2024-04-25T11:23:39.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.577+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d141a1380 con 0x7f6d141029e0 2024-04-25T11:23:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.578+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d14107730 con 0x7f6d141029e0 2024-04-25T11:23:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.579+0000 7f6d189fc640 1 -- 172.21.15.80:0/2442319220 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f6d04042030 con 0x7f6d141029e0 2024-04-25T11:23:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.580+0000 7f6d189fc640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6d000afaf0 0x7f6d000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.580+0000 7f6d0bfff640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6d000afaf0 0x7f6d000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.580+0000 7f6d189fc640 1 -- 172.21.15.80:0/2442319220 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f6d040ff530 con 0x7f6d141029e0 2024-04-25T11:23:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.580+0000 7f6d0bfff640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6d000afaf0 0x7f6d000b2000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc005fd0 tx=0x7f6cfc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:39.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.584+0000 7f6d189fc640 1 -- 172.21.15.80:0/2442319220 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6d040c8100 con 0x7f6d141029e0 2024-04-25T11:23:39.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:39 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/175602114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:23:39.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:39 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1441532155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:39.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:39 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/344881098' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:39.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:39 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/175602114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:23:39.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:39 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1441532155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:39.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:39 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/344881098' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:39.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.759+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6d140637d0 con 0x7f6d141029e0 2024-04-25T11:23:39.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.759+0000 7f6d189fc640 1 -- 172.21.15.80:0/2442319220 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) ==== 104+0+11 (secure 0 0 0) 0x7f6d040c7a00 con 0x7f6d141029e0 2024-04-25T11:23:39.754 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:23:39.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6d000afaf0 msgr2=0x7f6d000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6d000afaf0 0x7f6d000b2000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc005fd0 tx=0x7f6cfc005850 comp rx=0 tx=0).stop 2024-04-25T11:23:39.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 msgr2=0x7f6d14199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d14199270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d04006010 tx=0x7f6d04031a50 comp rx=0 tx=0).stop 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 shutdown_connections 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6d000afaf0 0x7f6d000b2000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d14108920 0x7f6d141a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14103c20 0x7f6d141997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 --2- 172.21.15.80:0/2442319220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d141029e0 0x7f6d14199270 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 >> 172.21.15.80:0/2442319220 conn(0x7f6d140fdbd0 msgr2=0x7f6d14104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 shutdown_connections 2024-04-25T11:23:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.762+0000 7f6d199fe640 1 -- 172.21.15.80:0/2442319220 wait complete. 2024-04-25T11:23:39.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:23:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 -- 172.21.15.80:0/1525631064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518106c10 msgr2=0x7f75181090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 --2- 172.21.15.80:0/1525631064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518106c10 0x7f75181090f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f750c009900 tx=0x7f750c02a410 comp rx=0 tx=0).stop 2024-04-25T11:23:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 -- 172.21.15.80:0/1525631064 shutdown_connections 2024-04-25T11:23:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 --2- 172.21.15.80:0/1525631064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518106c10 0x7f75181090f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 --2- 172.21.15.80:0/1525631064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7518109780 0x7f751810bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 --2- 172.21.15.80:0/1525631064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7518101e30 0x7f7518102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 -- 172.21.15.80:0/1525631064 >> 172.21.15.80:0/1525631064 conn(0x7f75180fd380 msgr2=0x7f75180ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 -- 172.21.15.80:0/1525631064 shutdown_connections 2024-04-25T11:23:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.885+0000 7f751e6e7640 1 -- 172.21.15.80:0/1525631064 wait complete. 2024-04-25T11:23:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 Processor -- start 2024-04-25T11:23:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 -- start start 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518101e30 0x7f751819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7518106c10 0x7f751819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7518109780 0x7f75181a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f751810f5f0 con 0x7f7518101e30 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f751810f470 con 0x7f7518106c10 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751e6e7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f751810f770 con 0x7f7518109780 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f7517fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518101e30 0x7f751819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f7517fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518101e30 0x7f751819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56206/0 (socket says 172.21.15.80:56206) 2024-04-25T11:23:39.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f7517fff640 1 -- 172.21.15.80:0/2902311804 learned_addr learned my addr 172.21.15.80:0/2902311804 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.886+0000 7f751cc84640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7518109780 0x7f75181a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f75177fe640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7518106c10 0x7f751819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f7517fff640 1 -- 172.21.15.80:0/2902311804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7518109780 msgr2=0x7f75181a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f7517fff640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7518109780 0x7f75181a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f7517fff640 1 -- 172.21.15.80:0/2902311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7518106c10 msgr2=0x7f751819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f7517fff640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7518106c10 0x7f751819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f7517fff640 1 -- 172.21.15.80:0/2902311804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75181a1c80 con 0x7f7518101e30 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f75177fe640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7518106c10 0x7f751819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f7517fff640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518101e30 0x7f751819a1f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7508005fd0 tx=0x7f750800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f75157fa640 1 -- 172.21.15.80:0/2902311804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508017070 con 0x7f7518101e30 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75181a1f70 con 0x7f7518101e30 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f75157fa640 1 -- 172.21.15.80:0/2902311804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7508009c30 con 0x7f7518101e30 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f75157fa640 1 -- 172.21.15.80:0/2902311804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508003d30 con 0x7f7518101e30 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.887+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75181a2430 con 0x7f7518101e30 2024-04-25T11:23:39.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.888+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75180feea0 con 0x7f7518101e30 2024-04-25T11:23:39.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.889+0000 7f75157fa640 1 -- 172.21.15.80:0/2902311804 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f7508003ed0 con 0x7f7518101e30 2024-04-25T11:23:39.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.890+0000 7f75157fa640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f75000afaf0 0x7f75000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:39.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.890+0000 7f75177fe640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f75000afaf0 0x7f75000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:39.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.890+0000 7f75157fa640 1 -- 172.21.15.80:0/2902311804 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f75080df0f0 con 0x7f7518101e30 2024-04-25T11:23:39.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.890+0000 7f75177fe640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f75000afaf0 0x7f75000b2000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f750c006010 tx=0x7f750c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:39.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:39.894+0000 7f75157fa640 1 -- 172.21.15.80:0/2902311804 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7508020030 con 0x7f7518101e30 2024-04-25T11:23:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.070+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f751802dce0 con 0x7f7518101e30 2024-04-25T11:23:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.070+0000 7f75157fa640 1 -- 172.21.15.80:0/2902311804 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) ==== 100+0+11 (secure 0 0 0) 0x7f7508009de0 con 0x7f7518101e30 2024-04-25T11:23:40.065 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f75000afaf0 msgr2=0x7f75000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f75000afaf0 0x7f75000b2000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f750c006010 tx=0x7f750c000bc0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518101e30 msgr2=0x7f751819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518101e30 0x7f751819a1f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7508005fd0 tx=0x7f750800dde0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 shutdown_connections 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f75000afaf0 0x7f75000b2000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7518109780 0x7f75181a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7518106c10 0x7f751819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 --2- 172.21.15.80:0/2902311804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7518101e30 0x7f751819a1f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 >> 172.21.15.80:0/2902311804 conn(0x7f75180fd380 msgr2=0x7f751810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 shutdown_connections 2024-04-25T11:23:40.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.072+0000 7f751e6e7640 1 -- 172.21.15.80:0/2902311804 wait complete. 2024-04-25T11:23:40.081 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:23:40.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- 172.21.15.80:0/3626585684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 msgr2=0x7f4b601036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/3626585684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b601036c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009ca0 tx=0x7f4b5802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- 172.21.15.80:0/3626585684 shutdown_connections 2024-04-25T11:23:40.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/3626585684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b60108900 0x7f4b6010ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/3626585684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b60103c00 0x7f4b60104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/3626585684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b601036c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- 172.21.15.80:0/3626585684 >> 172.21.15.80:0/3626585684 conn(0x7f4b600fdbd0 msgr2=0x7f4b60100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- 172.21.15.80:0/3626585684 shutdown_connections 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- 172.21.15.80:0/3626585684 wait complete. 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 Processor -- start 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- start start 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b60199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b60103c00 0x7f4b60199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b60108900 0x7f4b601a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6010e4a0 con 0x7f4b601029c0 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.194+0000 7f4b66fc0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6010e320 con 0x7f4b60108900 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b66fc0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6010e620 con 0x7f4b60103c00 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b60199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b60199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56222/0 (socket says 172.21.15.80:56222) 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 -- 172.21.15.80:0/802796920 learned_addr learned my addr 172.21.15.80:0/802796920 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b5ffff640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b60103c00 0x7f4b60199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 -- 172.21.15.80:0/802796920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b60103c00 msgr2=0x7f4b60199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b6555d640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b60108900 0x7f4b601a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b60103c00 0x7f4b60199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 -- 172.21.15.80:0/802796920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b60108900 msgr2=0x7f4b601a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b60108900 0x7f4b601a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 -- 172.21.15.80:0/802796920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b601a0c40 con 0x7f4b601029c0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b64d5c640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b60199100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4b580098d0 tx=0x7f4b58031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b5dffb640 1 -- 172.21.15.80:0/802796920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58003cb0 con 0x7f4b601029c0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b5dffb640 1 -- 172.21.15.80:0/802796920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b58003e50 con 0x7f4b601029c0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b601a0ed0 con 0x7f4b601029c0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b5dffb640 1 -- 172.21.15.80:0/802796920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5802fc60 con 0x7f4b601029c0 2024-04-25T11:23:40.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.195+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b601a1330 con 0x7f4b601029c0 2024-04-25T11:23:40.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.196+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b60107710 con 0x7f4b601029c0 2024-04-25T11:23:40.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.198+0000 7f4b5dffb640 1 -- 172.21.15.80:0/802796920 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f4b58004710 con 0x7f4b601029c0 2024-04-25T11:23:40.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.199+0000 7f4b5dffb640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b4c0afaf0 0x7f4b4c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.199+0000 7f4b5ffff640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b4c0afaf0 0x7f4b4c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.199+0000 7f4b5dffb640 1 -- 172.21.15.80:0/802796920 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f4b58100470 con 0x7f4b601029c0 2024-04-25T11:23:40.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.199+0000 7f4b5ffff640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b4c0afaf0 0x7f4b4c0b2000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b6019a1a0 tx=0x7f4b4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:40.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.203+0000 7f4b5dffb640 1 -- 172.21.15.80:0/802796920 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b580c90b0 con 0x7f4b601029c0 2024-04-25T11:23:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.420+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b6002dc70 con 0x7f4b601029c0 2024-04-25T11:23:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.420+0000 7f4b5dffb640 1 -- 172.21.15.80:0/802796920 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f4b580c89b0 con 0x7f4b601029c0 2024-04-25T11:23:40.415 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:40.415 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:22:18.430262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:23:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-04-25T11:23:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b4c0afaf0 msgr2=0x7f4b4c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b4c0afaf0 0x7f4b4c0b2000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b6019a1a0 tx=0x7f4b4800b410 comp rx=0 tx=0).stop 2024-04-25T11:23:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 msgr2=0x7f4b60199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b60199100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4b580098d0 tx=0x7f4b58031840 comp rx=0 tx=0).stop 2024-04-25T11:23:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 shutdown_connections 2024-04-25T11:23:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f4b4c0afaf0 0x7f4b4c0b2000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b60108900 0x7f4b601a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b60103c00 0x7f4b60199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 --2- 172.21.15.80:0/802796920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b601029c0 0x7f4b60199100 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 >> 172.21.15.80:0/802796920 conn(0x7f4b600fdbd0 msgr2=0x7f4b601048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 shutdown_connections 2024-04-25T11:23:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.423+0000 7f4b66fc0640 1 -- 172.21.15.80:0/802796920 wait complete. 2024-04-25T11:23:40.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:23:40.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.542+0000 7f182aab1640 1 -- 172.21.15.80:0/378681035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 msgr2=0x7f1824105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.542+0000 7f182aab1640 1 --2- 172.21.15.80:0/378681035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824105150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1818009900 tx=0x7f181802a410 comp rx=0 tx=0).stop 2024-04-25T11:23:40.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- 172.21.15.80:0/378681035 shutdown_connections 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 --2- 172.21.15.80:0/378681035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824105150 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 --2- 172.21.15.80:0/378681035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1824109a40 0x7f182410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 --2- 172.21.15.80:0/378681035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1824103b00 0x7f1824104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- 172.21.15.80:0/378681035 >> 172.21.15.80:0/378681035 conn(0x7f18240fed10 msgr2=0x7f18241011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- 172.21.15.80:0/378681035 shutdown_connections 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- 172.21.15.80:0/378681035 wait complete. 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 Processor -- start 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- start start 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1824103b00 0x7f1824077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1824109a40 0x7f1824076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f182410f620 con 0x7f1824104d40 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f182410f4a0 con 0x7f1824109a40 2024-04-25T11:23:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f182aab1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f182410f7a0 con 0x7f1824103b00 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.543+0000 7f1823fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56236/0 (socket says 172.21.15.80:56236) 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 -- 172.21.15.80:0/1513371104 learned_addr learned my addr 172.21.15.80:0/1513371104 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f182884d640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1824103b00 0x7f1824077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f182904e640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1824109a40 0x7f1824076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 -- 172.21.15.80:0/1513371104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1824103b00 msgr2=0x7f1824077960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1824103b00 0x7f1824077960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 -- 172.21.15.80:0/1513371104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1824109a40 msgr2=0x7f1824076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1824109a40 0x7f1824076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 -- 172.21.15.80:0/1513371104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1824076c70 con 0x7f1824104d40 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f182884d640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1824103b00 0x7f1824077960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1823fff640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824076000 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1818006010 tx=0x7f1818031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1821ffb640 1 -- 172.21.15.80:0/1513371104 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181803f030 con 0x7f1824104d40 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1821ffb640 1 -- 172.21.15.80:0/1513371104 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1818003aa0 con 0x7f1824104d40 2024-04-25T11:23:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f1821ffb640 1 -- 172.21.15.80:0/1513371104 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818035070 con 0x7f1824104d40 2024-04-25T11:23:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18241a4320 con 0x7f1824104d40 2024-04-25T11:23:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.544+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18241a4720 con 0x7f1824104d40 2024-04-25T11:23:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.546+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182406a190 con 0x7f1824104d40 2024-04-25T11:23:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.547+0000 7f1821ffb640 1 -- 172.21.15.80:0/1513371104 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f1818042030 con 0x7f1824104d40 2024-04-25T11:23:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.548+0000 7f1821ffb640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f180c0afaf0 0x7f180c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.548+0000 7f182884d640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f180c0afaf0 0x7f180c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.548+0000 7f1821ffb640 1 -- 172.21.15.80:0/1513371104 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f18180ff400 con 0x7f1824104d40 2024-04-25T11:23:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.548+0000 7f182884d640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f180c0afaf0 0x7f180c0b2000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1824104700 tx=0x7f1814005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.552+0000 7f1821ffb640 1 -- 172.21.15.80:0/1513371104 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f18180c7920 con 0x7f1824104d40 2024-04-25T11:23:40.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:40 smithi196 ceph-mon[32659]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:23:40.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:40 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/885222258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:40 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2442319220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:40 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2902311804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.731+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18240637a0 con 0x7f1824104d40 2024-04-25T11:23:40.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.733+0000 7f1821ffb640 1 -- 172.21.15.80:0/1513371104 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7f18180cbc20 con 0x7f1824104d40 2024-04-25T11:23:40.727 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:40.727 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:23:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f180c0afaf0 msgr2=0x7f180c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f180c0afaf0 0x7f180c0b2000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1824104700 tx=0x7f1814005f90 comp rx=0 tx=0).stop 2024-04-25T11:23:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 msgr2=0x7f1824076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824076000 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1818006010 tx=0x7f1818031a50 comp rx=0 tx=0).stop 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 shutdown_connections 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f180c0afaf0 0x7f180c0b2000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1824104d40 0x7f1824076000 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1824109a40 0x7f1824076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 --2- 172.21.15.80:0/1513371104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1824103b00 0x7f1824077960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 >> 172.21.15.80:0/1513371104 conn(0x7f18240fed10 msgr2=0x7f1824105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 shutdown_connections 2024-04-25T11:23:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.735+0000 7f182aab1640 1 -- 172.21.15.80:0/1513371104 wait complete. 2024-04-25T11:23:40.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:40 smithi080 ceph-mon[29126]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:23:40.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:40 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/885222258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.739 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:40 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2442319220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:40 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2902311804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.741 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:23:40.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:40 smithi082 ceph-mon[32440]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:23:40.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:40 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/885222258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:40 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2442319220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:40 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2902311804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:23:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 -- 172.21.15.80:0/1224405020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef44103af0 msgr2=0x7fef44103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 --2- 172.21.15.80:0/1224405020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef44103af0 0x7fef44103f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fef38009900 tx=0x7fef3802a410 comp rx=0 tx=0).stop 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 -- 172.21.15.80:0/1224405020 shutdown_connections 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 --2- 172.21.15.80:0/1224405020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef44103af0 0x7fef44103f00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 --2- 172.21.15.80:0/1224405020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef441087f0 0x7fef4410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 --2- 172.21.15.80:0/1224405020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef441028b0 0x7fef441035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 -- 172.21.15.80:0/1224405020 >> 172.21.15.80:0/1224405020 conn(0x7fef440fdaa0 msgr2=0x7fef440fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 -- 172.21.15.80:0/1224405020 shutdown_connections 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 -- 172.21.15.80:0/1224405020 wait complete. 2024-04-25T11:23:40.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.854+0000 7fef48d9f640 1 Processor -- start 2024-04-25T11:23:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef48d9f640 1 -- start start 2024-04-25T11:23:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef48d9f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef441028b0 0x7fef44198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef48d9f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44103af0 0x7fef44199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef48d9f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef441087f0 0x7fef441a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef48d9f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef4410e3c0 con 0x7fef441087f0 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef48d9f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef4410e240 con 0x7fef44103af0 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef48d9f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef4410e540 con 0x7fef441028b0 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef441087f0 0x7fef441a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef441087f0 0x7fef441a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56242/0 (socket says 172.21.15.80:56242) 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 -- 172.21.15.80:0/4268087763 learned_addr learned my addr 172.21.15.80:0/4268087763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef437fe640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef441028b0 0x7fef44198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef42ffd640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44103af0 0x7fef44199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 -- 172.21.15.80:0/4268087763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef441028b0 msgr2=0x7fef44198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef441028b0 0x7fef44198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 -- 172.21.15.80:0/4268087763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44103af0 msgr2=0x7fef44199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44103af0 0x7fef44199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef43fff640 1 -- 172.21.15.80:0/4268087763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef441a0b30 con 0x7fef441087f0 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.855+0000 7fef42ffd640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44103af0 0x7fef44199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.856+0000 7fef43fff640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef441087f0 0x7fef441a04c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c970 tx=0x7fef3c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.856+0000 7fef40ff9640 1 -- 172.21.15.80:0/4268087763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c007bb0 con 0x7fef441087f0 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.856+0000 7fef40ff9640 1 -- 172.21.15.80:0/4268087763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef3c007d50 con 0x7fef441087f0 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.856+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef441a0e20 con 0x7fef441087f0 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.856+0000 7fef40ff9640 1 -- 172.21.15.80:0/4268087763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c004e60 con 0x7fef441087f0 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.856+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef441a1300 con 0x7fef441087f0 2024-04-25T11:23:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.857+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef44107600 con 0x7fef441087f0 2024-04-25T11:23:40.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.858+0000 7fef40ff9640 1 -- 172.21.15.80:0/4268087763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fef3c005020 con 0x7fef441087f0 2024-04-25T11:23:40.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.859+0000 7fef40ff9640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef2c0afb60 0x7fef2c0b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:40.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.859+0000 7fef437fe640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef2c0afb60 0x7fef2c0b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:40.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.859+0000 7fef40ff9640 1 -- 172.21.15.80:0/4268087763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fef3c0de880 con 0x7fef441087f0 2024-04-25T11:23:40.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.860+0000 7fef437fe640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef2c0afb60 0x7fef2c0b2070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef441034b0 tx=0x7fef3400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:40.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:40.864+0000 7fef40ff9640 1 -- 172.21.15.80:0/4268087763 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef3c014030 con 0x7fef441087f0 2024-04-25T11:23:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.079+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef4406a030 con 0x7fef441087f0 2024-04-25T11:23:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.080+0000 7fef40ff9640 1 -- 172.21.15.80:0/4268087763 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fef3c0a7450 con 0x7fef441087f0 2024-04-25T11:23:41.074 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:41.075 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:22:18.430262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:23:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-04-25T11:23:41.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef2c0afb60 msgr2=0x7fef2c0b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef2c0afb60 0x7fef2c0b2070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef441034b0 tx=0x7fef3400d040 comp rx=0 tx=0).stop 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef441087f0 msgr2=0x7fef441a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef441087f0 0x7fef441a04c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c970 tx=0x7fef3c00ce30 comp rx=0 tx=0).stop 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 shutdown_connections 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fef2c0afb60 0x7fef2c0b2070 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef441087f0 0x7fef441a04c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef44103af0 0x7fef44199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 --2- 172.21.15.80:0/4268087763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef441028b0 0x7fef44198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 >> 172.21.15.80:0/4268087763 conn(0x7fef440fdaa0 msgr2=0x7fef441047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 shutdown_connections 2024-04-25T11:23:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.082+0000 7fef48d9f640 1 -- 172.21.15.80:0/4268087763 wait complete. 2024-04-25T11:23:41.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T11:22:13.737406+0000', 'modified': '2024-04-25T11:22:18.430262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24521, 'mds_1': 24499, 'mds_2': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/4149738023', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 4149738023}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 4149738023}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/3574274014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 3574274014}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 3574274014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6837/2620156093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 2620156093}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 2620156093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.82:6837/3792535888', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 3792535888}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 3792535888}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.196:6839/1079728905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 1079728905}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 1079728905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6839/3848058015', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 3848058015}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 3848058015}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24521, 'qdb_cluster': [24476, 24499, 24521]} 2024-04-25T11:23:41.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T11:23:41.089 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 -- 172.21.15.80:0/1228850699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8106c20 msgr2=0x7efda8109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 --2- 172.21.15.80:0/1228850699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8106c20 0x7efda8109100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efd98009900 tx=0x7efd9802a410 comp rx=0 tx=0).stop 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 -- 172.21.15.80:0/1228850699 shutdown_connections 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 --2- 172.21.15.80:0/1228850699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8106c20 0x7efda8109100 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 --2- 172.21.15.80:0/1228850699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda8109790 0x7efda810bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 --2- 172.21.15.80:0/1228850699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efda8101e40 0x7efda8102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 -- 172.21.15.80:0/1228850699 >> 172.21.15.80:0/1228850699 conn(0x7efda80fd350 msgr2=0x7efda80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 -- 172.21.15.80:0/1228850699 shutdown_connections 2024-04-25T11:23:41.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.203+0000 7efdaff2d640 1 -- 172.21.15.80:0/1228850699 wait complete. 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 Processor -- start 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 -- start start 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efda8101e40 0x7efda819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda8106c20 0x7efda819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8109790 0x7efda81a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efda810f620 con 0x7efda8109790 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efda810f4a0 con 0x7efda8106c20 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdaff2d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efda810f7a0 con 0x7efda8101e40 2024-04-25T11:23:41.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8109790 0x7efda81a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8109790 0x7efda81a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56272/0 (socket says 172.21.15.80:56272) 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 -- 172.21.15.80:0/3322240742 learned_addr learned my addr 172.21.15.80:0/3322240742 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdadcc9640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efda8101e40 0x7efda819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdad4c8640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda8106c20 0x7efda819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 -- 172.21.15.80:0/3322240742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efda8101e40 msgr2=0x7efda819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efda8101e40 0x7efda819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 -- 172.21.15.80:0/3322240742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda8106c20 msgr2=0x7efda819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda8106c20 0x7efda819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.204+0000 7efdae4ca640 1 -- 172.21.15.80:0/3322240742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda81a1d60 con 0x7efda8109790 2024-04-25T11:23:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.205+0000 7efdae4ca640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8109790 0x7efda81a16f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efda000eaa0 tx=0x7efda000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.205+0000 7efd9effd640 1 -- 172.21.15.80:0/3322240742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda000cdb0 con 0x7efda8109790 2024-04-25T11:23:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.205+0000 7efd9effd640 1 -- 172.21.15.80:0/3322240742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efda0005020 con 0x7efda8109790 2024-04-25T11:23:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.205+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda81a1ff0 con 0x7efda8109790 2024-04-25T11:23:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.205+0000 7efd9effd640 1 -- 172.21.15.80:0/3322240742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda00116d0 con 0x7efda8109790 2024-04-25T11:23:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.205+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda81a24b0 con 0x7efda8109790 2024-04-25T11:23:41.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.207+0000 7efd9effd640 1 -- 172.21.15.80:0/3322240742 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7efda00051d0 con 0x7efda8109790 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.207+0000 7efdb6ddd740 1 Processor -- start 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.207+0000 7efdb6ddd740 1 -- start start 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca93270 0x5607cce38780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca6a3b0 0x5607cce38d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce3fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5607ccd99740 con 0x5607cca72590 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607ccd353a0 con 0x5607cca6a3b0 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5607ccd95700 con 0x5607cca93270 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce3fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce3fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56278/0 (socket says 172.21.15.80:56278) 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 -- 172.21.15.80:0/2633084635 learned_addr learned my addr 172.21.15.80:0/2633084635 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca93270 0x5607cce38780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdadcc9640 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca6a3b0 0x5607cce38d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efd9effd640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd940afb70 0x7efd940b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 -- 172.21.15.80:0/2633084635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca93270 msgr2=0x5607cce38780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca93270 0x5607cce38780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 -- 172.21.15.80:0/2633084635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca6a3b0 msgr2=0x5607cce38d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca6a3b0 0x5607cce38d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 -- 172.21.15.80:0/2633084635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ccd51750 con 0x5607cca72590 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdae4ca640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd940afb70 0x7efd940b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efd9effd640 1 -- 172.21.15.80:0/3322240742 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7efda00decc0 con 0x7efda8109790 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efdad4c8640 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce3fc00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efd98005f70 tx=0x7efd98000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecc6cd6e2cbd92b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.208+0000 7efd93fff640 1 -- 172.21.15.80:0/2633084635 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98035040 con 0x5607cca72590 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efd93fff640 1 -- 172.21.15.80:0/2633084635 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd98031720 con 0x5607cca72590 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efd93fff640 1 -- 172.21.15.80:0/2633084635 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98003a80 con 0x5607cca72590 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdb6ddd740 1 -- 172.21.15.80:0/2633084635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 msgr2=0x5607cce3fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdae4ca640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd940afb70 0x7efd940b2080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efda00dcb20 tx=0x7efda0075d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce3fc00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efd98005f70 tx=0x7efd98000bc0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdb6ddd740 1 -- 172.21.15.80:0/2633084635 shutdown_connections 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce3fc00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca6a3b0 0x5607cce38d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/2633084635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca93270 0x5607cce38780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.209+0000 7efdb6ddd740 1 -- 172.21.15.80:0/2633084635 >> 172.21.15.80:0/2633084635 conn(0x5607cca873c0 msgr2=0x5607cce2fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 -- 172.21.15.80:0/2633084635 shutdown_connections 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 -- 172.21.15.80:0/2633084635 wait complete. 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 -- start start 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 Processor -- start 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce42670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 0x5607cce42bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca93270 0x5607cce49b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5607cce405f0 con 0x5607cca93270 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607ccd20fe0 con 0x5607cca72590 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5607cce40770 con 0x5607cca6a3b0 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdb6ddd740 10 client.0 _ll_register_callbacks cb 0x5607ccd37150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca93270 0x5607cce49b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca93270 0x5607cce49b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56294/0 (socket says 172.21.15.80:56294) 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdad4c8640 1 -- 172.21.15.80:0/1421390727 learned_addr learned my addr 172.21.15.80:0/1421390727 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.210+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce42670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdadcc9640 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 0x5607cce42bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdad4c8640 1 -- 172.21.15.80:0/1421390727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 msgr2=0x5607cce42670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce42670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdad4c8640 1 -- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 msgr2=0x5607cce42bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 0x5607cce42bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdad4c8640 1 -- 172.21.15.80:0/1421390727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607ccaab2d0 con 0x5607cca93270 2024-04-25T11:23:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca93270 0x5607cce49b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efd980096c0 tx=0x7efd98042040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3538ec89837f7623 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efd917fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efd917fa640 1 -- 172.21.15.80:0/1421390727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98035040 con 0x5607cca93270 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd98031720 con 0x5607cca93270 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efd917fa640 1 -- 172.21.15.80:0/1421390727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7efd98004070 con 0x5607cca93270 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efd917fa640 1 -- 172.21.15.80:0/1421390727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efd98004270 con 0x5607cca93270 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdb6ddd740 10 client.15090 fetch_fsmap learned FSMap version 21 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5607ccb756b0 con 0x5607cca93270 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.211+0000 7efd917fa640 1 -- 172.21.15.80:0/1421390727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd98031720 con 0x5607cca93270 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efd917fa640 1 -- 172.21.15.80:0/1421390727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efd98059410 con 0x5607cca93270 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdb6ddd740 10 client.15090 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdb6ddd740 10 client.15090 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdb6ddd740 20 client.15090 populate_metadata read hostname 'smithi080' 2024-04-25T11:23:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca51e40 0x5607cce4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdb6ddd740 4 client.15090 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607ccda7350 con 0x5607cca51e40 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdadcc9640 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca51e40 0x5607cce4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efd917fa640 10 client.15090 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.212+0000 7efdadcc9640 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca51e40 0x5607cce4fde0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19742b2c4dac9c20 server_cookie=4f461572473d2283 in_seq=0 out_seq=0 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efd917fa640 1 -- 172.21.15.80:0/1421390727 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5607ccda7350 con 0x5607cca51e40 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efd917fa640 10 client.15090 handle_command_reply: tid=0 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 client.15090 shutdown 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca93270 msgr2=0x5607cce49b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca93270 0x5607cce49b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efd980096c0 tx=0x7efd98042040 comp rx=0 tx=0).stop 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 shutdown_connections 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca51e40 0x5607cce4fde0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca93270 0x5607cce49b10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efd917fa640 0 client.15090 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:23:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 0x5607cce42bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1421390727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce42670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 >> 172.21.15.80:0/1421390727 conn(0x5607cca873c0 msgr2=0x5607cce2ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 shutdown_connections 2024-04-25T11:23:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.213+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1421390727 wait complete. 2024-04-25T11:23:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.214+0000 7efdb6ddd740 20 client.15090 trim_cache size 0 max 16384 2024-04-25T11:23:41.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 Processor -- start 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 -- start start 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca51e40 0x5607cce40c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce49a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 0x5607cce411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5607cce4e120 con 0x5607cca51e40 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607cce4e7f0 con 0x5607cca72590 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5607cce4eec0 con 0x5607cca6a3b0 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca51e40 0x5607cce40c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca51e40 0x5607cce40c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56298/0 (socket says 172.21.15.80:56298) 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.232+0000 7efdad4c8640 1 -- 172.21.15.80:0/4140797239 learned_addr learned my addr 172.21.15.80:0/4140797239 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdadcc9640 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce49a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdad4c8640 1 -- 172.21.15.80:0/4140797239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 msgr2=0x5607cce49a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdad4c8640 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce49a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdad4c8640 1 -- 172.21.15.80:0/4140797239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 msgr2=0x5607cce411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdad4c8640 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 0x5607cce411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdad4c8640 1 -- 172.21.15.80:0/4140797239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607cce40100 con 0x5607cca51e40 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdadcc9640 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce49a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efdad4c8640 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca51e40 0x5607cce40c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efd9802a930 tx=0x7efd9802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acd0a910baf9ad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efd937fe640 1 -- 172.21.15.80:0/4140797239 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98035070 con 0x5607cca51e40 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efd937fe640 1 -- 172.21.15.80:0/4140797239 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd98031e40 con 0x5607cca51e40 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.233+0000 7efd937fe640 1 -- 172.21.15.80:0/4140797239 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98059a50 con 0x5607cca51e40 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- 172.21.15.80:0/4140797239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca51e40 msgr2=0x5607cce40c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca51e40 0x5607cce40c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efd9802a930 tx=0x7efd9802a410 comp rx=0 tx=0).stop 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- 172.21.15.80:0/4140797239 shutdown_connections 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca72590 0x5607cce411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce49a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/4140797239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca51e40 0x5607cce40c90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- 172.21.15.80:0/4140797239 >> 172.21.15.80:0/4140797239 conn(0x5607cca873c0 msgr2=0x5607cce3caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- 172.21.15.80:0/4140797239 shutdown_connections 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- 172.21.15.80:0/4140797239 wait complete. 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- start start 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 Processor -- start 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca51e40 0x5607cce45010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce45550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce48490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5607cce4fc60 con 0x5607cca72590 2024-04-25T11:23:41.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607cce4f590 con 0x5607cca51e40 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5607cce50330 con 0x5607cca6a3b0 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.234+0000 7efdb6ddd740 10 client.0 _ll_register_callbacks cb 0x7efda4004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce48490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce48490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56310/0 (socket says 172.21.15.80:56310) 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 -- 172.21.15.80:0/1352188321 learned_addr learned my addr 172.21.15.80:0/1352188321 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca51e40 0x5607cce45010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdadcc9640 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce45550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 -- 172.21.15.80:0/1352188321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 msgr2=0x5607cce45550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce45550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 -- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca51e40 msgr2=0x5607cce45010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca51e40 0x5607cce45010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 -- 172.21.15.80:0/1352188321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607cce48a50 con 0x5607cca72590 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdad4c8640 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce48490 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efd98059860 tx=0x7efd98032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6712022c0252d6b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efd917fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efd917fa640 1 -- 172.21.15.80:0/1352188321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98035030 con 0x5607cca72590 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efd917fa640 1 -- 172.21.15.80:0/1352188321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7efd98059c70 con 0x5607cca72590 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5607ccda11c0 con 0x5607cca72590 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efd917fa640 1 -- 172.21.15.80:0/1352188321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efd980035f0 con 0x5607cca72590 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdb6ddd740 10 client.15096 fetch_fsmap learned FSMap version 21 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5607cce49c40 con 0x5607cca72590 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.235+0000 7efd917fa640 1 -- 172.21.15.80:0/1352188321 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5607ccda11c0 con 0x5607cca72590 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efd917fa640 1 -- 172.21.15.80:0/1352188321 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efd98032510 con 0x5607cca72590 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdb6ddd740 10 client.15096 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdb6ddd740 10 client.15096 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdb6ddd740 20 client.15096 populate_metadata read hostname 'smithi080' 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca93270 0x5607ccebbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdb6ddd740 4 client.15096 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "status"}) -- 0x5607ccd1c9a0 con 0x5607cca93270 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdadcc9640 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca93270 0x5607ccebbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efd917fa640 10 client.15096 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdadcc9640 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca93270 0x5607ccebbf40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0e17bf4839fbb65 server_cookie=b00471752759e95 in_seq=0 out_seq=0 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efd917fa640 1 -- 172.21.15.80:0/1352188321 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5607ccd1c9a0 con 0x5607cca93270 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efd917fa640 10 client.15096 handle_command_reply: tid=0 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.236+0000 7efdb6ddd740 1 client.15096 shutdown 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 msgr2=0x5607cce48490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce48490 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efd98059860 tx=0x7efd98032bc0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 shutdown_connections 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5607cca93270 0x5607ccebbf40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607cca72590 0x5607cce48490 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607cca6a3b0 0x5607cce45550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efd917fa640 0 client.15096 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 --2- 172.21.15.80:0/1352188321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607cca51e40 0x5607cce45010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 >> 172.21.15.80:0/1352188321 conn(0x5607cca873c0 msgr2=0x5607cce40bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 shutdown_connections 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 1 -- 172.21.15.80:0/1352188321 wait complete. 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdb6ddd740 20 client.15096 trim_cache size 0 max 16384 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 2, 2024-04-25T11:23:41.239 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24476, 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 83.813475534000005, 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 21, 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 79, 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 77, 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 104.85929501 2024-04-25T11:23:41.240 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd940afb70 msgr2=0x7efd940b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd940afb70 0x7efd940b2080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efda00dcb20 tx=0x7efda0075d90 comp rx=0 tx=0).stop 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8109790 msgr2=0x7efda81a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8109790 0x7efda81a16f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efda000eaa0 tx=0x7efda000ef60 comp rx=0 tx=0).stop 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 shutdown_connections 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd940afb70 0x7efd940b2080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda8109790 0x7efda81a16f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda8106c20 0x7efda819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.237+0000 7efdaff2d640 1 --2- 172.21.15.80:0/3322240742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efda8101e40 0x7efda819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.238+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 >> 172.21.15.80:0/3322240742 conn(0x7efda80fd350 msgr2=0x7efda8107c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.238+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 shutdown_connections 2024-04-25T11:23:41.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.238+0000 7efdaff2d640 1 -- 172.21.15.80:0/3322240742 wait complete. 2024-04-25T11:23:41.243 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-25T11:23:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 -- 172.21.15.80:0/3008769566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048103af0 msgr2=0x7ff0481047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 --2- 172.21.15.80:0/3008769566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048103af0 0x7ff0481047f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff044009900 tx=0x7ff04402a410 comp rx=0 tx=0).stop 2024-04-25T11:23:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 -- 172.21.15.80:0/3008769566 shutdown_connections 2024-04-25T11:23:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 --2- 172.21.15.80:0/3008769566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff048109a30 0x7ff04810be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 --2- 172.21.15.80:0/3008769566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff048104d30 0x7ff048105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 --2- 172.21.15.80:0/3008769566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048103af0 0x7ff0481047f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 -- 172.21.15.80:0/3008769566 >> 172.21.15.80:0/3008769566 conn(0x7ff0480fece0 msgr2=0x7ff048101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 -- 172.21.15.80:0/3008769566 shutdown_connections 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.357+0000 7ff050335640 1 -- 172.21.15.80:0/3008769566 wait complete. 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 Processor -- start 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 -- start start 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff048103af0 0x7ff04819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048104d30 0x7ff04819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff048109a30 0x7ff0481a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff04810f650 con 0x7ff048104d30 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff04810f4d0 con 0x7ff048109a30 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff050335640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff04810f7d0 con 0x7ff048103af0 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048104d30 0x7ff04819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048104d30 0x7ff04819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56332/0 (socket says 172.21.15.80:56332) 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2278961896 learned_addr learned my addr 172.21.15.80:0/2278961896 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff048103af0 0x7ff04819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff048109a30 0x7ff0481a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2278961896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff048103af0 msgr2=0x7ff04819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff048103af0 0x7ff04819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2278961896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff048109a30 msgr2=0x7ff0481a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff048109a30 0x7ff0481a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.358+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2278961896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0481a1d90 con 0x7ff048104d30 2024-04-25T11:23:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.359+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048104d30 0x7ff04819a790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c890 tx=0x7ff03800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.359+0000 7ff03f7fe640 1 -- 172.21.15.80:0/2278961896 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038004220 con 0x7ff048104d30 2024-04-25T11:23:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.359+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0481a2080 con 0x7ff048104d30 2024-04-25T11:23:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.359+0000 7ff03f7fe640 1 -- 172.21.15.80:0/2278961896 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0380043c0 con 0x7ff048104d30 2024-04-25T11:23:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.359+0000 7ff03f7fe640 1 -- 172.21.15.80:0/2278961896 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038004a00 con 0x7ff048104d30 2024-04-25T11:23:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.359+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0481a2650 con 0x7ff048104d30 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.361+0000 7ff0571e0740 1 Processor -- start 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff0571e0740 1 -- start start 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff03f7fe640 1 -- 172.21.15.80:0/2278961896 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7ff0380079b0 con 0x7ff048104d30 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e8fd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e8fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e9047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff0571e0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c3e862740 con 0x562c3e55c270 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff0571e0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c3e7fe3a0 con 0x562c3e5333b0 2024-04-25T11:23:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff0571e0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562c3e85e700 con 0x562c3e53b590 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e8fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e8fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56342/0 (socket says 172.21.15.80:56342) 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 -- 172.21.15.80:0/1673595611 learned_addr learned my addr 172.21.15.80:0/1673595611 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e9047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e8fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 -- 172.21.15.80:0/1673595611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 msgr2=0x562c3e9047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e9047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 -- 172.21.15.80:0/1673595611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 msgr2=0x562c3e8fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e8fd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 -- 172.21.15.80:0/1673595611 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c3e81a750 con 0x562c3e55c270 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff03f7fe640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0340afaf0 0x7ff0340b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.362+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e8fd370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff040007d90 tx=0x7ff04000c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b331d63d4d0c2b47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.363+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0340afaf0 0x7ff0340b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.363+0000 7ff03cbfe640 1 -- 172.21.15.80:0/1673595611 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040015020 con 0x562c3e55c270 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.363+0000 7ff03f7fe640 1 -- 172.21.15.80:0/2278961896 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff0380de9a0 con 0x7ff048104d30 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.363+0000 7ff03cbfe640 1 -- 172.21.15.80:0/1673595611 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff040011ae0 con 0x562c3e55c270 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.363+0000 7ff03cbfe640 1 -- 172.21.15.80:0/1673595611 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0400109d0 con 0x562c3e55c270 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- 172.21.15.80:0/1673595611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 msgr2=0x562c3e8fd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0340afaf0 0x7ff0340b2000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff044005ab0 tx=0x7ff044031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e8fd370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff040007d90 tx=0x7ff04000c560 comp rx=0 tx=0).stop 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- 172.21.15.80:0/1673595611 shutdown_connections 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e9047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e8fd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 --2- 172.21.15.80:0/1673595611 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e8fd370 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- 172.21.15.80:0/1673595611 >> 172.21.15.80:0/1673595611 conn(0x562c3e5503c0 msgr2=0x562c3e8f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- 172.21.15.80:0/1673595611 shutdown_connections 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- 172.21.15.80:0/1673595611 wait complete. 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- start start 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 Processor -- start 2024-04-25T11:23:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e5333b0 0x562c3e907320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e907860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e55c270 0x562c3e90e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c3e905240 con 0x562c3e53b590 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c3e7e9fe0 con 0x562c3e55c270 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562c3e9053c0 con 0x562c3e5333b0 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff0571e0740 10 client.0 _ll_register_callbacks cb 0x562c3e800150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff04d8d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e907860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff04d8d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e907860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56344/0 (socket says 172.21.15.80:56344) 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.364+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2781794463 learned_addr learned my addr 172.21.15.80:0/2781794463 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e5333b0 0x562c3e907320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e55c270 0x562c3e90e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e5333b0 msgr2=0x562c3e907320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e5333b0 0x562c3e907320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2781794463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e55c270 msgr2=0x562c3e90e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e55c270 0x562c3e90e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04d8d0640 1 -- 172.21.15.80:0/2781794463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c3e5742d0 con 0x562c3e53b590 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e55c270 0x562c3e90e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e5333b0 0x562c3e907320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e907860 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff0380a6b70 tx=0x7ff0380a6d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee09f777e8d4e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff031ffb640 1 -- 172.21.15.80:0/2781794463 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03801d040 con 0x562c3e53b590 2024-04-25T11:23:41.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff031ffb640 1 -- 172.21.15.80:0/2781794463 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff0380a60d0 con 0x562c3e53b590 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff040011ae0 con 0x562c3e53b590 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff031ffb640 1 -- 172.21.15.80:0/2781794463 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0380a6980 con 0x562c3e53b590 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff0571e0740 10 client.15108 fetch_fsmap learned FSMap version 21 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562c3e63e6b0 con 0x562c3e53b590 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff031ffb640 1 -- 172.21.15.80:0/2781794463 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff040011ae0 con 0x562c3e53b590 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff031ffb640 1 -- 172.21.15.80:0/2781794463 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0380a5b40 con 0x562c3e53b590 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.365+0000 7ff0571e0740 10 client.15108 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:23:41.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff0571e0740 10 client.15108 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff0571e0740 20 client.15108 populate_metadata read hostname 'smithi080' 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff0571e0740 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e51ae40 0x562c3e915030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff0571e0740 4 client.15108 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c3e870350 con 0x562c3e51ae40 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e51ae40 0x562c3e915030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff031ffb640 10 client.15108 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.366+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e51ae40 0x562c3e915030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f7e88181a39ab9b server_cookie=311276ef223363b8 in_seq=0 out_seq=0 2024-04-25T11:23:41.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff031ffb640 1 -- 172.21.15.80:0/2781794463 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562c3e870350 con 0x562c3e51ae40 2024-04-25T11:23:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff031ffb640 10 client.15108 handle_command_reply: tid=0 2024-04-25T11:23:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 client.15108 shutdown 2024-04-25T11:23:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 msgr2=0x562c3e907860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e907860 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff0380a6b70 tx=0x7ff0380a6d00 comp rx=0 tx=0).stop 2024-04-25T11:23:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 shutdown_connections 2024-04-25T11:23:41.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e907860 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e51ae40 0x562c3e915030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e55c270 0x562c3e90e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 --2- 172.21.15.80:0/2781794463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e5333b0 0x562c3e907320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff031ffb640 0 client.15108 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:23:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 >> 172.21.15.80:0/2781794463 conn(0x562c3e5503c0 msgr2=0x562c3e8f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 shutdown_connections 2024-04-25T11:23:41.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 1 -- 172.21.15.80:0/2781794463 wait complete. 2024-04-25T11:23:41.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.367+0000 7ff0571e0740 20 client.15108 trim_cache size 0 max 16384 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 Processor -- start 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 -- start start 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e912a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e90e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e55c270 0x562c3e90ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c3e913370 con 0x562c3e53b590 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c3e913a40 con 0x562c3e5333b0 2024-04-25T11:23:41.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff0571e0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562c3e914110 con 0x562c3e55c270 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e90e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e90e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56350/0 (socket says 172.21.15.80:56350) 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 -- 172.21.15.80:0/346592289 learned_addr learned my addr 172.21.15.80:0/346592289 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e912a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 -- 172.21.15.80:0/346592289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e55c270 msgr2=0x562c3e90ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e55c270 0x562c3e90ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 -- 172.21.15.80:0/346592289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 msgr2=0x562c3e912a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e912a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 -- 172.21.15.80:0/346592289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c3e9021a0 con 0x562c3e53b590 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e912a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.386+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e90e6e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff0380a40e0 tx=0x7ff038000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca9a1c416d0af5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff033fff640 1 -- 172.21.15.80:0/346592289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03801d040 con 0x562c3e53b590 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff033fff640 1 -- 172.21.15.80:0/346592289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0380dee50 con 0x562c3e53b590 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff033fff640 1 -- 172.21.15.80:0/346592289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a5b40 con 0x562c3e53b590 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 -- 172.21.15.80:0/346592289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 msgr2=0x562c3e90e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e90e6e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff0380a40e0 tx=0x7ff038000bc0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 -- 172.21.15.80:0/346592289 shutdown_connections 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e53b590 0x562c3e90e6e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e55c270 0x562c3e90ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 --2- 172.21.15.80:0/346592289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e912a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 -- 172.21.15.80:0/346592289 >> 172.21.15.80:0/346592289 conn(0x562c3e5503c0 msgr2=0x562c3e905940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 -- 172.21.15.80:0/346592289 shutdown_connections 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.387+0000 7ff0571e0740 1 -- 172.21.15.80:0/346592289 wait complete. 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 -- start start 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 Processor -- start 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e90a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e90ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e90da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c3e914eb0 con 0x562c3e55c270 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c3e9147e0 con 0x562c3e5333b0 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562c3e915580 con 0x562c3e53b590 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff0571e0740 10 client.0 _ll_register_callbacks cb 0x7ff038004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e90da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e90da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56358/0 (socket says 172.21.15.80:56358) 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 -- 172.21.15.80:0/703046650 learned_addr learned my addr 172.21.15.80:0/703046650 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04d8d0640 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e90ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e90a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 -- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 msgr2=0x562c3e90ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e90ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 -- 172.21.15.80:0/703046650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 msgr2=0x562c3e90a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e90a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.388+0000 7ff04e8d2640 1 -- 172.21.15.80:0/703046650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c3e90e030 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff04e8d2640 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e90da70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff0400070f0 tx=0x7ff040011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c628a9a31692cdde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff031ffb640 1 -- 172.21.15.80:0/703046650 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040028060 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff031ffb640 1 -- 172.21.15.80:0/703046650 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff040007840 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0380dee50 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff031ffb640 1 -- 172.21.15.80:0/703046650 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff040015050 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 10 client.15114 fetch_fsmap learned FSMap version 21 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562c3e90f220 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff031ffb640 1 -- 172.21.15.80:0/703046650 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0380dee50 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff031ffb640 1 -- 172.21.15.80:0/703046650 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff04002e3f0 con 0x562c3e55c270 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 10 client.15114 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 10 client.15114 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 20 client.15114 populate_metadata read hostname 'smithi080' 2024-04-25T11:23:41.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e4f0280 0x562c3e981310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 4 client.15114 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.389+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "status"}) -- 0x562c3e86a1c0 con 0x562c3e4f0280 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e4f0280 0x562c3e981310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff04e0d1640 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e4f0280 0x562c3e981310 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eea42835fc0b0888 server_cookie=6b34554b44c7bee3 in_seq=0 out_seq=0 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff031ffb640 10 client.15114 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff031ffb640 1 -- 172.21.15.80:0/703046650 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562c3e86a1c0 con 0x562c3e4f0280 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff031ffb640 10 client.15114 handle_command_reply: tid=0 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 client.15114 shutdown 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 msgr2=0x562c3e90da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e90da70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff0400070f0 tx=0x7ff040011b80 comp rx=0 tx=0).stop 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 shutdown_connections 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c3e55c270 0x562c3e90da70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x562c3e4f0280 0x562c3e981310 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562c3e53b590 0x562c3e90ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 --2- 172.21.15.80:0/703046650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c3e5333b0 0x562c3e90a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff031ffb640 0 client.15114 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 >> 172.21.15.80:0/703046650 conn(0x562c3e5503c0 msgr2=0x562c3e8f86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 shutdown_connections 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 1 -- 172.21.15.80:0/703046650 wait complete. 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.390+0000 7ff0571e0740 20 client.15114 trim_cache size 0 max 16384 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24499, 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T11:23:41.392 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T11:23:41.393 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T11:23:41.393 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 84.974366305000004, 2024-04-25T11:23:41.393 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 21, 2024-04-25T11:23:41.393 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 79, 2024-04-25T11:23:41.393 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 77, 2024-04-25T11:23:41.393 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 102.098761599 2024-04-25T11:23:41.393 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0340afaf0 msgr2=0x7ff0340b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0340afaf0 0x7ff0340b2000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff044005ab0 tx=0x7ff044031400 comp rx=0 tx=0).stop 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048104d30 msgr2=0x7ff04819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048104d30 0x7ff04819a790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c890 tx=0x7ff03800cd50 comp rx=0 tx=0).stop 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 shutdown_connections 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0340afaf0 0x7ff0340b2000 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff048104d30 0x7ff04819a790 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff048109a30 0x7ff0481a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 --2- 172.21.15.80:0/2278961896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff048103af0 0x7ff04819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 >> 172.21.15.80:0/2278961896 conn(0x7ff0480fece0 msgr2=0x7ff048105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 shutdown_connections 2024-04-25T11:23:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.391+0000 7ff050335640 1 -- 172.21.15.80:0/2278961896 wait complete. 2024-04-25T11:23:41.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2042422654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 msgr2=0x7fdb1c1036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2042422654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c1036e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009900 tx=0x7fdb0c02a410 comp rx=0 tx=0).stop 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2042422654 shutdown_connections 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2042422654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb1c108920 0x7fdb1c10ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2042422654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103c20 0x7fdb1c104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2042422654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c1036e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2042422654 >> 172.21.15.80:0/2042422654 conn(0x7fdb1c0fdbd0 msgr2=0x7fdb1c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2042422654 shutdown_connections 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.512+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2042422654 wait complete. 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 Processor -- start 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 -- start start 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb1c103c20 0x7fdb1c19a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c108920 0x7fdb1c1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c10f610 con 0x7fdb1c1029e0 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c10f490 con 0x7fdb1c108920 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb21fd7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c10f790 con 0x7fdb1c103c20 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c19a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56390/0 (socket says 172.21.15.80:56390) 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2196648623 learned_addr learned my addr 172.21.15.80:0/2196648623 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1affd640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb1c103c20 0x7fdb1c19a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c108920 0x7fdb1c1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2196648623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb1c103c20 msgr2=0x7fdb1c19a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb1c103c20 0x7fdb1c19a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2196648623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c108920 msgr2=0x7fdb1c1a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c108920 0x7fdb1c1a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2196648623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c1a1dc0 con 0x7fdb1c1029e0 2024-04-25T11:23:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.513+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c108920 0x7fdb1c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.514+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c19a2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c006010 tx=0x7fdb0c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.514+0000 7fdb18ff9640 1 -- 172.21.15.80:0/2196648623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c03f030 con 0x7fdb1c1029e0 2024-04-25T11:23:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.514+0000 7fdb18ff9640 1 -- 172.21.15.80:0/2196648623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb0c003aa0 con 0x7fdb1c1029e0 2024-04-25T11:23:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.514+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c1a2050 con 0x7fdb1c1029e0 2024-04-25T11:23:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.514+0000 7fdb18ff9640 1 -- 172.21.15.80:0/2196648623 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c035070 con 0x7fdb1c1029e0 2024-04-25T11:23:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.514+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c1a2540 con 0x7fdb1c1029e0 2024-04-25T11:23:41.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 Processor -- start 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb18ff9640 1 -- 172.21.15.80:0/2196648623 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fdb0c042030 con 0x7fdb1c1029e0 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 -- start start 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b5f1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b556740 con 0x55eb5b250270 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b4f23a0 con 0x55eb5b2273b0 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.516+0000 7fdb28f67740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b552700 con 0x55eb5b22f590 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b5f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b5f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56406/0 (socket says 172.21.15.80:56406) 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 -- 172.21.15.80:0/3515581431 learned_addr learned my addr 172.21.15.80:0/3515581431 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1affd640 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 -- 172.21.15.80:0/3515581431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 msgr2=0x55eb5b5f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb18ff9640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdb040afaf0 0x7fdb040b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 -- 172.21.15.80:0/3515581431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b2273b0 msgr2=0x55eb5b5f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 -- 172.21.15.80:0/3515581431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5b50e750 con 0x55eb5b250270 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb18ff9640 1 -- 172.21.15.80:0/2196648623 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fdb0c0ff160 con 0x7fdb1c1029e0 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b5f1370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009fb0 tx=0x7fdb14010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97755b90d5f2d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdb040afaf0 0x7fdb040b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb01ffb640 1 -- 172.21.15.80:0/3515581431 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14022070 con 0x55eb5b250270 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.517+0000 7fdb01ffb640 1 -- 172.21.15.80:0/3515581431 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb140113e0 con 0x55eb5b250270 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb01ffb640 1 -- 172.21.15.80:0/3515581431 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14016070 con 0x55eb5b250270 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 -- 172.21.15.80:0/3515581431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 msgr2=0x55eb5b5f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdb040afaf0 0x7fdb040b2000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb1401f000 tx=0x7fdb14022000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b5f1370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009fb0 tx=0x7fdb14010800 comp rx=0 tx=0).stop 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 -- 172.21.15.80:0/3515581431 shutdown_connections 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5f87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 --2- 172.21.15.80:0/3515581431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b5f1370 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 -- 172.21.15.80:0/3515581431 >> 172.21.15.80:0/3515581431 conn(0x55eb5b2443c0 msgr2=0x55eb5b5ecd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 -- 172.21.15.80:0/3515581431 shutdown_connections 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.518+0000 7fdb28f67740 1 -- 172.21.15.80:0/3515581431 wait complete. 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 -- start start 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 Processor -- start 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b250270 0x55eb5b602760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b5f9240 con 0x55eb5b2273b0 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b4ddfe0 con 0x55eb5b22f590 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b5f93c0 con 0x55eb5b250270 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb28f67740 10 client.0 _ll_register_callbacks cb 0x55eb5b4f4150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56410/0 (socket says 172.21.15.80:56410) 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/681993043 learned_addr learned my addr 172.21.15.80:0/681993043 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb1affd640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.519+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b250270 0x55eb5b602760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/681993043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b250270 msgr2=0x55eb5b602760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b250270 0x55eb5b602760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 msgr2=0x55eb5b5fb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/681993043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5b2682d0 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b250270 0x55eb5b602760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fb2c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0c48a0 tx=0x7fdb0c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba8c23fda32584e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdafaffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdafaffd640 1 -- 172.21.15.80:0/681993043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c049070 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdafaffd640 1 -- 172.21.15.80:0/681993043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fdb0c003c50 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb140113e0 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdafaffd640 1 -- 172.21.15.80:0/681993043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdb0c0c6da0 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 10 client.15126 fetch_fsmap learned FSMap version 21 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55eb5b3326b0 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdafaffd640 1 -- 172.21.15.80:0/681993043 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb140113e0 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdafaffd640 1 -- 172.21.15.80:0/681993043 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdb0c0c38c0 con 0x55eb5b2273b0 2024-04-25T11:23:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 10 client.15126 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 20 client.15126 populate_metadata read hostname 'smithi080' 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b20ee40 0x55eb5b609000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 4 client.15126 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.520+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb5b564350 con 0x55eb5b20ee40 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.521+0000 7fdb1affd640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b20ee40 0x55eb5b609000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.521+0000 7fdafaffd640 10 client.15126 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.521+0000 7fdb1affd640 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b20ee40 0x55eb5b609000 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f145d1e6f89bab65 server_cookie=f054d636e227d98e in_seq=0 out_seq=0 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdafaffd640 1 -- 172.21.15.80:0/681993043 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55eb5b564350 con 0x55eb5b20ee40 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdafaffd640 10 client.15126 handle_command_reply: tid=0 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 client.15126 shutdown 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 msgr2=0x55eb5b5fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fb2c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0c48a0 tx=0x7fdb0c009260 comp rx=0 tx=0).stop 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 shutdown_connections 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b20ee40 0x55eb5b609000 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b250270 0x55eb5b602760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 --2- 172.21.15.80:0/681993043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fb2c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdafaffd640 0 client.15126 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 >> 172.21.15.80:0/681993043 conn(0x55eb5b2443c0 msgr2=0x55eb5b5ebd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 shutdown_connections 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 1 -- 172.21.15.80:0/681993043 wait complete. 2024-04-25T11:23:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.522+0000 7fdb28f67740 20 client.15126 trim_cache size 0 max 16384 2024-04-25T11:23:41.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 Processor -- start 2024-04-25T11:23:41.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 -- start start 2024-04-25T11:23:41.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5ece00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b250270 0x55eb5b6026f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b607340 con 0x55eb5b2273b0 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b607a10 con 0x55eb5b250270 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb28f67740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b6080e0 con 0x55eb5b22f590 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56416/0 (socket says 172.21.15.80:56416) 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.541+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2136074954 learned_addr learned my addr 172.21.15.80:0/2136074954 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1affd640 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b250270 0x55eb5b6026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2136074954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 msgr2=0x55eb5b5ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2136074954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b250270 msgr2=0x55eb5b6026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b250270 0x55eb5b6026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1b7fe640 1 -- 172.21.15.80:0/2136074954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5b5f6100 con 0x55eb5b2273b0 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1affd640 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f4980 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c031440 tx=0x7fdb0c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafd35bc5fb46f1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb017fa640 1 -- 172.21.15.80:0/2136074954 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c049070 con 0x55eb5b2273b0 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb017fa640 1 -- 172.21.15.80:0/2136074954 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb0c0c7140 con 0x55eb5b2273b0 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.542+0000 7fdb017fa640 1 -- 172.21.15.80:0/2136074954 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0c7630 con 0x55eb5b2273b0 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 -- 172.21.15.80:0/2136074954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 msgr2=0x55eb5b5f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f4980 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c031440 tx=0x7fdb0c0095a0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 -- 172.21.15.80:0/2136074954 shutdown_connections 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b250270 0x55eb5b6026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b22f590 0x55eb5b5ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2136074954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b2273b0 0x55eb5b5f4980 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 -- 172.21.15.80:0/2136074954 >> 172.21.15.80:0/2136074954 conn(0x55eb5b2443c0 msgr2=0x55eb5b5ec6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 -- 172.21.15.80:0/2136074954 shutdown_connections 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 -- 172.21.15.80:0/2136074954 wait complete. 2024-04-25T11:23:41.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 -- start start 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.543+0000 7fdb28f67740 1 Processor -- start 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b601630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b608e80 con 0x55eb5b250270 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b6087b0 con 0x55eb5b22f590 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55eb5b609550 con 0x55eb5b2273b0 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 10 client.0 _ll_register_callbacks cb 0x7fdb0c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b601630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b601630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56424/0 (socket says 172.21.15.80:56424) 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 -- 172.21.15.80:0/2764813986 learned_addr learned my addr 172.21.15.80:0/2764813986 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1affd640 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 -- 172.21.15.80:0/2764813986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b2273b0 msgr2=0x55eb5b5fe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 -- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 msgr2=0x55eb5b5fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fe6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 -- 172.21.15.80:0/2764813986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5b601bf0 con 0x55eb5b250270 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb1bfff640 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b601630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009f80 tx=0x7fdb14012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c71ba6c2b5d3e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdafaffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdafaffd640 1 -- 172.21.15.80:0/2764813986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14036060 con 0x55eb5b250270 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdafaffd640 1 -- 172.21.15.80:0/2764813986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fdb14004a00 con 0x55eb5b250270 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb0c0c7140 con 0x55eb5b250270 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.544+0000 7fdafaffd640 1 -- 172.21.15.80:0/2764813986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdb14016040 con 0x55eb5b250270 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 10 client.15132 fetch_fsmap learned FSMap version 21 2024-04-25T11:23:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55eb5b602e70 con 0x55eb5b250270 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdafaffd640 1 -- 172.21.15.80:0/2764813986 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb0c0c7140 con 0x55eb5b250270 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdafaffd640 1 -- 172.21.15.80:0/2764813986 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdb14030070 con 0x55eb5b250270 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 10 client.15132 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 10 client.15132 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 20 client.15132 populate_metadata read hostname 'smithi080' 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b1e4280 0x55eb5b674e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 4 client.15132 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "status"}) -- 0x55eb5b55e1c0 con 0x55eb5b1e4280 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.545+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b1e4280 0x55eb5b674e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdafaffd640 10 client.15132 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb1b7fe640 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b1e4280 0x55eb5b674e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9214e415eac391bf server_cookie=3d8f511221ecf83 in_seq=0 out_seq=0 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdafaffd640 1 -- 172.21.15.80:0/2764813986 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55eb5b55e1c0 con 0x55eb5b1e4280 2024-04-25T11:23:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdafaffd640 10 client.15132 handle_command_reply: tid=0 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 client.15132 shutdown 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 msgr2=0x55eb5b601630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b601630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009f80 tx=0x7fdb14012aa0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 shutdown_connections 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eb5b1e4280 0x55eb5b674e00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eb5b250270 0x55eb5b601630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb5b22f590 0x55eb5b5fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdafaffd640 0 client.15132 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 --2- 172.21.15.80:0/2764813986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eb5b2273b0 0x55eb5b5fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 >> 172.21.15.80:0/2764813986 conn(0x55eb5b2443c0 msgr2=0x55eb5b5fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 shutdown_connections 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 1 -- 172.21.15.80:0/2764813986 wait complete. 2024-04-25T11:23:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.546+0000 7fdb28f67740 20 client.15132 trim_cache size 0 max 16384 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24521, 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 87.167186856000001, 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 21, 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 79, 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 77, 2024-04-25T11:23:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 93.697983102999999 2024-04-25T11:23:41.549 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:23:41.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdb040afaf0 msgr2=0x7fdb040b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdb040afaf0 0x7fdb040b2000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb1401f000 tx=0x7fdb14022000 comp rx=0 tx=0).stop 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 msgr2=0x7fdb1c19a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c19a2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c006010 tx=0x7fdb0c031a50 comp rx=0 tx=0).stop 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 shutdown_connections 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fdb040afaf0 0x7fdb040b2000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c108920 0x7fdb1c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb1c103c20 0x7fdb1c19a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 --2- 172.21.15.80:0/2196648623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb1c1029e0 0x7fdb1c19a2f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 >> 172.21.15.80:0/2196648623 conn(0x7fdb1c0fdbd0 msgr2=0x7fdb1c104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 shutdown_connections 2024-04-25T11:23:41.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:41.547+0000 7fdb21fd7640 1 -- 172.21.15.80:0/2196648623 wait complete. 2024-04-25T11:23:41.553 INFO:tasks.cephadm:Setup complete, yielding 2024-04-25T11:23:41.553 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T11:23:41.563 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:23:41.564 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-25T11:23:41.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:41 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/802796920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:41 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1513371104' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:41 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4268087763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:41 smithi196 ceph-mon[32659]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:41.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:41 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/802796920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:41 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1513371104' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:41 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4268087763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:41 smithi082 ceph-mon[32440]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:41.797 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:41.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:41 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/802796920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:41 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1513371104' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.879 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:41 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4268087763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:23:41.879 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:41 smithi080 ceph-mon[29126]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:43.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 -- 172.21.15.80:0/585785017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c1030e0 msgr2=0x7fe12c1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:43.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 --2- 172.21.15.80:0/585785017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c1030e0 0x7fe12c1034f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009990 tx=0x7fe11c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 -- 172.21.15.80:0/585785017 shutdown_connections 2024-04-25T11:23:43.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 --2- 172.21.15.80:0/585785017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c104bb0 0x7fe12c10b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 --2- 172.21.15.80:0/585785017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c1030e0 0x7fe12c1034f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 --2- 172.21.15.80:0/585785017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c104210 0x7fe12c104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 -- 172.21.15.80:0/585785017 >> 172.21.15.80:0/585785017 conn(0x7fe12c0fe740 msgr2=0x7fe12c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 -- 172.21.15.80:0/585785017 shutdown_connections 2024-04-25T11:23:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.582+0000 7fe1326c1700 1 -- 172.21.15.80:0/585785017 wait complete. 2024-04-25T11:23:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 Processor -- start 2024-04-25T11:23:43.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 -- start start 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1030e0 0x7fe12c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c104210 0x7fe12c19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c104bb0 0x7fe12c1a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c10fcc0 con 0x7fe12c104210 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c10fb40 con 0x7fe12c1030e0 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe1326c1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c10fe40 con 0x7fe12c104bb0 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe12b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c104210 0x7fe12c19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe12b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c104210 0x7fe12c19ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56454/0 (socket says 172.21.15.80:56454) 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe12b7fe700 1 -- 172.21.15.80:0/341441544 learned_addr learned my addr 172.21.15.80:0/341441544 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe12bfff700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1030e0 0x7fe12c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.583+0000 7fe130c5e700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c104bb0 0x7fe12c1a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:43.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe12b7fe700 1 -- 172.21.15.80:0/341441544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c104bb0 msgr2=0x7fe12c1a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe12b7fe700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c104bb0 0x7fe12c1a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe12b7fe700 1 -- 172.21.15.80:0/341441544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1030e0 msgr2=0x7fe12c19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe12b7fe700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1030e0 0x7fe12c19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe12b7fe700 1 -- 172.21.15.80:0/341441544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12c1a2270 con 0x7fe12c104210 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe12b7fe700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c104210 0x7fe12c19ace0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe12000c9b0 tx=0x7fe12000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe1297fa700 1 -- 172.21.15.80:0/341441544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120007b00 con 0x7fe12c104210 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe1297fa700 1 -- 172.21.15.80:0/341441544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe12000ce50 con 0x7fe12c104210 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe1297fa700 1 -- 172.21.15.80:0/341441544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120018660 con 0x7fe12c104210 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12c1a2560 con 0x7fe12c104210 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.584+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12c1a2a50 con 0x7fe12c104210 2024-04-25T11:23:43.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.585+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe12c051190 con 0x7fe12c104210 2024-04-25T11:23:43.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.587+0000 7fe1297fa700 1 -- 172.21.15.80:0/341441544 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fe12000f450 con 0x7fe12c104210 2024-04-25T11:23:43.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.587+0000 7fe1297fa700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1140afc00 0x7fe1140b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:43.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.587+0000 7fe12bfff700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1140afc00 0x7fe1140b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:43.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.587+0000 7fe1297fa700 1 -- 172.21.15.80:0/341441544 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fe1200ded90 con 0x7fe12c104210 2024-04-25T11:23:43.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.588+0000 7fe12bfff700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1140afc00 0x7fe1140b2110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0038a0 tx=0x7fe11c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:43.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.591+0000 7fe1297fa700 1 -- 172.21.15.80:0/341441544 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe120014030 con 0x7fe12c104210 2024-04-25T11:23:43.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.809+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe12c063ad0 con 0x7fe1140afc00 2024-04-25T11:23:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.811+0000 7fe1297fa700 1 -- 172.21.15.80:0/341441544 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe12c063ad0 con 0x7fe1140afc00 2024-04-25T11:23:43.805 INFO:teuthology.orchestra.run.smithi080.stdout:Backend: cephadm 2024-04-25T11:23:43.806 INFO:teuthology.orchestra.run.smithi080.stdout:Available: Yes 2024-04-25T11:23:43.806 INFO:teuthology.orchestra.run.smithi080.stdout:Paused: No 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1140afc00 msgr2=0x7fe1140b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1140afc00 0x7fe1140b2110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0038a0 tx=0x7fe11c01a040 comp rx=0 tx=0).stop 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c104210 msgr2=0x7fe12c19ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c104210 0x7fe12c19ace0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe12000c9b0 tx=0x7fe12000ccc0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 shutdown_connections 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1140afc00 0x7fe1140b2110 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c104bb0 0x7fe12c1a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1030e0 0x7fe12c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 --2- 172.21.15.80:0/341441544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe12c104210 0x7fe12c19ace0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 >> 172.21.15.80:0/341441544 conn(0x7fe12c0fe740 msgr2=0x7fe12c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 shutdown_connections 2024-04-25T11:23:43.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:43.814+0000 7fe1326c1700 1 -- 172.21.15.80:0/341441544 wait complete. 2024-04-25T11:23:44.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:44 smithi080 ceph-mon[29126]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:44.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-25T11:23:44.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:44 smithi196 ceph-mon[32659]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:44.702 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:44.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:44 smithi082 ceph-mon[32440]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:45.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:45 smithi080 ceph-mon[29126]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:45.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:45 smithi196 ceph-mon[32659]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:45.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:45 smithi082 ceph-mon[32440]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:46.393 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:46 smithi080 ceph-mon[29126]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:46.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.418+0000 7f521d856700 1 -- 172.21.15.80:0/994368564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 msgr2=0x7f52181034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:46.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.418+0000 7f521d856700 1 --2- 172.21.15.80:0/994368564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181034e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f520c009990 tx=0x7f520c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 -- 172.21.15.80:0/994368564 shutdown_connections 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 --2- 172.21.15.80:0/994368564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218104ba0 0x7f521810b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 --2- 172.21.15.80:0/994368564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181034e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 --2- 172.21.15.80:0/994368564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218104200 0x7f5218104610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 -- 172.21.15.80:0/994368564 >> 172.21.15.80:0/994368564 conn(0x7f52180fe730 msgr2=0x7f5218100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 -- 172.21.15.80:0/994368564 shutdown_connections 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 -- 172.21.15.80:0/994368564 wait complete. 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 Processor -- start 2024-04-25T11:23:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.419+0000 7f521d856700 1 -- start start 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218104200 0x7f5218199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218104ba0 0x7f52181a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f521810eb20 con 0x7f52181030d0 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f521810e9a0 con 0x7f5218104200 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f521810eca0 con 0x7f5218104ba0 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56474/0 (socket says 172.21.15.80:56474) 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 -- 172.21.15.80:0/1392000167 learned_addr learned my addr 172.21.15.80:0/1392000167 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f52167fc700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218104200 0x7f5218199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 -- 172.21.15.80:0/1392000167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218104ba0 msgr2=0x7f52181a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218104ba0 0x7f52181a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 -- 172.21.15.80:0/1392000167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218104200 msgr2=0x7f5218199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218104200 0x7f5218199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 -- 172.21.15.80:0/1392000167 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5218075970 con 0x7f52181030d0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f52167fc700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218104200 0x7f5218199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f5216ffd700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181996d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f520c000c00 tx=0x7f520c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521c854700 1 -- 172.21.15.80:0/1392000167 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c004830 con 0x7f52181030d0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5218075c00 con 0x7f52181030d0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521c854700 1 -- 172.21.15.80:0/1392000167 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f520c003c00 con 0x7f52181030d0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521c854700 1 -- 172.21.15.80:0/1392000167 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c005360 con 0x7f52181030d0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.420+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5218076080 con 0x7f52181030d0 2024-04-25T11:23:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.421+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5218051190 con 0x7f52181030d0 2024-04-25T11:23:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.423+0000 7f521c854700 1 -- 172.21.15.80:0/1392000167 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f520c005500 con 0x7f52181030d0 2024-04-25T11:23:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.423+0000 7f521c854700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f52000afb80 0x7f52000b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.423+0000 7f52167fc700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f52000afb80 0x7f52000b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.424+0000 7f521c854700 1 -- 172.21.15.80:0/1392000167 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f520c0dffb0 con 0x7f52181030d0 2024-04-25T11:23:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.424+0000 7f52167fc700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f52000afb80 0x7f52000b2090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5208005950 tx=0x7f5208005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:46.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.427+0000 7f521c854700 1 -- 172.21.15.80:0/1392000167 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f520c013070 con 0x7f52181030d0 2024-04-25T11:23:46.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.637+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5218076400 con 0x7f52000afb80 2024-04-25T11:23:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.650+0000 7f521c854700 1 -- 172.21.15.80:0/1392000167 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f5218076400 con 0x7f52000afb80 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.a smithi080 running (102s) 16s ago 101s 80.7M - 19.0.0-3291-g994e2f20 d53c96779a29 8ccd7807e23a 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.b smithi082 running (99s) 32s ago 98s 95.8M - 19.0.0-3291-g994e2f20 d53c96779a29 ee77e2f0910e 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.c smithi196 running (113s) 32s ago 113s 85.2M - 19.0.0-3291-g994e2f20 d53c96779a29 fd0fbdd31f9d 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.d smithi080 running (2m) 16s ago 2m 81.6M - 19.0.0-3291-g994e2f20 d53c96779a29 d96ba53fdd88 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.e smithi082 running (119s) 32s ago 118s 83.4M - 19.0.0-3291-g994e2f20 d53c96779a29 0fe8dddd2e87 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.f smithi196 running (116s) 32s ago 116s 83.6M - 19.0.0-3291-g994e2f20 d53c96779a29 d30e06c9f41d 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.g smithi080 running (104s) 16s ago 104s 81.3M - 19.0.0-3291-g994e2f20 d53c96779a29 4b180c95824c 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.h smithi082 running (110s) 32s ago 110s 87.9M - 19.0.0-3291-g994e2f20 d53c96779a29 d2f46978b6ba 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.i smithi196 running (107s) 32s ago 107s 85.5M - 19.0.0-3291-g994e2f20 d53c96779a29 b2f85528d22e 2024-04-25T11:23:46.645 INFO:teuthology.orchestra.run.smithi080.stdout:mds.j smithi080 running (2m) 16s ago 2m 83.0M - 19.0.0-3291-g994e2f20 d53c96779a29 3e4d7f36062b 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mds.k smithi082 running (2m) 32s ago 2m 81.2M - 19.0.0-3291-g994e2f20 d53c96779a29 88a655b1c176 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mds.l smithi196 running (2m) 32s ago 2m 81.4M - 19.0.0-3291-g994e2f20 d53c96779a29 6f38fb2a60e4 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi080 *:9283,8765 running (9m) 16s ago 9m 583M - 19.0.0-3291-g994e2f20 d53c96779a29 9991e343a928 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi082 *:8443,8765 running (7m) 32s ago 7m 520M - 19.0.0-3291-g994e2f20 d53c96779a29 2994882f2731 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.z smithi196 *:8443,8765 running (7m) 32s ago 7m 519M - 19.0.0-3291-g994e2f20 d53c96779a29 4844d3feb8f5 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (9m) 16s ago 9m 117M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 48cc840f8d89 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi082 running (7m) 32s ago 7m 107M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 cbf4f3ec1a58 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi196 running (8m) 32s ago 8m 107M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 37ca34ca85f6 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (7m) 16s ago 7m 114M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 07516da1ba7f 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi082 running (6m) 32s ago 6m 112M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 3507f3425f39 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi196 running (6m) 32s ago 6m 112M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 2353d3b9dd51 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (6m) 16s ago 6m 113M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 705c68dad910 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi082 running (5m) 32s ago 5m 112M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 e6b2cc8aae36 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi196 running (5m) 32s ago 5m 109M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 c21891864e14 2024-04-25T11:23:46.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi080 running (4m) 16s ago 4m 119M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 eae23db77b1f 2024-04-25T11:23:46.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi082 running (4m) 32s ago 4m 122M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 1c7efc92a184 2024-04-25T11:23:46.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.8 smithi196 running (3m) 32s ago 3m 123M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 17fd6f11ef96 2024-04-25T11:23:46.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.9 smithi080 running (3m) 16s ago 3m 108M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 1187f555fda7 2024-04-25T11:23:46.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.10 smithi082 running (3m) 32s ago 3m 114M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 a9b72fbfdf52 2024-04-25T11:23:46.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.11 smithi196 running (2m) 32s ago 2m 118M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 105472e13c0b 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.652+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f52000afb80 msgr2=0x7f52000b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.652+0000 7f521d856700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f52000afb80 0x7f52000b2090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5208005950 tx=0x7f5208005f50 comp rx=0 tx=0).stop 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.652+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 msgr2=0x7f52181996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.652+0000 7f521d856700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181996d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f520c000c00 tx=0x7f520c0047b0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 shutdown_connections 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f52000afb80 0x7f52000b2090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218104ba0 0x7f52181a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181030d0 0x7f52181996d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 --2- 172.21.15.80:0/1392000167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218104200 0x7f5218199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 >> 172.21.15.80:0/1392000167 conn(0x7f52180fe730 msgr2=0x7f5218107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 shutdown_connections 2024-04-25T11:23:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:46.653+0000 7f521d856700 1 -- 172.21.15.80:0/1392000167 wait complete. 2024-04-25T11:23:46.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:46 smithi196 ceph-mon[32659]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:46.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:46 smithi082 ceph-mon[32440]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:47.441 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-25T11:23:47.685 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:48.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:48 smithi080 ceph-mon[29126]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:48.629 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:48 smithi080 ceph-mon[29126]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:48.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:48 smithi196 ceph-mon[32659]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:48.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:48 smithi196 ceph-mon[32659]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:48.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:48 smithi082 ceph-mon[32440]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:48.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:48 smithi082 ceph-mon[32440]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:49.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.488+0000 7f127cd45700 1 -- 172.21.15.80:0/4210989715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105cd0 msgr2=0x7f127810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:49.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.488+0000 7f127cd45700 1 --2- 172.21.15.80:0/4210989715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105cd0 0x7f127810c580 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f127000b0a0 tx=0x7f127000b3b0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 -- 172.21.15.80:0/4210989715 shutdown_connections 2024-04-25T11:23:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 --2- 172.21.15.80:0/4210989715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105cd0 0x7f127810c580 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 --2- 172.21.15.80:0/4210989715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1278104200 0x7f1278104610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 --2- 172.21.15.80:0/4210989715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278105330 0x7f1278105740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 -- 172.21.15.80:0/4210989715 >> 172.21.15.80:0/4210989715 conn(0x7f12780ff840 msgr2=0x7f1278101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 -- 172.21.15.80:0/4210989715 shutdown_connections 2024-04-25T11:23:49.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 -- 172.21.15.80:0/4210989715 wait complete. 2024-04-25T11:23:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.489+0000 7f127cd45700 1 Processor -- start 2024-04-25T11:23:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127cd45700 1 -- start start 2024-04-25T11:23:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127cd45700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278104200 0x7f127819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127cd45700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105330 0x7f127819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127cd45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1278105cd0 0x7f12781a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127cd45700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f127810fc60 con 0x7f1278105330 2024-04-25T11:23:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127cd45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f127810fae0 con 0x7f1278105cd0 2024-04-25T11:23:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127cd45700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f127810fde0 con 0x7f1278104200 2024-04-25T11:23:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105330 0x7f127819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105330 0x7f127819acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34064/0 (socket says 172.21.15.80:34064) 2024-04-25T11:23:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 -- 172.21.15.80:0/797077637 learned_addr learned my addr 172.21.15.80:0/797077637 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f127659c700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278104200 0x7f127819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1276d9d700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1278105cd0 0x7f12781a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 -- 172.21.15.80:0/797077637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278104200 msgr2=0x7f127819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278104200 0x7f127819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 -- 172.21.15.80:0/797077637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1278105cd0 msgr2=0x7f12781a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1278105cd0 0x7f12781a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 -- 172.21.15.80:0/797077637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12781a2280 con 0x7f1278105330 2024-04-25T11:23:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1276d9d700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1278105cd0 0x7f12781a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.490+0000 7f1275d9b700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105330 0x7f127819acf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f126800c9b0 tx=0x7f126800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.491+0000 7f12677fe700 1 -- 172.21.15.80:0/797077637 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268007b00 con 0x7f1278105330 2024-04-25T11:23:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.491+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12781a2570 con 0x7f1278105330 2024-04-25T11:23:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.491+0000 7f12677fe700 1 -- 172.21.15.80:0/797077637 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1268007ca0 con 0x7f1278105330 2024-04-25T11:23:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.491+0000 7f12677fe700 1 -- 172.21.15.80:0/797077637 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268018660 con 0x7f1278105330 2024-04-25T11:23:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.491+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781a2b00 con 0x7f1278105330 2024-04-25T11:23:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.492+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1278051190 con 0x7f1278105330 2024-04-25T11:23:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.493+0000 7f12677fe700 1 -- 172.21.15.80:0/797077637 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f126800f450 con 0x7f1278105330 2024-04-25T11:23:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.494+0000 7f12677fe700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f12600afb80 0x7f12600b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.494+0000 7f127659c700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f12600afb80 0x7f12600b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.494+0000 7f12677fe700 1 -- 172.21.15.80:0/797077637 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f12680deed0 con 0x7f1278105330 2024-04-25T11:23:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.494+0000 7f127659c700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f12600afb80 0x7f12600b2090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1278105230 tx=0x7f126c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.498+0000 7f12677fe700 1 -- 172.21.15.80:0/797077637 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1268014030 con 0x7f1278105330 2024-04-25T11:23:49.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.705+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f1278063ad0 con 0x7f12600afb80 2024-04-25T11:23:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.711+0000 7f12677fe700 1 -- 172.21.15.80:0/797077637 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f1278063ad0 con 0x7f12600afb80 2024-04-25T11:23:49.706 INFO:teuthology.orchestra.run.smithi080.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-25T11:23:49.706 INFO:teuthology.orchestra.run.smithi080.stdout:mds.all 12/12 36s ago 2m smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-25T11:23:49.706 INFO:teuthology.orchestra.run.smithi080.stdout:mgr 3/3 36s ago 7m smithi080=x;smithi082=y;smithi196=z;count:3 2024-04-25T11:23:49.707 INFO:teuthology.orchestra.run.smithi080.stdout:mon 3/3 36s ago 8m smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi196:172.21.15.196=c;count:3 2024-04-25T11:23:49.707 INFO:teuthology.orchestra.run.smithi080.stdout:osd 12 36s ago - 2024-04-25T11:23:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f12600afb80 msgr2=0x7f12600b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f12600afb80 0x7f12600b2090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1278105230 tx=0x7f126c00a380 comp rx=0 tx=0).stop 2024-04-25T11:23:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105330 msgr2=0x7f127819acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105330 0x7f127819acf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f126800c9b0 tx=0x7f126800ccc0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 shutdown_connections 2024-04-25T11:23:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f12600afb80 0x7f12600b2090 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1278105cd0 0x7f12781a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278104200 0x7f127819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 --2- 172.21.15.80:0/797077637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1278105330 0x7f127819acf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 >> 172.21.15.80:0/797077637 conn(0x7f12780ff840 msgr2=0x7f1278108560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 shutdown_connections 2024-04-25T11:23:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:49.713+0000 7f127cd45700 1 -- 172.21.15.80:0/797077637 wait complete. 2024-04-25T11:23:50.506 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-25T11:23:50.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:50 smithi080 ceph-mon[29126]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:50.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:50 smithi196 ceph-mon[32659]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:50.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:50 smithi082 ceph-mon[32440]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:51.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:51 smithi196 ceph-mon[32659]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:51.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:51 smithi082 ceph-mon[32440]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:51.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:51 smithi080 ceph-mon[29126]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:52.429 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:52 smithi080 ceph-mon[29126]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 -- 172.21.15.80:0/3953440065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 msgr2=0x7f2964104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:52.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 --2- 172.21.15.80:0/3953440065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f2964104670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2958009990 tx=0x7f2958009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 -- 172.21.15.80:0/3953440065 shutdown_connections 2024-04-25T11:23:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 --2- 172.21.15.80:0/3953440065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2964104c00 0x7f296410b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 --2- 172.21.15.80:0/3953440065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2964103130 0x7f2964103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 --2- 172.21.15.80:0/3953440065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f2964104670 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 -- 172.21.15.80:0/3953440065 >> 172.21.15.80:0/3953440065 conn(0x7f29640fe790 msgr2=0x7f2964100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 -- 172.21.15.80:0/3953440065 shutdown_connections 2024-04-25T11:23:52.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 -- 172.21.15.80:0/3953440065 wait complete. 2024-04-25T11:23:52.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.547+0000 7f2968832700 1 Processor -- start 2024-04-25T11:23:52.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2968832700 1 -- start start 2024-04-25T11:23:52.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2968832700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2964103130 0x7f296419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2968832700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f296419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2968832700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2964104c00 0x7f29641a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2968832700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f296410fd30 con 0x7f2964104260 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2968832700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f296410fbb0 con 0x7f2964104c00 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2968832700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f296410feb0 con 0x7f2964103130 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f296419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f296419ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34082/0 (socket says 172.21.15.80:34082) 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 -- 172.21.15.80:0/3252586453 learned_addr learned my addr 172.21.15.80:0/3252586453 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2962d9d700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2964104c00 0x7f29641a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f296259c700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2964103130 0x7f296419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 -- 172.21.15.80:0/3252586453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2964103130 msgr2=0x7f296419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2964103130 0x7f296419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 -- 172.21.15.80:0/3252586453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2964104c00 msgr2=0x7f29641a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:52.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2964104c00 0x7f29641a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 -- 172.21.15.80:0/3252586453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29641a2320 con 0x7f2964104260 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2962d9d700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2964104c00 0x7f29641a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f2961d9b700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f296419ad00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2958006010 tx=0x7f29580047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.548+0000 7f29537fe700 1 -- 172.21.15.80:0/3252586453 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958027070 con 0x7f2964104260 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.549+0000 7f29537fe700 1 -- 172.21.15.80:0/3252586453 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29580040c0 con 0x7f2964104260 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.549+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29641a25b0 con 0x7f2964104260 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.549+0000 7f29537fe700 1 -- 172.21.15.80:0/3252586453 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958022d90 con 0x7f2964104260 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.549+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29641a2a00 con 0x7f2964104260 2024-04-25T11:23:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.549+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2964051190 con 0x7f2964104260 2024-04-25T11:23:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.551+0000 7f29537fe700 1 -- 172.21.15.80:0/3252586453 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f295802a070 con 0x7f2964104260 2024-04-25T11:23:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.551+0000 7f29537fe700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f294c0afb80 0x7f294c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.552+0000 7f296259c700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f294c0afb80 0x7f294c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.552+0000 7f29537fe700 1 -- 172.21.15.80:0/3252586453 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f29580dfcf0 con 0x7f2964104260 2024-04-25T11:23:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.552+0000 7f296259c700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f294c0afb80 0x7f294c0b2090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2964104160 tx=0x7f295400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.555+0000 7f29537fe700 1 -- 172.21.15.80:0/3252586453 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2958013070 con 0x7f2964104260 2024-04-25T11:23:52.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:52 smithi196 ceph-mon[32659]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:52.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:52 smithi082 ceph-mon[32440]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:23:52.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.760+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2964063ad0 con 0x7f294c0afb80 2024-04-25T11:23:52.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.761+0000 7f29537fe700 1 -- 172.21.15.80:0/3252586453 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f2964063ad0 con 0x7f294c0afb80 2024-04-25T11:23:52.756 INFO:teuthology.orchestra.run.smithi080.stdout:HOST ADDR LABELS STATUS 2024-04-25T11:23:52.756 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080 172.21.15.80 2024-04-25T11:23:52.756 INFO:teuthology.orchestra.run.smithi080.stdout:smithi082 172.21.15.82 2024-04-25T11:23:52.756 INFO:teuthology.orchestra.run.smithi080.stdout:smithi196 172.21.15.196 2024-04-25T11:23:52.756 INFO:teuthology.orchestra.run.smithi080.stdout:3 hosts in cluster 2024-04-25T11:23:52.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.763+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f294c0afb80 msgr2=0x7f294c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:52.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.763+0000 7f2968832700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f294c0afb80 0x7f294c0b2090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2964104160 tx=0x7f295400a380 comp rx=0 tx=0).stop 2024-04-25T11:23:52.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.763+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 msgr2=0x7f296419ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:52.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.763+0000 7f2968832700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f296419ad00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2958006010 tx=0x7f29580047b0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 shutdown_connections 2024-04-25T11:23:52.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f294c0afb80 0x7f294c0b2090 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2964104c00 0x7f29641a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2964103130 0x7f296419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 --2- 172.21.15.80:0/3252586453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2964104260 0x7f296419ad00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:52.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 >> 172.21.15.80:0/3252586453 conn(0x7f29640fe790 msgr2=0x7f2964107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:52.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 shutdown_connections 2024-04-25T11:23:52.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:52.764+0000 7f2968832700 1 -- 172.21.15.80:0/3252586453 wait complete. 2024-04-25T11:23:53.507 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-25T11:23:53.745 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:54.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:54 smithi196 ceph-mon[32659]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:54.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:54 smithi196 ceph-mon[32659]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:54.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:54 smithi082 ceph-mon[32440]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:54.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:54 smithi082 ceph-mon[32440]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:54.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:54 smithi080 ceph-mon[29126]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:54.879 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:54 smithi080 ceph-mon[29126]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:55.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 -- 172.21.15.80:0/3922311939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c104210 msgr2=0x7fd69c104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/3922311939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c104210 0x7fd69c104620 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd684009990 tx=0x7fd684009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 -- 172.21.15.80:0/3922311939 shutdown_connections 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/3922311939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104bb0 0x7fd69c10b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/3922311939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd69c1030e0 0x7fd69c1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/3922311939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c104210 0x7fd69c104620 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 -- 172.21.15.80:0/3922311939 >> 172.21.15.80:0/3922311939 conn(0x7fd69c0fe740 msgr2=0x7fd69c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 -- 172.21.15.80:0/3922311939 shutdown_connections 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.604+0000 7fd6a09bd700 1 -- 172.21.15.80:0/3922311939 wait complete. 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 Processor -- start 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 -- start start 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c1030e0 0x7fd69c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104210 0x7fd69c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd69c104bb0 0x7fd69c1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:55.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c10eb80 con 0x7fd69c1030e0 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c10ea00 con 0x7fd69c104210 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd6a09bd700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c10ed00 con 0x7fd69c104bb0 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd69a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c1030e0 0x7fd69c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd691d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104210 0x7fd69c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd69a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c1030e0 0x7fd69c1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34098/0 (socket says 172.21.15.80:34098) 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.605+0000 7fd69a59c700 1 -- 172.21.15.80:0/704021084 learned_addr learned my addr 172.21.15.80:0/704021084 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd69ad9d700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd69c104bb0 0x7fd69c1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd69a59c700 1 -- 172.21.15.80:0/704021084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd69c104bb0 msgr2=0x7fd69c1a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd69a59c700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd69c104bb0 0x7fd69c1a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd69a59c700 1 -- 172.21.15.80:0/704021084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104210 msgr2=0x7fd69c199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd69a59c700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104210 0x7fd69c199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd69a59c700 1 -- 172.21.15.80:0/704021084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c1a1230 con 0x7fd69c1030e0 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd69a59c700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c1030e0 0x7fd69c1996d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0098c0 tx=0x7fd68c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:55.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd693fff700 1 -- 172.21.15.80:0/704021084 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c01d070 con 0x7fd69c1030e0 2024-04-25T11:23:55.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c06b540 con 0x7fd69c1030e0 2024-04-25T11:23:55.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd693fff700 1 -- 172.21.15.80:0/704021084 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd68c0078f0 con 0x7fd69c1030e0 2024-04-25T11:23:55.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c06ba80 con 0x7fd69c1030e0 2024-04-25T11:23:55.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.606+0000 7fd693fff700 1 -- 172.21.15.80:0/704021084 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c018a20 con 0x7fd69c1030e0 2024-04-25T11:23:55.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.608+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c051190 con 0x7fd69c1030e0 2024-04-25T11:23:55.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.609+0000 7fd693fff700 1 -- 172.21.15.80:0/704021084 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fd68c020070 con 0x7fd69c1030e0 2024-04-25T11:23:55.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.610+0000 7fd693fff700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6880afb80 0x7fd6880b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:55.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.610+0000 7fd691d9b700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6880afb80 0x7fd6880b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:55.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.610+0000 7fd693fff700 1 -- 172.21.15.80:0/704021084 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fd68c0e0770 con 0x7fd69c1030e0 2024-04-25T11:23:55.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.610+0000 7fd691d9b700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6880afb80 0x7fd6880b2090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd68400b5c0 tx=0x7fd68401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:55.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.613+0000 7fd693fff700 1 -- 172.21.15.80:0/704021084 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd68c027070 con 0x7fd69c1030e0 2024-04-25T11:23:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.818+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 --> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd69c10a300 con 0x7fd6880afb80 2024-04-25T11:23:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.820+0000 7fd693fff700 1 -- 172.21.15.80:0/704021084 <== mgr.14152 v2:172.21.15.80:6800/3135257773 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd69c10a300 con 0x7fd6880afb80 2024-04-25T11:23:55.815 INFO:teuthology.orchestra.run.smithi080.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-25T11:23:55.815 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204014T400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-25T11:23:55.815 INFO:teuthology.orchestra.run.smithi080.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-25T11:23:55.815 INFO:teuthology.orchestra.run.smithi080.stdout:smithi196 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-25T11:23:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6880afb80 msgr2=0x7fd6880b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6880afb80 0x7fd6880b2090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd68400b5c0 tx=0x7fd68401a040 comp rx=0 tx=0).stop 2024-04-25T11:23:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c1030e0 msgr2=0x7fd69c1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c1030e0 0x7fd69c1996d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0098c0 tx=0x7fd68c009bd0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 shutdown_connections 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd6880afb80 0x7fd6880b2090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd69c104bb0 0x7fd69c1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd69c1030e0 0x7fd69c1996d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 --2- 172.21.15.80:0/704021084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104210 0x7fd69c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 >> 172.21.15.80:0/704021084 conn(0x7fd69c0fe740 msgr2=0x7fd69c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 shutdown_connections 2024-04-25T11:23:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:55.823+0000 7fd6a09bd700 1 -- 172.21.15.80:0/704021084 wait complete. 2024-04-25T11:23:56.486 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:56 smithi080 ceph-mon[29126]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:56.487 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T11:23:56.496 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:23:56.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T11:23:56.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:56 smithi196 ceph-mon[32659]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:56.739 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:23:56.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:56 smithi082 ceph-mon[32440]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:23:57.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:57 smithi196 ceph-mon[32659]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:57.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:57 smithi082 ceph-mon[32440]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:57.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:57 smithi080 ceph-mon[29126]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:23:58.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 -- 172.21.15.80:0/4213370695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924103e30 msgr2=0x7f5924104240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:58.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 --2- 172.21.15.80:0/4213370695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924103e30 0x7f5924104240 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5918009990 tx=0x7f5918009ca0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 -- 172.21.15.80:0/4213370695 shutdown_connections 2024-04-25T11:23:58.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 --2- 172.21.15.80:0/4213370695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59241048b0 0x7f592410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 --2- 172.21.15.80:0/4213370695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924105880 0x7f5924105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 --2- 172.21.15.80:0/4213370695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924103e30 0x7f5924104240 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 -- 172.21.15.80:0/4213370695 >> 172.21.15.80:0/4213370695 conn(0x7f59240ff8a0 msgr2=0x7f5924101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:58.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 -- 172.21.15.80:0/4213370695 shutdown_connections 2024-04-25T11:23:58.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.554+0000 7f592a800700 1 -- 172.21.15.80:0/4213370695 wait complete. 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 Processor -- start 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 -- start start 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5924103e30 0x7f592419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241048b0 0x7f592419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924105880 0x7f59241a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f592410fdc0 con 0x7f59241048b0 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f592410fc40 con 0x7f5924103e30 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f592a800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f592410ff40 con 0x7f5924105880 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241048b0 0x7f592419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:58.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241048b0 0x7f592419ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50598/0 (socket says 172.21.15.80:50598) 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 -- 172.21.15.80:0/809671923 learned_addr learned my addr 172.21.15.80:0/809671923 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f5923fff700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5924103e30 0x7f592419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f5928d9d700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924105880 0x7f59241a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 -- 172.21.15.80:0/809671923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924105880 msgr2=0x7f59241a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924105880 0x7f59241a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 -- 172.21.15.80:0/809671923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5924103e30 msgr2=0x7f592419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5924103e30 0x7f592419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f59237fe700 1 -- 172.21.15.80:0/809671923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59241a2440 con 0x7f59241048b0 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f5923fff700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5924103e30 0x7f592419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.555+0000 7f5928d9d700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924105880 0x7f59241a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.556+0000 7f59237fe700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241048b0 0x7f592419ae70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5918006010 tx=0x7f59180047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.556+0000 7f59217fa700 1 -- 172.21.15.80:0/809671923 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918027070 con 0x7f59241048b0 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.556+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59241a26d0 con 0x7f59241048b0 2024-04-25T11:23:58.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.556+0000 7f59217fa700 1 -- 172.21.15.80:0/809671923 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5918004140 con 0x7f59241048b0 2024-04-25T11:23:58.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.556+0000 7f59217fa700 1 -- 172.21.15.80:0/809671923 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591800f460 con 0x7f59241048b0 2024-04-25T11:23:58.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.556+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59241a2b80 con 0x7f59241048b0 2024-04-25T11:23:58.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.557+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5924051190 con 0x7f59241048b0 2024-04-25T11:23:58.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.558+0000 7f59217fa700 1 -- 172.21.15.80:0/809671923 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f591802a070 con 0x7f59241048b0 2024-04-25T11:23:58.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.559+0000 7f59217fa700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f590c0afb80 0x7f590c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:23:58.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.559+0000 7f5923fff700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f590c0afb80 0x7f590c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:23:58.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.559+0000 7f59217fa700 1 -- 172.21.15.80:0/809671923 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f59180dfed0 con 0x7f59241048b0 2024-04-25T11:23:58.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.559+0000 7f5923fff700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f590c0afb80 0x7f590c0b2090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5914005950 tx=0x7f59140058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:23:58.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.563+0000 7f59217fa700 1 -- 172.21.15.80:0/809671923 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5918013070 con 0x7f59241048b0 2024-04-25T11:23:58.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:58 smithi080 ceph-mon[29126]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:58.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:58 smithi196 ceph-mon[32659]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:58.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:58 smithi082 ceph-mon[32440]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.805+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f59240642a0 con 0x7f59241048b0 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.806+0000 7f59217fa700 1 -- 172.21.15.80:0/809671923 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3042 (secure 0 0 0) 0x7f59180a8b30 con 0x7f59241048b0 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stdout:e21 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stdout:legacy client fscid: 1 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stdout:Filesystem 'cephfs' (1) 2024-04-25T11:23:58.800 INFO:teuthology.orchestra.run.smithi080.stdout:fs_name cephfs 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 21 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-04-25T11:22:13.737406+0000 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2024-04-25T11:22:18.430262+0000 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:tableserver 0 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:root 0 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:session_timeout 300 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:session_autoclose 300 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:max_file_size 1099511627776 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:max_xattr_size 65536 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:required_client_features {} 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:last_failure 0 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:last_failure_osd_epoch 0 2024-04-25T11:23:58.801 INFO:teuthology.orchestra.run.smithi080.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:max_mds 3 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:in 0,1,2 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:up {0=24521,1=24499,2=24476} 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:failed 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:damaged 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:stopped 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:data_pools [3] 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:metadata_pool 2 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:inline_data disabled 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:balancer 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:bal_rank_mask -1 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:standby_count_wanted 0 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:qdb_cluster leader: 24521 members: 24476,24499,24521 2024-04-25T11:23:58.802 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b{0:24521} state up:active seq 3 addr [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c{0:24472} state up:standby-replay seq 1 addr [v2:172.21.15.196:6836/2620156093,v1:172.21.15.196:6837/2620156093] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.i{1:24499} state up:active seq 6 addr [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.f{1:24460} state up:standby-replay seq 1 addr [v2:172.21.15.196:6834/3574274014,v1:172.21.15.196:6835/3574274014] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.h{2:24476} state up:active seq 7 addr [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.e{2:24443} state up:standby-replay seq 1 addr [v2:172.21.15.82:6834/4149738023,v1:172.21.15.82:6835/4149738023] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:Standby daemons: 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.j{-1:14574} state up:standby seq 1 addr [v2:172.21.15.80:6834/620066651,v1:172.21.15.80:6835/620066651] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d{-1:14586} state up:standby seq 1 addr [v2:172.21.15.80:6836/461835634,v1:172.21.15.80:6837/461835634] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.g{-1:14652} state up:standby seq 1 addr [v2:172.21.15.80:6838/362397006,v1:172.21.15.80:6839/362397006] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a{-1:14664} state up:standby seq 1 addr [v2:172.21.15.80:6840/4101739388,v1:172.21.15.80:6841/4101739388] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.l{-1:24415} state up:standby seq 1 addr [v2:172.21.15.196:6832/3230889920,v1:172.21.15.196:6833/3230889920] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.k{-1:24416} state up:standby seq 1 addr [v2:172.21.15.82:6832/942979898,v1:172.21.15.82:6833/942979898] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T11:23:58.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.807+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f590c0afb80 msgr2=0x7f590c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:58.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.807+0000 7f592a800700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f590c0afb80 0x7f590c0b2090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5914005950 tx=0x7f59140058e0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241048b0 msgr2=0x7f592419ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241048b0 0x7f592419ae70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5918006010 tx=0x7f59180047b0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 shutdown_connections 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f590c0afb80 0x7f590c0b2090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924105880 0x7f59241a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5924103e30 0x7f592419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 --2- 172.21.15.80:0/809671923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241048b0 0x7f592419ae70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 >> 172.21.15.80:0/809671923 conn(0x7f59240ff8a0 msgr2=0x7f59241085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 shutdown_connections 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:23:58.808+0000 7f592a800700 1 -- 172.21.15.80:0/809671923 wait complete. 2024-04-25T11:23:58.805 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-04-25T11:23:59.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:23:59 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/809671923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T11:23:59.647 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-25T11:23:59.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:23:59 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/809671923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T11:23:59.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:23:59 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/809671923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T11:23:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:24:00.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:00 smithi080 ceph-mon[29126]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:24:00.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:00 smithi196 ceph-mon[32659]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:24:00.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:00 smithi082 ceph-mon[32440]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:24:01.606 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:01 smithi080 ceph-mon[29126]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 -- 172.21.15.80:0/3446950787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748105cf0 msgr2=0x7f574810c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 --2- 172.21.15.80:0/3446950787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748105cf0 0x7f574810c5a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f574000b0a0 tx=0x7f574000b3b0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 -- 172.21.15.80:0/3446950787 shutdown_connections 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 --2- 172.21.15.80:0/3446950787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748105cf0 0x7f574810c5a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 --2- 172.21.15.80:0/3446950787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104220 0x7f5748104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 --2- 172.21.15.80:0/3446950787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5748105350 0x7f5748105760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 -- 172.21.15.80:0/3446950787 >> 172.21.15.80:0/3446950787 conn(0x7f57480ff860 msgr2=0x7f5748101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 -- 172.21.15.80:0/3446950787 shutdown_connections 2024-04-25T11:24:01.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 -- 172.21.15.80:0/3446950787 wait complete. 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 Processor -- start 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.628+0000 7f574e75b700 1 -- start start 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574e75b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748104220 0x7f574819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574e75b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5748105350 0x7f574819ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574e75b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748105cf0 0x7f57481a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574e75b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f574810fd00 con 0x7f5748104220 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574e75b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f574810fb80 con 0x7f5748105cf0 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574e75b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f574810fe80 con 0x7f5748105350 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748104220 0x7f574819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748104220 0x7f574819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50622/0 (socket says 172.21.15.80:50622) 2024-04-25T11:24:01.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 -- 172.21.15.80:0/1577847259 learned_addr learned my addr 172.21.15.80:0/1577847259 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574ccf8700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748105cf0 0x7f57481a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f57477fe700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5748105350 0x7f574819ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 -- 172.21.15.80:0/1577847259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5748105350 msgr2=0x7f574819ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5748105350 0x7f574819ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 -- 172.21.15.80:0/1577847259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748105cf0 msgr2=0x7f57481a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748105cf0 0x7f57481a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 -- 172.21.15.80:0/1577847259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57481a2340 con 0x7f5748104220 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574ccf8700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748105cf0 0x7f57481a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:01.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f5747fff700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748104220 0x7f574819a7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f573800d950 tx=0x7f573800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:01.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f57457fa700 1 -- 172.21.15.80:0/1577847259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738017070 con 0x7f5748104220 2024-04-25T11:24:01.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57481a2630 con 0x7f5748104220 2024-04-25T11:24:01.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f57457fa700 1 -- 172.21.15.80:0/1577847259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f573800de30 con 0x7f5748104220 2024-04-25T11:24:01.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.629+0000 7f57457fa700 1 -- 172.21.15.80:0/1577847259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738003b10 con 0x7f5748104220 2024-04-25T11:24:01.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.630+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57481a2bf0 con 0x7f5748104220 2024-04-25T11:24:01.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.631+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5748051190 con 0x7f5748104220 2024-04-25T11:24:01.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.632+0000 7f57457fa700 1 -- 172.21.15.80:0/1577847259 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f5738003cb0 con 0x7f5748104220 2024-04-25T11:24:01.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.632+0000 7f57457fa700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f57300afb80 0x7f57300b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:01.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.633+0000 7f57477fe700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f57300afb80 0x7f57300b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:01.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.633+0000 7f57457fa700 1 -- 172.21.15.80:0/1577847259 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f57380de7b0 con 0x7f5748104220 2024-04-25T11:24:01.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.633+0000 7f57477fe700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f57300afb80 0x7f57300b2090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f573c006fd0 tx=0x7f573c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:01.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.637+0000 7f57457fa700 1 -- 172.21.15.80:0/1577847259 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5738020030 con 0x7f5748104220 2024-04-25T11:24:01.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:01 smithi196 ceph-mon[32659]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:01.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:01 smithi082 ceph-mon[32440]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:01.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.835+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f57480642a0 con 0x7f5748104220 2024-04-25T11:24:01.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.836+0000 7f57457fa700 1 -- 172.21.15.80:0/1577847259 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v79) ==== 56+0+5299 (secure 0 0 0) 0x7f57380a7380 con 0x7f5748104220 2024-04-25T11:24:01.830 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 79 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:fsid bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-04-25T11:14:01.466404+0000 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2024-04-25T11:22:56.395000+0000 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:crush_version 26 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:full_ratio 0.95 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:backfillfull_ratio 0.9 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:nearfull_ratio 0.85 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:require_min_compat_client luminous 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:min_compat_client luminous 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:require_osd_release squid 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:stretch_mode_enabled false 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-25T11:24:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:max_osd 12 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 up in weight 1 up_from 8 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6802/1124765688,v1:172.21.15.80:6803/1124765688] [v2:172.21.15.80:6804/1124765688,v1:172.21.15.80:6805/1124765688] exists,up 43065203-899a-4a95-b206-10e80ad20d37 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 up in weight 1 up_from 13 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/3913713373,v1:172.21.15.82:6801/3913713373] [v2:172.21.15.82:6802/3913713373,v1:172.21.15.82:6803/3913713373] exists,up e75fb74a-e338-408d-b098-edd1c4aeff77 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 up in weight 1 up_from 18 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6800/700082321,v1:172.21.15.196:6801/700082321] [v2:172.21.15.196:6802/700082321,v1:172.21.15.196:6803/700082321] exists,up 1352c87b-d8f4-4f62-b4d9-d256d66bbe0a 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 up in weight 1 up_from 26 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6810/1446045179,v1:172.21.15.80:6811/1446045179] [v2:172.21.15.80:6812/1446045179,v1:172.21.15.80:6813/1446045179] exists,up 870b8e57-a5a4-48b9-8973-413bd846a860 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 up in weight 1 up_from 32 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6808/3035622192,v1:172.21.15.82:6809/3035622192] [v2:172.21.15.82:6810/3035622192,v1:172.21.15.82:6811/3035622192] exists,up cbdae8fe-80db-417f-b27b-b7a436f3035b 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 up in weight 1 up_from 37 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6808/2327068088,v1:172.21.15.196:6809/2327068088] [v2:172.21.15.196:6810/2327068088,v1:172.21.15.196:6811/2327068088] exists,up e7a50804-7087-46cc-b4fb-0f6487dc15e2 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 up in weight 1 up_from 43 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6818/3879298562,v1:172.21.15.80:6819/3879298562] [v2:172.21.15.80:6820/3879298562,v1:172.21.15.80:6821/3879298562] exists,up fd84057a-f5a0-4027-9b4e-e6948e1aa055 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 up in weight 1 up_from 48 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6816/2941501012,v1:172.21.15.82:6817/2941501012] [v2:172.21.15.82:6818/2941501012,v1:172.21.15.82:6819/2941501012] exists,up 854ef90b-8feb-45c3-a5c9-175a69bf967d 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.8 up in weight 1 up_from 55 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6816/2100656217,v1:172.21.15.196:6817/2100656217] [v2:172.21.15.196:6818/2100656217,v1:172.21.15.196:6819/2100656217] exists,up 30ef2bc4-8039-4330-a4eb-1c75fe5da3e0 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.9 up in weight 1 up_from 61 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6826/2904539109,v1:172.21.15.80:6827/2904539109] [v2:172.21.15.80:6828/2904539109,v1:172.21.15.80:6829/2904539109] exists,up 88aaa775-ab55-451c-b0cf-ef29189adf6a 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.10 up in weight 1 up_from 66 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6824/247644031,v1:172.21.15.82:6825/247644031] [v2:172.21.15.82:6826/247644031,v1:172.21.15.82:6827/247644031] exists,up 7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:osd.11 up in weight 1 up_from 72 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6824/3938310451,v1:172.21.15.196:6825/3938310451] [v2:172.21.15.196:6826/3938310451,v1:172.21.15.196:6827/3938310451] exists,up 980819ee-a7db-463d-aa88-5d68654f58f5 2024-04-25T11:24:01.832 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.b [2,1] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.e [2,4] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.f [8,11] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.1f [7,11] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.3 [4,9] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.e [4,6] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.1b [5,9,3,8] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.38 [3,9] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.3a [4,8] 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/1475839219 expires 2024-04-26T11:14:55.185433+0000 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/2391075178 expires 2024-04-26T11:14:55.185433+0000 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/2554689632 expires 2024-04-26T11:14:55.185433+0000 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/1376368736 expires 2024-04-26T11:14:55.185433+0000 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/572796280 expires 2024-04-26T11:14:28.254016+0000 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/2554689632 expires 2024-04-26T11:14:55.185433+0000 2024-04-25T11:24:01.833 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/369805094 expires 2024-04-26T11:14:28.254016+0000 2024-04-25T11:24:01.834 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/1021361872 expires 2024-04-26T11:14:28.254016+0000 2024-04-25T11:24:01.834 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/1021361872 expires 2024-04-26T11:14:28.254016+0000 2024-04-25T11:24:01.834 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/2537462013 expires 2024-04-26T11:14:28.254016+0000 2024-04-25T11:24:01.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f57300afb80 msgr2=0x7f57300b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:01.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f57300afb80 0x7f57300b2090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f573c006fd0 tx=0x7f573c008040 comp rx=0 tx=0).stop 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748104220 msgr2=0x7f574819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748104220 0x7f574819a7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f573800d950 tx=0x7f573800dd10 comp rx=0 tx=0).stop 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 shutdown_connections 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f57300afb80 0x7f57300b2090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748105cf0 0x7f57481a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5748104220 0x7f574819a7e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 --2- 172.21.15.80:0/1577847259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5748105350 0x7f574819ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.838+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 >> 172.21.15.80:0/1577847259 conn(0x7f57480ff860 msgr2=0x7f5748108580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.839+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 shutdown_connections 2024-04-25T11:24:01.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:01.839+0000 7f574e75b700 1 -- 172.21.15.80:0/1577847259 wait complete. 2024-04-25T11:24:02.579 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:02 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1577847259' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T11:24:02.608 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-25T11:24:02.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:24:02.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:02 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1577847259' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T11:24:02.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 -- 172.21.15.80:0/1429502011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 msgr2=0x7f4508109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 --2- 172.21.15.80:0/1429502011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f4508109330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009900 tx=0x7f44f802a410 comp rx=0 tx=0).stop 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 -- 172.21.15.80:0/1429502011 shutdown_connections 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 --2- 172.21.15.80:0/1429502011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f4508109330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 --2- 172.21.15.80:0/1429502011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4508109870 0x7f450810bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 --2- 172.21.15.80:0/1429502011 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45081045b0 0x7f45081069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 -- 172.21.15.80:0/1429502011 >> 172.21.15.80:0/1429502011 conn(0x7f45080fdbd0 msgr2=0x7f4508100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 -- 172.21.15.80:0/1429502011 shutdown_connections 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.737+0000 7f450fcaf640 1 -- 172.21.15.80:0/1429502011 wait complete. 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 Processor -- start 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 -- start start 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45081045b0 0x7f450819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f450819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:02.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4508109870 0x7f45081a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f450810f5f0 con 0x7f4508106f10 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f450810f470 con 0x7f45081045b0 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450fcaf640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f450810f770 con 0x7f4508109870 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f450819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f450819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50642/0 (socket says 172.21.15.80:50642) 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 -- 172.21.15.80:0/2193930335 learned_addr learned my addr 172.21.15.80:0/2193930335 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450da4b640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45081045b0 0x7f450819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450e24c640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4508109870 0x7f45081a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 -- 172.21.15.80:0/2193930335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4508109870 msgr2=0x7f45081a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4508109870 0x7f45081a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 -- 172.21.15.80:0/2193930335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45081045b0 msgr2=0x7f450819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45081045b0 0x7f450819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 -- 172.21.15.80:0/2193930335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45081a1d70 con 0x7f4508106f10 2024-04-25T11:24:02.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.738+0000 7f450d24a640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f450819a770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f44f8006010 tx=0x7f44f8004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:02.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.739+0000 7f44feffd640 1 -- 172.21.15.80:0/2193930335 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f803f030 con 0x7f4508106f10 2024-04-25T11:24:02.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.739+0000 7f44feffd640 1 -- 172.21.15.80:0/2193930335 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f8003cb0 con 0x7f4508106f10 2024-04-25T11:24:02.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.739+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45081a2000 con 0x7f4508106f10 2024-04-25T11:24:02.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.739+0000 7f44feffd640 1 -- 172.21.15.80:0/2193930335 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8035070 con 0x7f4508106f10 2024-04-25T11:24:02.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.739+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45081a2540 con 0x7f4508106f10 2024-04-25T11:24:02.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.740+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45080ff6f0 con 0x7f4508106f10 2024-04-25T11:24:02.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.742+0000 7f44feffd640 1 -- 172.21.15.80:0/2193930335 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f44f8042030 con 0x7f4508106f10 2024-04-25T11:24:02.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.742+0000 7f44feffd640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f44f40afb70 0x7f44f40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:02.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.743+0000 7f450da4b640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f44f40afb70 0x7f44f40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:02.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.743+0000 7f44feffd640 1 -- 172.21.15.80:0/2193930335 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f44f80ff8a0 con 0x7f4508106f10 2024-04-25T11:24:02.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.743+0000 7f450da4b640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f44f40afb70 0x7f44f40b2080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4504005fd0 tx=0x7f450400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.746+0000 7f44feffd640 1 -- 172.21.15.80:0/2193930335 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f44f80c8470 con 0x7f4508106f10 2024-04-25T11:24:02.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:02 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1577847259' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T11:24:02.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.925+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45080637a0 con 0x7f4508106f10 2024-04-25T11:24:02.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.927+0000 7f44feffd640 1 -- 172.21.15.80:0/2193930335 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7f44f8003e60 con 0x7f4508106f10 2024-04-25T11:24:02.921 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:02.921 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f44f40afb70 msgr2=0x7f44f40b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f44f40afb70 0x7f44f40b2080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4504005fd0 tx=0x7f450400b390 comp rx=0 tx=0).stop 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 msgr2=0x7f450819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f450819a770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f44f8006010 tx=0x7f44f8004340 comp rx=0 tx=0).stop 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 shutdown_connections 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f44f40afb70 0x7f44f40b2080 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4508106f10 0x7f450819a770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4508109870 0x7f45081a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 --2- 172.21.15.80:0/2193930335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45081045b0 0x7f450819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 >> 172.21.15.80:0/2193930335 conn(0x7f45080fdbd0 msgr2=0x7f4508105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 shutdown_connections 2024-04-25T11:24:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:02.929+0000 7f450fcaf640 1 -- 172.21.15.80:0/2193930335 wait complete. 2024-04-25T11:24:02.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:24:02.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.051+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1073407319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718106c30 msgr2=0x7fd718109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.051+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1073407319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718106c30 0x7fd718109110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009900 tx=0x7fd70c02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.051+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1073407319 shutdown_connections 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.051+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1073407319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718106c30 0x7fd718109110 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1073407319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7181097a0 0x7fd71810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1073407319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd718104240 0x7fd718106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1073407319 >> 172.21.15.80:0/1073407319 conn(0x7fd7180fdbc0 msgr2=0x7fd718100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1073407319 shutdown_connections 2024-04-25T11:24:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1073407319 wait complete. 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 Processor -- start 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 -- start start 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.052+0000 7fd71ddc5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718104240 0x7fd71819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd71ddc5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd718106c30 0x7fd71819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd71ddc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7181097a0 0x7fd7181a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd71ddc5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd71810f5c0 con 0x7fd718104240 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd71ddc5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd71810f440 con 0x7fd7181097a0 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd71ddc5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd71810f740 con 0x7fd718106c30 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718104240 0x7fd71819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718104240 0x7fd71819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50668/0 (socket says 172.21.15.80:50668) 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 -- 172.21.15.80:0/1258145994 learned_addr learned my addr 172.21.15.80:0/1258145994 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd717fff640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7181097a0 0x7fd7181a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd716ffd640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd718106c30 0x7fd71819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 -- 172.21.15.80:0/1258145994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd718106c30 msgr2=0x7fd71819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd718106c30 0x7fd71819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 -- 172.21.15.80:0/1258145994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7181097a0 msgr2=0x7fd7181a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7181097a0 0x7fd7181a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 -- 172.21.15.80:0/1258145994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7181a1d40 con 0x7fd718104240 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd717fff640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7181097a0 0x7fd7181a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd7177fe640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718104240 0x7fd71819a200 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd70800d950 tx=0x7fd70800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd714ff9640 1 -- 172.21.15.80:0/1258145994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708017030 con 0x7fd718104240 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd714ff9640 1 -- 172.21.15.80:0/1258145994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd708004020 con 0x7fd718104240 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7181a1fd0 con 0x7fd718104240 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd714ff9640 1 -- 172.21.15.80:0/1258145994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7080047a0 con 0x7fd718104240 2024-04-25T11:24:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.053+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7181a2490 con 0x7fd718104240 2024-04-25T11:24:03.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.054+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7180ff6e0 con 0x7fd718104240 2024-04-25T11:24:03.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.056+0000 7fd714ff9640 1 -- 172.21.15.80:0/1258145994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fd708009a30 con 0x7fd718104240 2024-04-25T11:24:03.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.057+0000 7fd714ff9640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd7000afaf0 0x7fd7000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.057+0000 7fd716ffd640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd7000afaf0 0x7fd7000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.057+0000 7fd714ff9640 1 -- 172.21.15.80:0/1258145994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fd7080dee00 con 0x7fd718104240 2024-04-25T11:24:03.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.057+0000 7fd716ffd640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd7000afaf0 0x7fd7000b2000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd70c02a930 tx=0x7fd70c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.060+0000 7fd714ff9640 1 -- 172.21.15.80:0/1258145994 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd7080a79d0 con 0x7fd718104240 2024-04-25T11:24:03.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.242+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7180637a0 con 0x7fd718104240 2024-04-25T11:24:03.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.242+0000 7fd714ff9640 1 -- 172.21.15.80:0/1258145994 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7fd7080a72d0 con 0x7fd718104240 2024-04-25T11:24:03.237 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd7000afaf0 msgr2=0x7fd7000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd7000afaf0 0x7fd7000b2000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd70c02a930 tx=0x7fd70c000bc0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718104240 msgr2=0x7fd71819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718104240 0x7fd71819a200 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd70800d950 tx=0x7fd70800de10 comp rx=0 tx=0).stop 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 shutdown_connections 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fd7000afaf0 0x7fd7000b2000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7181097a0 0x7fd7181a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd718106c30 0x7fd71819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 --2- 172.21.15.80:0/1258145994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd718104240 0x7fd71819a200 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 >> 172.21.15.80:0/1258145994 conn(0x7fd7180fdbc0 msgr2=0x7fd718104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:03.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 shutdown_connections 2024-04-25T11:24:03.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.244+0000 7fd71ddc5640 1 -- 172.21.15.80:0/1258145994 wait complete. 2024-04-25T11:24:03.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:24:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.367+0000 7fb9d9772640 1 -- 172.21.15.80:0/1358552092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 msgr2=0x7fb9d41036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.367+0000 7fb9d9772640 1 --2- 172.21.15.80:0/1358552092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d41036e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009ca0 tx=0x7fb9c402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.367+0000 7fb9d9772640 1 -- 172.21.15.80:0/1358552092 shutdown_connections 2024-04-25T11:24:03.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.367+0000 7fb9d9772640 1 --2- 172.21.15.80:0/1358552092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4108920 0x7fb9d410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.367+0000 7fb9d9772640 1 --2- 172.21.15.80:0/1358552092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9d4103c20 0x7fb9d4104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.368+0000 7fb9d9772640 1 --2- 172.21.15.80:0/1358552092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d41036e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.368+0000 7fb9d9772640 1 -- 172.21.15.80:0/1358552092 >> 172.21.15.80:0/1358552092 conn(0x7fb9d40fdbd0 msgr2=0x7fb9d4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.368+0000 7fb9d9772640 1 -- 172.21.15.80:0/1358552092 shutdown_connections 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.368+0000 7fb9d9772640 1 -- 172.21.15.80:0/1358552092 wait complete. 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.368+0000 7fb9d9772640 1 Processor -- start 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.368+0000 7fb9d9772640 1 -- start start 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.368+0000 7fb9d9772640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d410d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d9772640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9d4103c20 0x7fb9d410b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d9772640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4108920 0x7fb9d410be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d9772640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d410f610 con 0x7fb9d41029e0 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d9772640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d410f490 con 0x7fb9d4108920 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d9772640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d410f790 con 0x7fb9d4103c20 2024-04-25T11:24:03.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d410d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d410d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50698/0 (socket says 172.21.15.80:50698) 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 -- 172.21.15.80:0/845998012 learned_addr learned my addr 172.21.15.80:0/845998012 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d37fe640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4108920 0x7fb9d410be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d27fc640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9d4103c20 0x7fb9d410b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 -- 172.21.15.80:0/845998012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9d4103c20 msgr2=0x7fb9d410b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9d4103c20 0x7fb9d410b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 -- 172.21.15.80:0/845998012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4108920 msgr2=0x7fb9d410be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4108920 0x7fb9d410be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 -- 172.21.15.80:0/845998012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d410c5c0 con 0x7fb9d41029e0 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d27fc640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9d4103c20 0x7fb9d410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d37fe640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4108920 0x7fb9d410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d2ffd640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d410d2b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40098d0 tx=0x7fb9c4031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9bbfff640 1 -- 172.21.15.80:0/845998012 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4003cb0 con 0x7fb9d41029e0 2024-04-25T11:24:03.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d41a4620 con 0x7fb9d41029e0 2024-04-25T11:24:03.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9bbfff640 1 -- 172.21.15.80:0/845998012 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c4003e50 con 0x7fb9d41029e0 2024-04-25T11:24:03.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9bbfff640 1 -- 172.21.15.80:0/845998012 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c402fc60 con 0x7fb9d41029e0 2024-04-25T11:24:03.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.369+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d41a4ae0 con 0x7fb9d41029e0 2024-04-25T11:24:03.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.370+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d4107730 con 0x7fb9d41029e0 2024-04-25T11:24:03.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.372+0000 7fb9bbfff640 1 -- 172.21.15.80:0/845998012 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fb9c4004710 con 0x7fb9d41029e0 2024-04-25T11:24:03.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.373+0000 7fb9bbfff640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9bc0afaf0 0x7fb9bc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.373+0000 7fb9d27fc640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9bc0afaf0 0x7fb9bc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.373+0000 7fb9bbfff640 1 -- 172.21.15.80:0/845998012 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fb9c4100510 con 0x7fb9d41029e0 2024-04-25T11:24:03.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.374+0000 7fb9d27fc640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9bc0afaf0 0x7fb9bc0b2000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80058c0 tx=0x7fb9c8005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.377+0000 7fb9bbfff640 1 -- 172.21.15.80:0/845998012 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb9c40c9170 con 0x7fb9d41029e0 2024-04-25T11:24:03.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.556+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb9d402db80 con 0x7fb9d41029e0 2024-04-25T11:24:03.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.557+0000 7fb9bbfff640 1 -- 172.21.15.80:0/845998012 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) ==== 104+0+11 (secure 0 0 0) 0x7fb9c40d1160 con 0x7fb9d41029e0 2024-04-25T11:24:03.551 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:24:03.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9bc0afaf0 msgr2=0x7fb9bc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9bc0afaf0 0x7fb9bc0b2000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80058c0 tx=0x7fb9c8005d50 comp rx=0 tx=0).stop 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 msgr2=0x7fb9d410d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d410d2b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40098d0 tx=0x7fb9c4031840 comp rx=0 tx=0).stop 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 shutdown_connections 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb9bc0afaf0 0x7fb9bc0b2000 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4108920 0x7fb9d410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9d4103c20 0x7fb9d410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 --2- 172.21.15.80:0/845998012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d41029e0 0x7fb9d410d2b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 >> 172.21.15.80:0/845998012 conn(0x7fb9d40fdbd0 msgr2=0x7fb9d4104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 shutdown_connections 2024-04-25T11:24:03.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.559+0000 7fb9d9772640 1 -- 172.21.15.80:0/845998012 wait complete. 2024-04-25T11:24:03.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:03 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2193930335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:03.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:03 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1258145994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:03.564 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:03 smithi080 ceph-mon[29126]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:24:03.565 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 -- 172.21.15.80:0/3011066580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 msgr2=0x7f803c105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 --2- 172.21.15.80:0/3011066580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c105140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f802c009900 tx=0x7f802c02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 -- 172.21.15.80:0/3011066580 shutdown_connections 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 --2- 172.21.15.80:0/3011066580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c105140 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 --2- 172.21.15.80:0/3011066580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f803c109a30 0x7f803c10be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 --2- 172.21.15.80:0/3011066580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f803c103af0 0x7f803c1047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 -- 172.21.15.80:0/3011066580 >> 172.21.15.80:0/3011066580 conn(0x7f803c0fece0 msgr2=0x7f803c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 -- 172.21.15.80:0/3011066580 shutdown_connections 2024-04-25T11:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.680+0000 7f80436b1640 1 -- 172.21.15.80:0/3011066580 wait complete. 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 Processor -- start 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 -- start start 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f803c103af0 0x7f803c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f803c109a30 0x7f803c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10f5f0 con 0x7f803c104d30 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10f470 con 0x7f803c109a30 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f80436b1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10f770 con 0x7f803c103af0 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f8040c4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f8040c4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c19a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50712/0 (socket says 172.21.15.80:50712) 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.681+0000 7f8040c4c640 1 -- 172.21.15.80:0/1713616500 learned_addr learned my addr 172.21.15.80:0/1713616500 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f8041c4e640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f803c109a30 0x7f803c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f804144d640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f803c103af0 0x7f803c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f8040c4c640 1 -- 172.21.15.80:0/1713616500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f803c103af0 msgr2=0x7f803c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f8040c4c640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f803c103af0 0x7f803c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f8040c4c640 1 -- 172.21.15.80:0/1713616500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f803c109a30 msgr2=0x7f803c1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f8040c4c640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f803c109a30 0x7f803c1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f8040c4c640 1 -- 172.21.15.80:0/1713616500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803c1a1d50 con 0x7f803c104d30 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f8040c4c640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c19a7c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f802c006010 tx=0x7f802c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f80327fc640 1 -- 172.21.15.80:0/1713616500 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c03f030 con 0x7f803c104d30 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f80327fc640 1 -- 172.21.15.80:0/1713616500 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f802c003aa0 con 0x7f803c104d30 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f80327fc640 1 -- 172.21.15.80:0/1713616500 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c035070 con 0x7f803c104d30 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803c1a1fe0 con 0x7f803c104d30 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.682+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f803c1a23f0 con 0x7f803c104d30 2024-04-25T11:24:03.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.683+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f803c108840 con 0x7f803c104d30 2024-04-25T11:24:03.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.684+0000 7f80327fc640 1 -- 172.21.15.80:0/1713616500 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f802c042030 con 0x7f803c104d30 2024-04-25T11:24:03.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.685+0000 7f80327fc640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80280afaf0 0x7f80280b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.685+0000 7f804144d640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80280afaf0 0x7f80280b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.685+0000 7f80327fc640 1 -- 172.21.15.80:0/1713616500 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f802c0ff950 con 0x7f803c104d30 2024-04-25T11:24:03.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.685+0000 7f804144d640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80280afaf0 0x7f80280b2000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f803c1046f0 tx=0x7f8038005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.688+0000 7f80327fc640 1 -- 172.21.15.80:0/1713616500 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f802c0c8520 con 0x7f803c104d30 2024-04-25T11:24:03.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:03 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2193930335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:03.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:03 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1258145994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:03.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:03 smithi196 ceph-mon[32659]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:24:03.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:03 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2193930335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:03.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:03 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1258145994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:03.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:03 smithi082 ceph-mon[32440]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:24:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.867+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f803c0637d0 con 0x7f803c104d30 2024-04-25T11:24:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.867+0000 7f80327fc640 1 -- 172.21.15.80:0/1713616500 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) ==== 100+0+11 (secure 0 0 0) 0x7f802c0c7e20 con 0x7f803c104d30 2024-04-25T11:24:03.862 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80280afaf0 msgr2=0x7f80280b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80280afaf0 0x7f80280b2000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f803c1046f0 tx=0x7f8038005f90 comp rx=0 tx=0).stop 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 msgr2=0x7f803c19a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c19a7c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f802c006010 tx=0x7f802c031a50 comp rx=0 tx=0).stop 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 shutdown_connections 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f80280afaf0 0x7f80280b2000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f803c104d30 0x7f803c19a7c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f803c109a30 0x7f803c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 --2- 172.21.15.80:0/1713616500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f803c103af0 0x7f803c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 >> 172.21.15.80:0/1713616500 conn(0x7f803c0fece0 msgr2=0x7f803c105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 shutdown_connections 2024-04-25T11:24:03.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.870+0000 7f80436b1640 1 -- 172.21.15.80:0/1713616500 wait complete. 2024-04-25T11:24:03.875 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:24:03.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 -- 172.21.15.80:0/2566394083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480108940 msgr2=0x7fa48010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 --2- 172.21.15.80:0/2566394083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480108940 0x7fa48010ad60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa478009ca0 tx=0x7fa47802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 -- 172.21.15.80:0/2566394083 shutdown_connections 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 --2- 172.21.15.80:0/2566394083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480108940 0x7fa48010ad60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 --2- 172.21.15.80:0/2566394083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa480103c40 0x7fa480104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 --2- 172.21.15.80:0/2566394083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa480102a00 0x7fa480103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 -- 172.21.15.80:0/2566394083 >> 172.21.15.80:0/2566394083 conn(0x7fa4800fdbf0 msgr2=0x7fa4801000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 -- 172.21.15.80:0/2566394083 shutdown_connections 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.988+0000 7fa487242640 1 -- 172.21.15.80:0/2566394083 wait complete. 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 Processor -- start 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 -- start start 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480102a00 0x7fa48010f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa480103c40 0x7fa48010db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa480108940 0x7fa48010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa4800758c0 con 0x7fa480102a00 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa480075740 con 0x7fa480108940 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa487242640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa480075a40 con 0x7fa480103c40 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa484fde640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480102a00 0x7fa48010f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa484fde640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480102a00 0x7fa48010f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50724/0 (socket says 172.21.15.80:50724) 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa484fde640 1 -- 172.21.15.80:0/1498569676 learned_addr learned my addr 172.21.15.80:0/1498569676 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa47ffff640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa480103c40 0x7fa48010db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.989+0000 7fa4857df640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa480108940 0x7fa48010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa484fde640 1 -- 172.21.15.80:0/1498569676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa480103c40 msgr2=0x7fa48010db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa484fde640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa480103c40 0x7fa48010db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa484fde640 1 -- 172.21.15.80:0/1498569676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa480108940 msgr2=0x7fa48010e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa484fde640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa480108940 0x7fa48010e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa484fde640 1 -- 172.21.15.80:0/1498569676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48010e7b0 con 0x7fa480102a00 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa484fde640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480102a00 0x7fa48010f4a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa47400c970 tx=0x7fa47400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa47dffb640 1 -- 172.21.15.80:0/1498569676 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474004220 con 0x7fa480102a00 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa47dffb640 1 -- 172.21.15.80:0/1498569676 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4740043c0 con 0x7fa480102a00 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4801a4240 con 0x7fa480102a00 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa47dffb640 1 -- 172.21.15.80:0/1498569676 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47400f450 con 0x7fa480102a00 2024-04-25T11:24:03.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.990+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4801a4700 con 0x7fa480102a00 2024-04-25T11:24:03.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.991+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa480107750 con 0x7fa480102a00 2024-04-25T11:24:03.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.993+0000 7fa47dffb640 1 -- 172.21.15.80:0/1498569676 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fa4740079b0 con 0x7fa480102a00 2024-04-25T11:24:03.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.993+0000 7fa47dffb640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4700afaf0 0x7fa4700b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:03.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.993+0000 7fa47ffff640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4700afaf0 0x7fa4700b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:03.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.993+0000 7fa47dffb640 1 -- 172.21.15.80:0/1498569676 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fa4740decf0 con 0x7fa480102a00 2024-04-25T11:24:03.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.994+0000 7fa47ffff640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4700afaf0 0x7fa4700b2000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa48010ee40 tx=0x7fa46c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:03.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:03.997+0000 7fa47dffb640 1 -- 172.21.15.80:0/1498569676 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa474014030 con 0x7fa480102a00 2024-04-25T11:24:04.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.212+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa48002db50 con 0x7fa480102a00 2024-04-25T11:24:04.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.213+0000 7fa47dffb640 1 -- 172.21.15.80:0/1498569676 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fa4740a7270 con 0x7fa480102a00 2024-04-25T11:24:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:04.208 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:22:18.430262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:24:04.208 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4700afaf0 msgr2=0x7fa4700b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4700afaf0 0x7fa4700b2000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa48010ee40 tx=0x7fa46c00b410 comp rx=0 tx=0).stop 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480102a00 msgr2=0x7fa48010f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480102a00 0x7fa48010f4a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa47400c970 tx=0x7fa47400ce30 comp rx=0 tx=0).stop 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 shutdown_connections 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa4700afaf0 0x7fa4700b2000 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa480108940 0x7fa48010e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa480103c40 0x7fa48010db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 --2- 172.21.15.80:0/1498569676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa480102a00 0x7fa48010f4a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 >> 172.21.15.80:0/1498569676 conn(0x7fa4800fdbf0 msgr2=0x7fa480104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 shutdown_connections 2024-04-25T11:24:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.216+0000 7fa487242640 1 -- 172.21.15.80:0/1498569676 wait complete. 2024-04-25T11:24:04.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- 172.21.15.80:0/2732905909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 msgr2=0x7ff1d0101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/2732905909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d0101be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009900 tx=0x7ff1bc02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- 172.21.15.80:0/2732905909 shutdown_connections 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/2732905909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d0101be0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/2732905909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d0102270 0x7ff1d010bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/2732905909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d01050c0 0x7ff1d01054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- 172.21.15.80:0/2732905909 >> 172.21.15.80:0/2732905909 conn(0x7ff1d00fd390 msgr2=0x7ff1d00ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:04.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- 172.21.15.80:0/2732905909 shutdown_connections 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- 172.21.15.80:0/2732905909 wait complete. 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 Processor -- start 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- start start 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d0102270 0x7ff1d019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d01050c0 0x7ff1d01a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d010f630 con 0x7ff1d0101770 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d010f4b0 con 0x7ff1d01050c0 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.335+0000 7ff1d6bce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d010f7b0 con 0x7ff1d0102270 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d019a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50748/0 (socket says 172.21.15.80:50748) 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 -- 172.21.15.80:0/3536951572 learned_addr learned my addr 172.21.15.80:0/3536951572 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1cffff640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d0102270 0x7ff1d019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d516b640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d01050c0 0x7ff1d01a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 -- 172.21.15.80:0/3536951572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d0102270 msgr2=0x7ff1d019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d0102270 0x7ff1d019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 -- 172.21.15.80:0/3536951572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d01050c0 msgr2=0x7ff1d01a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d01050c0 0x7ff1d01a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 -- 172.21.15.80:0/3536951572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d01a1d70 con 0x7ff1d0101770 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d496a640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d019a230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400d740 tx=0x7ff1c400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1cdffb640 1 -- 172.21.15.80:0/3536951572 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4017070 con 0x7ff1d0101770 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d01a2060 con 0x7ff1d0101770 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1cdffb640 1 -- 172.21.15.80:0/3536951572 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c400de50 con 0x7ff1d0101770 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1cdffb640 1 -- 172.21.15.80:0/3536951572 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4003c20 con 0x7ff1d0101770 2024-04-25T11:24:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.336+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d01a25b0 con 0x7ff1d0101770 2024-04-25T11:24:04.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.337+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d0108a50 con 0x7ff1d0101770 2024-04-25T11:24:04.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.339+0000 7ff1cdffb640 1 -- 172.21.15.80:0/3536951572 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7ff1c4003dc0 con 0x7ff1d0101770 2024-04-25T11:24:04.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.339+0000 7ff1cdffb640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff1c00afaf0 0x7ff1c00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.339+0000 7ff1cffff640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff1c00afaf0 0x7ff1c00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.339+0000 7ff1cdffb640 1 -- 172.21.15.80:0/3536951572 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff1c40de640 con 0x7ff1d0101770 2024-04-25T11:24:04.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.340+0000 7ff1cffff640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff1c00afaf0 0x7ff1c00b2000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009230 tx=0x7ff1bc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:04.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.344+0000 7ff1cdffb640 1 -- 172.21.15.80:0/3536951572 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff1c40a7210 con 0x7ff1d0101770 2024-04-25T11:24:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.522+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1d00637a0 con 0x7ff1d0101770 2024-04-25T11:24:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.524+0000 7ff1cdffb640 1 -- 172.21.15.80:0/3536951572 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7ff1c40a6b10 con 0x7ff1d0101770 2024-04-25T11:24:04.518 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:04.519 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff1c00afaf0 msgr2=0x7ff1c00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff1c00afaf0 0x7ff1c00b2000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009230 tx=0x7ff1bc031400 comp rx=0 tx=0).stop 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 msgr2=0x7ff1d019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d019a230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400d740 tx=0x7ff1c400dc00 comp rx=0 tx=0).stop 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 shutdown_connections 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff1c00afaf0 0x7ff1c00b2000 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d01050c0 0x7ff1d01a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d0102270 0x7ff1d019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 --2- 172.21.15.80:0/3536951572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1d0101770 0x7ff1d019a230 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 >> 172.21.15.80:0/3536951572 conn(0x7ff1d00fd390 msgr2=0x7ff1d0105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 shutdown_connections 2024-04-25T11:24:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.526+0000 7ff1d6bce640 1 -- 172.21.15.80:0/3536951572 wait complete. 2024-04-25T11:24:04.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:04 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/845998012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:04.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:04 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1713616500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:04.531 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:04 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1498569676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:04.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:24:04.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:24:04.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 -- 172.21.15.80:0/1442876438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698104d40 msgr2=0x7fc698105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 --2- 172.21.15.80:0/1442876438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698104d40 0x7fc698105150 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc688009900 tx=0x7fc68802a410 comp rx=0 tx=0).stop 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 -- 172.21.15.80:0/1442876438 shutdown_connections 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 --2- 172.21.15.80:0/1442876438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698104d40 0x7fc698105150 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 --2- 172.21.15.80:0/1442876438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc698109a40 0x7fc69810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 --2- 172.21.15.80:0/1442876438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc698103b00 0x7fc698104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 -- 172.21.15.80:0/1442876438 >> 172.21.15.80:0/1442876438 conn(0x7fc6980fed10 msgr2=0x7fc6981011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 -- 172.21.15.80:0/1442876438 shutdown_connections 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.650+0000 7fc69fd72640 1 -- 172.21.15.80:0/1442876438 wait complete. 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 Processor -- start 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 -- start start 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698103b00 0x7fc69819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc698104d40 0x7fc69819a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc698109a40 0x7fc6981a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc69810f680 con 0x7fc698103b00 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc69810f500 con 0x7fc698104d40 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc69810f800 con 0x7fc698109a40 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698103b00 0x7fc69819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698103b00 0x7fc69819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50774/0 (socket says 172.21.15.80:50774) 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 -- 172.21.15.80:0/2671764671 learned_addr learned my addr 172.21.15.80:0/2671764671 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69d30d640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc698104d40 0x7fc69819a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 -- 172.21.15.80:0/2671764671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc698109a40 msgr2=0x7fc6981a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc698109a40 0x7fc6981a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 -- 172.21.15.80:0/2671764671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc698104d40 msgr2=0x7fc69819a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc698104d40 0x7fc69819a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 -- 172.21.15.80:0/2671764671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6981a1d80 con 0x7fc698103b00 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69db0e640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698103b00 0x7fc69819a340 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc694006fd0 tx=0x7fc69400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc68effd640 1 -- 172.21.15.80:0/2671764671 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694011830 con 0x7fc698103b00 2024-04-25T11:24:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc68effd640 1 -- 172.21.15.80:0/2671764671 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc694016070 con 0x7fc698103b00 2024-04-25T11:24:04.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6981a2070 con 0x7fc698103b00 2024-04-25T11:24:04.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.651+0000 7fc68effd640 1 -- 172.21.15.80:0/2671764671 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694010e00 con 0x7fc698103b00 2024-04-25T11:24:04.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.652+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6981a2640 con 0x7fc698103b00 2024-04-25T11:24:04.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.652+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc698108850 con 0x7fc698103b00 2024-04-25T11:24:04.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.655+0000 7fc68effd640 1 -- 172.21.15.80:0/2671764671 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fc69401b460 con 0x7fc698103b00 2024-04-25T11:24:04.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.655+0000 7fc68effd640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc6840afaf0 0x7fc6840b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.655+0000 7fc69d30d640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc6840afaf0 0x7fc6840b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.655+0000 7fc68effd640 1 -- 172.21.15.80:0/2671764671 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fc6940de9c0 con 0x7fc698103b00 2024-04-25T11:24:04.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.656+0000 7fc69d30d640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc6840afaf0 0x7fc6840b2000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc688000c00 tx=0x7fc688031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:04.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.659+0000 7fc68effd640 1 -- 172.21.15.80:0/2671764671 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6940a7590 con 0x7fc698103b00 2024-04-25T11:24:04.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:04 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/845998012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:04.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:04 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1713616500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:04.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:04 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1498569676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:04.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:04 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/845998012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:04.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:04 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1713616500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:04.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:04 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1498569676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:04.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.840+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc69802dda0 con 0x7fc698103b00 2024-04-25T11:24:04.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.841+0000 7fc68effd640 1 -- 172.21.15.80:0/2671764671 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7fc6940a6e90 con 0x7fc698103b00 2024-04-25T11:24:04.835 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc6840afaf0 msgr2=0x7fc6840b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc6840afaf0 0x7fc6840b2000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc688000c00 tx=0x7fc688031400 comp rx=0 tx=0).stop 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698103b00 msgr2=0x7fc69819a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698103b00 0x7fc69819a340 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc694006fd0 tx=0x7fc69400b8e0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 shutdown_connections 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc6840afaf0 0x7fc6840b2000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc698109a40 0x7fc6981a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc698104d40 0x7fc69819a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 --2- 172.21.15.80:0/2671764671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc698103b00 0x7fc69819a340 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 >> 172.21.15.80:0/2671764671 conn(0x7fc6980fed10 msgr2=0x7fc698105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:04.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 shutdown_connections 2024-04-25T11:24:04.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.843+0000 7fc69fd72640 1 -- 172.21.15.80:0/2671764671 wait complete. 2024-04-25T11:24:04.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:24:04.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 -- 172.21.15.80:0/3759459269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 msgr2=0x7f7984103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 --2- 172.21.15.80:0/3759459269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984103600 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7978009900 tx=0x7f797802a410 comp rx=0 tx=0).stop 2024-04-25T11:24:04.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 -- 172.21.15.80:0/3759459269 shutdown_connections 2024-04-25T11:24:04.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 --2- 172.21.15.80:0/3759459269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984103600 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 --2- 172.21.15.80:0/3759459269 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7984107ef0 0x7f798410a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 --2- 172.21.15.80:0/3759459269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7984101fb0 0x7f7984102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 -- 172.21.15.80:0/3759459269 >> 172.21.15.80:0/3759459269 conn(0x7f79840fd1a0 msgr2=0x7f79840ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 -- 172.21.15.80:0/3759459269 shutdown_connections 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.967+0000 7f798359e640 1 -- 172.21.15.80:0/3759459269 wait complete. 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 Processor -- start 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 -- start start 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7984101fb0 0x7f7984198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7984107ef0 0x7f79841a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f798410dad0 con 0x7f79841031f0 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f798410d950 con 0x7f7984107ef0 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798359e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f798410dc50 con 0x7f7984101fb0 2024-04-25T11:24:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50784/0 (socket says 172.21.15.80:50784) 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 -- 172.21.15.80:0/2597226432 learned_addr learned my addr 172.21.15.80:0/2597226432 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798259c640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7984101fb0 0x7f7984198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7982d9d640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7984107ef0 0x7f79841a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 -- 172.21.15.80:0/2597226432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7984101fb0 msgr2=0x7f7984198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7984101fb0 0x7f7984198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 -- 172.21.15.80:0/2597226432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7984107ef0 msgr2=0x7f79841a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7984107ef0 0x7f79841a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7981d9b640 1 -- 172.21.15.80:0/2597226432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79841a0a40 con 0x7f79841031f0 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f798259c640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7984101fb0 0x7f7984198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.968+0000 7f7982d9d640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7984107ef0 0x7f79841a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:04.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.969+0000 7f7981d9b640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984199440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7978006010 tx=0x7f7978004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:04.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.969+0000 7f79737fe640 1 -- 172.21.15.80:0/2597226432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978046070 con 0x7f79841031f0 2024-04-25T11:24:04.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.969+0000 7f79737fe640 1 -- 172.21.15.80:0/2597226432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79780044b0 con 0x7f79841031f0 2024-04-25T11:24:04.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.969+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798410e4a0 con 0x7f79841031f0 2024-04-25T11:24:04.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.969+0000 7f79737fe640 1 -- 172.21.15.80:0/2597226432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978035050 con 0x7f79841031f0 2024-04-25T11:24:04.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.969+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798410e990 con 0x7f79841031f0 2024-04-25T11:24:04.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.970+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798406a030 con 0x7f79841031f0 2024-04-25T11:24:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.971+0000 7f79737fe640 1 -- 172.21.15.80:0/2597226432 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f7978049070 con 0x7f79841031f0 2024-04-25T11:24:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.972+0000 7f79737fe640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f796c0afae0 0x7f796c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.972+0000 7f798259c640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f796c0afae0 0x7f796c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.972+0000 7f79737fe640 1 -- 172.21.15.80:0/2597226432 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f7978100dd0 con 0x7f79841031f0 2024-04-25T11:24:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.972+0000 7f798259c640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f796c0afae0 0x7f796c0b1ff0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7984102bb0 tx=0x7f797c005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:04.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:04.976+0000 7f79737fe640 1 -- 172.21.15.80:0/2597226432 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7978050080 con 0x7f79841031f0 2024-04-25T11:24:05.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.154+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79841a0cd0 con 0x7f79841031f0 2024-04-25T11:24:05.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.155+0000 7f79737fe640 1 -- 172.21.15.80:0/2597226432 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) ==== 104+0+11 (secure 0 0 0) 0x7f79780c99a0 con 0x7f79841031f0 2024-04-25T11:24:05.149 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f796c0afae0 msgr2=0x7f796c0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f796c0afae0 0x7f796c0b1ff0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7984102bb0 tx=0x7f797c005e70 comp rx=0 tx=0).stop 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 msgr2=0x7f7984199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984199440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7978006010 tx=0x7f7978004340 comp rx=0 tx=0).stop 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 shutdown_connections 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f796c0afae0 0x7f796c0b1ff0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79841031f0 0x7f7984199440 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7984107ef0 0x7f79841a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 --2- 172.21.15.80:0/2597226432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7984101fb0 0x7f7984198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 >> 172.21.15.80:0/2597226432 conn(0x7f79840fd1a0 msgr2=0x7f798410a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:05.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 shutdown_connections 2024-04-25T11:24:05.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.157+0000 7f798359e640 1 -- 172.21.15.80:0/2597226432 wait complete. 2024-04-25T11:24:05.162 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:24:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 -- 172.21.15.80:0/62383336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec101f20 msgr2=0x7f00ec106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 --2- 172.21.15.80:0/62383336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec101f20 0x7f00ec106b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009900 tx=0x7f00dc02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 -- 172.21.15.80:0/62383336 shutdown_connections 2024-04-25T11:24:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 --2- 172.21.15.80:0/62383336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec109a30 0x7f00ec10be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 --2- 172.21.15.80:0/62383336 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec1070d0 0x7f00ec1094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 --2- 172.21.15.80:0/62383336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec101f20 0x7f00ec106b90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 -- 172.21.15.80:0/62383336 >> 172.21.15.80:0/62383336 conn(0x7f00ec0fd380 msgr2=0x7f00ec0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 -- 172.21.15.80:0/62383336 shutdown_connections 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.279+0000 7f00f284a640 1 -- 172.21.15.80:0/62383336 wait complete. 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 Processor -- start 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 -- start start 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec101f20 0x7f00ec19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1070d0 0x7f00ec19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec109a30 0x7f00ec1a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec10f6a0 con 0x7f00ec1070d0 2024-04-25T11:24:05.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec10f520 con 0x7f00ec101f20 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f284a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec10f820 con 0x7f00ec109a30 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1070d0 0x7f00ec19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1070d0 0x7f00ec19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50800/0 (socket says 172.21.15.80:50800) 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00eb7fe640 1 -- 172.21.15.80:0/2548355222 learned_addr learned my addr 172.21.15.80:0/2548355222 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00f0de7640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec109a30 0x7f00ec1a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00ebfff640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec101f20 0x7f00ec19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00eb7fe640 1 -- 172.21.15.80:0/2548355222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec109a30 msgr2=0x7f00ec1a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec109a30 0x7f00ec1a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.280+0000 7f00eb7fe640 1 -- 172.21.15.80:0/2548355222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec101f20 msgr2=0x7f00ec19a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec101f20 0x7f00ec19a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00eb7fe640 1 -- 172.21.15.80:0/2548355222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec1a1e10 con 0x7f00ec1070d0 2024-04-25T11:24:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00ebfff640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec101f20 0x7f00ec19a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1070d0 0x7f00ec19a810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d770 tx=0x7f00e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00e97fa640 1 -- 172.21.15.80:0/2548355222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0017070 con 0x7f00ec1070d0 2024-04-25T11:24:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00e97fa640 1 -- 172.21.15.80:0/2548355222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00e00054d0 con 0x7f00ec1070d0 2024-04-25T11:24:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec1a2100 con 0x7f00ec1070d0 2024-04-25T11:24:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00e97fa640 1 -- 172.21.15.80:0/2548355222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0004c30 con 0x7f00ec1070d0 2024-04-25T11:24:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.281+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec1a2600 con 0x7f00ec1070d0 2024-04-25T11:24:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.282+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ec0feea0 con 0x7f00ec1070d0 2024-04-25T11:24:05.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.283+0000 7f00e97fa640 1 -- 172.21.15.80:0/2548355222 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f00e0004dd0 con 0x7f00ec1070d0 2024-04-25T11:24:05.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.284+0000 7f00e97fa640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f00d40afaf0 0x7f00d40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.284+0000 7f00ebfff640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f00d40afaf0 0x7f00d40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.284+0000 7f00e97fa640 1 -- 172.21.15.80:0/2548355222 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f00e00debb0 con 0x7f00ec1070d0 2024-04-25T11:24:05.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.285+0000 7f00ebfff640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f00d40afaf0 0x7f00d40b2000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00dc005f70 tx=0x7f00dc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:05.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.288+0000 7f00e97fa640 1 -- 172.21.15.80:0/2548355222 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f00e00a7780 con 0x7f00ec1070d0 2024-04-25T11:24:05.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.476+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f00ec0637a0 con 0x7f00ec1070d0 2024-04-25T11:24:05.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.476+0000 7f00e97fa640 1 -- 172.21.15.80:0/2548355222 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) ==== 100+0+11 (secure 0 0 0) 0x7f00e00a7080 con 0x7f00ec1070d0 2024-04-25T11:24:05.471 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:24:05.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.478+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f00d40afaf0 msgr2=0x7f00d40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.478+0000 7f00f284a640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f00d40afaf0 0x7f00d40b2000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00dc005f70 tx=0x7f00dc000bc0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.478+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1070d0 msgr2=0x7f00ec19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.478+0000 7f00f284a640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1070d0 0x7f00ec19a810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d770 tx=0x7f00e000dc30 comp rx=0 tx=0).stop 2024-04-25T11:24:05.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 shutdown_connections 2024-04-25T11:24:05.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f00d40afaf0 0x7f00d40b2000 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1070d0 0x7f00ec19a810 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec109a30 0x7f00ec1a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 --2- 172.21.15.80:0/2548355222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec101f20 0x7f00ec19a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 >> 172.21.15.80:0/2548355222 conn(0x7f00ec0fd380 msgr2=0x7f00ec105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:05.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 shutdown_connections 2024-04-25T11:24:05.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.479+0000 7f00f284a640 1 -- 172.21.15.80:0/2548355222 wait complete. 2024-04-25T11:24:05.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.598+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/4256788340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 msgr2=0x7f6c2810ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.598+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/4256788340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c2810ad60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009ca0 tx=0x7f6c2002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.598+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/4256788340 shutdown_connections 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.598+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/4256788340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c2810ad60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.598+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/4256788340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c28103c40 0x7f6c28104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.598+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/4256788340 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c28102a00 0x7f6c28103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.598+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/4256788340 >> 172.21.15.80:0/4256788340 conn(0x7f6c280fdbf0 msgr2=0x7f6c281000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/4256788340 shutdown_connections 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/4256788340 wait complete. 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 Processor -- start 2024-04-25T11:24:05.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 -- start start 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c28102a00 0x7f6c28075840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c28103c40 0x7f6c2819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c281a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2810e530 con 0x7f6c28108940 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2810e3b0 con 0x7f6c28102a00 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.599+0000 7f6c2e0ee640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2810e6b0 con 0x7f6c28103c40 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c281a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c281a14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50822/0 (socket says 172.21.15.80:50822) 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 -- 172.21.15.80:0/1873729730 learned_addr learned my addr 172.21.15.80:0/1873729730 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c1effd640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c28103c40 0x7f6c2819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c277fe640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c28102a00 0x7f6c28075840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 -- 172.21.15.80:0/1873729730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c28103c40 msgr2=0x7f6c2819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c28103c40 0x7f6c2819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 -- 172.21.15.80:0/1873729730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c28102a00 msgr2=0x7f6c28075840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c28102a00 0x7f6c28075840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 -- 172.21.15.80:0/1873729730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c281a1cf0 con 0x7f6c28108940 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c27fff640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c281a14d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c20004af0 tx=0x7f6c20031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c257fa640 1 -- 172.21.15.80:0/1873729730 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20003b70 con 0x7f6c28108940 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c257fa640 1 -- 172.21.15.80:0/1873729730 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c20003d10 con 0x7f6c28108940 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c281a1f80 con 0x7f6c28108940 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c257fa640 1 -- 172.21.15.80:0/1873729730 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2002fb20 con 0x7f6c28108940 2024-04-25T11:24:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.600+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c281a23e0 con 0x7f6c28108940 2024-04-25T11:24:05.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.601+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2806a190 con 0x7f6c28108940 2024-04-25T11:24:05.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.603+0000 7f6c257fa640 1 -- 172.21.15.80:0/1873729730 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f6c20004580 con 0x7f6c28108940 2024-04-25T11:24:05.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.603+0000 7f6c257fa640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6c140afaf0 0x7f6c140b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.604+0000 7f6c277fe640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6c140afaf0 0x7f6c140b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.604+0000 7f6c257fa640 1 -- 172.21.15.80:0/1873729730 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f6c201002f0 con 0x7f6c28108940 2024-04-25T11:24:05.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.604+0000 7f6c277fe640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6c140afaf0 0x7f6c140b2000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6c28103600 tx=0x7f6c18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:05.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.607+0000 7f6c257fa640 1 -- 172.21.15.80:0/1873729730 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6c200c8ec0 con 0x7f6c28108940 2024-04-25T11:24:05.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:05 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3536951572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:05.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:05 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2671764671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:05.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:05 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2597226432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:05.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:05 smithi196 ceph-mon[32659]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:24:05.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:05 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3536951572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:05.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:05 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2671764671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:05.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:05 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2597226432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:05.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:05 smithi082 ceph-mon[32440]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:24:05.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.823+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c2802dc10 con 0x7f6c28108940 2024-04-25T11:24:05.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.824+0000 7f6c257fa640 1 -- 172.21.15.80:0/1873729730 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f6c200c87c0 con 0x7f6c28108940 2024-04-25T11:24:05.818 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:05.818 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:22:18.430262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:24:05.819 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-04-25T11:24:05.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6c140afaf0 msgr2=0x7f6c140b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6c140afaf0 0x7f6c140b2000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6c28103600 tx=0x7f6c18005f90 comp rx=0 tx=0).stop 2024-04-25T11:24:05.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 msgr2=0x7f6c281a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c281a14d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c20004af0 tx=0x7f6c20031700 comp rx=0 tx=0).stop 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 shutdown_connections 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f6c140afaf0 0x7f6c140b2000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c28108940 0x7f6c281a14d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c28103c40 0x7f6c2819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 --2- 172.21.15.80:0/1873729730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c28102a00 0x7f6c28075840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 >> 172.21.15.80:0/1873729730 conn(0x7f6c280fdbf0 msgr2=0x7f6c28104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 shutdown_connections 2024-04-25T11:24:05.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.826+0000 7f6c2e0ee640 1 -- 172.21.15.80:0/1873729730 wait complete. 2024-04-25T11:24:05.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:05 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3536951572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:05 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2671764671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:05 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2597226432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:05.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:05 smithi080 ceph-mon[29126]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T11:24:05.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:24:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 -- 172.21.15.80:0/4215976455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8103af0 msgr2=0x7fa3f81047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 --2- 172.21.15.80:0/4215976455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8103af0 0x7fa3f81047f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009900 tx=0x7fa3e802a410 comp rx=0 tx=0).stop 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 -- 172.21.15.80:0/4215976455 shutdown_connections 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 --2- 172.21.15.80:0/4215976455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8109a30 0x7fa3f810be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 --2- 172.21.15.80:0/4215976455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8104d30 0x7fa3f8105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 --2- 172.21.15.80:0/4215976455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8103af0 0x7fa3f81047f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 -- 172.21.15.80:0/4215976455 >> 172.21.15.80:0/4215976455 conn(0x7fa3f80fed40 msgr2=0x7fa3f8101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 -- 172.21.15.80:0/4215976455 shutdown_connections 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.946+0000 7fa3fc861640 1 -- 172.21.15.80:0/4215976455 wait complete. 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 Processor -- start 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 -- start start 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8103af0 0x7fa3f819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8104d30 0x7fa3f819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8109a30 0x7fa3f81a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f810f5f0 con 0x7fa3f8109a30 2024-04-25T11:24:05.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f810f470 con 0x7fa3f8103af0 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3fc861640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f810f770 con 0x7fa3f8104d30 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8109a30 0x7fa3f81a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8109a30 0x7fa3f81a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50826/0 (socket says 172.21.15.80:50826) 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 -- 172.21.15.80:0/2963813134 learned_addr learned my addr 172.21.15.80:0/2963813134 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f659c640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8103af0 0x7fa3f819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f5d9b640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8104d30 0x7fa3f819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 -- 172.21.15.80:0/2963813134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8104d30 msgr2=0x7fa3f819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8104d30 0x7fa3f819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 -- 172.21.15.80:0/2963813134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8103af0 msgr2=0x7fa3f819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8103af0 0x7fa3f819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f6d9d640 1 -- 172.21.15.80:0/2963813134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f81a1d60 con 0x7fa3f8109a30 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.947+0000 7fa3f659c640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8103af0 0x7fa3f819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.948+0000 7fa3f6d9d640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8109a30 0x7fa3f81a16f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000cad0 tx=0x7fa3f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:05.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.948+0000 7fa3e77fe640 1 -- 172.21.15.80:0/2963813134 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f000ae20 con 0x7fa3f8109a30 2024-04-25T11:24:05.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.948+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f81a1ff0 con 0x7fa3f8109a30 2024-04-25T11:24:05.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.948+0000 7fa3e77fe640 1 -- 172.21.15.80:0/2963813134 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0005020 con 0x7fa3f8109a30 2024-04-25T11:24:05.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.948+0000 7fa3e77fe640 1 -- 172.21.15.80:0/2963813134 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f000f6b0 con 0x7fa3f8109a30 2024-04-25T11:24:05.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.948+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f81a2500 con 0x7fa3f8109a30 2024-04-25T11:24:05.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.949+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f8108840 con 0x7fa3f8109a30 2024-04-25T11:24:05.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.950+0000 7fa3e77fe640 1 -- 172.21.15.80:0/2963813134 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fa3f00051d0 con 0x7fa3f8109a30 2024-04-25T11:24:05.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.951+0000 7fa3e77fe640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa3e00afaf0 0x7fa3e00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:05.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.951+0000 7fa3f659c640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa3e00afaf0 0x7fa3e00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:05.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.951+0000 7fa3e77fe640 1 -- 172.21.15.80:0/2963813134 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fa3f00deff0 con 0x7fa3f8109a30 2024-04-25T11:24:05.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.951+0000 7fa3f659c640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa3e00afaf0 0x7fa3e00b2000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009230 tx=0x7fa3e8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:05.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:05.954+0000 7fa3e77fe640 1 -- 172.21.15.80:0/2963813134 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa3f0014030 con 0x7fa3f8109a30 2024-04-25T11:24:06.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.132+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3f802dd20 con 0x7fa3f8109a30 2024-04-25T11:24:06.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.134+0000 7fa3e77fe640 1 -- 172.21.15.80:0/2963813134 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7fa3f00a7c60 con 0x7fa3f8109a30 2024-04-25T11:24:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:06.128 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:24:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa3e00afaf0 msgr2=0x7fa3e00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa3e00afaf0 0x7fa3e00b2000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009230 tx=0x7fa3e8000bc0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8109a30 msgr2=0x7fa3f81a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8109a30 0x7fa3f81a16f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000cad0 tx=0x7fa3f000cf90 comp rx=0 tx=0).stop 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 shutdown_connections 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fa3e00afaf0 0x7fa3e00b2000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f8109a30 0x7fa3f81a16f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8104d30 0x7fa3f819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 --2- 172.21.15.80:0/2963813134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8103af0 0x7fa3f819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 >> 172.21.15.80:0/2963813134 conn(0x7fa3f80fed40 msgr2=0x7fa3f8105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 shutdown_connections 2024-04-25T11:24:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.136+0000 7fa3fc861640 1 -- 172.21.15.80:0/2963813134 wait complete. 2024-04-25T11:24:06.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T11:22:13.737406+0000', 'modified': '2024-04-25T11:22:18.430262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24521, 'mds_1': 24499, 'mds_2': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/4149738023', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 4149738023}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 4149738023}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/3574274014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 3574274014}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 3574274014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6837/2620156093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 2620156093}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 2620156093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.82:6837/3792535888', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 3792535888}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 3792535888}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.196:6839/1079728905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 1079728905}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 1079728905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6839/3848058015', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 3848058015}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 3848058015}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24521, 'qdb_cluster': [24476, 24499, 24521]} 2024-04-25T11:24:06.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T11:24:06.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-25T11:24:06.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/1825189314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 msgr2=0x7fbe2410be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/1825189314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe2410be50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009ca0 tx=0x7fbe1c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/1825189314 shutdown_connections 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/1825189314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe2410be50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/1825189314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24104d30 0x7fbe24105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/1825189314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe24103af0 0x7fbe241047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/1825189314 >> 172.21.15.80:0/1825189314 conn(0x7fbe240fece0 msgr2=0x7fbe24101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/1825189314 shutdown_connections 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.257+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/1825189314 wait complete. 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 Processor -- start 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 -- start start 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe24103af0 0x7fbe2419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24104d30 0x7fbe2419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe241a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2410f620 con 0x7fbe24109a30 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2410f4a0 con 0x7fbe24104d30 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe2a9d7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2410f7a0 con 0x7fbe24103af0 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe241a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe241a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50850/0 (socket says 172.21.15.80:50850) 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 -- 172.21.15.80:0/2921099876 learned_addr learned my addr 172.21.15.80:0/2921099876 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe23fff640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe24103af0 0x7fbe2419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 -- 172.21.15.80:0/2921099876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe24103af0 msgr2=0x7fbe2419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe24103af0 0x7fbe2419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe237fe640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24104d30 0x7fbe2419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 -- 172.21.15.80:0/2921099876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24104d30 msgr2=0x7fbe2419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24104d30 0x7fbe2419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe28f74640 1 -- 172.21.15.80:0/2921099876 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe241a1d40 con 0x7fbe24109a30 2024-04-25T11:24:06.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.258+0000 7fbe237fe640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24104d30 0x7fbe2419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:06.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.259+0000 7fbe28f74640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe241a16d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0097b0 tx=0x7fbe1c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.259+0000 7fbe217fa640 1 -- 172.21.15.80:0/2921099876 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c004240 con 0x7fbe24109a30 2024-04-25T11:24:06.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.259+0000 7fbe217fa640 1 -- 172.21.15.80:0/2921099876 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe1c02f380 con 0x7fbe24109a30 2024-04-25T11:24:06.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.259+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe241a1fd0 con 0x7fbe24109a30 2024-04-25T11:24:06.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.259+0000 7fbe217fa640 1 -- 172.21.15.80:0/2921099876 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c02fc30 con 0x7fbe24109a30 2024-04-25T11:24:06.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.259+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe241a2490 con 0x7fbe24109a30 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.261+0000 7fbe31967740 1 Processor -- start 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.261+0000 7fbe217fa640 1 -- 172.21.15.80:0/2921099876 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fbe1c0043e0 con 0x7fbe24109a30 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.261+0000 7fbe31967740 1 -- start start 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe31967740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 0x55773bc88370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe31967740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe31967740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc8f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe31967740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55773bbed740 con 0x55773b8be3b0 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe31967740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55773bb893a0 con 0x55773b8c6590 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe31967740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55773bbe9700 con 0x55773b8e7270 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc888f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50858/0 (socket says 172.21.15.80:50858) 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 -- 172.21.15.80:0/4202639668 learned_addr learned my addr 172.21.15.80:0/4202639668 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe237fe640 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 0x55773bc88370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe237fe640 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc8f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 -- 172.21.15.80:0/4202639668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 msgr2=0x55773bc88370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 0x55773bc88370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe217fa640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe0c0afb70 0x7fbe0c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 -- 172.21.15.80:0/4202639668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 msgr2=0x55773bc8f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc8f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 -- 172.21.15.80:0/4202639668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55773bba5750 con 0x55773b8be3b0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe28f74640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe0c0afb70 0x7fbe0c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.262+0000 7fbe23fff640 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc888f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400cb90 tx=0x7fbe1400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee34c79b5d6a0bed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.263+0000 7fbe217fa640 1 -- 172.21.15.80:0/2921099876 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fbe1c1003f0 con 0x7fbe24109a30 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.263+0000 7fbe0a7fc640 1 -- 172.21.15.80:0/4202639668 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14010630 con 0x55773b8be3b0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.263+0000 7fbe0a7fc640 1 -- 172.21.15.80:0/4202639668 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe14010c80 con 0x55773b8be3b0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.263+0000 7fbe0a7fc640 1 -- 172.21.15.80:0/4202639668 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1401aa70 con 0x55773b8be3b0 2024-04-25T11:24:06.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.263+0000 7fbe31967740 1 -- 172.21.15.80:0/4202639668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 msgr2=0x55773bc888f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.263+0000 7fbe28f74640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe0c0afb70 0x7fbe0c0b2080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0fdf30 tx=0x7fbe1c097380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.263+0000 7fbe31967740 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc888f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400cb90 tx=0x7fbe1400e720 comp rx=0 tx=0).stop 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- 172.21.15.80:0/4202639668 shutdown_connections 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc888f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc8f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 --2- 172.21.15.80:0/4202639668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 0x55773bc88370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- 172.21.15.80:0/4202639668 >> 172.21.15.80:0/4202639668 conn(0x55773b8db3c0 msgr2=0x55773bc83d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- 172.21.15.80:0/4202639668 shutdown_connections 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- 172.21.15.80:0/4202639668 wait complete. 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- start start 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 Processor -- start 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8be3b0 0x55773bc922b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8e7270 0x55773bc99750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55773bc90240 con 0x55773b8e7270 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55773bb74fe0 con 0x55773b8c6590 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.264+0000 7fbe31967740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55773bc903c0 con 0x55773b8be3b0 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe31967740 10 client.0 _ll_register_callbacks cb 0x55773bb8b150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8e7270 0x55773bc99750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8e7270 0x55773bc99750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50864/0 (socket says 172.21.15.80:50864) 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 -- 172.21.15.80:0/685224066 learned_addr learned my addr 172.21.15.80:0/685224066 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe23fff640 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8be3b0 0x55773bc922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 -- 172.21.15.80:0/685224066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8be3b0 msgr2=0x55773bc922b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8be3b0 0x55773bc922b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 -- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 msgr2=0x55773bc927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 -- 172.21.15.80:0/685224066 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55773b8ff2d0 con 0x55773b8e7270 2024-04-25T11:24:06.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe237fe640 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8e7270 0x55773bc99750 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe18013dd0 tx=0x7fbe1800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495eb32f2b122a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe037fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe037fe640 1 -- 172.21.15.80:0/685224066 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1801f410 con 0x55773b8e7270 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe14010c80 con 0x55773b8e7270 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe037fe640 1 -- 172.21.15.80:0/685224066 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fbe1800e410 con 0x55773b8e7270 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe037fe640 1 -- 172.21.15.80:0/685224066 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbe1800e610 con 0x55773b8e7270 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe31967740 10 client.15252 fetch_fsmap learned FSMap version 21 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.265+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55773b9c96b0 con 0x55773b8e7270 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe037fe640 1 -- 172.21.15.80:0/685224066 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe14010c80 con 0x55773b8e7270 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe037fe640 1 -- 172.21.15.80:0/685224066 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbe1800f040 con 0x55773b8e7270 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe31967740 10 client.15252 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe31967740 10 client.15252 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe31967740 20 client.15252 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe31967740 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b8a5e40 0x55773bc9ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe31967740 4 client.15252 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55773bbfb350 con 0x55773b8a5e40 2024-04-25T11:24:06.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.266+0000 7fbe23fff640 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b8a5e40 0x55773bc9ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.267+0000 7fbe037fe640 10 client.15252 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:06.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.267+0000 7fbe23fff640 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b8a5e40 0x55773bc9ffc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28f1ca52106d1f00 server_cookie=6d1c8b7aa5a1b913 in_seq=0 out_seq=0 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.267+0000 7fbe037fe640 1 -- 172.21.15.80:0/685224066 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55773bbfb350 con 0x55773b8a5e40 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.267+0000 7fbe037fe640 10 client.15252 handle_command_reply: tid=0 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.267+0000 7fbe31967740 1 client.15252 shutdown 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.267+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8e7270 msgr2=0x55773bc99750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.267+0000 7fbe31967740 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8e7270 0x55773bc99750 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe18013dd0 tx=0x7fbe1800bac0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 shutdown_connections 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b8a5e40 0x55773bc9ffc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8e7270 0x55773bc99750 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8c6590 0x55773bc927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 --2- 172.21.15.80:0/685224066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8be3b0 0x55773bc922b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe037fe640 0 client.15252 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 >> 172.21.15.80:0/685224066 conn(0x55773b8db3c0 msgr2=0x55773bc82d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 shutdown_connections 2024-04-25T11:24:06.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 1 -- 172.21.15.80:0/685224066 wait complete. 2024-04-25T11:24:06.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.268+0000 7fbe31967740 20 client.15252 trim_cache size 0 max 16384 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 Processor -- start 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 -- start start 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8be3b0 0x55773bc907f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8c6590 0x55773bc99670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 0x55773bc90d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55773bc9e300 con 0x55773b8c6590 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55773bc9e9d0 con 0x55773b8be3b0 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe31967740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55773bc9f0a0 con 0x55773b8e7270 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8c6590 0x55773bc99670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8c6590 0x55773bc99670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50874/0 (socket says 172.21.15.80:50874) 2024-04-25T11:24:06.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 -- 172.21.15.80:0/1357400328 learned_addr learned my addr 172.21.15.80:0/1357400328 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 -- 172.21.15.80:0/1357400328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 msgr2=0x55773bc90d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 --2- 172.21.15.80:0/1357400328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 0x55773bc90d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 -- 172.21.15.80:0/1357400328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8be3b0 msgr2=0x55773bc907f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 --2- 172.21.15.80:0/1357400328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8be3b0 0x55773bc907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 -- 172.21.15.80:0/1357400328 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55773bc9f550 con 0x55773b8c6590 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe23fff640 1 --2- 172.21.15.80:0/1357400328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8c6590 0x55773bc99670 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400f010 tx=0x7fbe140056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0e610d63d35960 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.287+0000 7fbe09ffb640 1 -- 172.21.15.80:0/1357400328 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1402c070 con 0x55773b8c6590 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe09ffb640 1 -- 172.21.15.80:0/1357400328 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe14003aa0 con 0x55773b8c6590 2024-04-25T11:24:06.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe09ffb640 1 -- 172.21.15.80:0/1357400328 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14010720 con 0x55773b8c6590 2024-04-25T11:24:06.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 -- 172.21.15.80:0/1357400328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8c6590 msgr2=0x55773bc99670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 --2- 172.21.15.80:0/1357400328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8c6590 0x55773bc99670 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400f010 tx=0x7fbe140056d0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 -- 172.21.15.80:0/1357400328 shutdown_connections 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 --2- 172.21.15.80:0/1357400328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8c6590 0x55773bc99670 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 --2- 172.21.15.80:0/1357400328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8e7270 0x55773bc90d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 --2- 172.21.15.80:0/1357400328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8be3b0 0x55773bc907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 -- 172.21.15.80:0/1357400328 >> 172.21.15.80:0/1357400328 conn(0x55773b8db3c0 msgr2=0x55773bc8c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 -- 172.21.15.80:0/1357400328 shutdown_connections 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.288+0000 7fbe31967740 1 -- 172.21.15.80:0/1357400328 wait complete. 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 -- start start 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 Processor -- start 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc94ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8c6590 0x55773bc95020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8e7270 0x55773bc97f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55773bc9fe40 con 0x55773b8be3b0 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55773bc9f770 con 0x55773b8e7270 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55773bca0510 con 0x55773b8c6590 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe31967740 10 client.0 _ll_register_callbacks cb 0x7fbe1800b780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc94ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc94ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50880/0 (socket says 172.21.15.80:50880) 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe237fe640 1 -- 172.21.15.80:0/1352980333 learned_addr learned my addr 172.21.15.80:0/1352980333 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe23fff640 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8c6590 0x55773bc95020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.289+0000 7fbe237fe640 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8e7270 0x55773bc97f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe237fe640 1 -- 172.21.15.80:0/1352980333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8c6590 msgr2=0x55773bc95020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe237fe640 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8c6590 0x55773bc95020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe237fe640 1 -- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8e7270 msgr2=0x55773bc97f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe237fe640 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8e7270 0x55773bc97f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe237fe640 1 -- 172.21.15.80:0/1352980333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55773bc98520 con 0x55773b8be3b0 2024-04-25T11:24:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe237fe640 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc94ae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005760 tx=0x7fbe1800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ca5d4c5a408966 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe037fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe037fe640 1 -- 172.21.15.80:0/1352980333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1800e410 con 0x55773b8be3b0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe037fe640 1 -- 172.21.15.80:0/1352980333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fbe18013800 con 0x55773b8be3b0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe14003aa0 con 0x55773b8be3b0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe037fe640 1 -- 172.21.15.80:0/1352980333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbe1803a050 con 0x55773b8be3b0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 10 client.15258 fetch_fsmap learned FSMap version 21 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55773bc99800 con 0x55773b8be3b0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe037fe640 1 -- 172.21.15.80:0/1352980333 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe14003aa0 con 0x55773b8be3b0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe037fe640 1 -- 172.21.15.80:0/1352980333 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbe1802a900 con 0x55773b8be3b0 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 10 client.15258 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 10 client.15258 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 20 client.15258 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:06.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b87b280 0x55773bd0c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 4 client.15258 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.290+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "status"}) -- 0x55773bbf51c0 con 0x55773b87b280 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe23fff640 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b87b280 0x55773bd0c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe037fe640 10 client.15258 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe23fff640 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b87b280 0x55773bd0c380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5f7feec61252ba6 server_cookie=d3b733b3726d360b in_seq=0 out_seq=0 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe037fe640 1 -- 172.21.15.80:0/1352980333 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55773bbf51c0 con 0x55773b87b280 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe037fe640 10 client.15258 handle_command_reply: tid=0 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe31967740 1 client.15258 shutdown 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 msgr2=0x55773bc94ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.291+0000 7fbe31967740 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc94ae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005760 tx=0x7fbe1800b850 comp rx=0 tx=0).stop 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 shutdown_connections 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55773b87b280 0x55773bd0c380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55773b8e7270 0x55773bc97f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55773b8c6590 0x55773bc95020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe037fe640 0 client.15258 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 --2- 172.21.15.80:0/1352980333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55773b8be3b0 0x55773bc94ae0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 >> 172.21.15.80:0/1352980333 conn(0x55773b8db3c0 msgr2=0x55773bc907f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 shutdown_connections 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 1 -- 172.21.15.80:0/1352980333 wait complete. 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe31967740 20 client.15258 trim_cache size 0 max 16384 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 2, 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24476, 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T11:24:06.292 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T11:24:06.293 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T11:24:06.293 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 108.86831275599999, 2024-04-25T11:24:06.293 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 21, 2024-04-25T11:24:06.293 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 79, 2024-04-25T11:24:06.293 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 77, 2024-04-25T11:24:06.293 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 129.91413180800001 2024-04-25T11:24:06.293 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe0c0afb70 msgr2=0x7fbe0c0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe0c0afb70 0x7fbe0c0b2080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0fdf30 tx=0x7fbe1c097380 comp rx=0 tx=0).stop 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 msgr2=0x7fbe241a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe241a16d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0097b0 tx=0x7fbe1c003c20 comp rx=0 tx=0).stop 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 shutdown_connections 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fbe0c0afb70 0x7fbe0c0b2080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe24109a30 0x7fbe241a16d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe24104d30 0x7fbe2419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 --2- 172.21.15.80:0/2921099876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe24103af0 0x7fbe2419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 >> 172.21.15.80:0/2921099876 conn(0x7fbe240fece0 msgr2=0x7fbe24105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 shutdown_connections 2024-04-25T11:24:06.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.292+0000 7fbe2a9d7640 1 -- 172.21.15.80:0/2921099876 wait complete. 2024-04-25T11:24:06.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 -- 172.21.15.80:0/837146866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc101c90 msgr2=0x7f15fc106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 --2- 172.21.15.80:0/837146866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc101c90 0x7f15fc106950 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009860 tx=0x7f15f002a340 comp rx=0 tx=0).stop 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 -- 172.21.15.80:0/837146866 shutdown_connections 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 --2- 172.21.15.80:0/837146866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc1095b0 0x7f15fc10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 --2- 172.21.15.80:0/837146866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15fc102190 0x7f15fc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 --2- 172.21.15.80:0/837146866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc101c90 0x7f15fc106950 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 -- 172.21.15.80:0/837146866 >> 172.21.15.80:0/837146866 conn(0x7f15fc0fd1a0 msgr2=0x7f15fc0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 -- 172.21.15.80:0/837146866 shutdown_connections 2024-04-25T11:24:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 -- 172.21.15.80:0/837146866 wait complete. 2024-04-25T11:24:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 Processor -- start 2024-04-25T11:24:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.414+0000 7f1601f9f640 1 -- start start 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f1601f9f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15fc101c90 0x7f15fc19c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f1601f9f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc102190 0x7f15fc19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f1601f9f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc1095b0 0x7f15fc1a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f1601f9f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc10f3f0 con 0x7f15fc1095b0 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f1601f9f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc10f270 con 0x7f15fc102190 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f1601f9f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc10f570 con 0x7f15fc101c90 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc1095b0 0x7f15fc1a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f1600f9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15fc101c90 0x7f15fc19c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f15fbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc102190 0x7f15fc19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc1095b0 0x7f15fc1a3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50892/0 (socket says 172.21.15.80:50892) 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 -- 172.21.15.80:0/2451731274 learned_addr learned my addr 172.21.15.80:0/2451731274 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 -- 172.21.15.80:0/2451731274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15fc101c90 msgr2=0x7f15fc19c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15fc101c90 0x7f15fc19c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 -- 172.21.15.80:0/2451731274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc102190 msgr2=0x7f15fc19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc102190 0x7f15fc19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 -- 172.21.15.80:0/2451731274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc1a3d00 con 0x7f15fc1095b0 2024-04-25T11:24:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f160179e640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc1095b0 0x7f15fc1a3690 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f15f400eb10 tx=0x7f15f400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.415+0000 7f15f9ffb640 1 -- 172.21.15.80:0/2451731274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f400ce20 con 0x7f15fc1095b0 2024-04-25T11:24:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.416+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc1a3ff0 con 0x7f15fc1095b0 2024-04-25T11:24:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.416+0000 7f15f9ffb640 1 -- 172.21.15.80:0/2451731274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15f4005020 con 0x7f15fc1095b0 2024-04-25T11:24:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.416+0000 7f15f9ffb640 1 -- 172.21.15.80:0/2451731274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4010690 con 0x7f15fc1095b0 2024-04-25T11:24:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.416+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15fc1a4450 con 0x7f15fc1095b0 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.418+0000 7f15f9ffb640 1 -- 172.21.15.80:0/2451731274 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f15f4005510 con 0x7f15fc1095b0 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.418+0000 7f160a18a740 1 Processor -- start 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160a18a740 1 -- start start 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160a18a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136f2270 0x55f813a93560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160a18a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136c93b0 0x55f813a93ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160a18a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136d1590 0x55f813a9a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160a18a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f8139f8740 con 0x55f8136f2270 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160a18a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f8139943a0 con 0x55f8136c93b0 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160a18a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f8139f4700 con 0x55f8136d1590 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136f2270 0x55f813a93560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136f2270 0x55f813a93560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50902/0 (socket says 172.21.15.80:50902) 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 -- 172.21.15.80:0/718718747 learned_addr learned my addr 172.21.15.80:0/718718747 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f1600f9d640 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136c93b0 0x55f813a93ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15f9ffb640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f15ec0afae0 0x7f15ec0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136d1590 0x55f813a9a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f160179e640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f15ec0afae0 0x7f15ec0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 -- 172.21.15.80:0/718718747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136d1590 msgr2=0x55f813a9a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136d1590 0x55f813a9a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 -- 172.21.15.80:0/718718747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136c93b0 msgr2=0x55f813a93ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136c93b0 0x55f813a93ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 -- 172.21.15.80:0/718718747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8139b0750 con 0x55f8136f2270 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f1600f9d640 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136c93b0 0x55f813a93ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15f9ffb640 1 -- 172.21.15.80:0/2451731274 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f15f40df180 con 0x7f15fc1095b0 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.419+0000 7f15fbfff640 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136f2270 0x55f813a93560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15e80135a0 tx=0x7f15e8009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0a0b39c8a8bbdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f15e6ffd640 1 -- 172.21.15.80:0/718718747 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8004050 con 0x55f8136f2270 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160179e640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f15ec0afae0 0x7f15ec0b1ff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15f40a48c0 tx=0x7f15f4090040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f15e6ffd640 1 -- 172.21.15.80:0/718718747 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15e80041f0 con 0x55f8136f2270 2024-04-25T11:24:06.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f15e6ffd640 1 -- 172.21.15.80:0/718718747 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e800f8b0 con 0x55f8136f2270 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 -- 172.21.15.80:0/718718747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136f2270 msgr2=0x55f813a93560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136f2270 0x55f813a93560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15e80135a0 tx=0x7f15e8009890 comp rx=0 tx=0).stop 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 -- 172.21.15.80:0/718718747 shutdown_connections 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136d1590 0x55f813a9a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136c93b0 0x55f813a93ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 --2- 172.21.15.80:0/718718747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136f2270 0x55f813a93560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 -- 172.21.15.80:0/718718747 >> 172.21.15.80:0/718718747 conn(0x55f8136e63c0 msgr2=0x55f813a8eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.420+0000 7f160a18a740 1 -- 172.21.15.80:0/718718747 shutdown_connections 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 -- 172.21.15.80:0/718718747 wait complete. 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 -- start start 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 Processor -- start 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136c93b0 0x55f813a9d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136d1590 0x55f813a9d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136f2270 0x55f813aa4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f813a9b3d0 con 0x55f8136c93b0 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f81397ffe0 con 0x55f8136d1590 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f813a9b550 con 0x55f8136f2270 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f160a18a740 10 client.0 _ll_register_callbacks cb 0x55f813996150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f15fbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136c93b0 0x55f813a9d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f15fbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136c93b0 0x55f813a9d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50916/0 (socket says 172.21.15.80:50916) 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.421+0000 7f15fbfff640 1 -- 172.21.15.80:0/129849189 learned_addr learned my addr 172.21.15.80:0/129849189 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f1600f9d640 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136d1590 0x55f813a9d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15fbfff640 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136f2270 0x55f813aa4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15fbfff640 1 -- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136f2270 msgr2=0x55f813aa4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15fbfff640 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136f2270 0x55f813aa4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15fbfff640 1 -- 172.21.15.80:0/129849189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136d1590 msgr2=0x55f813a9d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15fbfff640 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136d1590 0x55f813a9d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15fbfff640 1 -- 172.21.15.80:0/129849189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f81370a2d0 con 0x55f8136c93b0 2024-04-25T11:24:06.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15fbfff640 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136c93b0 0x55f813a9d3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15e8013ef0 tx=0x7f15e80094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f243e67346918287 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15dbfff640 1 -- 172.21.15.80:0/129849189 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8005050 con 0x55f8136c93b0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15dbfff640 1 -- 172.21.15.80:0/129849189 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f15e80051f0 con 0x55f8136c93b0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15e80041f0 con 0x55f8136c93b0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15dbfff640 1 -- 172.21.15.80:0/129849189 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f15e8036050 con 0x55f8136c93b0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f160a18a740 10 client.15270 fetch_fsmap learned FSMap version 21 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f8137d46b0 con 0x55f8136c93b0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.422+0000 7f15dbfff640 1 -- 172.21.15.80:0/129849189 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15e80041f0 con 0x55f8136c93b0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f15dbfff640 1 -- 172.21.15.80:0/129849189 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f15e801e070 con 0x55f8136c93b0 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f160a18a740 10 client.15270 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f160a18a740 10 client.15270 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f160a18a740 20 client.15270 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f160a18a740 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f8136b0e40 0x55f813aaadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f160a18a740 4 client.15270 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:06.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f813a06350 con 0x55f8136b0e40 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f1600f9d640 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f8136b0e40 0x55f813aaadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f15dbfff640 10 client.15270 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.423+0000 7f1600f9d640 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f8136b0e40 0x55f813aaadf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9161a493fd73af73 server_cookie=bc80a8e1539f043b in_seq=0 out_seq=0 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f15dbfff640 1 -- 172.21.15.80:0/129849189 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f813a06350 con 0x55f8136b0e40 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f15dbfff640 10 client.15270 handle_command_reply: tid=0 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 client.15270 shutdown 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136c93b0 msgr2=0x55f813a9d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136c93b0 0x55f813a9d3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15e8013ef0 tx=0x7f15e80094f0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 shutdown_connections 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f8136b0e40 0x55f813aaadf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136f2270 0x55f813aa4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f15dbfff640 0 client.15270 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136d1590 0x55f813a9d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 --2- 172.21.15.80:0/129849189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136c93b0 0x55f813a9d3f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 >> 172.21.15.80:0/129849189 conn(0x55f8136e63c0 msgr2=0x55f813a8df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 shutdown_connections 2024-04-25T11:24:06.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 1 -- 172.21.15.80:0/129849189 wait complete. 2024-04-25T11:24:06.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.424+0000 7f160a18a740 20 client.15270 trim_cache size 0 max 16384 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 Processor -- start 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 -- start start 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f813aa9130 con 0x55f8136d1590 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f813aa9800 con 0x55f8136f2270 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f160a18a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f813aa9ed0 con 0x55f8136c93b0 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38176/0 (socket says 172.21.15.80:38176) 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 -- 172.21.15.80:0/3774152758 learned_addr learned my addr 172.21.15.80:0/3774152758 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f15fbfff640 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 -- 172.21.15.80:0/3774152758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 msgr2=0x55f813aa88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 -- 172.21.15.80:0/3774152758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 msgr2=0x55f813aa4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 -- 172.21.15.80:0/3774152758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f813a93110 con 0x55f8136d1590 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.444+0000 7f1600f9d640 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa47b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005eb0 tx=0x7f15f0030450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d3be681da79f86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f15e67fc640 1 -- 172.21.15.80:0/3774152758 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0037040 con 0x55f8136d1590 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f15e67fc640 1 -- 172.21.15.80:0/3774152758 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15f0043070 con 0x55f8136d1590 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f15e67fc640 1 -- 172.21.15.80:0/3774152758 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0003ab0 con 0x55f8136d1590 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f160a18a740 1 -- 172.21.15.80:0/3774152758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 msgr2=0x55f813aa47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f160a18a740 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa47b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005eb0 tx=0x7f15f0030450 comp rx=0 tx=0).stop 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f160a18a740 1 -- 172.21.15.80:0/3774152758 shutdown_connections 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f160a18a740 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa47b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f160a18a740 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f160a18a740 1 --2- 172.21.15.80:0/3774152758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.445+0000 7f160a18a740 1 -- 172.21.15.80:0/3774152758 >> 172.21.15.80:0/3774152758 conn(0x55f8136e63c0 msgr2=0x55f813a9ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 -- 172.21.15.80:0/3774152758 shutdown_connections 2024-04-25T11:24:06.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 -- 172.21.15.80:0/3774152758 wait complete. 2024-04-25T11:24:06.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 -- start start 2024-04-25T11:24:06.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 Processor -- start 2024-04-25T11:24:06.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f813aaac70 con 0x55f8136d1590 2024-04-25T11:24:06.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f813aaa5a0 con 0x55f8136f2270 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f813aab340 con 0x55f8136c93b0 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f160a18a740 10 client.0 _ll_register_callbacks cb 0x7f15f40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f1600f9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f1600f9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38180/0 (socket says 172.21.15.80:38180) 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f1600f9d640 1 -- 172.21.15.80:0/977206654 learned_addr learned my addr 172.21.15.80:0/977206654 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.446+0000 7f15fbfff640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15fbfff640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f1600f9d640 1 -- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 msgr2=0x55f813aa00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f1600f9d640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f1600f9d640 1 -- 172.21.15.80:0/977206654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 msgr2=0x55f813aa3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f1600f9d640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f1600f9d640 1 -- 172.21.15.80:0/977206654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f813aa3b30 con 0x55f8136d1590 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15fbfff640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f1600f9d640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa0630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f15f002c010 tx=0x7f15f00303b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe49c424c0f073d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15dbfff640 1 -- 172.21.15.80:0/977206654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0037040 con 0x55f8136d1590 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15dbfff640 1 -- 172.21.15.80:0/977206654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f15f0055480 con 0x55f8136d1590 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15f0043070 con 0x55f8136d1590 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15dbfff640 1 -- 172.21.15.80:0/977206654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f15f0055680 con 0x55f8136d1590 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f160a18a740 10 client.15276 fetch_fsmap learned FSMap version 21 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f813aa4db0 con 0x55f8136d1590 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15dbfff640 1 -- 172.21.15.80:0/977206654 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15f0043070 con 0x55f8136d1590 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.447+0000 7f15dbfff640 1 -- 172.21.15.80:0/977206654 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f15f00329a0 con 0x55f8136d1590 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 10 client.15276 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 10 client.15276 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 20 client.15276 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f813686280 0x55f813b169d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 4 client.15276 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "status"}) -- 0x55f813a001c0 con 0x55f813686280 2024-04-25T11:24:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f15fbfff640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f813686280 0x55f813b169d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f15dbfff640 10 client.15276 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f15fbfff640 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f813686280 0x55f813b169d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f30ec34ad04def9 server_cookie=609785ef7557af68 in_seq=0 out_seq=0 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f15dbfff640 1 -- 172.21.15.80:0/977206654 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f813a001c0 con 0x55f813686280 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f15dbfff640 10 client.15276 handle_command_reply: tid=0 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 1 client.15276 shutdown 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 msgr2=0x55f813aa0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.448+0000 7f160a18a740 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa0630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f15f002c010 tx=0x7f15f00303b0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 shutdown_connections 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f8136d1590 0x55f813aa0630 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55f813686280 0x55f813b169d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8136f2270 0x55f813aa3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f15dbfff640 0 client.15276 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 --2- 172.21.15.80:0/977206654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8136c93b0 0x55f813aa00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 >> 172.21.15.80:0/977206654 conn(0x55f8136e63c0 msgr2=0x55f813a8e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 shutdown_connections 2024-04-25T11:24:06.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 1 -- 172.21.15.80:0/977206654 wait complete. 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f160a18a740 20 client.15276 trim_cache size 0 max 16384 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24499, 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 110.032642889, 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 21, 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 79, 2024-04-25T11:24:06.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 77, 2024-04-25T11:24:06.450 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 127.15704056200001 2024-04-25T11:24:06.450 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:06.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f15ec0afae0 msgr2=0x7f15ec0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f15ec0afae0 0x7f15ec0b1ff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15f40a48c0 tx=0x7f15f4090040 comp rx=0 tx=0).stop 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc1095b0 msgr2=0x7f15fc1a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc1095b0 0x7f15fc1a3690 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f15f400eb10 tx=0x7f15f400ef10 comp rx=0 tx=0).stop 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 shutdown_connections 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f15ec0afae0 0x7f15ec0b1ff0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15fc1095b0 0x7f15fc1a3690 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc102190 0x7f15fc19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 --2- 172.21.15.80:0/2451731274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15fc101c90 0x7f15fc19c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 >> 172.21.15.80:0/2451731274 conn(0x7f15fc0fd1a0 msgr2=0x7f15fc0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 shutdown_connections 2024-04-25T11:24:06.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.449+0000 7f1601f9f640 1 -- 172.21.15.80:0/2451731274 wait complete. 2024-04-25T11:24:06.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T11:24:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 -- 172.21.15.80:0/3302428158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4108920 msgr2=0x7ff9e410ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 --2- 172.21.15.80:0/3302428158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4108920 0x7ff9e410ad40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009ca0 tx=0x7ff9dc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 -- 172.21.15.80:0/3302428158 shutdown_connections 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 --2- 172.21.15.80:0/3302428158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4108920 0x7ff9e410ad40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 --2- 172.21.15.80:0/3302428158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9e4103c20 0x7ff9e4104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 --2- 172.21.15.80:0/3302428158 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9e41029e0 0x7ff9e41036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 -- 172.21.15.80:0/3302428158 >> 172.21.15.80:0/3302428158 conn(0x7ff9e40fdbd0 msgr2=0x7ff9e4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 -- 172.21.15.80:0/3302428158 shutdown_connections 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 -- 172.21.15.80:0/3302428158 wait complete. 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 Processor -- start 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.570+0000 7ff9ec415640 1 -- start start 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9e41029e0 0x7ff9e4199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4103c20 0x7ff9e4199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9e4108920 0x7ff9e41a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e410e510 con 0x7ff9e4103c20 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e410e390 con 0x7ff9e41029e0 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e410e690 con 0x7ff9e4108920 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4103c20 0x7ff9e4199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4103c20 0x7ff9e4199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38192/0 (socket says 172.21.15.80:38192) 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 -- 172.21.15.80:0/181943694 learned_addr learned my addr 172.21.15.80:0/181943694 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9e4108920 0x7ff9e41a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 -- 172.21.15.80:0/181943694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9e4108920 msgr2=0x7ff9e41a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9e4108920 0x7ff9e41a08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 -- 172.21.15.80:0/181943694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9e41029e0 msgr2=0x7ff9e4199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9e41029e0 0x7ff9e4199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 -- 172.21.15.80:0/181943694 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e41a0f40 con 0x7ff9e4103c20 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4103c20 0x7ff9e4199940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000d950 tx=0x7ff9e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9db7fe640 1 -- 172.21.15.80:0/181943694 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0017070 con 0x7ff9e4103c20 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e41a1230 con 0x7ff9e4103c20 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9db7fe640 1 -- 172.21.15.80:0/181943694 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e0009c30 con 0x7ff9e4103c20 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9db7fe640 1 -- 172.21.15.80:0/181943694 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000f620 con 0x7ff9e4103c20 2024-04-25T11:24:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.571+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e41a1780 con 0x7ff9e4103c20 2024-04-25T11:24:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9db7fe640 1 -- 172.21.15.80:0/181943694 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7ff9e0010460 con 0x7ff9e4103c20 2024-04-25T11:24:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 Processor -- start 2024-04-25T11:24:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 -- start start 2024-04-25T11:24:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44ce1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44ce1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44ce8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aa44c44740 con 0x55aa449153b0 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa44be03a0 con 0x55aa4491d590 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.574+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa44c40700 con 0x55aa4493e270 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9db7fe640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9d00afaf0 0x7ff9d00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44ce1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44ce1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38206/0 (socket says 172.21.15.80:38206) 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/1152125519 learned_addr learned my addr 172.21.15.80:0/1152125519 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9d00afaf0 0x7ff9d00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44ce8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44ce1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/1152125519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 msgr2=0x55aa44ce1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44ce1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/1152125519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 msgr2=0x55aa44ce8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44ce8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9db7fe640 1 -- 172.21.15.80:0/181943694 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff9e00de950 con 0x7ff9e4103c20 2024-04-25T11:24:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/1152125519 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa44bfc750 con 0x55aa449153b0 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44ce8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44ce1b00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400a9c0 tx=0x7ff9d400ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce094bac50a221c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9d00afaf0 0x7ff9d00b2000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55aa44ce2750 tx=0x7ff9dc031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9d8bfe640 1 -- 172.21.15.80:0/1152125519 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400cde0 con 0x55aa449153b0 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9d8bfe640 1 -- 172.21.15.80:0/1152125519 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9d40054d0 con 0x55aa449153b0 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.575+0000 7ff9d8bfe640 1 -- 172.21.15.80:0/1152125519 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400f690 con 0x55aa449153b0 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 -- 172.21.15.80:0/1152125519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 msgr2=0x55aa44ce1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44ce1b00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400a9c0 tx=0x7ff9d400ae80 comp rx=0 tx=0).stop 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 -- 172.21.15.80:0/1152125519 shutdown_connections 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44ce1b00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44ce8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/1152125519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44ce1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 -- 172.21.15.80:0/1152125519 >> 172.21.15.80:0/1152125519 conn(0x55aa449323c0 msgr2=0x55aa44cdad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 -- 172.21.15.80:0/1152125519 shutdown_connections 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.576+0000 7ff9f33a6740 1 -- 172.21.15.80:0/1152125519 wait complete. 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 -- start start 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 Processor -- start 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa449153b0 0x55aa44ceb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4491d590 0x55aa44ceba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4493e270 0x55aa44cf2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aa44ce9450 con 0x55aa4491d590 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa44bcbfe0 con 0x55aa4493e270 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa44ce95d0 con 0x55aa449153b0 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9f33a6740 10 client.0 _ll_register_callbacks cb 0x55aa44be2150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4491d590 0x55aa44ceba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4491d590 0x55aa44ceba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38214/0 (socket says 172.21.15.80:38214) 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 -- 172.21.15.80:0/2393985879 learned_addr learned my addr 172.21.15.80:0/2393985879 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa449153b0 0x55aa44ceb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4493e270 0x55aa44cf2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 -- 172.21.15.80:0/2393985879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa449153b0 msgr2=0x55aa44ceb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa449153b0 0x55aa44ceb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 -- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4493e270 msgr2=0x55aa44cf2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4493e270 0x55aa44cf2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9e99b0640 1 -- 172.21.15.80:0/2393985879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa449562d0 con 0x55aa4491d590 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.577+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4493e270 0x55aa44cf2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4491d590 0x55aa44ceba10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00dc490 tx=0x7ff9e0020e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2789a17adb6b08c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9cdffb640 1 -- 172.21.15.80:0/2393985879 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0020040 con 0x55aa4491d590 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9cdffb640 1 -- 172.21.15.80:0/2393985879 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff9e00a3410 con 0x55aa4491d590 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9d40054d0 con 0x55aa4491d590 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9cdffb640 1 -- 172.21.15.80:0/2393985879 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff9e00a6930 con 0x55aa4491d590 2024-04-25T11:24:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 10 client.15288 fetch_fsmap learned FSMap version 21 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aa44a206b0 con 0x55aa4491d590 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9cdffb640 1 -- 172.21.15.80:0/2393985879 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9d40054d0 con 0x55aa4491d590 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9cdffb640 1 -- 172.21.15.80:0/2393985879 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff9e00a2790 con 0x55aa4491d590 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 10 client.15288 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 10 client.15288 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 20 client.15288 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448fce40 0x55aa44cf9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 4 client.15288 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.578+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa44c52350 con 0x55aa448fce40 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.579+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448fce40 0x55aa44cf9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.579+0000 7ff9cdffb640 10 client.15288 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.579+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448fce40 0x55aa44cf9130 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafcaa9358559621 server_cookie=1bc2362567d93577 in_seq=0 out_seq=0 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9cdffb640 1 -- 172.21.15.80:0/2393985879 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa44c52350 con 0x55aa448fce40 2024-04-25T11:24:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9cdffb640 10 client.15288 handle_command_reply: tid=0 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 client.15288 shutdown 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4491d590 msgr2=0x55aa44ceba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4491d590 0x55aa44ceba10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00dc490 tx=0x7ff9e0020e80 comp rx=0 tx=0).stop 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 shutdown_connections 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448fce40 0x55aa44cf9130 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4491d590 0x55aa44ceba10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9cdffb640 0 client.15288 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4493e270 0x55aa44cf2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/2393985879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa449153b0 0x55aa44ceb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 >> 172.21.15.80:0/2393985879 conn(0x55aa449323c0 msgr2=0x55aa44cd9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 shutdown_connections 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 1 -- 172.21.15.80:0/2393985879 wait complete. 2024-04-25T11:24:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.580+0000 7ff9f33a6740 20 client.15288 trim_cache size 0 max 16384 2024-04-25T11:24:06.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 Processor -- start 2024-04-25T11:24:06.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 -- start start 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa449153b0 0x55aa44cea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4491d590 0x55aa44cf2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4493e270 0x55aa44ceb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aa44cf7470 con 0x55aa4493e270 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa44cf7b40 con 0x55aa449153b0 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa44cf8210 con 0x55aa4491d590 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9ea9b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4493e270 0x55aa44ceb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9ea9b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4493e270 0x55aa44ceb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38222/0 (socket says 172.21.15.80:38222) 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9ea9b2640 1 -- 172.21.15.80:0/3069189986 learned_addr learned my addr 172.21.15.80:0/3069189986 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9ea9b2640 1 -- 172.21.15.80:0/3069189986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4491d590 msgr2=0x55aa44cf2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa449153b0 0x55aa44cea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4491d590 0x55aa44cf2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.598+0000 7ff9ea9b2640 1 -- 172.21.15.80:0/3069189986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa449153b0 msgr2=0x55aa44cea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa449153b0 0x55aa44cea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9ea9b2640 1 -- 172.21.15.80:0/3069189986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa44ce49a0 con 0x55aa4493e270 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa449153b0 0x55aa44cea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4493e270 0x55aa44ceb0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc035000 tx=0x7ff9dc040070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765acf842e728b73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9cffff640 1 -- 172.21.15.80:0/3069189986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc003df0 con 0x55aa4493e270 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9cffff640 1 -- 172.21.15.80:0/3069189986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9dc036040 con 0x55aa4493e270 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9cffff640 1 -- 172.21.15.80:0/3069189986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc02fae0 con 0x55aa4493e270 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9f33a6740 1 -- 172.21.15.80:0/3069189986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4493e270 msgr2=0x55aa44ceb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.599+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4493e270 0x55aa44ceb0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc035000 tx=0x7ff9dc040070 comp rx=0 tx=0).stop 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- 172.21.15.80:0/3069189986 shutdown_connections 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa4493e270 0x55aa44ceb0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4491d590 0x55aa44cf2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/3069189986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa449153b0 0x55aa44cea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- 172.21.15.80:0/3069189986 >> 172.21.15.80:0/3069189986 conn(0x55aa449323c0 msgr2=0x55aa44ce9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- 172.21.15.80:0/3069189986 shutdown_connections 2024-04-25T11:24:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- 172.21.15.80:0/3069189986 wait complete. 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- start start 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 Processor -- start 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44cefdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44cf0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44cf1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aa44cf8fb0 con 0x55aa449153b0 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa44cf88e0 con 0x55aa4491d590 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa44cf9680 con 0x55aa4493e270 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9f33a6740 10 client.0 _ll_register_callbacks cb 0x7ff9e000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44cefdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44cefdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38224/0 (socket says 172.21.15.80:38224) 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/390918591 learned_addr learned my addr 172.21.15.80:0/390918591 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea9b2640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44cf1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/390918591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 msgr2=0x55aa44cf1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44cf0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44cf1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 msgr2=0x55aa44cf0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44cf0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9ea1b1640 1 -- 172.21.15.80:0/390918591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa44ce6320 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.600+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44cf0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9ea1b1640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44cefdc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4004700 tx=0x7ff9d400a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b928921a48809647 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9cdffb640 1 -- 172.21.15.80:0/390918591 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4026430 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9cdffb640 1 -- 172.21.15.80:0/390918591 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff9d40265d0 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9dc036040 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9cdffb640 1 -- 172.21.15.80:0/390918591 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff9d40267d0 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 10 client.15294 fetch_fsmap learned FSMap version 21 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aa44cf2910 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9cdffb640 1 -- 172.21.15.80:0/390918591 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9dc036040 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9cdffb640 1 -- 172.21.15.80:0/390918591 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff9d400fce0 con 0x55aa449153b0 2024-04-25T11:24:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 10 client.15294 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 10 client.15294 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 20 client.15294 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448d2280 0x55aa44d652a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 4 client.15294 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.601+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "status"}) -- 0x55aa44c4c1c0 con 0x55aa448d2280 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448d2280 0x55aa44d652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9cdffb640 10 client.15294 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9e99b0640 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448d2280 0x55aa44d652a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=995150f06deedfd4 server_cookie=e24ebf77b6c2c34 in_seq=0 out_seq=0 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9cdffb640 1 -- 172.21.15.80:0/390918591 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aa44c4c1c0 con 0x55aa448d2280 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9cdffb640 10 client.15294 handle_command_reply: tid=0 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 client.15294 shutdown 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 msgr2=0x55aa44cefdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44cefdc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4004700 tx=0x7ff9d400a470 comp rx=0 tx=0).stop 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 shutdown_connections 2024-04-25T11:24:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa448d2280 0x55aa44d652a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa4493e270 0x55aa44cf1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9cdffb640 0 client.15294 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa4491d590 0x55aa44cf0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 --2- 172.21.15.80:0/390918591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa449153b0 0x55aa44cefdc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 >> 172.21.15.80:0/390918591 conn(0x55aa449323c0 msgr2=0x55aa44ceb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 shutdown_connections 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 1 -- 172.21.15.80:0/390918591 wait complete. 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.602+0000 7ff9f33a6740 20 client.15294 trim_cache size 0 max 16384 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "bba277ec-02f4-11ef-bc93-c7b262605968", 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-25T11:24:06.603 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24521, 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 112.22356759500001, 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 21, 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 79, 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 77, 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 118.754363774 2024-04-25T11:24:06.604 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9d00afaf0 msgr2=0x7ff9d00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9d00afaf0 0x7ff9d00b2000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55aa44ce2750 tx=0x7ff9dc031af0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4103c20 msgr2=0x7ff9e4199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4103c20 0x7ff9e4199940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000d950 tx=0x7ff9e000de10 comp rx=0 tx=0).stop 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 shutdown_connections 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff9d00afaf0 0x7ff9d00b2000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e4103c20 0x7ff9e4199940 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9e4108920 0x7ff9e41a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 --2- 172.21.15.80:0/181943694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9e41029e0 0x7ff9e4199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 >> 172.21.15.80:0/181943694 conn(0x7ff9e40fdbd0 msgr2=0x7ff9e4104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 shutdown_connections 2024-04-25T11:24:06.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.603+0000 7ff9ec415640 1 -- 172.21.15.80:0/181943694 wait complete. 2024-04-25T11:24:06.609 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T11:24:06.617 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T11:24:06.618 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T11:24:06.618 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T11:24:06.618 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-25T11:24:06.619 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T11:24:06.619 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:24:06.619 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-25T11:24:06.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:06 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2548355222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:06.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:06 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1873729730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:06.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:06 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2963813134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:06.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 -- 172.21.15.80:0/1805108074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981022a0 msgr2=0x7fc79810bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 --2- 172.21.15.80:0/1805108074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981022a0 0x7fc79810bd00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc790009ca0 tx=0x7fc79002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 -- 172.21.15.80:0/1805108074 shutdown_connections 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 --2- 172.21.15.80:0/1805108074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981022a0 0x7fc79810bd00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 --2- 172.21.15.80:0/1805108074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7981017a0 0x7fc798101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 --2- 172.21.15.80:0/1805108074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7981050f0 0x7fc798105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 -- 172.21.15.80:0/1805108074 >> 172.21.15.80:0/1805108074 conn(0x7fc7980fd3c0 msgr2=0x7fc7980ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 -- 172.21.15.80:0/1805108074 shutdown_connections 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.732+0000 7fc79fac6640 1 -- 172.21.15.80:0/1805108074 wait complete. 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 Processor -- start 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 -- start start 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7981017a0 0x7fc79819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7981022a0 0x7fc79819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981050f0 0x7fc7981a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc79810f6d0 con 0x7fc7981050f0 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc79810f550 con 0x7fc7981022a0 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79fac6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc79810f850 con 0x7fc7981017a0 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79e063640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981050f0 0x7fc7981a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79e063640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981050f0 0x7fc7981a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38250/0 (socket says 172.21.15.80:38250) 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79e063640 1 -- 172.21.15.80:0/2878519811 learned_addr learned my addr 172.21.15.80:0/2878519811 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79d061640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7981022a0 0x7fc79819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.733+0000 7fc79d862640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7981017a0 0x7fc79819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79e063640 1 -- 172.21.15.80:0/2878519811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7981017a0 msgr2=0x7fc79819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79e063640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7981017a0 0x7fc79819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79e063640 1 -- 172.21.15.80:0/2878519811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7981022a0 msgr2=0x7fc79819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79e063640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7981022a0 0x7fc79819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:06.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79e063640 1 -- 172.21.15.80:0/2878519811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7981a1cc0 con 0x7fc7981050f0 2024-04-25T11:24:06.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79e063640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981050f0 0x7fc7981a1700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc7900097b0 tx=0x7fc790003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc78effd640 1 -- 172.21.15.80:0/2878519811 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790004240 con 0x7fc7981050f0 2024-04-25T11:24:06.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc78effd640 1 -- 172.21.15.80:0/2878519811 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7900317c0 con 0x7fc7981050f0 2024-04-25T11:24:06.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc78effd640 1 -- 172.21.15.80:0/2878519811 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79002fd70 con 0x7fc7981050f0 2024-04-25T11:24:06.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7981a1f50 con 0x7fc7981050f0 2024-04-25T11:24:06.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.734+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7981a23e0 con 0x7fc7981050f0 2024-04-25T11:24:06.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.735+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79810aa90 con 0x7fc7981050f0 2024-04-25T11:24:06.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.736+0000 7fc78effd640 1 -- 172.21.15.80:0/2878519811 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fc7900043e0 con 0x7fc7981050f0 2024-04-25T11:24:06.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.737+0000 7fc78effd640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc7840afae0 0x7fc7840b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:06.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.737+0000 7fc79d862640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc7840afae0 0x7fc7840b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:06.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.737+0000 7fc78effd640 1 -- 172.21.15.80:0/2878519811 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fc790100880 con 0x7fc7981050f0 2024-04-25T11:24:06.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.737+0000 7fc79d862640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc7840afae0 0x7fc7840b1ff0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc7940058c0 tx=0x7fc794005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:06.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.741+0000 7fc78effd640 1 -- 172.21.15.80:0/2878519811 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc7900c9450 con 0x7fc7981050f0 2024-04-25T11:24:06.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:06 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2548355222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:06.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:06 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1873729730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:06.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:06 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2963813134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:06.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:06 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2548355222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:06.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:06 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1873729730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:06.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:06 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2963813134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:06.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:06.965+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fc798050740 con 0x7fc7981050f0 2024-04-25T11:24:07.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.444+0000 7fc78effd640 1 -- 172.21.15.80:0/2878519811 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fc7900c8d50 con 0x7fc7981050f0 2024-04-25T11:24:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc7840afae0 msgr2=0x7fc7840b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc7840afae0 0x7fc7840b1ff0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc7940058c0 tx=0x7fc794005850 comp rx=0 tx=0).stop 2024-04-25T11:24:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981050f0 msgr2=0x7fc7981a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981050f0 0x7fc7981a1700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc7900097b0 tx=0x7fc790003c20 comp rx=0 tx=0).stop 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 shutdown_connections 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc7840afae0 0x7fc7840b1ff0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7981050f0 0x7fc7981a1700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7981022a0 0x7fc79819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 --2- 172.21.15.80:0/2878519811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7981017a0 0x7fc79819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 >> 172.21.15.80:0/2878519811 conn(0x7fc7980fd3c0 msgr2=0x7fc798107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 shutdown_connections 2024-04-25T11:24:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:07.447+0000 7fc79fac6640 1 -- 172.21.15.80:0/2878519811 wait complete. 2024-04-25T11:24:07.459 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T11:24:07.482 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T11:24:07.482 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-25T11:24:07.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:07.482 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T11:24:07.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:07.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T11:24:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-04-25T11:24:07.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:24:07.565 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-04-25T11:24:07.565 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T11:24:07.565 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:07.565 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T11:24:07.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2878519811' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T11:24:07.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-mon[32659]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:24:07.690 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: ignoring --setuser ceph since I am not root 2024-04-25T11:24:07.691 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: ignoring --setgroup ceph since I am not root 2024-04-25T11:24:07.691 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-mgr[34517]: -- 172.21.15.196:0/1916285929 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556dea2745a0 con 0x556deeffe480 2024-04-25T11:24:07.691 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:07.652+0000 7fcfaf69c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:24:07.743 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2878519811' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T11:24:07.744 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-mon[32440]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:24:07.744 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: ignoring --setuser ceph since I am not root 2024-04-25T11:24:07.744 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: ignoring --setgroup ceph since I am not root 2024-04-25T11:24:07.744 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-mgr[33828]: -- 172.21.15.82:0/4138458087 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612540985a0 con 0x561258e22900 2024-04-25T11:24:07.744 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:07.647+0000 7f726a854200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:24:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:24:07.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:07 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2878519811' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T11:24:07.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:07 smithi080 ceph-mon[29126]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T11:24:07.859 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: ignoring --setuser ceph since I am not root 2024-04-25T11:24:07.859 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: ignoring --setgroup ceph since I am not root 2024-04-25T11:24:07.859 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:07.660+0000 7fc56514f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T11:24:07.859 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:07.864+0000 7fc56514f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:24:08.127 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:07.974+0000 7fc56514f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:24:08.190 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:07.840+0000 7fcfaf69c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:24:08.190 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:07.944+0000 7fcfaf69c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:24:08.237 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:07.833+0000 7f726a854200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:24:08.237 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:07.935+0000 7f726a854200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T11:24:08.237 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:08.243+0000 7f726a854200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:24:08.378 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:08.297+0000 7fc56514f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:24:08.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:08 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2878519811' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T11:24:08.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:08 smithi082 ceph-mon[32440]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-25T11:24:08.494 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:08.329+0000 7f726a854200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:24:08.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:08 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2878519811' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T11:24:08.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:08 smithi196 ceph-mon[32659]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-25T11:24:08.690 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:08.255+0000 7fcfaf69c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T11:24:08.690 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:08.341+0000 7fcfaf69c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:24:08.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:08 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2878519811' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T11:24:08.878 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:08 smithi080 ceph-mon[29126]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-25T11:24:08.879 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:08.384+0000 7fc56514f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T11:24:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 -- 172.21.15.80:0/1226866878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88105330 msgr2=0x7efd88105740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 --2- 172.21.15.80:0/1226866878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88105330 0x7efd88105740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009990 tx=0x7efd7c009ca0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 -- 172.21.15.80:0/1226866878 shutdown_connections 2024-04-25T11:24:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 --2- 172.21.15.80:0/1226866878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd8810e7a0 0x7efd88110c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 --2- 172.21.15.80:0/1226866878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd88105330 0x7efd88105740 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 --2- 172.21.15.80:0/1226866878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd88105c80 0x7efd8810e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 -- 172.21.15.80:0/1226866878 >> 172.21.15.80:0/1226866878 conn(0x7efd880fec90 msgr2=0x7efd881010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.680+0000 7efd8d19d700 1 -- 172.21.15.80:0/1226866878 shutdown_connections 2024-04-25T11:24:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.681+0000 7efd8d19d700 1 -- 172.21.15.80:0/1226866878 wait complete. 2024-04-25T11:24:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 Processor -- start 2024-04-25T11:24:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 -- start start 2024-04-25T11:24:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88105330 0x7efd881a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd88105c80 0x7efd881a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8810e7a0 0x7efd8819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efd88114320 con 0x7efd8810e7a0 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd881141a0 con 0x7efd88105330 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8d19d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efd881144a0 con 0x7efd88105c80 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd86d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88105330 0x7efd881a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd86d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88105330 0x7efd881a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:45584/0 (socket says 172.21.15.80:45584) 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd86d9d700 1 -- 172.21.15.80:0/183720021 learned_addr learned my addr 172.21.15.80:0/183720021 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8659c700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd88105c80 0x7efd881a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.682+0000 7efd8759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8810e7a0 0x7efd8819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8659c700 1 -- 172.21.15.80:0/183720021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88105330 msgr2=0x7efd881a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8659c700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88105330 0x7efd881a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8659c700 1 -- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8810e7a0 msgr2=0x7efd8819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8659c700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8810e7a0 0x7efd8819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8659c700 1 -- 172.21.15.80:0/183720021 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8819b150 con 0x7efd88105c80 2024-04-25T11:24:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8659c700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd88105c80 0x7efd881a0dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e9f0 tx=0x7efd7800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd6ffff700 1 -- 172.21.15.80:0/183720021 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78004220 con 0x7efd88105c80 2024-04-25T11:24:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8819b440 con 0x7efd88105c80 2024-04-25T11:24:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd6ffff700 1 -- 172.21.15.80:0/183720021 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd780043c0 con 0x7efd88105c80 2024-04-25T11:24:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd6ffff700 1 -- 172.21.15.80:0/183720021 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78005020 con 0x7efd88105c80 2024-04-25T11:24:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.683+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd881a7710 con 0x7efd88105c80 2024-04-25T11:24:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.684+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd88051190 con 0x7efd88105c80 2024-04-25T11:24:09.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.686+0000 7efd6ffff700 1 -- 172.21.15.80:0/183720021 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7efd78004830 con 0x7efd88105c80 2024-04-25T11:24:09.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.686+0000 7efd6ffff700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 0x7efd700b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:09.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.686+0000 7efd86d9d700 1 -- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 msgr2=0x7efd700b20e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:09.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.686+0000 7efd6ffff700 1 -- 172.21.15.80:0/183720021 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7efd780dec00 con 0x7efd88105c80 2024-04-25T11:24:09.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.686+0000 7efd86d9d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 0x7efd700b20e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.691+0000 7efd6ffff700 1 -- 172.21.15.80:0/183720021 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efd780a77d0 con 0x7efd88105c80 2024-04-25T11:24:09.841 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:09.506+0000 7f726a854200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:24:09.842 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:09.677+0000 7f726a854200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:24:09.842 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:09.848+0000 7f726a854200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:24:09.876 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:09.533+0000 7fcfaf69c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:24:09.876 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:09.708+0000 7fcfaf69c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:24:09.876 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:09.882+0000 7fcfaf69c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:24:09.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:09.601+0000 7fc56514f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T11:24:09.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:09.784+0000 7fc56514f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T11:24:09.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.887+0000 7efd86d9d700 1 -- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 msgr2=0x7efd700b20e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:09.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.887+0000 7efd86d9d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 0x7efd700b20e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T11:24:09.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.937+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd8819bfd0 con 0x7efd88105c80 2024-04-25T11:24:09.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.938+0000 7efd6ffff700 1 -- 172.21.15.80:0/183720021 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7efd780a70d0 con 0x7efd88105c80 2024-04-25T11:24:09.932 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 msgr2=0x7efd700b20e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 0x7efd700b20e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd88105c80 msgr2=0x7efd881a0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd88105c80 0x7efd881a0dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e9f0 tx=0x7efd7800ed00 comp rx=0 tx=0).stop 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 shutdown_connections 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7efd700afbd0 0x7efd700b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd8810e7a0 0x7efd8819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88105330 0x7efd881a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 --2- 172.21.15.80:0/183720021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd88105c80 0x7efd881a0dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 >> 172.21.15.80:0/183720021 conn(0x7efd880fec90 msgr2=0x7efd88100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 shutdown_connections 2024-04-25T11:24:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:09.940+0000 7efd8d19d700 1 -- 172.21.15.80:0/183720021 wait complete. 2024-04-25T11:24:10.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:09 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/183720021' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T11:24:10.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:09 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/183720021' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T11:24:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:09 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/183720021' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T11:24:10.259 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:09.960+0000 7fc56514f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T11:24:10.428 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:10.140+0000 7f726a854200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:24:10.429 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:10.234+0000 7f726a854200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:24:10.429 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:10.434+0000 7f726a854200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:24:10.440 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:10.177+0000 7fcfaf69c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:24:10.440 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:10.272+0000 7fcfaf69c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:24:10.562 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:10.264+0000 7fc56514f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T11:24:10.562 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:10.360+0000 7fc56514f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T11:24:10.562 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:10.567+0000 7fc56514f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:24:10.661 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T11:24:10.661 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T11:24:10.661 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-25T11:24:10.661 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T11:24:10.661 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:10.661 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T11:24:10.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T11:24:10.662 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T11:24:10.662 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T11:24:10.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:10.662 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-25T11:24:10.677 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T11:24:10.677 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T11:24:10.677 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T11:24:10.677 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T11:24:10.678 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42061sec preferred_lft 42061sec 2024-04-25T11:24:10.679 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::dc2d:475a:513b:1454/64 scope link noprefixroute 2024-04-25T11:24:10.679 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-25T11:24:10.679 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T11:24:10.679 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T11:24:10.679 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T11:24:10.679 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-04-25T11:24:10.679 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-04-25T11:24:10.680 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-04-25T11:24:10.680 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T11:24:10.680 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T11:24:10.743 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:10.630+0000 7f726a854200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:24:10.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T11:24:10.823 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:10.775+0000 7fc56514f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:24:10.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:10.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:10.866 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T11:24:10.890 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-25T11:24:10.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:10.892 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-25T11:24:10.939 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:10.477+0000 7fcfaf69c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T11:24:10.940 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:10.677+0000 7fcfaf69c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T11:24:10.966 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-25T11:24:10.966 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T11:24:10.966 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T11:24:10.967 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T11:24:10.967 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T11:24:10.969 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T11:24:10.969 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T11:24:10.970 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T11:24:10.970 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T11:24:10.970 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T11:24:10.970 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T11:24:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T11:24:11.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:11.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:11.264 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T11:24:11.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:11.280 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-25T11:24:11.336 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T11:24:11.336 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T11:24:11.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T11:24:11.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T11:24:11.336 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T11:24:11.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T11:24:11.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:11.455 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T11:24:11.455 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T11:24:11.455 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T11:24:11.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T11:24:11.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T11:24:11.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T11:24:11.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T11:24:11.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T11:24:11.456 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T11:24:11.493 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:11.230+0000 7f726a854200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:24:11.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T11:24:11.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:11.581 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T11:24:11.581 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-25T11:24:11.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-25T11:24:11.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T11:24:11.581 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-25T11:24:11.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T11:24:11.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:11.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T11:24:11.657 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:11.671 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T11:24:11.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T11:24:11.671 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:11.690 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:11.278+0000 7fcfaf69c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:24:11.849 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-25T11:24:11.849 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-25T11:24:11.849 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/38ab8361-f782-43e4-9220-6761784a9597 2024-04-25T11:24:11.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:11.850 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/38ab8361-f782-43e4-9220-6761784a9597 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-25T11:24:11.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:11.433+0000 7fc56514f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T11:24:11.937 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-25T11:24:11.937 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-25T11:24:11.937 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2024-04-25T11:24:11.950 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:11.657+0000 7f726a854200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:24:11.950 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:11.753+0000 7f726a854200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:24:11.950 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:11.956+0000 7f726a854200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:24:12.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:11.709+0000 7fcfaf69c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:24:12.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:11.807+0000 7fcfaf69c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:24:12.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:12.011+0000 7fcfaf69c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:24:12.047 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-25T11:24:12.047 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-25T11:24:12.047 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.82:3300,172.21.15.196:3300" 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.80:3300,172.21.15.82:3300,172.21.15.196:3300:/volumes/qa/sv_1/38ab8361-f782-43e4-9220-6761784a9597 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=bba277ec-02f4-11ef-bc93-c7b262605968" will pass to kernel 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T11:24:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T11:24:12.050 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T11:24:12.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:12.050 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:12.075 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T11:24:12.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T11:24:12.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:12.173 INFO:teuthology.orchestra.run.smithi080.stdout:client24973 2024-04-25T11:24:12.173 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:24:12.173 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T11:24:12.189 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T11:24:12.240 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:11.914+0000 7fc56514f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T11:24:12.241 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:12.026+0000 7fc56514f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T11:24:12.241 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:12.247+0000 7fc56514f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T11:24:12.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T11:24:12.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:12.288 INFO:teuthology.orchestra.run.smithi080.stdout:client24973 2024-04-25T11:24:12.288 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T11:24:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T11:24:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:12.386 INFO:teuthology.orchestra.run.smithi080.stdout:client24973 2024-04-25T11:24:12.386 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/bba277ec-02f4-11ef-bc93-c7b262605968.client24973/status') 2024-04-25T11:24:12.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T11:24:12.446 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.24973 (3)172.21.15.80:0/1346229390 2024-04-25T11:24:12.447 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-04-25T11:24:12.447 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-04-25T11:24:12.447 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-04-25T11:24:12.447 INFO:teuthology.orchestra.run.smithi080.stderr:71 bytes copied, 2.3225e-05 s, 3.1 MB/s 2024-04-25T11:24:12.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T11:24:12.454 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T11:24:12.465 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T11:24:12.465 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:24:12.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 -- 172.21.15.80:0/983505204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8109a60 msgr2=0x7f78d810be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 --2- 172.21.15.80:0/983505204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8109a60 0x7f78d810be80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009ca0 tx=0x7f78d002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 -- 172.21.15.80:0/983505204 shutdown_connections 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 --2- 172.21.15.80:0/983505204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8109a60 0x7f78d810be80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 --2- 172.21.15.80:0/983505204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d8107100 0x7f78d8109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 --2- 172.21.15.80:0/983505204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d8101f50 0x7f78d8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 -- 172.21.15.80:0/983505204 >> 172.21.15.80:0/983505204 conn(0x7f78d80fd390 msgr2=0x7f78d80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 -- 172.21.15.80:0/983505204 shutdown_connections 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.584+0000 7f78dd49f640 1 -- 172.21.15.80:0/983505204 wait complete. 2024-04-25T11:24:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 Processor -- start 2024-04-25T11:24:12.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 -- start start 2024-04-25T11:24:12.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8101f50 0x7f78d819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d8107100 0x7f78d819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d8109a60 0x7f78d81a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f78d810f700 con 0x7f78d8101f50 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f78d810f580 con 0x7f78d8109a60 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78dd49f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f78d810f880 con 0x7f78d8107100 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8101f50 0x7f78d819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8101f50 0x7f78d819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38316/0 (socket says 172.21.15.80:38316) 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78d6ffd640 1 -- 172.21.15.80:0/3554369573 learned_addr learned my addr 172.21.15.80:0/3554369573 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.585+0000 7f78d77fe640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d8109a60 0x7f78d81a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78d67fc640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d8107100 0x7f78d819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78d6ffd640 1 -- 172.21.15.80:0/3554369573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d8107100 msgr2=0x7f78d819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78d6ffd640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d8107100 0x7f78d819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78d6ffd640 1 -- 172.21.15.80:0/3554369573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d8109a60 msgr2=0x7f78d81a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:12.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78d6ffd640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d8109a60 0x7f78d81a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78d6ffd640 1 -- 172.21.15.80:0/3554369573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d81a1db0 con 0x7f78d8101f50 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78d6ffd640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8101f50 0x7f78d819a270 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00e9c0 tx=0x7f78cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78bffff640 1 -- 172.21.15.80:0/3554369573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00cd80 con 0x7f78d8101f50 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d81a20a0 con 0x7f78d8101f50 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78bffff640 1 -- 172.21.15.80:0/3554369573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78cc0054d0 con 0x7f78d8101f50 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78bffff640 1 -- 172.21.15.80:0/3554369573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc010430 con 0x7f78d8101f50 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.586+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d81a2640 con 0x7f78d8101f50 2024-04-25T11:24:12.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.587+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d80feeb0 con 0x7f78d8101f50 2024-04-25T11:24:12.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.589+0000 7f78bffff640 1 -- 172.21.15.80:0/3554369573 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7f78cc004fb0 con 0x7f78d8101f50 2024-04-25T11:24:12.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.590+0000 7f78bffff640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 0x7f78c00b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:12.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.590+0000 7f78d67fc640 1 -- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 msgr2=0x7f78c00b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:12.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.590+0000 7f78bffff640 1 -- 172.21.15.80:0/3554369573 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7f78cc0df000 con 0x7f78d8101f50 2024-04-25T11:24:12.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.590+0000 7f78d67fc640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 0x7f78c00b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:12.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.595+0000 7f78bffff640 1 -- 172.21.15.80:0/3554369573 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f78cc0a7c70 con 0x7f78d8101f50 2024-04-25T11:24:12.743 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:12.476+0000 7f726a854200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:24:12.743 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:12.571+0000 7f726a854200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:24:12.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.791+0000 7f78d67fc640 1 -- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 msgr2=0x7f78c00b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:12.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.791+0000 7f78d67fc640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 0x7f78c00b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T11:24:12.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.816+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f78d802db50 con 0x7f78d8101f50 2024-04-25T11:24:12.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.868+0000 7f78bffff640 1 -- 172.21.15.80:0/3554369573 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7f78cc0a7570 con 0x7f78d8101f50 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.870+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 msgr2=0x7f78c00b2040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.870+0000 7f78dd49f640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 0x7f78c00b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.870+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8101f50 msgr2=0x7f78d819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.870+0000 7f78dd49f640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8101f50 0x7f78d819a270 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00e9c0 tx=0x7f78cc00ee80 comp rx=0 tx=0).stop 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 shutdown_connections 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7f78c00afb30 0x7f78c00b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d8109a60 0x7f78d81a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d8107100 0x7f78d819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 --2- 172.21.15.80:0/3554369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78d8101f50 0x7f78d819a270 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 >> 172.21.15.80:0/3554369573 conn(0x7f78d80fd390 msgr2=0x7f78d81055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:12.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 shutdown_connections 2024-04-25T11:24:12.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:12.871+0000 7f78dd49f640 1 -- 172.21.15.80:0/3554369573 wait complete. 2024-04-25T11:24:12.868 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:12.544+0000 7fcfaf69c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:24:12.868 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:12.640+0000 7fcfaf69c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:24:12.877 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-25T11:24:12.889 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-04-25T11:24:12.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 -- 172.21.15.80:0/1260749006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0102f30 msgr2=0x7ff0e0103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 --2- 172.21.15.80:0/1260749006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0102f30 0x7ff0e0103340 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009900 tx=0x7ff0d002a410 comp rx=0 tx=0).stop 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 -- 172.21.15.80:0/1260749006 shutdown_connections 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 --2- 172.21.15.80:0/1260749006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0104450 0x7ff0e010ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 --2- 172.21.15.80:0/1260749006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e0103910 0x7ff0e0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 --2- 172.21.15.80:0/1260749006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0102f30 0x7ff0e0103340 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 -- 172.21.15.80:0/1260749006 >> 172.21.15.80:0/1260749006 conn(0x7ff0e00fd330 msgr2=0x7ff0e00ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 -- 172.21.15.80:0/1260749006 shutdown_connections 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.016+0000 7ff0e5534640 1 -- 172.21.15.80:0/1260749006 wait complete. 2024-04-25T11:24:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 Processor -- start 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 -- start start 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0102f30 0x7ff0e01021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e0103910 0x7ff0e01a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0104450 0x7ff0e01a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e010e4c0 con 0x7ff0e0104450 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e010e340 con 0x7ff0e0103910 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.017+0000 7ff0e5534640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e010e640 con 0x7ff0e0102f30 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0104450 0x7ff0e01a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0deffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0102f30 0x7ff0e01021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0104450 0x7ff0e01a3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38324/0 (socket says 172.21.15.80:38324) 2024-04-25T11:24:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0df7fe640 1 -- 172.21.15.80:0/3428373085 learned_addr learned my addr 172.21.15.80:0/3428373085 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0de7fc640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e0103910 0x7ff0e01a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0deffd640 1 -- 172.21.15.80:0/3428373085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e0103910 msgr2=0x7ff0e01a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0deffd640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e0103910 0x7ff0e01a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0deffd640 1 -- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0104450 msgr2=0x7ff0e01a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0deffd640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0104450 0x7ff0e01a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0deffd640 1 -- 172.21.15.80:0/3428373085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e01a3f60 con 0x7ff0e0102f30 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0deffd640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0102f30 0x7ff0e01021d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0d002a930 tx=0x7ff0d0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0c7fff640 1 -- 172.21.15.80:0/3428373085 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d003f070 con 0x7ff0e0102f30 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e01a41f0 con 0x7ff0e0102f30 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0c7fff640 1 -- 172.21.15.80:0/3428373085 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0d0031910 con 0x7ff0e0102f30 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e01a4700 con 0x7ff0e0102f30 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.018+0000 7ff0c7fff640 1 -- 172.21.15.80:0/3428373085 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0048060 con 0x7ff0e0102f30 2024-04-25T11:24:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.019+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e01078d0 con 0x7ff0e0102f30 2024-04-25T11:24:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.021+0000 7ff0c7fff640 1 -- 172.21.15.80:0/3428373085 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7ff0d003bb90 con 0x7ff0e0102f30 2024-04-25T11:24:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.021+0000 7ff0c7fff640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0c80afb40 0x7ff0c80b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.021+0000 7ff0de7fc640 1 -- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0c80afb40 msgr2=0x7ff0c80b2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:13.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.021+0000 7ff0c7fff640 1 -- 172.21.15.80:0/3428373085 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7ff0d00ff7d0 con 0x7ff0e0102f30 2024-04-25T11:24:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.021+0000 7ff0de7fc640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0c80afb40 0x7ff0c80b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.025+0000 7ff0c7fff640 1 -- 172.21.15.80:0/3428373085 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff0d00c7d50 con 0x7ff0e0102f30 2024-04-25T11:24:13.118 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:12 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3554369573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T11:24:13.119 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:12.890+0000 7fcfaf69c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:24:13.119 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:13.026+0000 7fcfaf69c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:24:13.119 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:13.124+0000 7fcfaf69c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:24:13.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:12 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3554369573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T11:24:13.128 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:12.797+0000 7fc56514f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T11:24:13.128 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:12.897+0000 7fc56514f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T11:24:13.162 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:12 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3554369573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T11:24:13.162 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:12.818+0000 7f726a854200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:24:13.162 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:12.955+0000 7f726a854200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:24:13.162 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:13.052+0000 7f726a854200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:24:13.162 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:13.168+0000 7f726a854200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:24:13.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.210+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0e00637a0 con 0x7ff0e0102f30 2024-04-25T11:24:13.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.211+0000 7ff0c7fff640 1 -- 172.21.15.80:0/3428373085 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7ff0d00cc050 con 0x7ff0e0102f30 2024-04-25T11:24:13.205 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:13.205 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:24:13.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0c80afb40 msgr2=0x7ff0c80b2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:13.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0c80afb40 0x7ff0c80b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0102f30 msgr2=0x7ff0e01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0102f30 0x7ff0e01021d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0d002a930 tx=0x7ff0d0004270 comp rx=0 tx=0).stop 2024-04-25T11:24:13.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 shutdown_connections 2024-04-25T11:24:13.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7ff0c80afb40 0x7ff0c80b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0e0104450 0x7ff0e01a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e0103910 0x7ff0e01a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 --2- 172.21.15.80:0/3428373085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0e0102f30 0x7ff0e01021d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 >> 172.21.15.80:0/3428373085 conn(0x7ff0e00fd330 msgr2=0x7ff0e0104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:13.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 shutdown_connections 2024-04-25T11:24:13.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.214+0000 7ff0e5534640 1 -- 172.21.15.80:0/3428373085 wait complete. 2024-04-25T11:24:13.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:24:13.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:24:13.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 -- 172.21.15.80:0/1579501811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 msgr2=0x7fe1701037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 --2- 172.21.15.80:0/1579501811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe1701037e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe160009900 tx=0x7fe16002a410 comp rx=0 tx=0).stop 2024-04-25T11:24:13.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 -- 172.21.15.80:0/1579501811 shutdown_connections 2024-04-25T11:24:13.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 --2- 172.21.15.80:0/1579501811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe1701037e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 --2- 172.21.15.80:0/1579501811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1701080d0 0x7fe17010a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 --2- 172.21.15.80:0/1579501811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe170102190 0x7fe170102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 -- 172.21.15.80:0/1579501811 >> 172.21.15.80:0/1579501811 conn(0x7fe1700fd380 msgr2=0x7fe1700ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:13.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 -- 172.21.15.80:0/1579501811 shutdown_connections 2024-04-25T11:24:13.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 -- 172.21.15.80:0/1579501811 wait complete. 2024-04-25T11:24:13.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.340+0000 7fe175a97640 1 Processor -- start 2024-04-25T11:24:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe175a97640 1 -- start start 2024-04-25T11:24:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe175a97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe170102190 0x7fe17019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe175a97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe17019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe175a97640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1701080d0 0x7fe1701a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe175a97640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe17010dcb0 con 0x7fe1701033d0 2024-04-25T11:24:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe175a97640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe17010db30 con 0x7fe170102190 2024-04-25T11:24:13.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe175a97640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe17010de30 con 0x7fe1701080d0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe17019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe17019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38350/0 (socket says 172.21.15.80:38350) 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 -- 172.21.15.80:0/1879578444 learned_addr learned my addr 172.21.15.80:0/1879578444 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16ffff640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1701080d0 0x7fe1701a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16f7fe640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe170102190 0x7fe17019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 -- 172.21.15.80:0/1879578444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1701080d0 msgr2=0x7fe1701a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1701080d0 0x7fe1701a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 -- 172.21.15.80:0/1879578444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe170102190 msgr2=0x7fe17019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe170102190 0x7fe17019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.341+0000 7fe16effd640 1 -- 172.21.15.80:0/1879578444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1701a1da0 con 0x7fe1701033d0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.342+0000 7fe16effd640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe17019a7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe160006010 tx=0x7fe1600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.342+0000 7fe16cff9640 1 -- 172.21.15.80:0/1879578444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16003f030 con 0x7fe1701033d0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.342+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1701a2030 con 0x7fe1701033d0 2024-04-25T11:24:13.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.342+0000 7fe16cff9640 1 -- 172.21.15.80:0/1879578444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe160031910 con 0x7fe1701033d0 2024-04-25T11:24:13.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.342+0000 7fe16cff9640 1 -- 172.21.15.80:0/1879578444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160035070 con 0x7fe1701033d0 2024-04-25T11:24:13.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.342+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1701a2520 con 0x7fe1701033d0 2024-04-25T11:24:13.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.343+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1701a2780 con 0x7fe1701033d0 2024-04-25T11:24:13.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.345+0000 7fe16cff9640 1 -- 172.21.15.80:0/1879578444 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7fe160042030 con 0x7fe1701033d0 2024-04-25T11:24:13.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.345+0000 7fe16cff9640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1580afb40 0x7fe1580b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.346+0000 7fe16f7fe640 1 -- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1580afb40 msgr2=0x7fe1580b2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:13.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.346+0000 7fe16cff9640 1 -- 172.21.15.80:0/1879578444 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fe1600ff7f0 con 0x7fe1701033d0 2024-04-25T11:24:13.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.346+0000 7fe16f7fe640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1580afb40 0x7fe1580b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:13.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.349+0000 7fe16cff9640 1 -- 172.21.15.80:0/1879578444 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe1600c7d70 con 0x7fe1701033d0 2024-04-25T11:24:13.407 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:13.160+0000 7fc56514f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T11:24:13.407 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:13.305+0000 7fc56514f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T11:24:13.407 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:13.413+0000 7fc56514f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T11:24:13.440 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:13.241+0000 7fcfaf69c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:24:13.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.534+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe1701a2950 con 0x7fe1701033d0 2024-04-25T11:24:13.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.535+0000 7fe16cff9640 1 -- 172.21.15.80:0/1879578444 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7fe1600cc070 con 0x7fe1701033d0 2024-04-25T11:24:13.528 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:24:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1580afb40 msgr2=0x7fe1580b2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1580afb40 0x7fe1580b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 msgr2=0x7fe17019a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe17019a7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe160006010 tx=0x7fe1600042f0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 shutdown_connections 2024-04-25T11:24:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fe1580afb40 0x7fe1580b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1701033d0 0x7fe17019a7a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1701080d0 0x7fe1701a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 --2- 172.21.15.80:0/1879578444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe170102190 0x7fe17019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 >> 172.21.15.80:0/1879578444 conn(0x7fe1700fd380 msgr2=0x7fe17006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 shutdown_connections 2024-04-25T11:24:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.537+0000 7fe175a97640 1 -- 172.21.15.80:0/1879578444 wait complete. 2024-04-25T11:24:13.541 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:24:13.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.663+0000 7fc54fafa640 1 -- 172.21.15.80:0/1585592633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 msgr2=0x7fc54810ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.663+0000 7fc54fafa640 1 --2- 172.21.15.80:0/1585592633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc54810ad50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc540009ca0 tx=0x7fc54002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.663+0000 7fc54fafa640 1 -- 172.21.15.80:0/1585592633 shutdown_connections 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.663+0000 7fc54fafa640 1 --2- 172.21.15.80:0/1585592633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc54810ad50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.663+0000 7fc54fafa640 1 --2- 172.21.15.80:0/1585592633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc548103c30 0x7fc548104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.663+0000 7fc54fafa640 1 --2- 172.21.15.80:0/1585592633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5481029f0 0x7fc5481036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.663+0000 7fc54fafa640 1 -- 172.21.15.80:0/1585592633 >> 172.21.15.80:0/1585592633 conn(0x7fc5480fdc00 msgr2=0x7fc548100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.664+0000 7fc54fafa640 1 -- 172.21.15.80:0/1585592633 shutdown_connections 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.664+0000 7fc54fafa640 1 -- 172.21.15.80:0/1585592633 wait complete. 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.664+0000 7fc54fafa640 1 Processor -- start 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.664+0000 7fc54fafa640 1 -- start start 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54fafa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5481029f0 0x7fc5481990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54fafa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc548103c30 0x7fc548199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54fafa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc5481a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54fafa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc54810e520 con 0x7fc548108930 2024-04-25T11:24:13.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54fafa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc54810e3a0 con 0x7fc5481029f0 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54fafa640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc54810e6a0 con 0x7fc548103c30 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54e097640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc5481a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54e097640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc5481a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38370/0 (socket says 172.21.15.80:38370) 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d896640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5481029f0 0x7fc5481990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54e097640 1 -- 172.21.15.80:0/3328619982 learned_addr learned my addr 172.21.15.80:0/3328619982 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d095640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc548103c30 0x7fc548199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d896640 1 -- 172.21.15.80:0/3328619982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc548103c30 msgr2=0x7fc548199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d896640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc548103c30 0x7fc548199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d896640 1 -- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 msgr2=0x7fc5481a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d896640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc5481a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d896640 1 -- 172.21.15.80:0/3328619982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5481a0c00 con 0x7fc5481029f0 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54e097640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc5481a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc54d896640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5481029f0 0x7fc5481990c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5481022c0 tx=0x7fc54400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:13.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.665+0000 7fc53effd640 1 -- 172.21.15.80:0/3328619982 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54400cc40 con 0x7fc5481029f0 2024-04-25T11:24:13.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.666+0000 7fc53effd640 1 -- 172.21.15.80:0/3328619982 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc54400cde0 con 0x7fc5481029f0 2024-04-25T11:24:13.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.666+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5481a0ef0 con 0x7fc5481029f0 2024-04-25T11:24:13.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.666+0000 7fc53effd640 1 -- 172.21.15.80:0/3328619982 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544010430 con 0x7fc5481029f0 2024-04-25T11:24:13.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.666+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5481a1350 con 0x7fc5481029f0 2024-04-25T11:24:13.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.667+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5480692e0 con 0x7fc5481029f0 2024-04-25T11:24:13.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.668+0000 7fc53effd640 1 -- 172.21.15.80:0/3328619982 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7fc544004020 con 0x7fc5481029f0 2024-04-25T11:24:13.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.669+0000 7fc53effd640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc5340afb40 0x7fc5340b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.669+0000 7fc54d095640 1 -- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc5340afb40 msgr2=0x7fc5340b2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:13.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.669+0000 7fc53effd640 1 -- 172.21.15.80:0/3328619982 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fc5440df0c0 con 0x7fc5481029f0 2024-04-25T11:24:13.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.669+0000 7fc54d095640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc5340afb40 0x7fc5340b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:13.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.674+0000 7fc53effd640 1 -- 172.21.15.80:0/3328619982 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc5440a7c90 con 0x7fc5481029f0 2024-04-25T11:24:13.743 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:13.474+0000 7f726a854200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:24:13.849 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:13.535+0000 7fc56514f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T11:24:13.850 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:13.856+0000 7fc56514f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:24:13.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.858+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc5480637a0 con 0x7fc5481029f0 2024-04-25T11:24:13.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.858+0000 7fc53effd640 1 -- 172.21.15.80:0/3328619982 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) ==== 104+0+11 (secure 0 0 0) 0x7fc5440a7590 con 0x7fc5481029f0 2024-04-25T11:24:13.851 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc5340afb40 msgr2=0x7fc5340b2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc5340afb40 0x7fc5340b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5481029f0 msgr2=0x7fc5481990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5481029f0 0x7fc5481990c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5481022c0 tx=0x7fc54400ee50 comp rx=0 tx=0).stop 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 shutdown_connections 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc5340afb40 0x7fc5340b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc548108930 0x7fc5481a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc548103c30 0x7fc548199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 --2- 172.21.15.80:0/3328619982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5481029f0 0x7fc5481990c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.860+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 >> 172.21.15.80:0/3328619982 conn(0x7fc5480fdc00 msgr2=0x7fc548104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.861+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 shutdown_connections 2024-04-25T11:24:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.861+0000 7fc54fafa640 1 -- 172.21.15.80:0/3328619982 wait complete. 2024-04-25T11:24:13.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:24:13.871 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:13.553+0000 7fcfaf69c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 -- 172.21.15.80:0/2045855817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1033a0 msgr2=0x7fb16c1037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 --2- 172.21.15.80:0/2045855817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1033a0 0x7fb16c1037b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb15800aa10 tx=0x7fb15802b720 comp rx=0 tx=0).stop 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 -- 172.21.15.80:0/2045855817 shutdown_connections 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 --2- 172.21.15.80:0/2045855817 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c1080a0 0x7fb16c10a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 --2- 172.21.15.80:0/2045855817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1033a0 0x7fb16c1037b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 --2- 172.21.15.80:0/2045855817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb16c102160 0x7fb16c102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 -- 172.21.15.80:0/2045855817 >> 172.21.15.80:0/2045855817 conn(0x7fb16c0fd350 msgr2=0x7fb16c0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 -- 172.21.15.80:0/2045855817 shutdown_connections 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 -- 172.21.15.80:0/2045855817 wait complete. 2024-04-25T11:24:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.985+0000 7fb172a67640 1 Processor -- start 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb172a67640 1 -- start start 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb172a67640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c102160 0x7fb16c19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb172a67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb16c1033a0 0x7fb16c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb172a67640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1080a0 0x7fb16c1a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb172a67640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10d3f0 con 0x7fb16c102160 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb172a67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10d270 con 0x7fb16c1033a0 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb172a67640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10d570 con 0x7fb16c1080a0 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c102160 0x7fb16c19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c102160 0x7fb16c19a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38388/0 (socket says 172.21.15.80:38388) 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 -- 172.21.15.80:0/408866777 learned_addr learned my addr 172.21.15.80:0/408866777 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb16bfff640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb16c1033a0 0x7fb16c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb171004640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1080a0 0x7fb16c1a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 -- 172.21.15.80:0/408866777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1080a0 msgr2=0x7fb16c1a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1080a0 0x7fb16c1a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 -- 172.21.15.80:0/408866777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb16c1033a0 msgr2=0x7fb16c19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb16c1033a0 0x7fb16c19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 -- 172.21.15.80:0/408866777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c1a1d60 con 0x7fb16c102160 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb170803640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c102160 0x7fb16c19a220 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb16000e980 tx=0x7fb16000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.986+0000 7fb169ffb640 1 -- 172.21.15.80:0/408866777 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16000ccc0 con 0x7fb16c102160 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.987+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c1a1ff0 con 0x7fb16c102160 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.987+0000 7fb169ffb640 1 -- 172.21.15.80:0/408866777 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1600108e0 con 0x7fb16c102160 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.987+0000 7fb169ffb640 1 -- 172.21.15.80:0/408866777 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1600187d0 con 0x7fb16c102160 2024-04-25T11:24:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.987+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a2500 con 0x7fb16c102160 2024-04-25T11:24:13.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.988+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c1a2760 con 0x7fb16c102160 2024-04-25T11:24:13.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.989+0000 7fb169ffb640 1 -- 172.21.15.80:0/408866777 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7fb16001f020 con 0x7fb16c102160 2024-04-25T11:24:13.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.990+0000 7fb169ffb640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb15c0afb40 0x7fb15c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:13.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.990+0000 7fb16bfff640 1 -- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb15c0afb40 msgr2=0x7fb15c0b2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:13.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.990+0000 7fb169ffb640 1 -- 172.21.15.80:0/408866777 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fb1600df2a0 con 0x7fb16c102160 2024-04-25T11:24:13.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.990+0000 7fb16bfff640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb15c0afb40 0x7fb15c0b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:13.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:13.993+0000 7fb169ffb640 1 -- 172.21.15.80:0/408866777 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb1600a7e70 con 0x7fb16c102160 2024-04-25T11:24:14.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3554369573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-25T11:24:14.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-mon[29126]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:24:14.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3428373085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:14.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1879578444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:14.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:13 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3328619982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:14.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3554369573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-25T11:24:14.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-mon[32659]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:24:14.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3428373085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:14.158 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1879578444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:14.158 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:13 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3328619982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:14.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.177+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb16c1a2930 con 0x7fb16c102160 2024-04-25T11:24:14.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.178+0000 7fb169ffb640 1 -- 172.21.15.80:0/408866777 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) ==== 100+0+11 (secure 0 0 0) 0x7fb1600a7770 con 0x7fb16c102160 2024-04-25T11:24:14.171 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:24:14.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb15c0afb40 msgr2=0x7fb15c0b2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:14.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb15c0afb40 0x7fb15c0b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c102160 msgr2=0x7fb16c19a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c102160 0x7fb16c19a220 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb16000e980 tx=0x7fb16000ed80 comp rx=0 tx=0).stop 2024-04-25T11:24:14.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 shutdown_connections 2024-04-25T11:24:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fb15c0afb40 0x7fb15c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb16c1080a0 0x7fb16c1a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb16c1033a0 0x7fb16c19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 --2- 172.21.15.80:0/408866777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb16c102160 0x7fb16c19a220 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 >> 172.21.15.80:0/408866777 conn(0x7fb16c0fd350 msgr2=0x7fb16c106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 shutdown_connections 2024-04-25T11:24:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.180+0000 7fb172a67640 1 -- 172.21.15.80:0/408866777 wait complete. 2024-04-25T11:24:14.185 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:24:14.243 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:14.074+0000 7f726a854200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:24:14.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3554369573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-25T11:24:14.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-mon[32440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:24:14.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3428373085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:14.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1879578444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:14.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:13 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3328619982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 -- 172.21.15.80:0/195540744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60101730 msgr2=0x7fba60101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 --2- 172.21.15.80:0/195540744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60101730 0x7fba60101ba0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fba54009900 tx=0x7fba5402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 -- 172.21.15.80:0/195540744 shutdown_connections 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 --2- 172.21.15.80:0/195540744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60101730 0x7fba60101ba0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 --2- 172.21.15.80:0/195540744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba60102230 0x7fba6010bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 --2- 172.21.15.80:0/195540744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba60105080 0x7fba60105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 -- 172.21.15.80:0/195540744 >> 172.21.15.80:0/195540744 conn(0x7fba600fd330 msgr2=0x7fba600ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 -- 172.21.15.80:0/195540744 shutdown_connections 2024-04-25T11:24:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.302+0000 7fba64ef2640 1 -- 172.21.15.80:0/195540744 wait complete. 2024-04-25T11:24:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 Processor -- start 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 -- start start 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba60101730 0x7fba6019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba60102230 0x7fba6019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60105080 0x7fba601a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba6010f610 con 0x7fba60105080 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba6010f490 con 0x7fba60102230 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.303+0000 7fba64ef2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fba6010f790 con 0x7fba60101730 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60105080 0x7fba601a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60105080 0x7fba601a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38416/0 (socket says 172.21.15.80:38416) 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 -- 172.21.15.80:0/2398247867 learned_addr learned my addr 172.21.15.80:0/2398247867 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5dd9b640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba60102230 0x7fba6019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5e59c640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba60101730 0x7fba6019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 -- 172.21.15.80:0/2398247867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba60101730 msgr2=0x7fba6019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba60101730 0x7fba6019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 -- 172.21.15.80:0/2398247867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba60102230 msgr2=0x7fba6019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba60102230 0x7fba6019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 -- 172.21.15.80:0/2398247867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba601a1d30 con 0x7fba60105080 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5dd9b640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba60102230 0x7fba6019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba5ed9d640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60105080 0x7fba601a16c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba5800eaa0 tx=0x7fba5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba4f7fe640 1 -- 172.21.15.80:0/2398247867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5800cdb0 con 0x7fba60105080 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba4f7fe640 1 -- 172.21.15.80:0/2398247867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba58005020 con 0x7fba60105080 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba601a1fc0 con 0x7fba60105080 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba4f7fe640 1 -- 172.21.15.80:0/2398247867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba580116d0 con 0x7fba60105080 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.304+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba601a2480 con 0x7fba60105080 2024-04-25T11:24:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.305+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba60108a10 con 0x7fba60105080 2024-04-25T11:24:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.308+0000 7fba4f7fe640 1 -- 172.21.15.80:0/2398247867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7fba580054a0 con 0x7fba60105080 2024-04-25T11:24:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.308+0000 7fba4f7fe640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba480afb40 0x7fba480b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.308+0000 7fba5e59c640 1 -- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba480afb40 msgr2=0x7fba480b2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.308+0000 7fba4f7fe640 1 -- 172.21.15.80:0/2398247867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fba580df150 con 0x7fba60105080 2024-04-25T11:24:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.308+0000 7fba5e59c640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba480afb40 0x7fba480b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:14.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.312+0000 7fba4f7fe640 1 -- 172.21.15.80:0/2398247867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fba58016030 con 0x7fba60105080 2024-04-25T11:24:14.440 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:14.163+0000 7fcfaf69c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:24:14.440 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z[34513]: 2024-04-25T11:24:14.386+0000 7fcfaf69c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:24:14.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.500+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba600637a0 con 0x7fba60105080 2024-04-25T11:24:14.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.501+0000 7fba4f7fe640 1 -- 172.21.15.80:0/2398247867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22679 (secure 0 0 0) 0x7fba580a76d0 con 0x7fba60105080 2024-04-25T11:24:14.495 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:14.495 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":79,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:22:56.395000+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:24:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba480afb40 msgr2=0x7fba480b2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba480afb40 0x7fba480b2050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60105080 msgr2=0x7fba601a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60105080 0x7fba601a16c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba5800eaa0 tx=0x7fba5800ef60 comp rx=0 tx=0).stop 2024-04-25T11:24:14.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 shutdown_connections 2024-04-25T11:24:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fba480afb40 0x7fba480b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba60105080 0x7fba601a16c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba60102230 0x7fba6019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 --2- 172.21.15.80:0/2398247867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba60101730 0x7fba6019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 >> 172.21.15.80:0/2398247867 conn(0x7fba600fd330 msgr2=0x7fba60105be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.503+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 shutdown_connections 2024-04-25T11:24:14.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.504+0000 7fba64ef2640 1 -- 172.21.15.80:0/2398247867 wait complete. 2024-04-25T11:24:14.508 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:24:14.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:24:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 -- 172.21.15.80:0/2564544218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac108740 msgr2=0x7fc2ac10ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 --2- 172.21.15.80:0/2564544218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac108740 0x7fc2ac10ab60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009ca0 tx=0x7fc2a402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 -- 172.21.15.80:0/2564544218 shutdown_connections 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 --2- 172.21.15.80:0/2564544218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac108740 0x7fc2ac10ab60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 --2- 172.21.15.80:0/2564544218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac103a40 0x7fc2ac103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 --2- 172.21.15.80:0/2564544218 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2ac102800 0x7fc2ac103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 -- 172.21.15.80:0/2564544218 >> 172.21.15.80:0/2564544218 conn(0x7fc2ac0fd9f0 msgr2=0x7fc2ac0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 -- 172.21.15.80:0/2564544218 shutdown_connections 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.629+0000 7fc2b359d640 1 -- 172.21.15.80:0/2564544218 wait complete. 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 Processor -- start 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 -- start start 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac102800 0x7fc2ac06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac103a40 0x7fc2ac19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2ac108740 0x7fc2ac1a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac10e310 con 0x7fc2ac102800 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac10e190 con 0x7fc2ac103a40 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b359d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac10e490 con 0x7fc2ac108740 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b259b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac102800 0x7fc2ac06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b259b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac102800 0x7fc2ac06a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38420/0 (socket says 172.21.15.80:38420) 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b259b640 1 -- 172.21.15.80:0/1747280720 learned_addr learned my addr 172.21.15.80:0/1747280720 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b1d9a640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac103a40 0x7fc2ac19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.630+0000 7fc2b2d9c640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2ac108740 0x7fc2ac1a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b259b640 1 -- 172.21.15.80:0/1747280720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2ac108740 msgr2=0x7fc2ac1a12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b259b640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2ac108740 0x7fc2ac1a12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b259b640 1 -- 172.21.15.80:0/1747280720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac103a40 msgr2=0x7fc2ac19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b259b640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac103a40 0x7fc2ac19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b259b640 1 -- 172.21.15.80:0/1747280720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ac1a1b00 con 0x7fc2ac102800 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b1d9a640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac103a40 0x7fc2ac19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b259b640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac102800 0x7fc2ac06a920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800e9f0 tx=0x7fc2a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a800ccc0 con 0x7fc2ac102800 2024-04-25T11:24:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2a80035f0 con 0x7fc2ac102800 2024-04-25T11:24:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a800ce60 con 0x7fc2ac102800 2024-04-25T11:24:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ac1a1df0 con 0x7fc2ac102800 2024-04-25T11:24:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.631+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ac1a2250 con 0x7fc2ac102800 2024-04-25T11:24:14.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.632+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ac069be0 con 0x7fc2ac102800 2024-04-25T11:24:14.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.634+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7fc2a8003aa0 con 0x7fc2ac102800 2024-04-25T11:24:14.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.634+0000 7fc2a37fe640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc2980afb30 0x7fc2980b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.635+0000 7fc2b1d9a640 1 -- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc2980afb30 msgr2=0x7fc2980b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3135257773 2024-04-25T11:24:14.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.635+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8248+0+0 (secure 0 0 0) 0x7fc2a80df040 con 0x7fc2ac102800 2024-04-25T11:24:14.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.635+0000 7fc2b1d9a640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc2980afb30 0x7fc2980b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T11:24:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.638+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc2a80a7c10 con 0x7fc2ac102800 2024-04-25T11:24:14.743 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y[33823]: 2024-04-25T11:24:14.291+0000 7f726a854200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:24:14.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.761+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 20) ==== 147205+0+0 (secure 0 0 0) 0x7fc2a80a37a0 con 0x7fc2ac102800 2024-04-25T11:24:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.761+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc2980afb30 msgr2=0x7fc2980b2040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T11:24:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.761+0000 7fc2a37fe640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc2980afb30 0x7fc2980b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.836+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc2ac02dc10 con 0x7fc2ac102800 2024-04-25T11:24:14.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.837+0000 7fc2a37fe640 1 -- 172.21.15.80:0/1747280720 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7fc2a800ce60 con 0x7fc2ac102800 2024-04-25T11:24:14.830 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:24:14.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac102800 msgr2=0x7fc2ac06a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac102800 0x7fc2ac06a920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800e9f0 tx=0x7fc2a800eeb0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 shutdown_connections 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:6800/3135257773,v1:172.21.15.80:6801/3135257773] conn(0x7fc2980afb30 0x7fc2980b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2ac108740 0x7fc2ac1a12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac103a40 0x7fc2ac19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 --2- 172.21.15.80:0/1747280720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2ac102800 0x7fc2ac06a920 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.839+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 >> 172.21.15.80:0/1747280720 conn(0x7fc2ac0fd9f0 msgr2=0x7fc2ac104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.840+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 shutdown_connections 2024-04-25T11:24:14.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.840+0000 7fc2b359d640 1 -- 172.21.15.80:0/1747280720 wait complete. 2024-04-25T11:24:14.844 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:14.509+0000 7fc56514f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T11:24:14.844 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:14.748+0000 7fc56514f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T11:24:14.845 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:24:14.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 -- 172.21.15.80:0/2391532253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181029e0 msgr2=0x7f52181036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 --2- 172.21.15.80:0/2391532253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181029e0 0x7f52181036e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5214009900 tx=0x7f521402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:14.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 -- 172.21.15.80:0/2391532253 shutdown_connections 2024-04-25T11:24:14.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 --2- 172.21.15.80:0/2391532253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5218108920 0x7f521810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 --2- 172.21.15.80:0/2391532253 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218103c20 0x7f5218104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 --2- 172.21.15.80:0/2391532253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52181029e0 0x7f52181036e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 -- 172.21.15.80:0/2391532253 >> 172.21.15.80:0/2391532253 conn(0x7f52180fdbd0 msgr2=0x7f5218100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 -- 172.21.15.80:0/2391532253 shutdown_connections 2024-04-25T11:24:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:14.999+0000 7f521f267640 1 -- 172.21.15.80:0/2391532253 wait complete. 2024-04-25T11:24:14.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 Processor -- start 2024-04-25T11:24:14.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 -- start start 2024-04-25T11:24:14.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52181029e0 0x7f521806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5218103c20 0x7f52181a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218108920 0x7f52181a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f521810e530 con 0x7f5218103c20 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f521810e3b0 con 0x7f52181029e0 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521f267640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f521810e6b0 con 0x7f5218108920 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521c802640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5218103c20 0x7f52181a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521d003640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52181029e0 0x7f521806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521c802640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5218103c20 0x7f52181a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38502/0 (socket says 172.21.15.80:38502) 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521c802640 1 -- 172.21.15.80:0/1026912862 learned_addr learned my addr 172.21.15.80:0/1026912862 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.000+0000 7f521d804640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218108920 0x7f52181a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f521d003640 1 -- 172.21.15.80:0/1026912862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218108920 msgr2=0x7f52181a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f521d003640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218108920 0x7f52181a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f521d003640 1 -- 172.21.15.80:0/1026912862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5218103c20 msgr2=0x7f52181a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f521d003640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5218103c20 0x7f52181a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f521d003640 1 -- 172.21.15.80:0/1026912862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52181a42d0 con 0x7f52181029e0 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f521c802640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5218103c20 0x7f52181a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f521d003640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52181029e0 0x7f521806a960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5214009230 tx=0x7f5214003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f520e7fc640 1 -- 172.21.15.80:0/1026912862 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521403f070 con 0x7f52181029e0 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f520e7fc640 1 -- 172.21.15.80:0/1026912862 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214031c50 con 0x7f52181029e0 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.001+0000 7f520e7fc640 1 -- 172.21.15.80:0/1026912862 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214035030 con 0x7f52181029e0 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.002+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52181a4560 con 0x7f52181029e0 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.002+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52181a49b0 con 0x7f52181029e0 2024-04-25T11:24:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.003+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5218107730 con 0x7f52181029e0 2024-04-25T11:24:14.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.005+0000 7f520e7fc640 1 -- 172.21.15.80:0/1026912862 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 147205+0+0 (secure 0 0 0) 0x7f5214042070 con 0x7f52181029e0 2024-04-25T11:24:14.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.006+0000 7f520e7fc640 1 -- 172.21.15.80:0/1026912862 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f52140ff0d0 con 0x7f52181029e0 2024-04-25T11:24:15.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.009+0000 7f520e7fc640 1 -- 172.21.15.80:0/1026912862 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f52140c7fa0 con 0x7f52181029e0 2024-04-25T11:24:15.128 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.023+0000 7fc4c308d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.023+0000 7fc4c308d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.023+0000 7fc4c308d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.023+0000 7fc4c308d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.023+0000 7fc4c308d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.026+0000 7fc4c6894700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.026+0000 7fc4c6894700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.026+0000 7fc4c6894700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.026+0000 7fc4c6894700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.129 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:24:15.026+0000 7fc4c6894700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/408866777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: Standby manager daemon y restarted 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: Standby manager daemon y started 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: Standby manager daemon z restarted 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: Standby manager daemon z started 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:24:15.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2398247867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: Active manager daemon x restarted 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: Activating manager daemon x 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: mgrmap e20: x(active, starting, since 0.0135841s), standbys: y, z 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T11:24:15.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:24:15.132 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: Manager daemon x is now available 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1747280720' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T11:24:15.133 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:14 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T11:24:15.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/408866777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:15.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: Standby manager daemon y restarted 2024-04-25T11:24:15.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: Standby manager daemon y started 2024-04-25T11:24:15.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T11:24:15.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:24:15.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T11:24:15.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: Standby manager daemon z restarted 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: Standby manager daemon z started 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2398247867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: Active manager daemon x restarted 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: Activating manager daemon x 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: mgrmap e20: x(active, starting, since 0.0135841s), standbys: y, z 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T11:24:15.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:24:15.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: Manager daemon x is now available 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:15.193 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1747280720' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:15.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T11:24:15.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:14 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T11:24:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.206+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f521802dda0 con 0x7f52181029e0 2024-04-25T11:24:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.206+0000 7f520e7fc640 1 -- 172.21.15.80:0/1026912862 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7f52140c78a0 con 0x7f52181029e0 2024-04-25T11:24:15.199 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.208+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52181029e0 msgr2=0x7f521806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.208+0000 7f521f267640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52181029e0 0x7f521806a960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5214009230 tx=0x7f5214003b90 comp rx=0 tx=0).stop 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.209+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 shutdown_connections 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.209+0000 7f521f267640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5218103c20 0x7f52181a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.209+0000 7f521f267640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5218108920 0x7f52181a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.209+0000 7f521f267640 1 --2- 172.21.15.80:0/1026912862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52181029e0 0x7f521806a960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.209+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 >> 172.21.15.80:0/1026912862 conn(0x7f52180fdbd0 msgr2=0x7f5218104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.209+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 shutdown_connections 2024-04-25T11:24:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.209+0000 7f521f267640 1 -- 172.21.15.80:0/1026912862 wait complete. 2024-04-25T11:24:15.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/408866777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: Standby manager daemon y restarted 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: Standby manager daemon y started 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.82:0/2471779424' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:24:15.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: Standby manager daemon z restarted 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: Standby manager daemon z started 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.? 172.21.15.196:0/571706610' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2398247867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: Active manager daemon x restarted 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: Activating manager daemon x 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: mgrmap e20: x(active, starting, since 0.0135841s), standbys: y, z 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T11:24:15.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T11:24:15.246 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T11:24:15.247 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T11:24:15.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: Manager daemon x is now available 2024-04-25T11:24:15.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:15.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1747280720' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:15.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T11:24:15.248 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:14 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T11:24:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 -- 172.21.15.80:0/1547753948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34106f30 msgr2=0x7fde34109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 --2- 172.21.15.80:0/1547753948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34106f30 0x7fde34109350 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fde24009900 tx=0x7fde2402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 -- 172.21.15.80:0/1547753948 shutdown_connections 2024-04-25T11:24:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 --2- 172.21.15.80:0/1547753948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34106f30 0x7fde34109350 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 --2- 172.21.15.80:0/1547753948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34109890 0x7fde3410bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 --2- 172.21.15.80:0/1547753948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde341045d0 0x7fde341069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 -- 172.21.15.80:0/1547753948 >> 172.21.15.80:0/1547753948 conn(0x7fde340fdbd0 msgr2=0x7fde34100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:15.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 -- 172.21.15.80:0/1547753948 shutdown_connections 2024-04-25T11:24:15.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 -- 172.21.15.80:0/1547753948 wait complete. 2024-04-25T11:24:15.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 Processor -- start 2024-04-25T11:24:15.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.335+0000 7fde3b98f640 1 -- start start 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3b98f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde341045d0 0x7fde3419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3b98f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde34106f30 0x7fde3419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3b98f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34109890 0x7fde341a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3b98f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fde3410f610 con 0x7fde341045d0 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3b98f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde3410f490 con 0x7fde34109890 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde341045d0 0x7fde3419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3b98f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fde3410f790 con 0x7fde34106f30 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde341045d0 0x7fde3419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38562/0 (socket says 172.21.15.80:38562) 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde38f2a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde34106f30 0x7fde3419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 -- 172.21.15.80:0/2408377 learned_addr learned my addr 172.21.15.80:0/2408377 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:15.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde39f2c640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34109890 0x7fde341a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 -- 172.21.15.80:0/2408377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde34106f30 msgr2=0x7fde3419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde34106f30 0x7fde3419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 -- 172.21.15.80:0/2408377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34109890 msgr2=0x7fde341a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34109890 0x7fde341a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 -- 172.21.15.80:0/2408377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde341a2110 con 0x7fde341045d0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde38f2a640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde34106f30 0x7fde3419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.336+0000 7fde3972b640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde341045d0 0x7fde3419a5d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fde30009be0 tx=0x7fde3000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.337+0000 7fde2a7fc640 1 -- 172.21.15.80:0/2408377 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30005020 con 0x7fde341045d0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.337+0000 7fde2a7fc640 1 -- 172.21.15.80:0/2408377 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde30005670 con 0x7fde341045d0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.337+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde34102000 con 0x7fde341045d0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.337+0000 7fde2a7fc640 1 -- 172.21.15.80:0/2408377 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30019670 con 0x7fde341045d0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.337+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde34102550 con 0x7fde341045d0 2024-04-25T11:24:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.338+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3406c2a0 con 0x7fde341045d0 2024-04-25T11:24:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.340+0000 7fde2a7fc640 1 -- 172.21.15.80:0/2408377 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 20) ==== 147205+0+0 (secure 0 0 0) 0x7fde300046c0 con 0x7fde341045d0 2024-04-25T11:24:15.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.342+0000 7fde2a7fc640 1 -- 172.21.15.80:0/2408377 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fde300e28f0 con 0x7fde341045d0 2024-04-25T11:24:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.345+0000 7fde2a7fc640 1 -- 172.21.15.80:0/2408377 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fde30004e40 con 0x7fde341045d0 2024-04-25T11:24:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.529+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fde341028c0 con 0x7fde341045d0 2024-04-25T11:24:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.529+0000 7fde2a7fc640 1 -- 172.21.15.80:0/2408377 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7fde300ab170 con 0x7fde341045d0 2024-04-25T11:24:15.522 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:24:15.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde341045d0 msgr2=0x7fde3419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde341045d0 0x7fde3419a5d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fde30009be0 tx=0x7fde3000b690 comp rx=0 tx=0).stop 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 shutdown_connections 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34109890 0x7fde341a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde34106f30 0x7fde3419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 --2- 172.21.15.80:0/2408377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde341045d0 0x7fde3419a5d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 >> 172.21.15.80:0/2408377 conn(0x7fde340fdbd0 msgr2=0x7fde34104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 shutdown_connections 2024-04-25T11:24:15.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.531+0000 7fde3b98f640 1 -- 172.21.15.80:0/2408377 wait complete. 2024-04-25T11:24:15.535 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-04-25T11:24:15.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:24:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 -- 172.21.15.80:0/3771101879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0101e40 msgr2=0x7ff1f0102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 --2- 172.21.15.80:0/3771101879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0101e40 0x7ff1f0102250 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009900 tx=0x7ff1e002a400 comp rx=0 tx=0).stop 2024-04-25T11:24:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 -- 172.21.15.80:0/3771101879 shutdown_connections 2024-04-25T11:24:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 --2- 172.21.15.80:0/3771101879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1f0103380 0x7ff1f0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 --2- 172.21.15.80:0/3771101879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1f0102820 0x7ff1f0102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 --2- 172.21.15.80:0/3771101879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0101e40 0x7ff1f0102250 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 -- 172.21.15.80:0/3771101879 >> 172.21.15.80:0/3771101879 conn(0x7ff1f00fd9f0 msgr2=0x7ff1f00ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.651+0000 7ff1f519d640 1 -- 172.21.15.80:0/3771101879 shutdown_connections 2024-04-25T11:24:15.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.652+0000 7ff1f519d640 1 -- 172.21.15.80:0/3771101879 wait complete. 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.652+0000 7ff1f519d640 1 Processor -- start 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.652+0000 7ff1f519d640 1 -- start start 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.652+0000 7ff1f519d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1f0101e40 0x7ff1f019c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.652+0000 7ff1f519d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1f0102820 0x7ff1f019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.652+0000 7ff1f519d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0103380 0x7ff1f01a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f519d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01115f0 con 0x7ff1f0103380 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f519d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0111470 con 0x7ff1f0102820 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f519d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0111770 con 0x7ff1f0101e40 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0103380 0x7ff1f01a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0103380 0x7ff1f01a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38572/0 (socket says 172.21.15.80:38572) 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 -- 172.21.15.80:0/477611224 learned_addr learned my addr 172.21.15.80:0/477611224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1effff640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1f0101e40 0x7ff1f019c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1ef7fe640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1f0102820 0x7ff1f019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 -- 172.21.15.80:0/477611224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1f0101e40 msgr2=0x7ff1f019c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1f0101e40 0x7ff1f019c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 -- 172.21.15.80:0/477611224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1f0102820 msgr2=0x7ff1f019c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1f0102820 0x7ff1f019c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 -- 172.21.15.80:0/477611224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f01a3d60 con 0x7ff1f0103380 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f499c640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0103380 0x7ff1f01a36f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800eb10 tx=0x7ff1e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8004b20 con 0x7ff1f0103380 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f01a3ff0 con 0x7ff1f0103380 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1e8004cc0 con 0x7ff1f0103380 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.653+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8010690 con 0x7ff1f0103380 2024-04-25T11:24:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.654+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f01a44b0 con 0x7ff1f0103380 2024-04-25T11:24:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.655+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f010d2a0 con 0x7ff1f0103380 2024-04-25T11:24:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.656+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 20) ==== 147205+0+0 (secure 0 0 0) 0x7ff1e8005000 con 0x7ff1f0103380 2024-04-25T11:24:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.657+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7ff1e80dedf0 con 0x7ff1f0103380 2024-04-25T11:24:15.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.665+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff1e8053ff0 con 0x7ff1f0103380 2024-04-25T11:24:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.771+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 21) ==== 147332+0+0 (secure 0 0 0) 0x7ff1e80a2f30 con 0x7ff1f0103380 2024-04-25T11:24:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.771+0000 7ff1ed7fa640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff1d80b68b0 0x7ff1d80b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.778+0000 7ff1effff640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff1d80b68b0 0x7ff1d80b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:15.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.780+0000 7ff1effff640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff1d80b68b0 0x7ff1d80b8cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0000c00 tx=0x7ff1e0031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:15.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.928+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1f002db50 con 0x7ff1f0103380 2024-04-25T11:24:15.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.929+0000 7ff1ed7fa640 1 -- 172.21.15.80:0/477611224 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7ff1e8021440 con 0x7ff1f0103380 2024-04-25T11:24:15.922 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:15.922 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:24:12.817395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24521,24476,24499]},"id":1}]} 2024-04-25T11:24:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T11:24:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff1d80b68b0 msgr2=0x7ff1d80b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff1d80b68b0 0x7ff1d80b8cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0000c00 tx=0x7ff1e0031400 comp rx=0 tx=0).stop 2024-04-25T11:24:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0103380 msgr2=0x7ff1f01a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0103380 0x7ff1f01a36f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800eb10 tx=0x7ff1e800c2d0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 shutdown_connections 2024-04-25T11:24:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff1d80b68b0 0x7ff1d80b8cd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1f0103380 0x7ff1f01a36f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1f0102820 0x7ff1f019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 --2- 172.21.15.80:0/477611224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1f0101e40 0x7ff1f019c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 >> 172.21.15.80:0/477611224 conn(0x7ff1f00fd9f0 msgr2=0x7ff1f010a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 shutdown_connections 2024-04-25T11:24:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:15.931+0000 7ff1f519d640 1 -- 172.21.15.80:0/477611224 wait complete. 2024-04-25T11:24:15.935 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-04-25T11:24:15.936 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-04-25T11:24:15.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:24:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 -- 172.21.15.80:0/2732919044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 msgr2=0x7f3128109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 --2- 172.21.15.80:0/2732919044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f3128109350 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f311c009900 tx=0x7f311c02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 -- 172.21.15.80:0/2732919044 shutdown_connections 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 --2- 172.21.15.80:0/2732919044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f3128109350 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 --2- 172.21.15.80:0/2732919044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3128109890 0x7f312810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 --2- 172.21.15.80:0/2732919044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31281045d0 0x7f31281069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 -- 172.21.15.80:0/2732919044 >> 172.21.15.80:0/2732919044 conn(0x7f31280fdbd0 msgr2=0x7f3128100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 -- 172.21.15.80:0/2732919044 shutdown_connections 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.052+0000 7f312db6c640 1 -- 172.21.15.80:0/2732919044 wait complete. 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 Processor -- start 2024-04-25T11:24:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 -- start start 2024-04-25T11:24:16.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31281045d0 0x7f3128103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f31281020c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3128109890 0x7f3128102600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f312810f610 con 0x7f3128106f30 2024-04-25T11:24:16.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f312810f490 con 0x7f3128109890 2024-04-25T11:24:16.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f312db6c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f312810f790 con 0x7f31281045d0 2024-04-25T11:24:16.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f3126ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f31281020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f3126ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f31281020c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38590/0 (socket says 172.21.15.80:38590) 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f3126ffd640 1 -- 172.21.15.80:0/1042227360 learned_addr learned my addr 172.21.15.80:0/1042227360 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f31277fe640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31281045d0 0x7f3128103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.053+0000 7f3127fff640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3128109890 0x7f3128102600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3126ffd640 1 -- 172.21.15.80:0/1042227360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31281045d0 msgr2=0x7f3128103a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3126ffd640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31281045d0 0x7f3128103a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3126ffd640 1 -- 172.21.15.80:0/1042227360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3128109890 msgr2=0x7f3128102600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3126ffd640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3128109890 0x7f3128102600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3126ffd640 1 -- 172.21.15.80:0/1042227360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3128102d30 con 0x7f3128106f30 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3127fff640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3128109890 0x7f3128102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3126ffd640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f31281020c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f311c006010 tx=0x7f311c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3124ff9640 1 -- 172.21.15.80:0/1042227360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c03f030 con 0x7f3128106f30 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3124ff9640 1 -- 172.21.15.80:0/1042227360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f311c031910 con 0x7f3128106f30 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31281a4390 con 0x7f3128106f30 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f3124ff9640 1 -- 172.21.15.80:0/1042227360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c035070 con 0x7f3128106f30 2024-04-25T11:24:16.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.054+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31281a4790 con 0x7f3128106f30 2024-04-25T11:24:16.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.055+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312806a190 con 0x7f3128106f30 2024-04-25T11:24:16.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.056+0000 7f3124ff9640 1 -- 172.21.15.80:0/1042227360 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 21) ==== 147332+0+0 (secure 0 0 0) 0x7f311c042030 con 0x7f3128106f30 2024-04-25T11:24:16.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.057+0000 7f3124ff9640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f31100af8e0 0x7f31100b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.057+0000 7f31277fe640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f31100af8e0 0x7f31100b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.057+0000 7f3124ff9640 1 -- 172.21.15.80:0/1042227360 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f311c0fedb0 con 0x7f3128106f30 2024-04-25T11:24:16.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.058+0000 7f31277fe640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f31100af8e0 0x7f31100b1df0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31280757f0 tx=0x7f3118005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:16.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.062+0000 7f3124ff9640 1 -- 172.21.15.80:0/1042227360 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f311c0c7520 con 0x7f3128106f30 2024-04-25T11:24:16.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1026912862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:16.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2408377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:16.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:15 smithi080 ceph-mon[29126]: mgrmap e21: x(active, since 1.02295s), standbys: y, z 2024-04-25T11:24:16.173 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1026912862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:16.173 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2408377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:16.173 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:15 smithi082 ceph-mon[32440]: mgrmap e21: x(active, since 1.02295s), standbys: y, z 2024-04-25T11:24:16.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1026912862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:16.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2408377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:16.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:15 smithi196 ceph-mon[32659]: mgrmap e21: x(active, since 1.02295s), standbys: y, z 2024-04-25T11:24:16.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.244+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3128062fe0 con 0x7f31100af8e0 2024-04-25T11:24:16.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.252+0000 7f3124ff9640 1 -- 172.21.15.80:0/1042227360 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258014 (secure 0 0 0) 0x7f3128062fe0 con 0x7f31100af8e0 2024-04-25T11:24:16.248 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:16.249 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f31100af8e0 msgr2=0x7f31100b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f31100af8e0 0x7f31100b1df0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31280757f0 tx=0x7f3118005f90 comp rx=0 tx=0).stop 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 msgr2=0x7f31281020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f31281020c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f311c006010 tx=0x7f311c0042f0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 shutdown_connections 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f31100af8e0 0x7f31100b1df0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3128106f30 0x7f31281020c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3128109890 0x7f3128102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 --2- 172.21.15.80:0/1042227360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31281045d0 0x7f3128103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 >> 172.21.15.80:0/1042227360 conn(0x7f31280fdbd0 msgr2=0x7f3128106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:16.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 shutdown_connections 2024-04-25T11:24:16.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.256+0000 7f312db6c640 1 -- 172.21.15.80:0/1042227360 wait complete. 2024-04-25T11:24:16.260 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2024-04-25T11:24:15.786736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189722,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":917,"num_read_kb":598,"num_write":415,"num_write_kb":3593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351544,"kb_used_data":10684,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590280,"statfs":{"total":1151940427776,"available":1151580446720,"internally_reserved":0,"allocated":10940416,"data_stored":8049340,"data_compressed":262050,"data_compressed_allocated":352256,"data_compressed_original":3104768,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105763+0000","last_change":"2024-04-25T11:22:14.408035+0000","last_active":"2024-04-25T11:24:15.105763+0000","last_peered":"2024-04-25T11:24:15.105763+0000","last_clean":"2024-04-25T11:24:15.105763+0000","last_became_active":"2024-04-25T11:22:14.407691+0000","last_became_peered":"2024-04-25T11:22:14.407691+0000","last_unstale":"2024-04-25T11:24:15.105763+0000","last_undegraded":"2024-04-25T11:24:15.105763+0000","last_fullsized":"2024-04-25T11:24:15.105763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:27.388402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035265+0000","last_change":"2024-04-25T11:22:14.415270+0000","last_active":"2024-04-25T11:24:15.035265+0000","last_peered":"2024-04-25T11:24:15.035265+0000","last_clean":"2024-04-25T11:24:15.035265+0000","last_became_active":"2024-04-25T11:22:14.413962+0000","last_became_peered":"2024-04-25T11:22:14.413962+0000","last_unstale":"2024-04-25T11:24:15.035265+0000","last_undegraded":"2024-04-25T11:24:15.035265+0000","last_fullsized":"2024-04-25T11:24:15.035265+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:31.160774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035041+0000","last_change":"2024-04-25T11:22:14.402643+0000","last_active":"2024-04-25T11:24:15.035041+0000","last_peered":"2024-04-25T11:24:15.035041+0000","last_clean":"2024-04-25T11:24:15.035041+0000","last_became_active":"2024-04-25T11:22:14.401940+0000","last_became_peered":"2024-04-25T11:22:14.401940+0000","last_unstale":"2024-04-25T11:24:15.035041+0000","last_undegraded":"2024-04-25T11:24:15.035041+0000","last_fullsized":"2024-04-25T11:24:15.035041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:47.270354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034182+0000","last_change":"2024-04-25T11:22:14.413726+0000","last_active":"2024-04-25T11:24:15.034182+0000","last_peered":"2024-04-25T11:24:15.034182+0000","last_clean":"2024-04-25T11:24:15.034182+0000","last_became_active":"2024-04-25T11:22:14.412971+0000","last_became_peered":"2024-04-25T11:22:14.412971+0000","last_unstale":"2024-04-25T11:24:15.034182+0000","last_undegraded":"2024-04-25T11:24:15.034182+0000","last_fullsized":"2024-04-25T11:24:15.034182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:42.017286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860304+0000","last_change":"2024-04-25T11:22:14.403390+0000","last_active":"2024-04-25T11:24:14.860304+0000","last_peered":"2024-04-25T11:24:14.860304+0000","last_clean":"2024-04-25T11:24:14.860304+0000","last_became_active":"2024-04-25T11:22:14.402999+0000","last_became_peered":"2024-04-25T11:22:14.402999+0000","last_unstale":"2024-04-25T11:24:14.860304+0000","last_undegraded":"2024-04-25T11:24:14.860304+0000","last_fullsized":"2024-04-25T11:24:14.860304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:59.283486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.867832+0000","last_change":"2024-04-25T11:22:56.415548+0000","last_active":"2024-04-25T11:24:14.867832+0000","last_peered":"2024-04-25T11:24:14.867832+0000","last_clean":"2024-04-25T11:24:14.867832+0000","last_became_active":"2024-04-25T11:22:56.414819+0000","last_became_peered":"2024-04-25T11:22:56.414819+0000","last_unstale":"2024-04-25T11:24:14.867832+0000","last_undegraded":"2024-04-25T11:24:14.867832+0000","last_fullsized":"2024-04-25T11:24:14.867832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:32.599336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029944+0000","last_change":"2024-04-25T11:22:14.404800+0000","last_active":"2024-04-25T11:24:15.029944+0000","last_peered":"2024-04-25T11:24:15.029944+0000","last_clean":"2024-04-25T11:24:15.029944+0000","last_became_active":"2024-04-25T11:22:14.404445+0000","last_became_peered":"2024-04-25T11:22:14.404445+0000","last_unstale":"2024-04-25T11:24:15.029944+0000","last_undegraded":"2024-04-25T11:24:15.029944+0000","last_fullsized":"2024-04-25T11:24:15.029944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:51.498081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857553+0000","last_change":"2024-04-25T11:22:56.415367+0000","last_active":"2024-04-25T11:24:14.857553+0000","last_peered":"2024-04-25T11:24:14.857553+0000","last_clean":"2024-04-25T11:24:14.857553+0000","last_became_active":"2024-04-25T11:22:56.414982+0000","last_became_peered":"2024-04-25T11:22:56.414982+0000","last_unstale":"2024-04-25T11:24:14.857553+0000","last_undegraded":"2024-04-25T11:24:14.857553+0000","last_fullsized":"2024-04-25T11:24:14.857553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:23.069726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757315+0000","last_change":"2024-04-25T11:22:14.410119+0000","last_active":"2024-04-25T11:24:14.757315+0000","last_peered":"2024-04-25T11:24:14.757315+0000","last_clean":"2024-04-25T11:24:14.757315+0000","last_became_active":"2024-04-25T11:22:14.409736+0000","last_became_peered":"2024-04-25T11:22:14.409736+0000","last_unstale":"2024-04-25T11:24:14.757315+0000","last_undegraded":"2024-04-25T11:24:14.757315+0000","last_fullsized":"2024-04-25T11:24:14.757315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:57.842921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868217+0000","last_change":"2024-04-25T11:22:14.416368+0000","last_active":"2024-04-25T11:24:14.868217+0000","last_peered":"2024-04-25T11:24:14.868217+0000","last_clean":"2024-04-25T11:24:14.868217+0000","last_became_active":"2024-04-25T11:22:14.415888+0000","last_became_peered":"2024-04-25T11:22:14.415888+0000","last_unstale":"2024-04-25T11:24:14.868217+0000","last_undegraded":"2024-04-25T11:24:14.868217+0000","last_fullsized":"2024-04-25T11:24:14.868217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:00.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030167+0000","last_change":"2024-04-25T11:22:14.402490+0000","last_active":"2024-04-25T11:24:15.030167+0000","last_peered":"2024-04-25T11:24:15.030167+0000","last_clean":"2024-04-25T11:24:15.030167+0000","last_became_active":"2024-04-25T11:22:14.402115+0000","last_became_peered":"2024-04-25T11:22:14.402115+0000","last_unstale":"2024-04-25T11:24:15.030167+0000","last_undegraded":"2024-04-25T11:24:15.030167+0000","last_fullsized":"2024-04-25T11:24:15.030167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:34.783230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034075+0000","last_change":"2024-04-25T11:22:14.420570+0000","last_active":"2024-04-25T11:24:15.034075+0000","last_peered":"2024-04-25T11:24:15.034075+0000","last_clean":"2024-04-25T11:24:15.034075+0000","last_became_active":"2024-04-25T11:22:14.420187+0000","last_became_peered":"2024-04-25T11:22:14.420187+0000","last_unstale":"2024-04-25T11:24:15.034075+0000","last_undegraded":"2024-04-25T11:24:15.034075+0000","last_fullsized":"2024-04-25T11:24:15.034075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:52.828114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819248+0000","last_change":"2024-04-25T11:22:14.414789+0000","last_active":"2024-04-25T11:24:14.819248+0000","last_peered":"2024-04-25T11:24:14.819248+0000","last_clean":"2024-04-25T11:24:14.819248+0000","last_became_active":"2024-04-25T11:22:14.414465+0000","last_became_peered":"2024-04-25T11:22:14.414465+0000","last_unstale":"2024-04-25T11:24:14.819248+0000","last_undegraded":"2024-04-25T11:24:14.819248+0000","last_fullsized":"2024-04-25T11:24:14.819248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:37.748045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034849+0000","last_change":"2024-04-25T11:22:14.413268+0000","last_active":"2024-04-25T11:24:15.034849+0000","last_peered":"2024-04-25T11:24:15.034849+0000","last_clean":"2024-04-25T11:24:15.034849+0000","last_became_active":"2024-04-25T11:22:14.412897+0000","last_became_peered":"2024-04-25T11:22:14.412897+0000","last_unstale":"2024-04-25T11:24:15.034849+0000","last_undegraded":"2024-04-25T11:24:15.034849+0000","last_fullsized":"2024-04-25T11:24:15.034849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:49.997236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034758+0000","last_change":"2024-04-25T11:22:14.411114+0000","last_active":"2024-04-25T11:24:15.034758+0000","last_peered":"2024-04-25T11:24:15.034758+0000","last_clean":"2024-04-25T11:24:15.034758+0000","last_became_active":"2024-04-25T11:22:14.410700+0000","last_became_peered":"2024-04-25T11:22:14.410700+0000","last_unstale":"2024-04-25T11:24:15.034758+0000","last_undegraded":"2024-04-25T11:24:15.034758+0000","last_fullsized":"2024-04-25T11:24:15.034758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:38.367214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756939+0000","last_change":"2024-04-25T11:22:14.408073+0000","last_active":"2024-04-25T11:24:14.756939+0000","last_peered":"2024-04-25T11:24:14.756939+0000","last_clean":"2024-04-25T11:24:14.756939+0000","last_became_active":"2024-04-25T11:22:14.406878+0000","last_became_peered":"2024-04-25T11:22:14.406878+0000","last_unstale":"2024-04-25T11:24:14.756939+0000","last_undegraded":"2024-04-25T11:24:14.756939+0000","last_fullsized":"2024-04-25T11:24:14.756939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:00.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105698+0000","last_change":"2024-04-25T11:22:14.406990+0000","last_active":"2024-04-25T11:24:15.105698+0000","last_peered":"2024-04-25T11:24:15.105698+0000","last_clean":"2024-04-25T11:24:15.105698+0000","last_became_active":"2024-04-25T11:22:14.406643+0000","last_became_peered":"2024-04-25T11:22:14.406643+0000","last_unstale":"2024-04-25T11:24:15.105698+0000","last_undegraded":"2024-04-25T11:24:15.105698+0000","last_fullsized":"2024-04-25T11:24:15.105698+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:15.226490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857915+0000","last_change":"2024-04-25T11:22:14.410651+0000","last_active":"2024-04-25T11:24:14.857915+0000","last_peered":"2024-04-25T11:24:14.857915+0000","last_clean":"2024-04-25T11:24:14.857915+0000","last_became_active":"2024-04-25T11:22:14.410299+0000","last_became_peered":"2024-04-25T11:22:14.410299+0000","last_unstale":"2024-04-25T11:24:14.857915+0000","last_undegraded":"2024-04-25T11:24:14.857915+0000","last_fullsized":"2024-04-25T11:24:14.857915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:50.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030468+0000","last_change":"2024-04-25T11:22:14.405714+0000","last_active":"2024-04-25T11:24:15.030468+0000","last_peered":"2024-04-25T11:24:15.030468+0000","last_clean":"2024-04-25T11:24:15.030468+0000","last_became_active":"2024-04-25T11:22:14.405376+0000","last_became_peered":"2024-04-25T11:22:14.405376+0000","last_unstale":"2024-04-25T11:24:15.030468+0000","last_undegraded":"2024-04-25T11:24:15.030468+0000","last_fullsized":"2024-04-25T11:24:15.030468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:18.538532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857780+0000","last_change":"2024-04-25T11:22:56.421708+0000","last_active":"2024-04-25T11:24:14.857780+0000","last_peered":"2024-04-25T11:24:14.857780+0000","last_clean":"2024-04-25T11:24:14.857780+0000","last_became_active":"2024-04-25T11:22:56.413182+0000","last_became_peered":"2024-04-25T11:22:56.413182+0000","last_unstale":"2024-04-25T11:24:14.857780+0000","last_undegraded":"2024-04-25T11:24:14.857780+0000","last_fullsized":"2024-04-25T11:24:14.857780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:30.235026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754711+0000","last_change":"2024-04-25T11:22:14.411893+0000","last_active":"2024-04-25T11:24:14.754711+0000","last_peered":"2024-04-25T11:24:14.754711+0000","last_clean":"2024-04-25T11:24:14.754711+0000","last_became_active":"2024-04-25T11:22:14.409727+0000","last_became_peered":"2024-04-25T11:22:14.409727+0000","last_unstale":"2024-04-25T11:24:14.754711+0000","last_undegraded":"2024-04-25T11:24:14.754711+0000","last_fullsized":"2024-04-25T11:24:14.754711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:41.961790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755143+0000","last_change":"2024-04-25T11:22:13.398983+0000","last_active":"2024-04-25T11:24:14.755143+0000","last_peered":"2024-04-25T11:24:14.755143+0000","last_clean":"2024-04-25T11:24:14.755143+0000","last_became_active":"2024-04-25T11:22:13.397819+0000","last_became_peered":"2024-04-25T11:22:13.397819+0000","last_unstale":"2024-04-25T11:24:14.755143+0000","last_undegraded":"2024-04-25T11:24:14.755143+0000","last_fullsized":"2024-04-25T11:24:14.755143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:19.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035122+0000","last_change":"2024-04-25T11:22:14.410589+0000","last_active":"2024-04-25T11:24:15.035122+0000","last_peered":"2024-04-25T11:24:15.035122+0000","last_clean":"2024-04-25T11:24:15.035122+0000","last_became_active":"2024-04-25T11:22:14.409921+0000","last_became_peered":"2024-04-25T11:22:14.409921+0000","last_unstale":"2024-04-25T11:24:15.035122+0000","last_undegraded":"2024-04-25T11:24:15.035122+0000","last_fullsized":"2024-04-25T11:24:15.035122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:59.251335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860673+0000","last_change":"2024-04-25T11:22:13.406244+0000","last_active":"2024-04-25T11:24:14.860673+0000","last_peered":"2024-04-25T11:24:14.860673+0000","last_clean":"2024-04-25T11:24:14.860673+0000","last_became_active":"2024-04-25T11:22:13.405902+0000","last_became_peered":"2024-04-25T11:22:13.405902+0000","last_unstale":"2024-04-25T11:24:14.860673+0000","last_undegraded":"2024-04-25T11:24:14.860673+0000","last_fullsized":"2024-04-25T11:24:14.860673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:05.862922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757145+0000","last_change":"2024-04-25T11:22:14.421110+0000","last_active":"2024-04-25T11:24:14.757145+0000","last_peered":"2024-04-25T11:24:14.757145+0000","last_clean":"2024-04-25T11:24:14.757145+0000","last_became_active":"2024-04-25T11:22:14.420705+0000","last_became_peered":"2024-04-25T11:22:14.420705+0000","last_unstale":"2024-04-25T11:24:14.757145+0000","last_undegraded":"2024-04-25T11:24:14.757145+0000","last_fullsized":"2024-04-25T11:24:14.757145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:57.353467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860508+0000","last_change":"2024-04-25T11:22:13.406063+0000","last_active":"2024-04-25T11:24:14.860508+0000","last_peered":"2024-04-25T11:24:14.860508+0000","last_clean":"2024-04-25T11:24:14.860508+0000","last_became_active":"2024-04-25T11:22:13.405690+0000","last_became_peered":"2024-04-25T11:22:13.405690+0000","last_unstale":"2024-04-25T11:24:14.860508+0000","last_undegraded":"2024-04-25T11:24:14.860508+0000","last_fullsized":"2024-04-25T11:24:14.860508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:34.296298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756308+0000","last_change":"2024-04-25T11:22:14.413077+0000","last_active":"2024-04-25T11:24:14.756308+0000","last_peered":"2024-04-25T11:24:14.756308+0000","last_clean":"2024-04-25T11:24:14.756308+0000","last_became_active":"2024-04-25T11:22:14.412712+0000","last_became_peered":"2024-04-25T11:22:14.412712+0000","last_unstale":"2024-04-25T11:24:14.756308+0000","last_undegraded":"2024-04-25T11:24:14.756308+0000","last_fullsized":"2024-04-25T11:24:14.756308+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:41.683840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'10","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.623578+0000","last_change":"2024-04-25T11:22:13.396239+0000","last_active":"2024-04-25T11:24:15.623578+0000","last_peered":"2024-04-25T11:24:15.623578+0000","last_clean":"2024-04-25T11:24:15.623578+0000","last_became_active":"2024-04-25T11:22:13.395653+0000","last_became_peered":"2024-04-25T11:22:13.395653+0000","last_unstale":"2024-04-25T11:24:15.623578+0000","last_undegraded":"2024-04-25T11:24:15.623578+0000","last_fullsized":"2024-04-25T11:24:15.623578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:05.218927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860174+0000","last_change":"2024-04-25T11:22:14.409052+0000","last_active":"2024-04-25T11:24:14.860174+0000","last_peered":"2024-04-25T11:24:14.860174+0000","last_clean":"2024-04-25T11:24:14.860174+0000","last_became_active":"2024-04-25T11:22:14.408580+0000","last_became_peered":"2024-04-25T11:22:14.408580+0000","last_unstale":"2024-04-25T11:24:14.860174+0000","last_undegraded":"2024-04-25T11:24:14.860174+0000","last_fullsized":"2024-04-25T11:24:14.860174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:14.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.867776+0000","last_change":"2024-04-25T11:22:13.399086+0000","last_active":"2024-04-25T11:24:14.867776+0000","last_peered":"2024-04-25T11:24:14.867776+0000","last_clean":"2024-04-25T11:24:14.867776+0000","last_became_active":"2024-04-25T11:22:13.398559+0000","last_became_peered":"2024-04-25T11:22:13.398559+0000","last_unstale":"2024-04-25T11:24:14.867776+0000","last_undegraded":"2024-04-25T11:24:14.867776+0000","last_fullsized":"2024-04-25T11:24:14.867776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:09.913470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857939+0000","last_change":"2024-04-25T11:22:56.416426+0000","last_active":"2024-04-25T11:24:14.857939+0000","last_peered":"2024-04-25T11:24:14.857939+0000","last_clean":"2024-04-25T11:24:14.857939+0000","last_became_active":"2024-04-25T11:22:56.415792+0000","last_became_peered":"2024-04-25T11:22:56.415792+0000","last_unstale":"2024-04-25T11:24:14.857939+0000","last_undegraded":"2024-04-25T11:24:14.857939+0000","last_fullsized":"2024-04-25T11:24:14.857939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:24.421846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,8],"acting":[9,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819026+0000","last_change":"2024-04-25T11:22:13.392703+0000","last_active":"2024-04-25T11:24:14.819026+0000","last_peered":"2024-04-25T11:24:14.819026+0000","last_clean":"2024-04-25T11:24:14.819026+0000","last_became_active":"2024-04-25T11:22:13.392337+0000","last_became_peered":"2024-04-25T11:22:13.392337+0000","last_unstale":"2024-04-25T11:24:14.819026+0000","last_undegraded":"2024-04-25T11:24:14.819026+0000","last_fullsized":"2024-04-25T11:24:14.819026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:33.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754470+0000","last_change":"2024-04-25T11:22:14.398526+0000","last_active":"2024-04-25T11:24:14.754470+0000","last_peered":"2024-04-25T11:24:14.754470+0000","last_clean":"2024-04-25T11:24:14.754470+0000","last_became_active":"2024-04-25T11:22:14.398083+0000","last_became_peered":"2024-04-25T11:22:14.398083+0000","last_unstale":"2024-04-25T11:24:14.754470+0000","last_undegraded":"2024-04-25T11:24:14.754470+0000","last_fullsized":"2024-04-25T11:24:14.754470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:03.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755970+0000","last_change":"2024-04-25T11:22:13.397599+0000","last_active":"2024-04-25T11:24:14.755970+0000","last_peered":"2024-04-25T11:24:14.755970+0000","last_clean":"2024-04-25T11:24:14.755970+0000","last_became_active":"2024-04-25T11:22:13.396748+0000","last_became_peered":"2024-04-25T11:22:13.396748+0000","last_unstale":"2024-04-25T11:24:14.755970+0000","last_undegraded":"2024-04-25T11:24:14.755970+0000","last_fullsized":"2024-04-25T11:24:14.755970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:31.012095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857575+0000","last_change":"2024-04-25T11:22:14.404668+0000","last_active":"2024-04-25T11:24:14.857575+0000","last_peered":"2024-04-25T11:24:14.857575+0000","last_clean":"2024-04-25T11:24:14.857575+0000","last_became_active":"2024-04-25T11:22:14.404306+0000","last_became_peered":"2024-04-25T11:22:14.404306+0000","last_unstale":"2024-04-25T11:24:14.857575+0000","last_undegraded":"2024-04-25T11:24:14.857575+0000","last_fullsized":"2024-04-25T11:24:14.857575+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:16.430419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'5","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868252+0000","last_change":"2024-04-25T11:22:13.398240+0000","last_active":"2024-04-25T11:24:14.868252+0000","last_peered":"2024-04-25T11:24:14.868252+0000","last_clean":"2024-04-25T11:24:14.868252+0000","last_became_active":"2024-04-25T11:22:13.397875+0000","last_became_peered":"2024-04-25T11:22:13.397875+0000","last_unstale":"2024-04-25T11:24:14.868252+0000","last_undegraded":"2024-04-25T11:24:14.868252+0000","last_fullsized":"2024-04-25T11:24:14.868252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:29.007270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757419+0000","last_change":"2024-04-25T11:22:14.422075+0000","last_active":"2024-04-25T11:24:14.757419+0000","last_peered":"2024-04-25T11:24:14.757419+0000","last_clean":"2024-04-25T11:24:14.757419+0000","last_became_active":"2024-04-25T11:22:14.421699+0000","last_became_peered":"2024-04-25T11:22:14.421699+0000","last_unstale":"2024-04-25T11:24:14.757419+0000","last_undegraded":"2024-04-25T11:24:14.757419+0000","last_fullsized":"2024-04-25T11:24:14.757419+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030264+0000","last_change":"2024-04-25T11:22:13.398104+0000","last_active":"2024-04-25T11:24:15.030264+0000","last_peered":"2024-04-25T11:24:15.030264+0000","last_clean":"2024-04-25T11:24:15.030264+0000","last_became_active":"2024-04-25T11:22:13.397716+0000","last_became_peered":"2024-04-25T11:22:13.397716+0000","last_unstale":"2024-04-25T11:24:15.030264+0000","last_undegraded":"2024-04-25T11:24:15.030264+0000","last_fullsized":"2024-04-25T11:24:15.030264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035316+0000","last_change":"2024-04-25T11:22:14.413664+0000","last_active":"2024-04-25T11:24:15.035316+0000","last_peered":"2024-04-25T11:24:15.035316+0000","last_clean":"2024-04-25T11:24:15.035316+0000","last_became_active":"2024-04-25T11:22:14.412621+0000","last_became_peered":"2024-04-25T11:22:14.412621+0000","last_unstale":"2024-04-25T11:24:15.035316+0000","last_undegraded":"2024-04-25T11:24:15.035316+0000","last_fullsized":"2024-04-25T11:24:15.035316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:24.511828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756391+0000","last_change":"2024-04-25T11:22:13.397141+0000","last_active":"2024-04-25T11:24:14.756391+0000","last_peered":"2024-04-25T11:24:14.756391+0000","last_clean":"2024-04-25T11:24:14.756391+0000","last_became_active":"2024-04-25T11:22:13.396769+0000","last_became_peered":"2024-04-25T11:22:13.396769+0000","last_unstale":"2024-04-25T11:24:14.756391+0000","last_undegraded":"2024-04-25T11:24:14.756391+0000","last_fullsized":"2024-04-25T11:24:14.756391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:40.123906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757252+0000","last_change":"2024-04-25T11:22:14.412279+0000","last_active":"2024-04-25T11:24:14.757252+0000","last_peered":"2024-04-25T11:24:14.757252+0000","last_clean":"2024-04-25T11:24:14.757252+0000","last_became_active":"2024-04-25T11:22:14.410325+0000","last_became_peered":"2024-04-25T11:22:14.410325+0000","last_unstale":"2024-04-25T11:24:14.757252+0000","last_undegraded":"2024-04-25T11:24:14.757252+0000","last_fullsized":"2024-04-25T11:24:14.757252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:03.788349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'36","reported_seq":305,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.630689+0000","last_change":"2024-04-25T11:22:13.393664+0000","last_active":"2024-04-25T11:24:15.630689+0000","last_peered":"2024-04-25T11:24:15.630689+0000","last_clean":"2024-04-25T11:24:15.630689+0000","last_became_active":"2024-04-25T11:22:13.393279+0000","last_became_peered":"2024-04-25T11:22:13.393279+0000","last_unstale":"2024-04-25T11:24:15.630689+0000","last_undegraded":"2024-04-25T11:24:15.630689+0000","last_fullsized":"2024-04-25T11:24:15.630689+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":190,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860521+0000","last_change":"2024-04-25T11:22:14.399944+0000","last_active":"2024-04-25T11:24:14.860521+0000","last_peered":"2024-04-25T11:24:14.860521+0000","last_clean":"2024-04-25T11:24:14.860521+0000","last_became_active":"2024-04-25T11:22:14.399592+0000","last_became_peered":"2024-04-25T11:22:14.399592+0000","last_unstale":"2024-04-25T11:24:14.860521+0000","last_undegraded":"2024-04-25T11:24:14.860521+0000","last_fullsized":"2024-04-25T11:24:14.860521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:18.794517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030571+0000","last_change":"2024-04-25T11:22:13.398651+0000","last_active":"2024-04-25T11:24:15.030571+0000","last_peered":"2024-04-25T11:24:15.030571+0000","last_clean":"2024-04-25T11:24:15.030571+0000","last_became_active":"2024-04-25T11:22:13.398234+0000","last_became_peered":"2024-04-25T11:22:13.398234+0000","last_unstale":"2024-04-25T11:24:15.030571+0000","last_undegraded":"2024-04-25T11:24:15.030571+0000","last_fullsized":"2024-04-25T11:24:15.030571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:39.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819069+0000","last_change":"2024-04-25T11:22:14.404684+0000","last_active":"2024-04-25T11:24:14.819069+0000","last_peered":"2024-04-25T11:24:14.819069+0000","last_clean":"2024-04-25T11:24:14.819069+0000","last_became_active":"2024-04-25T11:22:14.404319+0000","last_became_peered":"2024-04-25T11:22:14.404319+0000","last_unstale":"2024-04-25T11:24:14.819069+0000","last_undegraded":"2024-04-25T11:24:14.819069+0000","last_fullsized":"2024-04-25T11:24:14.819069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:40.388670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756091+0000","last_change":"2024-04-25T11:22:13.397954+0000","last_active":"2024-04-25T11:24:14.756091+0000","last_peered":"2024-04-25T11:24:14.756091+0000","last_clean":"2024-04-25T11:24:14.756091+0000","last_became_active":"2024-04-25T11:22:13.397595+0000","last_became_peered":"2024-04-25T11:22:13.397595+0000","last_unstale":"2024-04-25T11:24:14.756091+0000","last_undegraded":"2024-04-25T11:24:14.756091+0000","last_fullsized":"2024-04-25T11:24:14.756091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:31.912201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030364+0000","last_change":"2024-04-25T11:22:14.411671+0000","last_active":"2024-04-25T11:24:15.030364+0000","last_peered":"2024-04-25T11:24:15.030364+0000","last_clean":"2024-04-25T11:24:15.030364+0000","last_became_active":"2024-04-25T11:22:14.411034+0000","last_became_peered":"2024-04-25T11:22:14.411034+0000","last_unstale":"2024-04-25T11:24:15.030364+0000","last_undegraded":"2024-04-25T11:24:15.030364+0000","last_fullsized":"2024-04-25T11:24:15.030364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:23.614652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'7","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.621751+0000","last_change":"2024-04-25T11:22:13.397193+0000","last_active":"2024-04-25T11:24:15.621751+0000","last_peered":"2024-04-25T11:24:15.621751+0000","last_clean":"2024-04-25T11:24:15.621751+0000","last_became_active":"2024-04-25T11:22:13.396319+0000","last_became_peered":"2024-04-25T11:22:13.396319+0000","last_unstale":"2024-04-25T11:24:15.621751+0000","last_undegraded":"2024-04-25T11:24:15.621751+0000","last_fullsized":"2024-04-25T11:24:15.621751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.140114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029922+0000","last_change":"2024-04-25T11:22:14.404123+0000","last_active":"2024-04-25T11:24:15.029922+0000","last_peered":"2024-04-25T11:24:15.029922+0000","last_clean":"2024-04-25T11:24:15.029922+0000","last_became_active":"2024-04-25T11:22:14.403751+0000","last_became_peered":"2024-04-25T11:22:14.403751+0000","last_unstale":"2024-04-25T11:24:15.029922+0000","last_undegraded":"2024-04-25T11:24:15.029922+0000","last_fullsized":"2024-04-25T11:24:15.029922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:22.361257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860145+0000","last_change":"2024-04-25T11:22:13.402801+0000","last_active":"2024-04-25T11:24:14.860145+0000","last_peered":"2024-04-25T11:24:14.860145+0000","last_clean":"2024-04-25T11:24:14.860145+0000","last_became_active":"2024-04-25T11:22:13.402417+0000","last_became_peered":"2024-04-25T11:22:13.402417+0000","last_unstale":"2024-04-25T11:24:14.860145+0000","last_undegraded":"2024-04-25T11:24:14.860145+0000","last_fullsized":"2024-04-25T11:24:14.860145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:55.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756039+0000","last_change":"2024-04-25T11:22:14.413947+0000","last_active":"2024-04-25T11:24:14.756039+0000","last_peered":"2024-04-25T11:24:14.756039+0000","last_clean":"2024-04-25T11:24:14.756039+0000","last_became_active":"2024-04-25T11:22:14.413549+0000","last_became_peered":"2024-04-25T11:22:14.413549+0000","last_unstale":"2024-04-25T11:24:14.756039+0000","last_undegraded":"2024-04-25T11:24:14.756039+0000","last_fullsized":"2024-04-25T11:24:14.756039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:42.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'3","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105714+0000","last_change":"2024-04-25T11:22:56.420875+0000","last_active":"2024-04-25T11:24:15.105714+0000","last_peered":"2024-04-25T11:24:15.105714+0000","last_clean":"2024-04-25T11:24:15.105714+0000","last_became_active":"2024-04-25T11:22:56.415615+0000","last_became_peered":"2024-04-25T11:22:56.415615+0000","last_unstale":"2024-04-25T11:24:15.105714+0000","last_undegraded":"2024-04-25T11:24:15.105714+0000","last_fullsized":"2024-04-25T11:24:15.105714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:55.053238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105629+0000","last_change":"2024-04-25T11:22:56.413403+0000","last_active":"2024-04-25T11:24:15.105629+0000","last_peered":"2024-04-25T11:24:15.105629+0000","last_clean":"2024-04-25T11:24:15.105629+0000","last_became_active":"2024-04-25T11:22:56.413002+0000","last_became_peered":"2024-04-25T11:22:56.413002+0000","last_unstale":"2024-04-25T11:24:15.105629+0000","last_undegraded":"2024-04-25T11:24:15.105629+0000","last_fullsized":"2024-04-25T11:24:15.105629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:42.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.858031+0000","last_change":"2024-04-25T11:22:13.394583+0000","last_active":"2024-04-25T11:24:14.858031+0000","last_peered":"2024-04-25T11:24:14.858031+0000","last_clean":"2024-04-25T11:24:14.858031+0000","last_became_active":"2024-04-25T11:22:13.394210+0000","last_became_peered":"2024-04-25T11:22:13.394210+0000","last_unstale":"2024-04-25T11:24:14.858031+0000","last_undegraded":"2024-04-25T11:24:14.858031+0000","last_fullsized":"2024-04-25T11:24:14.858031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:34.622567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868102+0000","last_change":"2024-04-25T11:22:14.404487+0000","last_active":"2024-04-25T11:24:14.868102+0000","last_peered":"2024-04-25T11:24:14.868102+0000","last_clean":"2024-04-25T11:24:14.868102+0000","last_became_active":"2024-04-25T11:22:14.404096+0000","last_became_peered":"2024-04-25T11:22:14.404096+0000","last_unstale":"2024-04-25T11:24:14.868102+0000","last_undegraded":"2024-04-25T11:24:14.868102+0000","last_fullsized":"2024-04-25T11:24:14.868102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:55.938011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030047+0000","last_change":"2024-04-25T11:22:13.397273+0000","last_active":"2024-04-25T11:24:15.030047+0000","last_peered":"2024-04-25T11:24:15.030047+0000","last_clean":"2024-04-25T11:24:15.030047+0000","last_became_active":"2024-04-25T11:22:13.396538+0000","last_became_peered":"2024-04-25T11:22:13.396538+0000","last_unstale":"2024-04-25T11:24:15.030047+0000","last_undegraded":"2024-04-25T11:24:15.030047+0000","last_fullsized":"2024-04-25T11:24:15.030047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:04.738107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868002+0000","last_change":"2024-04-25T11:22:56.454081+0000","last_active":"2024-04-25T11:24:14.868002+0000","last_peered":"2024-04-25T11:24:14.868002+0000","last_clean":"2024-04-25T11:24:14.868002+0000","last_became_active":"2024-04-25T11:22:56.453729+0000","last_became_peered":"2024-04-25T11:22:56.453729+0000","last_unstale":"2024-04-25T11:24:14.868002+0000","last_undegraded":"2024-04-25T11:24:14.868002+0000","last_fullsized":"2024-04-25T11:24:14.868002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:55.124699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756175+0000","last_change":"2024-04-25T11:22:14.411786+0000","last_active":"2024-04-25T11:24:14.756175+0000","last_peered":"2024-04-25T11:24:14.756175+0000","last_clean":"2024-04-25T11:24:14.756175+0000","last_became_active":"2024-04-25T11:22:14.411433+0000","last_became_peered":"2024-04-25T11:22:14.411433+0000","last_unstale":"2024-04-25T11:24:14.756175+0000","last_undegraded":"2024-04-25T11:24:14.756175+0000","last_fullsized":"2024-04-25T11:24:14.756175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:28.948581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034825+0000","last_change":"2024-04-25T11:22:13.396834+0000","last_active":"2024-04-25T11:24:15.034825+0000","last_peered":"2024-04-25T11:24:15.034825+0000","last_clean":"2024-04-25T11:24:15.034825+0000","last_became_active":"2024-04-25T11:22:13.396439+0000","last_became_peered":"2024-04-25T11:22:13.396439+0000","last_unstale":"2024-04-25T11:24:15.034825+0000","last_undegraded":"2024-04-25T11:24:15.034825+0000","last_fullsized":"2024-04-25T11:24:15.034825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755249+0000","last_change":"2024-04-25T11:22:14.404784+0000","last_active":"2024-04-25T11:24:14.755249+0000","last_peered":"2024-04-25T11:24:14.755249+0000","last_clean":"2024-04-25T11:24:14.755249+0000","last_became_active":"2024-04-25T11:22:14.404355+0000","last_became_peered":"2024-04-25T11:22:14.404355+0000","last_unstale":"2024-04-25T11:24:14.755249+0000","last_undegraded":"2024-04-25T11:24:14.755249+0000","last_fullsized":"2024-04-25T11:24:14.755249+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:04.698767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.033963+0000","last_change":"2024-04-25T11:22:13.389125+0000","last_active":"2024-04-25T11:24:15.033963+0000","last_peered":"2024-04-25T11:24:15.033963+0000","last_clean":"2024-04-25T11:24:15.033963+0000","last_became_active":"2024-04-25T11:22:13.387160+0000","last_became_peered":"2024-04-25T11:22:13.387160+0000","last_unstale":"2024-04-25T11:24:15.033963+0000","last_undegraded":"2024-04-25T11:24:15.033963+0000","last_fullsized":"2024-04-25T11:24:15.033963+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:11.839065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029987+0000","last_change":"2024-04-25T11:20:53.708987+0000","last_active":"2024-04-25T11:24:15.029987+0000","last_peered":"2024-04-25T11:24:15.029987+0000","last_clean":"2024-04-25T11:24:15.029987+0000","last_became_active":"2024-04-25T11:20:53.704654+0000","last_became_peered":"2024-04-25T11:20:53.704654+0000","last_unstale":"2024-04-25T11:24:15.029987+0000","last_undegraded":"2024-04-25T11:24:15.029987+0000","last_fullsized":"2024-04-25T11:24:15.029987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_clean_scrub_stamp":"2024-04-25T11:17:24.025142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:24.174044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.818909+0000","last_change":"2024-04-25T11:22:14.413776+0000","last_active":"2024-04-25T11:24:14.818909+0000","last_peered":"2024-04-25T11:24:14.818909+0000","last_clean":"2024-04-25T11:24:14.818909+0000","last_became_active":"2024-04-25T11:22:14.413417+0000","last_became_peered":"2024-04-25T11:22:14.413417+0000","last_unstale":"2024-04-25T11:24:14.818909+0000","last_undegraded":"2024-04-25T11:24:14.818909+0000","last_fullsized":"2024-04-25T11:24:14.818909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:15.393246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030141+0000","last_change":"2024-04-25T11:22:13.404113+0000","last_active":"2024-04-25T11:24:15.030141+0000","last_peered":"2024-04-25T11:24:15.030141+0000","last_clean":"2024-04-25T11:24:15.030141+0000","last_became_active":"2024-04-25T11:22:13.403711+0000","last_became_peered":"2024-04-25T11:22:13.403711+0000","last_unstale":"2024-04-25T11:24:15.030141+0000","last_undegraded":"2024-04-25T11:24:15.030141+0000","last_fullsized":"2024-04-25T11:24:15.030141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:52.618167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860535+0000","last_change":"2024-04-25T11:22:13.404334+0000","last_active":"2024-04-25T11:24:14.860535+0000","last_peered":"2024-04-25T11:24:14.860535+0000","last_clean":"2024-04-25T11:24:14.860535+0000","last_became_active":"2024-04-25T11:22:13.403896+0000","last_became_peered":"2024-04-25T11:22:13.403896+0000","last_unstale":"2024-04-25T11:24:14.860535+0000","last_undegraded":"2024-04-25T11:24:14.860535+0000","last_fullsized":"2024-04-25T11:24:14.860535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:24.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819548+0000","last_change":"2024-04-25T11:22:14.406921+0000","last_active":"2024-04-25T11:24:14.819548+0000","last_peered":"2024-04-25T11:24:14.819548+0000","last_clean":"2024-04-25T11:24:14.819548+0000","last_became_active":"2024-04-25T11:22:14.406520+0000","last_became_peered":"2024-04-25T11:22:14.406520+0000","last_unstale":"2024-04-25T11:24:14.819548+0000","last_undegraded":"2024-04-25T11:24:14.819548+0000","last_fullsized":"2024-04-25T11:24:14.819548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:24.127805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'44","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.984378+0000","last_change":"2024-04-25T11:22:13.400870+0000","last_active":"2024-04-25T11:24:14.984378+0000","last_peered":"2024-04-25T11:24:14.984378+0000","last_clean":"2024-04-25T11:24:14.984378+0000","last_became_active":"2024-04-25T11:22:13.400479+0000","last_became_peered":"2024-04-25T11:22:13.400479+0000","last_unstale":"2024-04-25T11:24:14.984378+0000","last_undegraded":"2024-04-25T11:24:14.984378+0000","last_fullsized":"2024-04-25T11:24:14.984378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:12.975205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754879+0000","last_change":"2024-04-25T11:22:14.402782+0000","last_active":"2024-04-25T11:24:14.754879+0000","last_peered":"2024-04-25T11:24:14.754879+0000","last_clean":"2024-04-25T11:24:14.754879+0000","last_became_active":"2024-04-25T11:22:14.402368+0000","last_became_peered":"2024-04-25T11:22:14.402368+0000","last_unstale":"2024-04-25T11:24:14.754879+0000","last_undegraded":"2024-04-25T11:24:14.754879+0000","last_fullsized":"2024-04-25T11:24:14.754879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:49.897015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034079+0000","last_change":"2024-04-25T11:22:13.390229+0000","last_active":"2024-04-25T11:24:15.034079+0000","last_peered":"2024-04-25T11:24:15.034079+0000","last_clean":"2024-04-25T11:24:15.034079+0000","last_became_active":"2024-04-25T11:22:13.389825+0000","last_became_peered":"2024-04-25T11:22:13.389825+0000","last_unstale":"2024-04-25T11:24:15.034079+0000","last_undegraded":"2024-04-25T11:24:15.034079+0000","last_fullsized":"2024-04-25T11:24:15.034079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:50.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035284+0000","last_change":"2024-04-25T11:22:14.412066+0000","last_active":"2024-04-25T11:24:15.035284+0000","last_peered":"2024-04-25T11:24:15.035284+0000","last_clean":"2024-04-25T11:24:15.035284+0000","last_became_active":"2024-04-25T11:22:14.411707+0000","last_became_peered":"2024-04-25T11:22:14.411707+0000","last_unstale":"2024-04-25T11:24:15.035284+0000","last_undegraded":"2024-04-25T11:24:15.035284+0000","last_fullsized":"2024-04-25T11:24:15.035284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:13.274928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757021+0000","last_change":"2024-04-25T11:22:13.397644+0000","last_active":"2024-04-25T11:24:14.757021+0000","last_peered":"2024-04-25T11:24:14.757021+0000","last_clean":"2024-04-25T11:24:14.757021+0000","last_became_active":"2024-04-25T11:22:13.397240+0000","last_became_peered":"2024-04-25T11:22:13.397240+0000","last_unstale":"2024-04-25T11:24:14.757021+0000","last_undegraded":"2024-04-25T11:24:14.757021+0000","last_fullsized":"2024-04-25T11:24:14.757021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.927399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860161+0000","last_change":"2024-04-25T11:22:14.416191+0000","last_active":"2024-04-25T11:24:14.860161+0000","last_peered":"2024-04-25T11:24:14.860161+0000","last_clean":"2024-04-25T11:24:14.860161+0000","last_became_active":"2024-04-25T11:22:14.415537+0000","last_became_peered":"2024-04-25T11:22:14.415537+0000","last_unstale":"2024-04-25T11:24:14.860161+0000","last_undegraded":"2024-04-25T11:24:14.860161+0000","last_fullsized":"2024-04-25T11:24:14.860161+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:27.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754572+0000","last_change":"2024-04-25T11:22:13.390329+0000","last_active":"2024-04-25T11:24:14.754572+0000","last_peered":"2024-04-25T11:24:14.754572+0000","last_clean":"2024-04-25T11:24:14.754572+0000","last_became_active":"2024-04-25T11:22:13.389854+0000","last_became_peered":"2024-04-25T11:22:13.389854+0000","last_unstale":"2024-04-25T11:24:14.754572+0000","last_undegraded":"2024-04-25T11:24:14.754572+0000","last_fullsized":"2024-04-25T11:24:14.754572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:01.238826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105442+0000","last_change":"2024-04-25T11:22:14.395782+0000","last_active":"2024-04-25T11:24:15.105442+0000","last_peered":"2024-04-25T11:24:15.105442+0000","last_clean":"2024-04-25T11:24:15.105442+0000","last_became_active":"2024-04-25T11:22:14.395321+0000","last_became_peered":"2024-04-25T11:22:14.395321+0000","last_unstale":"2024-04-25T11:24:15.105442+0000","last_undegraded":"2024-04-25T11:24:15.105442+0000","last_fullsized":"2024-04-25T11:24:15.105442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:08.842424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030255+0000","last_change":"2024-04-25T11:22:13.401087+0000","last_active":"2024-04-25T11:24:15.030255+0000","last_peered":"2024-04-25T11:24:15.030255+0000","last_clean":"2024-04-25T11:24:15.030255+0000","last_became_active":"2024-04-25T11:22:13.400537+0000","last_became_peered":"2024-04-25T11:22:13.400537+0000","last_unstale":"2024-04-25T11:24:15.030255+0000","last_undegraded":"2024-04-25T11:24:15.030255+0000","last_fullsized":"2024-04-25T11:24:15.030255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:24.566260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754789+0000","last_change":"2024-04-25T11:22:14.399436+0000","last_active":"2024-04-25T11:24:14.754789+0000","last_peered":"2024-04-25T11:24:14.754789+0000","last_clean":"2024-04-25T11:24:14.754789+0000","last_became_active":"2024-04-25T11:22:14.398968+0000","last_became_peered":"2024-04-25T11:22:14.398968+0000","last_unstale":"2024-04-25T11:24:14.754789+0000","last_undegraded":"2024-04-25T11:24:14.754789+0000","last_fullsized":"2024-04-25T11:24:14.754789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:52.426381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860261+0000","last_change":"2024-04-25T11:22:56.420115+0000","last_active":"2024-04-25T11:24:14.860261+0000","last_peered":"2024-04-25T11:24:14.860261+0000","last_clean":"2024-04-25T11:24:14.860261+0000","last_became_active":"2024-04-25T11:22:56.414491+0000","last_became_peered":"2024-04-25T11:22:56.414491+0000","last_unstale":"2024-04-25T11:24:14.860261+0000","last_undegraded":"2024-04-25T11:24:14.860261+0000","last_fullsized":"2024-04-25T11:24:14.860261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:36.180143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030158+0000","last_change":"2024-04-25T11:22:14.403391+0000","last_active":"2024-04-25T11:24:15.030158+0000","last_peered":"2024-04-25T11:24:15.030158+0000","last_clean":"2024-04-25T11:24:15.030158+0000","last_became_active":"2024-04-25T11:22:14.402817+0000","last_became_peered":"2024-04-25T11:22:14.402817+0000","last_unstale":"2024-04-25T11:24:15.030158+0000","last_undegraded":"2024-04-25T11:24:15.030158+0000","last_fullsized":"2024-04-25T11:24:15.030158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:34.190216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030473+0000","last_change":"2024-04-25T11:22:13.394733+0000","last_active":"2024-04-25T11:24:15.030473+0000","last_peered":"2024-04-25T11:24:15.030473+0000","last_clean":"2024-04-25T11:24:15.030473+0000","last_became_active":"2024-04-25T11:22:13.394389+0000","last_became_peered":"2024-04-25T11:22:13.394389+0000","last_unstale":"2024-04-25T11:24:15.030473+0000","last_undegraded":"2024-04-25T11:24:15.030473+0000","last_fullsized":"2024-04-25T11:24:15.030473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.751957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030220+0000","last_change":"2024-04-25T11:22:14.398974+0000","last_active":"2024-04-25T11:24:15.030220+0000","last_peered":"2024-04-25T11:24:15.030220+0000","last_clean":"2024-04-25T11:24:15.030220+0000","last_became_active":"2024-04-25T11:22:14.396317+0000","last_became_peered":"2024-04-25T11:22:14.396317+0000","last_unstale":"2024-04-25T11:24:15.030220+0000","last_undegraded":"2024-04-25T11:24:15.030220+0000","last_fullsized":"2024-04-25T11:24:15.030220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:43.173266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'39","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.981862+0000","last_change":"2024-04-25T11:22:13.405081+0000","last_active":"2024-04-25T11:24:14.981862+0000","last_peered":"2024-04-25T11:24:14.981862+0000","last_clean":"2024-04-25T11:24:14.981862+0000","last_became_active":"2024-04-25T11:22:13.404160+0000","last_became_peered":"2024-04-25T11:22:13.404160+0000","last_unstale":"2024-04-25T11:24:14.981862+0000","last_undegraded":"2024-04-25T11:24:14.981862+0000","last_fullsized":"2024-04-25T11:24:14.981862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:33.591987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030083+0000","last_change":"2024-04-25T11:22:14.406014+0000","last_active":"2024-04-25T11:24:15.030083+0000","last_peered":"2024-04-25T11:24:15.030083+0000","last_clean":"2024-04-25T11:24:15.030083+0000","last_became_active":"2024-04-25T11:22:14.405609+0000","last_became_peered":"2024-04-25T11:22:14.405609+0000","last_unstale":"2024-04-25T11:24:15.030083+0000","last_undegraded":"2024-04-25T11:24:15.030083+0000","last_fullsized":"2024-04-25T11:24:15.030083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:55.357497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819656+0000","last_change":"2024-04-25T11:22:56.422584+0000","last_active":"2024-04-25T11:24:14.819656+0000","last_peered":"2024-04-25T11:24:14.819656+0000","last_clean":"2024-04-25T11:24:14.819656+0000","last_became_active":"2024-04-25T11:22:56.415765+0000","last_became_peered":"2024-04-25T11:22:56.415765+0000","last_unstale":"2024-04-25T11:24:14.819656+0000","last_undegraded":"2024-04-25T11:24:14.819656+0000","last_fullsized":"2024-04-25T11:24:14.819656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:31.321372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030327+0000","last_change":"2024-04-25T11:22:14.396359+0000","last_active":"2024-04-25T11:24:15.030327+0000","last_peered":"2024-04-25T11:24:15.030327+0000","last_clean":"2024-04-25T11:24:15.030327+0000","last_became_active":"2024-04-25T11:22:14.395818+0000","last_became_peered":"2024-04-25T11:22:14.395818+0000","last_unstale":"2024-04-25T11:24:15.030327+0000","last_undegraded":"2024-04-25T11:24:15.030327+0000","last_fullsized":"2024-04-25T11:24:15.030327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.964366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105549+0000","last_change":"2024-04-25T11:22:14.396700+0000","last_active":"2024-04-25T11:24:15.105549+0000","last_peered":"2024-04-25T11:24:15.105549+0000","last_clean":"2024-04-25T11:24:15.105549+0000","last_became_active":"2024-04-25T11:22:14.396353+0000","last_became_peered":"2024-04-25T11:22:14.396353+0000","last_unstale":"2024-04-25T11:24:15.105549+0000","last_undegraded":"2024-04-25T11:24:15.105549+0000","last_fullsized":"2024-04-25T11:24:15.105549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:23.570878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030189+0000","last_change":"2024-04-25T11:22:14.412317+0000","last_active":"2024-04-25T11:24:15.030189+0000","last_peered":"2024-04-25T11:24:15.030189+0000","last_clean":"2024-04-25T11:24:15.030189+0000","last_became_active":"2024-04-25T11:22:14.411940+0000","last_became_peered":"2024-04-25T11:22:14.411940+0000","last_unstale":"2024-04-25T11:24:15.030189+0000","last_undegraded":"2024-04-25T11:24:15.030189+0000","last_fullsized":"2024-04-25T11:24:15.030189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030093+0000","last_change":"2024-04-25T11:22:14.407779+0000","last_active":"2024-04-25T11:24:15.030093+0000","last_peered":"2024-04-25T11:24:15.030093+0000","last_clean":"2024-04-25T11:24:15.030093+0000","last_became_active":"2024-04-25T11:22:14.407443+0000","last_became_peered":"2024-04-25T11:22:14.407443+0000","last_unstale":"2024-04-25T11:24:15.030093+0000","last_undegraded":"2024-04-25T11:24:15.030093+0000","last_fullsized":"2024-04-25T11:24:15.030093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:00.316425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035088+0000","last_change":"2024-04-25T11:22:14.412005+0000","last_active":"2024-04-25T11:24:15.035088+0000","last_peered":"2024-04-25T11:24:15.035088+0000","last_clean":"2024-04-25T11:24:15.035088+0000","last_became_active":"2024-04-25T11:22:14.411626+0000","last_became_peered":"2024-04-25T11:22:14.411626+0000","last_unstale":"2024-04-25T11:24:15.035088+0000","last_undegraded":"2024-04-25T11:24:15.035088+0000","last_fullsized":"2024-04-25T11:24:15.035088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.320505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819541+0000","last_change":"2024-04-25T11:22:14.415812+0000","last_active":"2024-04-25T11:24:14.819541+0000","last_peered":"2024-04-25T11:24:14.819541+0000","last_clean":"2024-04-25T11:24:14.819541+0000","last_became_active":"2024-04-25T11:22:14.415455+0000","last_became_peered":"2024-04-25T11:22:14.415455+0000","last_unstale":"2024-04-25T11:24:14.819541+0000","last_undegraded":"2024-04-25T11:24:14.819541+0000","last_fullsized":"2024-04-25T11:24:14.819541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:55.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105568+0000","last_change":"2024-04-25T11:22:14.400892+0000","last_active":"2024-04-25T11:24:15.105568+0000","last_peered":"2024-04-25T11:24:15.105568+0000","last_clean":"2024-04-25T11:24:15.105568+0000","last_became_active":"2024-04-25T11:22:14.400526+0000","last_became_peered":"2024-04-25T11:22:14.400526+0000","last_unstale":"2024-04-25T11:24:15.105568+0000","last_undegraded":"2024-04-25T11:24:15.105568+0000","last_fullsized":"2024-04-25T11:24:15.105568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:20.123680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030774+0000","last_change":"2024-04-25T11:22:14.403134+0000","last_active":"2024-04-25T11:24:15.030774+0000","last_peered":"2024-04-25T11:24:15.030774+0000","last_clean":"2024-04-25T11:24:15.030774+0000","last_became_active":"2024-04-25T11:22:14.402795+0000","last_became_peered":"2024-04-25T11:22:14.402795+0000","last_unstale":"2024-04-25T11:24:15.030774+0000","last_undegraded":"2024-04-25T11:24:15.030774+0000","last_fullsized":"2024-04-25T11:24:15.030774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.496135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754736+0000","last_change":"2024-04-25T11:22:14.410963+0000","last_active":"2024-04-25T11:24:14.754736+0000","last_peered":"2024-04-25T11:24:14.754736+0000","last_clean":"2024-04-25T11:24:14.754736+0000","last_became_active":"2024-04-25T11:22:14.410555+0000","last_became_peered":"2024-04-25T11:22:14.410555+0000","last_unstale":"2024-04-25T11:24:14.754736+0000","last_undegraded":"2024-04-25T11:24:14.754736+0000","last_fullsized":"2024-04-25T11:24:14.754736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:56.505717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755883+0000","last_change":"2024-04-25T11:22:14.405094+0000","last_active":"2024-04-25T11:24:14.755883+0000","last_peered":"2024-04-25T11:24:14.755883+0000","last_clean":"2024-04-25T11:24:14.755883+0000","last_became_active":"2024-04-25T11:22:14.404749+0000","last_became_peered":"2024-04-25T11:22:14.404749+0000","last_unstale":"2024-04-25T11:24:14.755883+0000","last_undegraded":"2024-04-25T11:24:14.755883+0000","last_fullsized":"2024-04-25T11:24:14.755883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:44.129648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754497+0000","last_change":"2024-04-25T11:22:14.396868+0000","last_active":"2024-04-25T11:24:14.754497+0000","last_peered":"2024-04-25T11:24:14.754497+0000","last_clean":"2024-04-25T11:24:14.754497+0000","last_became_active":"2024-04-25T11:22:14.396421+0000","last_became_peered":"2024-04-25T11:22:14.396421+0000","last_unstale":"2024-04-25T11:24:14.754497+0000","last_undegraded":"2024-04-25T11:24:14.754497+0000","last_fullsized":"2024-04-25T11:24:14.754497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:24.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757123+0000","last_change":"2024-04-25T11:22:14.400510+0000","last_active":"2024-04-25T11:24:14.757123+0000","last_peered":"2024-04-25T11:24:14.757123+0000","last_clean":"2024-04-25T11:24:14.757123+0000","last_became_active":"2024-04-25T11:22:14.400037+0000","last_became_peered":"2024-04-25T11:22:14.400037+0000","last_unstale":"2024-04-25T11:24:14.757123+0000","last_undegraded":"2024-04-25T11:24:14.757123+0000","last_fullsized":"2024-04-25T11:24:14.757123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.293068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819323+0000","last_change":"2024-04-25T11:22:14.404415+0000","last_active":"2024-04-25T11:24:14.819323+0000","last_peered":"2024-04-25T11:24:14.819323+0000","last_clean":"2024-04-25T11:24:14.819323+0000","last_became_active":"2024-04-25T11:22:14.404032+0000","last_became_peered":"2024-04-25T11:22:14.404032+0000","last_unstale":"2024-04-25T11:24:14.819323+0000","last_undegraded":"2024-04-25T11:24:14.819323+0000","last_fullsized":"2024-04-25T11:24:14.819323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:03.318304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105520+0000","last_change":"2024-04-25T11:22:14.410650+0000","last_active":"2024-04-25T11:24:15.105520+0000","last_peered":"2024-04-25T11:24:15.105520+0000","last_clean":"2024-04-25T11:24:15.105520+0000","last_became_active":"2024-04-25T11:22:14.410216+0000","last_became_peered":"2024-04-25T11:22:14.410216+0000","last_unstale":"2024-04-25T11:24:15.105520+0000","last_undegraded":"2024-04-25T11:24:15.105520+0000","last_fullsized":"2024-04-25T11:24:15.105520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:28.364279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106839,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":599120,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":836,"num_read_kb":529,"num_write":290,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1797360,"data_compressed":81483,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645350,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":868352,"data_stored":419958,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841579,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1211507,"data_compressed":52368,"data_compressed_allocated":69632,"data_compressed_original":745472,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005104,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":812806,"data_compressed":27886,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201334,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":897024,"data_stored":812704,"data_compressed":27886,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":921600,"data_stored":1013403,"data_compressed":44353,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":864256,"data_stored":418979,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":486530,"data_compressed":10599,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":884736,"data_stored":420250,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":478974,"data_compressed":7674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":419290,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":410984,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":1143955,"data_compressed":50509,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":67758,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70730,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134698,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393932,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":202250,"data_compressed":8015,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:24:16.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 -- 172.21.15.80:0/4262105597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58101f20 msgr2=0x7fee58106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/4262105597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58101f20 0x7fee58106b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fee50009be0 tx=0x7fee5002a6c0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 -- 172.21.15.80:0/4262105597 shutdown_connections 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/4262105597 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee58109a30 0x7fee5810be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/4262105597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee581070d0 0x7fee581094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/4262105597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58101f20 0x7fee58106b90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 -- 172.21.15.80:0/4262105597 >> 172.21.15.80:0/4262105597 conn(0x7fee580fd360 msgr2=0x7fee580ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 -- 172.21.15.80:0/4262105597 shutdown_connections 2024-04-25T11:24:16.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 -- 172.21.15.80:0/4262105597 wait complete. 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 Processor -- start 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.418+0000 7fee5fd2e640 1 -- start start 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5fd2e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee58101f20 0x7fee5819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5fd2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee581070d0 0x7fee5819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5fd2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58109a30 0x7fee581a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5fd2e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fee5810f680 con 0x7fee58109a30 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5fd2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee5810f500 con 0x7fee581070d0 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5fd2e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fee5810f800 con 0x7fee58101f20 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58109a30 0x7fee581a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58109a30 0x7fee581a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38612/0 (socket says 172.21.15.80:38612) 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 -- 172.21.15.80:0/1907609320 learned_addr learned my addr 172.21.15.80:0/1907609320 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5daca640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee58101f20 0x7fee5819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5d2c9640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee581070d0 0x7fee5819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 -- 172.21.15.80:0/1907609320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee58101f20 msgr2=0x7fee5819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee58101f20 0x7fee5819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 -- 172.21.15.80:0/1907609320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee581070d0 msgr2=0x7fee5819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee581070d0 0x7fee5819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 -- 172.21.15.80:0/1907609320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee581a1dc0 con 0x7fee58109a30 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5d2c9640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee581070d0 0x7fee5819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5e2cb640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58109a30 0x7fee581a1750 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e940 tx=0x7fee4800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee56ffd640 1 -- 172.21.15.80:0/1907609320 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4800cd80 con 0x7fee58109a30 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee56ffd640 1 -- 172.21.15.80:0/1907609320 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee480035f0 con 0x7fee58109a30 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee581a20b0 con 0x7fee58109a30 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.419+0000 7fee56ffd640 1 -- 172.21.15.80:0/1907609320 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48010670 con 0x7fee58109a30 2024-04-25T11:24:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.420+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee581a25b0 con 0x7fee58109a30 2024-04-25T11:24:16.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.420+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee580fee80 con 0x7fee58109a30 2024-04-25T11:24:16.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.422+0000 7fee56ffd640 1 -- 172.21.15.80:0/1907609320 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 21) ==== 147332+0+0 (secure 0 0 0) 0x7fee48003ac0 con 0x7fee58109a30 2024-04-25T11:24:16.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.422+0000 7fee56ffd640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fee400af8e0 0x7fee400b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.422+0000 7fee5daca640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fee400af8e0 0x7fee400b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.422+0000 7fee56ffd640 1 -- 172.21.15.80:0/1907609320 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fee480ded10 con 0x7fee58109a30 2024-04-25T11:24:16.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.423+0000 7fee5daca640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fee400af8e0 0x7fee400b1df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee5002acb0 tx=0x7fee50005fd0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:16.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.427+0000 7fee56ffd640 1 -- 172.21.15.80:0/1907609320 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fee480a7ad0 con 0x7fee58109a30 2024-04-25T11:24:16.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.605+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee58062fe0 con 0x7fee400af8e0 2024-04-25T11:24:16.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.612+0000 7fee56ffd640 1 -- 172.21.15.80:0/1907609320 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258014 (secure 0 0 0) 0x7fee58062fe0 con 0x7fee400af8e0 2024-04-25T11:24:16.609 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:16.610 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fee400af8e0 msgr2=0x7fee400b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fee400af8e0 0x7fee400b1df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee5002acb0 tx=0x7fee50005fd0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58109a30 msgr2=0x7fee581a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58109a30 0x7fee581a1750 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e940 tx=0x7fee4800ee00 comp rx=0 tx=0).stop 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 shutdown_connections 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fee400af8e0 0x7fee400b1df0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee58109a30 0x7fee581a1750 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee581070d0 0x7fee5819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 --2- 172.21.15.80:0/1907609320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee58101f20 0x7fee5819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 >> 172.21.15.80:0/1907609320 conn(0x7fee580fd360 msgr2=0x7fee58105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.615+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 shutdown_connections 2024-04-25T11:24:16.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.616+0000 7fee5fd2e640 1 -- 172.21.15.80:0/1907609320 wait complete. 2024-04-25T11:24:16.621 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2024-04-25T11:24:15.786736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189722,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":917,"num_read_kb":598,"num_write":415,"num_write_kb":3593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351544,"kb_used_data":10684,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590280,"statfs":{"total":1151940427776,"available":1151580446720,"internally_reserved":0,"allocated":10940416,"data_stored":8049340,"data_compressed":262050,"data_compressed_allocated":352256,"data_compressed_original":3104768,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105763+0000","last_change":"2024-04-25T11:22:14.408035+0000","last_active":"2024-04-25T11:24:15.105763+0000","last_peered":"2024-04-25T11:24:15.105763+0000","last_clean":"2024-04-25T11:24:15.105763+0000","last_became_active":"2024-04-25T11:22:14.407691+0000","last_became_peered":"2024-04-25T11:22:14.407691+0000","last_unstale":"2024-04-25T11:24:15.105763+0000","last_undegraded":"2024-04-25T11:24:15.105763+0000","last_fullsized":"2024-04-25T11:24:15.105763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:27.388402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035265+0000","last_change":"2024-04-25T11:22:14.415270+0000","last_active":"2024-04-25T11:24:15.035265+0000","last_peered":"2024-04-25T11:24:15.035265+0000","last_clean":"2024-04-25T11:24:15.035265+0000","last_became_active":"2024-04-25T11:22:14.413962+0000","last_became_peered":"2024-04-25T11:22:14.413962+0000","last_unstale":"2024-04-25T11:24:15.035265+0000","last_undegraded":"2024-04-25T11:24:15.035265+0000","last_fullsized":"2024-04-25T11:24:15.035265+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:31.160774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035041+0000","last_change":"2024-04-25T11:22:14.402643+0000","last_active":"2024-04-25T11:24:15.035041+0000","last_peered":"2024-04-25T11:24:15.035041+0000","last_clean":"2024-04-25T11:24:15.035041+0000","last_became_active":"2024-04-25T11:22:14.401940+0000","last_became_peered":"2024-04-25T11:22:14.401940+0000","last_unstale":"2024-04-25T11:24:15.035041+0000","last_undegraded":"2024-04-25T11:24:15.035041+0000","last_fullsized":"2024-04-25T11:24:15.035041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:47.270354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034182+0000","last_change":"2024-04-25T11:22:14.413726+0000","last_active":"2024-04-25T11:24:15.034182+0000","last_peered":"2024-04-25T11:24:15.034182+0000","last_clean":"2024-04-25T11:24:15.034182+0000","last_became_active":"2024-04-25T11:22:14.412971+0000","last_became_peered":"2024-04-25T11:22:14.412971+0000","last_unstale":"2024-04-25T11:24:15.034182+0000","last_undegraded":"2024-04-25T11:24:15.034182+0000","last_fullsized":"2024-04-25T11:24:15.034182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:42.017286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860304+0000","last_change":"2024-04-25T11:22:14.403390+0000","last_active":"2024-04-25T11:24:14.860304+0000","last_peered":"2024-04-25T11:24:14.860304+0000","last_clean":"2024-04-25T11:24:14.860304+0000","last_became_active":"2024-04-25T11:22:14.402999+0000","last_became_peered":"2024-04-25T11:22:14.402999+0000","last_unstale":"2024-04-25T11:24:14.860304+0000","last_undegraded":"2024-04-25T11:24:14.860304+0000","last_fullsized":"2024-04-25T11:24:14.860304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:59.283486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.867832+0000","last_change":"2024-04-25T11:22:56.415548+0000","last_active":"2024-04-25T11:24:14.867832+0000","last_peered":"2024-04-25T11:24:14.867832+0000","last_clean":"2024-04-25T11:24:14.867832+0000","last_became_active":"2024-04-25T11:22:56.414819+0000","last_became_peered":"2024-04-25T11:22:56.414819+0000","last_unstale":"2024-04-25T11:24:14.867832+0000","last_undegraded":"2024-04-25T11:24:14.867832+0000","last_fullsized":"2024-04-25T11:24:14.867832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:32.599336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029944+0000","last_change":"2024-04-25T11:22:14.404800+0000","last_active":"2024-04-25T11:24:15.029944+0000","last_peered":"2024-04-25T11:24:15.029944+0000","last_clean":"2024-04-25T11:24:15.029944+0000","last_became_active":"2024-04-25T11:22:14.404445+0000","last_became_peered":"2024-04-25T11:22:14.404445+0000","last_unstale":"2024-04-25T11:24:15.029944+0000","last_undegraded":"2024-04-25T11:24:15.029944+0000","last_fullsized":"2024-04-25T11:24:15.029944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:51.498081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857553+0000","last_change":"2024-04-25T11:22:56.415367+0000","last_active":"2024-04-25T11:24:14.857553+0000","last_peered":"2024-04-25T11:24:14.857553+0000","last_clean":"2024-04-25T11:24:14.857553+0000","last_became_active":"2024-04-25T11:22:56.414982+0000","last_became_peered":"2024-04-25T11:22:56.414982+0000","last_unstale":"2024-04-25T11:24:14.857553+0000","last_undegraded":"2024-04-25T11:24:14.857553+0000","last_fullsized":"2024-04-25T11:24:14.857553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:23.069726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757315+0000","last_change":"2024-04-25T11:22:14.410119+0000","last_active":"2024-04-25T11:24:14.757315+0000","last_peered":"2024-04-25T11:24:14.757315+0000","last_clean":"2024-04-25T11:24:14.757315+0000","last_became_active":"2024-04-25T11:22:14.409736+0000","last_became_peered":"2024-04-25T11:22:14.409736+0000","last_unstale":"2024-04-25T11:24:14.757315+0000","last_undegraded":"2024-04-25T11:24:14.757315+0000","last_fullsized":"2024-04-25T11:24:14.757315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:57.842921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868217+0000","last_change":"2024-04-25T11:22:14.416368+0000","last_active":"2024-04-25T11:24:14.868217+0000","last_peered":"2024-04-25T11:24:14.868217+0000","last_clean":"2024-04-25T11:24:14.868217+0000","last_became_active":"2024-04-25T11:22:14.415888+0000","last_became_peered":"2024-04-25T11:22:14.415888+0000","last_unstale":"2024-04-25T11:24:14.868217+0000","last_undegraded":"2024-04-25T11:24:14.868217+0000","last_fullsized":"2024-04-25T11:24:14.868217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:00.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030167+0000","last_change":"2024-04-25T11:22:14.402490+0000","last_active":"2024-04-25T11:24:15.030167+0000","last_peered":"2024-04-25T11:24:15.030167+0000","last_clean":"2024-04-25T11:24:15.030167+0000","last_became_active":"2024-04-25T11:22:14.402115+0000","last_became_peered":"2024-04-25T11:22:14.402115+0000","last_unstale":"2024-04-25T11:24:15.030167+0000","last_undegraded":"2024-04-25T11:24:15.030167+0000","last_fullsized":"2024-04-25T11:24:15.030167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:34.783230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034075+0000","last_change":"2024-04-25T11:22:14.420570+0000","last_active":"2024-04-25T11:24:15.034075+0000","last_peered":"2024-04-25T11:24:15.034075+0000","last_clean":"2024-04-25T11:24:15.034075+0000","last_became_active":"2024-04-25T11:22:14.420187+0000","last_became_peered":"2024-04-25T11:22:14.420187+0000","last_unstale":"2024-04-25T11:24:15.034075+0000","last_undegraded":"2024-04-25T11:24:15.034075+0000","last_fullsized":"2024-04-25T11:24:15.034075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:52.828114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819248+0000","last_change":"2024-04-25T11:22:14.414789+0000","last_active":"2024-04-25T11:24:14.819248+0000","last_peered":"2024-04-25T11:24:14.819248+0000","last_clean":"2024-04-25T11:24:14.819248+0000","last_became_active":"2024-04-25T11:22:14.414465+0000","last_became_peered":"2024-04-25T11:22:14.414465+0000","last_unstale":"2024-04-25T11:24:14.819248+0000","last_undegraded":"2024-04-25T11:24:14.819248+0000","last_fullsized":"2024-04-25T11:24:14.819248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:37.748045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034849+0000","last_change":"2024-04-25T11:22:14.413268+0000","last_active":"2024-04-25T11:24:15.034849+0000","last_peered":"2024-04-25T11:24:15.034849+0000","last_clean":"2024-04-25T11:24:15.034849+0000","last_became_active":"2024-04-25T11:22:14.412897+0000","last_became_peered":"2024-04-25T11:22:14.412897+0000","last_unstale":"2024-04-25T11:24:15.034849+0000","last_undegraded":"2024-04-25T11:24:15.034849+0000","last_fullsized":"2024-04-25T11:24:15.034849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:49.997236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034758+0000","last_change":"2024-04-25T11:22:14.411114+0000","last_active":"2024-04-25T11:24:15.034758+0000","last_peered":"2024-04-25T11:24:15.034758+0000","last_clean":"2024-04-25T11:24:15.034758+0000","last_became_active":"2024-04-25T11:22:14.410700+0000","last_became_peered":"2024-04-25T11:22:14.410700+0000","last_unstale":"2024-04-25T11:24:15.034758+0000","last_undegraded":"2024-04-25T11:24:15.034758+0000","last_fullsized":"2024-04-25T11:24:15.034758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:38.367214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756939+0000","last_change":"2024-04-25T11:22:14.408073+0000","last_active":"2024-04-25T11:24:14.756939+0000","last_peered":"2024-04-25T11:24:14.756939+0000","last_clean":"2024-04-25T11:24:14.756939+0000","last_became_active":"2024-04-25T11:22:14.406878+0000","last_became_peered":"2024-04-25T11:22:14.406878+0000","last_unstale":"2024-04-25T11:24:14.756939+0000","last_undegraded":"2024-04-25T11:24:14.756939+0000","last_fullsized":"2024-04-25T11:24:14.756939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:00.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105698+0000","last_change":"2024-04-25T11:22:14.406990+0000","last_active":"2024-04-25T11:24:15.105698+0000","last_peered":"2024-04-25T11:24:15.105698+0000","last_clean":"2024-04-25T11:24:15.105698+0000","last_became_active":"2024-04-25T11:22:14.406643+0000","last_became_peered":"2024-04-25T11:22:14.406643+0000","last_unstale":"2024-04-25T11:24:15.105698+0000","last_undegraded":"2024-04-25T11:24:15.105698+0000","last_fullsized":"2024-04-25T11:24:15.105698+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:15.226490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857915+0000","last_change":"2024-04-25T11:22:14.410651+0000","last_active":"2024-04-25T11:24:14.857915+0000","last_peered":"2024-04-25T11:24:14.857915+0000","last_clean":"2024-04-25T11:24:14.857915+0000","last_became_active":"2024-04-25T11:22:14.410299+0000","last_became_peered":"2024-04-25T11:22:14.410299+0000","last_unstale":"2024-04-25T11:24:14.857915+0000","last_undegraded":"2024-04-25T11:24:14.857915+0000","last_fullsized":"2024-04-25T11:24:14.857915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:50.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030468+0000","last_change":"2024-04-25T11:22:14.405714+0000","last_active":"2024-04-25T11:24:15.030468+0000","last_peered":"2024-04-25T11:24:15.030468+0000","last_clean":"2024-04-25T11:24:15.030468+0000","last_became_active":"2024-04-25T11:22:14.405376+0000","last_became_peered":"2024-04-25T11:22:14.405376+0000","last_unstale":"2024-04-25T11:24:15.030468+0000","last_undegraded":"2024-04-25T11:24:15.030468+0000","last_fullsized":"2024-04-25T11:24:15.030468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:18.538532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857780+0000","last_change":"2024-04-25T11:22:56.421708+0000","last_active":"2024-04-25T11:24:14.857780+0000","last_peered":"2024-04-25T11:24:14.857780+0000","last_clean":"2024-04-25T11:24:14.857780+0000","last_became_active":"2024-04-25T11:22:56.413182+0000","last_became_peered":"2024-04-25T11:22:56.413182+0000","last_unstale":"2024-04-25T11:24:14.857780+0000","last_undegraded":"2024-04-25T11:24:14.857780+0000","last_fullsized":"2024-04-25T11:24:14.857780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:30.235026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754711+0000","last_change":"2024-04-25T11:22:14.411893+0000","last_active":"2024-04-25T11:24:14.754711+0000","last_peered":"2024-04-25T11:24:14.754711+0000","last_clean":"2024-04-25T11:24:14.754711+0000","last_became_active":"2024-04-25T11:22:14.409727+0000","last_became_peered":"2024-04-25T11:22:14.409727+0000","last_unstale":"2024-04-25T11:24:14.754711+0000","last_undegraded":"2024-04-25T11:24:14.754711+0000","last_fullsized":"2024-04-25T11:24:14.754711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:41.961790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755143+0000","last_change":"2024-04-25T11:22:13.398983+0000","last_active":"2024-04-25T11:24:14.755143+0000","last_peered":"2024-04-25T11:24:14.755143+0000","last_clean":"2024-04-25T11:24:14.755143+0000","last_became_active":"2024-04-25T11:22:13.397819+0000","last_became_peered":"2024-04-25T11:22:13.397819+0000","last_unstale":"2024-04-25T11:24:14.755143+0000","last_undegraded":"2024-04-25T11:24:14.755143+0000","last_fullsized":"2024-04-25T11:24:14.755143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:19.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035122+0000","last_change":"2024-04-25T11:22:14.410589+0000","last_active":"2024-04-25T11:24:15.035122+0000","last_peered":"2024-04-25T11:24:15.035122+0000","last_clean":"2024-04-25T11:24:15.035122+0000","last_became_active":"2024-04-25T11:22:14.409921+0000","last_became_peered":"2024-04-25T11:22:14.409921+0000","last_unstale":"2024-04-25T11:24:15.035122+0000","last_undegraded":"2024-04-25T11:24:15.035122+0000","last_fullsized":"2024-04-25T11:24:15.035122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:59.251335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860673+0000","last_change":"2024-04-25T11:22:13.406244+0000","last_active":"2024-04-25T11:24:14.860673+0000","last_peered":"2024-04-25T11:24:14.860673+0000","last_clean":"2024-04-25T11:24:14.860673+0000","last_became_active":"2024-04-25T11:22:13.405902+0000","last_became_peered":"2024-04-25T11:22:13.405902+0000","last_unstale":"2024-04-25T11:24:14.860673+0000","last_undegraded":"2024-04-25T11:24:14.860673+0000","last_fullsized":"2024-04-25T11:24:14.860673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:05.862922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757145+0000","last_change":"2024-04-25T11:22:14.421110+0000","last_active":"2024-04-25T11:24:14.757145+0000","last_peered":"2024-04-25T11:24:14.757145+0000","last_clean":"2024-04-25T11:24:14.757145+0000","last_became_active":"2024-04-25T11:22:14.420705+0000","last_became_peered":"2024-04-25T11:22:14.420705+0000","last_unstale":"2024-04-25T11:24:14.757145+0000","last_undegraded":"2024-04-25T11:24:14.757145+0000","last_fullsized":"2024-04-25T11:24:14.757145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:57.353467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860508+0000","last_change":"2024-04-25T11:22:13.406063+0000","last_active":"2024-04-25T11:24:14.860508+0000","last_peered":"2024-04-25T11:24:14.860508+0000","last_clean":"2024-04-25T11:24:14.860508+0000","last_became_active":"2024-04-25T11:22:13.405690+0000","last_became_peered":"2024-04-25T11:22:13.405690+0000","last_unstale":"2024-04-25T11:24:14.860508+0000","last_undegraded":"2024-04-25T11:24:14.860508+0000","last_fullsized":"2024-04-25T11:24:14.860508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:34.296298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756308+0000","last_change":"2024-04-25T11:22:14.413077+0000","last_active":"2024-04-25T11:24:14.756308+0000","last_peered":"2024-04-25T11:24:14.756308+0000","last_clean":"2024-04-25T11:24:14.756308+0000","last_became_active":"2024-04-25T11:22:14.412712+0000","last_became_peered":"2024-04-25T11:22:14.412712+0000","last_unstale":"2024-04-25T11:24:14.756308+0000","last_undegraded":"2024-04-25T11:24:14.756308+0000","last_fullsized":"2024-04-25T11:24:14.756308+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:41.683840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'10","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.623578+0000","last_change":"2024-04-25T11:22:13.396239+0000","last_active":"2024-04-25T11:24:15.623578+0000","last_peered":"2024-04-25T11:24:15.623578+0000","last_clean":"2024-04-25T11:24:15.623578+0000","last_became_active":"2024-04-25T11:22:13.395653+0000","last_became_peered":"2024-04-25T11:22:13.395653+0000","last_unstale":"2024-04-25T11:24:15.623578+0000","last_undegraded":"2024-04-25T11:24:15.623578+0000","last_fullsized":"2024-04-25T11:24:15.623578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:05.218927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860174+0000","last_change":"2024-04-25T11:22:14.409052+0000","last_active":"2024-04-25T11:24:14.860174+0000","last_peered":"2024-04-25T11:24:14.860174+0000","last_clean":"2024-04-25T11:24:14.860174+0000","last_became_active":"2024-04-25T11:22:14.408580+0000","last_became_peered":"2024-04-25T11:22:14.408580+0000","last_unstale":"2024-04-25T11:24:14.860174+0000","last_undegraded":"2024-04-25T11:24:14.860174+0000","last_fullsized":"2024-04-25T11:24:14.860174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:14.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.867776+0000","last_change":"2024-04-25T11:22:13.399086+0000","last_active":"2024-04-25T11:24:14.867776+0000","last_peered":"2024-04-25T11:24:14.867776+0000","last_clean":"2024-04-25T11:24:14.867776+0000","last_became_active":"2024-04-25T11:22:13.398559+0000","last_became_peered":"2024-04-25T11:22:13.398559+0000","last_unstale":"2024-04-25T11:24:14.867776+0000","last_undegraded":"2024-04-25T11:24:14.867776+0000","last_fullsized":"2024-04-25T11:24:14.867776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:09.913470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857939+0000","last_change":"2024-04-25T11:22:56.416426+0000","last_active":"2024-04-25T11:24:14.857939+0000","last_peered":"2024-04-25T11:24:14.857939+0000","last_clean":"2024-04-25T11:24:14.857939+0000","last_became_active":"2024-04-25T11:22:56.415792+0000","last_became_peered":"2024-04-25T11:22:56.415792+0000","last_unstale":"2024-04-25T11:24:14.857939+0000","last_undegraded":"2024-04-25T11:24:14.857939+0000","last_fullsized":"2024-04-25T11:24:14.857939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:24.421846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,8],"acting":[9,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819026+0000","last_change":"2024-04-25T11:22:13.392703+0000","last_active":"2024-04-25T11:24:14.819026+0000","last_peered":"2024-04-25T11:24:14.819026+0000","last_clean":"2024-04-25T11:24:14.819026+0000","last_became_active":"2024-04-25T11:22:13.392337+0000","last_became_peered":"2024-04-25T11:22:13.392337+0000","last_unstale":"2024-04-25T11:24:14.819026+0000","last_undegraded":"2024-04-25T11:24:14.819026+0000","last_fullsized":"2024-04-25T11:24:14.819026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:33.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754470+0000","last_change":"2024-04-25T11:22:14.398526+0000","last_active":"2024-04-25T11:24:14.754470+0000","last_peered":"2024-04-25T11:24:14.754470+0000","last_clean":"2024-04-25T11:24:14.754470+0000","last_became_active":"2024-04-25T11:22:14.398083+0000","last_became_peered":"2024-04-25T11:22:14.398083+0000","last_unstale":"2024-04-25T11:24:14.754470+0000","last_undegraded":"2024-04-25T11:24:14.754470+0000","last_fullsized":"2024-04-25T11:24:14.754470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:03.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755970+0000","last_change":"2024-04-25T11:22:13.397599+0000","last_active":"2024-04-25T11:24:14.755970+0000","last_peered":"2024-04-25T11:24:14.755970+0000","last_clean":"2024-04-25T11:24:14.755970+0000","last_became_active":"2024-04-25T11:22:13.396748+0000","last_became_peered":"2024-04-25T11:22:13.396748+0000","last_unstale":"2024-04-25T11:24:14.755970+0000","last_undegraded":"2024-04-25T11:24:14.755970+0000","last_fullsized":"2024-04-25T11:24:14.755970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:31.012095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857575+0000","last_change":"2024-04-25T11:22:14.404668+0000","last_active":"2024-04-25T11:24:14.857575+0000","last_peered":"2024-04-25T11:24:14.857575+0000","last_clean":"2024-04-25T11:24:14.857575+0000","last_became_active":"2024-04-25T11:22:14.404306+0000","last_became_peered":"2024-04-25T11:22:14.404306+0000","last_unstale":"2024-04-25T11:24:14.857575+0000","last_undegraded":"2024-04-25T11:24:14.857575+0000","last_fullsized":"2024-04-25T11:24:14.857575+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:16.430419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'5","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868252+0000","last_change":"2024-04-25T11:22:13.398240+0000","last_active":"2024-04-25T11:24:14.868252+0000","last_peered":"2024-04-25T11:24:14.868252+0000","last_clean":"2024-04-25T11:24:14.868252+0000","last_became_active":"2024-04-25T11:22:13.397875+0000","last_became_peered":"2024-04-25T11:22:13.397875+0000","last_unstale":"2024-04-25T11:24:14.868252+0000","last_undegraded":"2024-04-25T11:24:14.868252+0000","last_fullsized":"2024-04-25T11:24:14.868252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:29.007270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757419+0000","last_change":"2024-04-25T11:22:14.422075+0000","last_active":"2024-04-25T11:24:14.757419+0000","last_peered":"2024-04-25T11:24:14.757419+0000","last_clean":"2024-04-25T11:24:14.757419+0000","last_became_active":"2024-04-25T11:22:14.421699+0000","last_became_peered":"2024-04-25T11:22:14.421699+0000","last_unstale":"2024-04-25T11:24:14.757419+0000","last_undegraded":"2024-04-25T11:24:14.757419+0000","last_fullsized":"2024-04-25T11:24:14.757419+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030264+0000","last_change":"2024-04-25T11:22:13.398104+0000","last_active":"2024-04-25T11:24:15.030264+0000","last_peered":"2024-04-25T11:24:15.030264+0000","last_clean":"2024-04-25T11:24:15.030264+0000","last_became_active":"2024-04-25T11:22:13.397716+0000","last_became_peered":"2024-04-25T11:22:13.397716+0000","last_unstale":"2024-04-25T11:24:15.030264+0000","last_undegraded":"2024-04-25T11:24:15.030264+0000","last_fullsized":"2024-04-25T11:24:15.030264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035316+0000","last_change":"2024-04-25T11:22:14.413664+0000","last_active":"2024-04-25T11:24:15.035316+0000","last_peered":"2024-04-25T11:24:15.035316+0000","last_clean":"2024-04-25T11:24:15.035316+0000","last_became_active":"2024-04-25T11:22:14.412621+0000","last_became_peered":"2024-04-25T11:22:14.412621+0000","last_unstale":"2024-04-25T11:24:15.035316+0000","last_undegraded":"2024-04-25T11:24:15.035316+0000","last_fullsized":"2024-04-25T11:24:15.035316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:24.511828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756391+0000","last_change":"2024-04-25T11:22:13.397141+0000","last_active":"2024-04-25T11:24:14.756391+0000","last_peered":"2024-04-25T11:24:14.756391+0000","last_clean":"2024-04-25T11:24:14.756391+0000","last_became_active":"2024-04-25T11:22:13.396769+0000","last_became_peered":"2024-04-25T11:22:13.396769+0000","last_unstale":"2024-04-25T11:24:14.756391+0000","last_undegraded":"2024-04-25T11:24:14.756391+0000","last_fullsized":"2024-04-25T11:24:14.756391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:40.123906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757252+0000","last_change":"2024-04-25T11:22:14.412279+0000","last_active":"2024-04-25T11:24:14.757252+0000","last_peered":"2024-04-25T11:24:14.757252+0000","last_clean":"2024-04-25T11:24:14.757252+0000","last_became_active":"2024-04-25T11:22:14.410325+0000","last_became_peered":"2024-04-25T11:22:14.410325+0000","last_unstale":"2024-04-25T11:24:14.757252+0000","last_undegraded":"2024-04-25T11:24:14.757252+0000","last_fullsized":"2024-04-25T11:24:14.757252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:03.788349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'36","reported_seq":305,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.630689+0000","last_change":"2024-04-25T11:22:13.393664+0000","last_active":"2024-04-25T11:24:15.630689+0000","last_peered":"2024-04-25T11:24:15.630689+0000","last_clean":"2024-04-25T11:24:15.630689+0000","last_became_active":"2024-04-25T11:22:13.393279+0000","last_became_peered":"2024-04-25T11:22:13.393279+0000","last_unstale":"2024-04-25T11:24:15.630689+0000","last_undegraded":"2024-04-25T11:24:15.630689+0000","last_fullsized":"2024-04-25T11:24:15.630689+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":190,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860521+0000","last_change":"2024-04-25T11:22:14.399944+0000","last_active":"2024-04-25T11:24:14.860521+0000","last_peered":"2024-04-25T11:24:14.860521+0000","last_clean":"2024-04-25T11:24:14.860521+0000","last_became_active":"2024-04-25T11:22:14.399592+0000","last_became_peered":"2024-04-25T11:22:14.399592+0000","last_unstale":"2024-04-25T11:24:14.860521+0000","last_undegraded":"2024-04-25T11:24:14.860521+0000","last_fullsized":"2024-04-25T11:24:14.860521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:18.794517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030571+0000","last_change":"2024-04-25T11:22:13.398651+0000","last_active":"2024-04-25T11:24:15.030571+0000","last_peered":"2024-04-25T11:24:15.030571+0000","last_clean":"2024-04-25T11:24:15.030571+0000","last_became_active":"2024-04-25T11:22:13.398234+0000","last_became_peered":"2024-04-25T11:22:13.398234+0000","last_unstale":"2024-04-25T11:24:15.030571+0000","last_undegraded":"2024-04-25T11:24:15.030571+0000","last_fullsized":"2024-04-25T11:24:15.030571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:39.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819069+0000","last_change":"2024-04-25T11:22:14.404684+0000","last_active":"2024-04-25T11:24:14.819069+0000","last_peered":"2024-04-25T11:24:14.819069+0000","last_clean":"2024-04-25T11:24:14.819069+0000","last_became_active":"2024-04-25T11:22:14.404319+0000","last_became_peered":"2024-04-25T11:22:14.404319+0000","last_unstale":"2024-04-25T11:24:14.819069+0000","last_undegraded":"2024-04-25T11:24:14.819069+0000","last_fullsized":"2024-04-25T11:24:14.819069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:40.388670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756091+0000","last_change":"2024-04-25T11:22:13.397954+0000","last_active":"2024-04-25T11:24:14.756091+0000","last_peered":"2024-04-25T11:24:14.756091+0000","last_clean":"2024-04-25T11:24:14.756091+0000","last_became_active":"2024-04-25T11:22:13.397595+0000","last_became_peered":"2024-04-25T11:22:13.397595+0000","last_unstale":"2024-04-25T11:24:14.756091+0000","last_undegraded":"2024-04-25T11:24:14.756091+0000","last_fullsized":"2024-04-25T11:24:14.756091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:31.912201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030364+0000","last_change":"2024-04-25T11:22:14.411671+0000","last_active":"2024-04-25T11:24:15.030364+0000","last_peered":"2024-04-25T11:24:15.030364+0000","last_clean":"2024-04-25T11:24:15.030364+0000","last_became_active":"2024-04-25T11:22:14.411034+0000","last_became_peered":"2024-04-25T11:22:14.411034+0000","last_unstale":"2024-04-25T11:24:15.030364+0000","last_undegraded":"2024-04-25T11:24:15.030364+0000","last_fullsized":"2024-04-25T11:24:15.030364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:23.614652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'7","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.621751+0000","last_change":"2024-04-25T11:22:13.397193+0000","last_active":"2024-04-25T11:24:15.621751+0000","last_peered":"2024-04-25T11:24:15.621751+0000","last_clean":"2024-04-25T11:24:15.621751+0000","last_became_active":"2024-04-25T11:22:13.396319+0000","last_became_peered":"2024-04-25T11:22:13.396319+0000","last_unstale":"2024-04-25T11:24:15.621751+0000","last_undegraded":"2024-04-25T11:24:15.621751+0000","last_fullsized":"2024-04-25T11:24:15.621751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.140114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029922+0000","last_change":"2024-04-25T11:22:14.404123+0000","last_active":"2024-04-25T11:24:15.029922+0000","last_peered":"2024-04-25T11:24:15.029922+0000","last_clean":"2024-04-25T11:24:15.029922+0000","last_became_active":"2024-04-25T11:22:14.403751+0000","last_became_peered":"2024-04-25T11:22:14.403751+0000","last_unstale":"2024-04-25T11:24:15.029922+0000","last_undegraded":"2024-04-25T11:24:15.029922+0000","last_fullsized":"2024-04-25T11:24:15.029922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:22.361257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860145+0000","last_change":"2024-04-25T11:22:13.402801+0000","last_active":"2024-04-25T11:24:14.860145+0000","last_peered":"2024-04-25T11:24:14.860145+0000","last_clean":"2024-04-25T11:24:14.860145+0000","last_became_active":"2024-04-25T11:22:13.402417+0000","last_became_peered":"2024-04-25T11:22:13.402417+0000","last_unstale":"2024-04-25T11:24:14.860145+0000","last_undegraded":"2024-04-25T11:24:14.860145+0000","last_fullsized":"2024-04-25T11:24:14.860145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:55.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756039+0000","last_change":"2024-04-25T11:22:14.413947+0000","last_active":"2024-04-25T11:24:14.756039+0000","last_peered":"2024-04-25T11:24:14.756039+0000","last_clean":"2024-04-25T11:24:14.756039+0000","last_became_active":"2024-04-25T11:22:14.413549+0000","last_became_peered":"2024-04-25T11:22:14.413549+0000","last_unstale":"2024-04-25T11:24:14.756039+0000","last_undegraded":"2024-04-25T11:24:14.756039+0000","last_fullsized":"2024-04-25T11:24:14.756039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:42.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'3","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105714+0000","last_change":"2024-04-25T11:22:56.420875+0000","last_active":"2024-04-25T11:24:15.105714+0000","last_peered":"2024-04-25T11:24:15.105714+0000","last_clean":"2024-04-25T11:24:15.105714+0000","last_became_active":"2024-04-25T11:22:56.415615+0000","last_became_peered":"2024-04-25T11:22:56.415615+0000","last_unstale":"2024-04-25T11:24:15.105714+0000","last_undegraded":"2024-04-25T11:24:15.105714+0000","last_fullsized":"2024-04-25T11:24:15.105714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:55.053238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105629+0000","last_change":"2024-04-25T11:22:56.413403+0000","last_active":"2024-04-25T11:24:15.105629+0000","last_peered":"2024-04-25T11:24:15.105629+0000","last_clean":"2024-04-25T11:24:15.105629+0000","last_became_active":"2024-04-25T11:22:56.413002+0000","last_became_peered":"2024-04-25T11:22:56.413002+0000","last_unstale":"2024-04-25T11:24:15.105629+0000","last_undegraded":"2024-04-25T11:24:15.105629+0000","last_fullsized":"2024-04-25T11:24:15.105629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:42.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.858031+0000","last_change":"2024-04-25T11:22:13.394583+0000","last_active":"2024-04-25T11:24:14.858031+0000","last_peered":"2024-04-25T11:24:14.858031+0000","last_clean":"2024-04-25T11:24:14.858031+0000","last_became_active":"2024-04-25T11:22:13.394210+0000","last_became_peered":"2024-04-25T11:22:13.394210+0000","last_unstale":"2024-04-25T11:24:14.858031+0000","last_undegraded":"2024-04-25T11:24:14.858031+0000","last_fullsized":"2024-04-25T11:24:14.858031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:34.622567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868102+0000","last_change":"2024-04-25T11:22:14.404487+0000","last_active":"2024-04-25T11:24:14.868102+0000","last_peered":"2024-04-25T11:24:14.868102+0000","last_clean":"2024-04-25T11:24:14.868102+0000","last_became_active":"2024-04-25T11:22:14.404096+0000","last_became_peered":"2024-04-25T11:22:14.404096+0000","last_unstale":"2024-04-25T11:24:14.868102+0000","last_undegraded":"2024-04-25T11:24:14.868102+0000","last_fullsized":"2024-04-25T11:24:14.868102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:55.938011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030047+0000","last_change":"2024-04-25T11:22:13.397273+0000","last_active":"2024-04-25T11:24:15.030047+0000","last_peered":"2024-04-25T11:24:15.030047+0000","last_clean":"2024-04-25T11:24:15.030047+0000","last_became_active":"2024-04-25T11:22:13.396538+0000","last_became_peered":"2024-04-25T11:22:13.396538+0000","last_unstale":"2024-04-25T11:24:15.030047+0000","last_undegraded":"2024-04-25T11:24:15.030047+0000","last_fullsized":"2024-04-25T11:24:15.030047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:04.738107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868002+0000","last_change":"2024-04-25T11:22:56.454081+0000","last_active":"2024-04-25T11:24:14.868002+0000","last_peered":"2024-04-25T11:24:14.868002+0000","last_clean":"2024-04-25T11:24:14.868002+0000","last_became_active":"2024-04-25T11:22:56.453729+0000","last_became_peered":"2024-04-25T11:22:56.453729+0000","last_unstale":"2024-04-25T11:24:14.868002+0000","last_undegraded":"2024-04-25T11:24:14.868002+0000","last_fullsized":"2024-04-25T11:24:14.868002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:55.124699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756175+0000","last_change":"2024-04-25T11:22:14.411786+0000","last_active":"2024-04-25T11:24:14.756175+0000","last_peered":"2024-04-25T11:24:14.756175+0000","last_clean":"2024-04-25T11:24:14.756175+0000","last_became_active":"2024-04-25T11:22:14.411433+0000","last_became_peered":"2024-04-25T11:22:14.411433+0000","last_unstale":"2024-04-25T11:24:14.756175+0000","last_undegraded":"2024-04-25T11:24:14.756175+0000","last_fullsized":"2024-04-25T11:24:14.756175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:28.948581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034825+0000","last_change":"2024-04-25T11:22:13.396834+0000","last_active":"2024-04-25T11:24:15.034825+0000","last_peered":"2024-04-25T11:24:15.034825+0000","last_clean":"2024-04-25T11:24:15.034825+0000","last_became_active":"2024-04-25T11:22:13.396439+0000","last_became_peered":"2024-04-25T11:22:13.396439+0000","last_unstale":"2024-04-25T11:24:15.034825+0000","last_undegraded":"2024-04-25T11:24:15.034825+0000","last_fullsized":"2024-04-25T11:24:15.034825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755249+0000","last_change":"2024-04-25T11:22:14.404784+0000","last_active":"2024-04-25T11:24:14.755249+0000","last_peered":"2024-04-25T11:24:14.755249+0000","last_clean":"2024-04-25T11:24:14.755249+0000","last_became_active":"2024-04-25T11:22:14.404355+0000","last_became_peered":"2024-04-25T11:22:14.404355+0000","last_unstale":"2024-04-25T11:24:14.755249+0000","last_undegraded":"2024-04-25T11:24:14.755249+0000","last_fullsized":"2024-04-25T11:24:14.755249+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:04.698767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.033963+0000","last_change":"2024-04-25T11:22:13.389125+0000","last_active":"2024-04-25T11:24:15.033963+0000","last_peered":"2024-04-25T11:24:15.033963+0000","last_clean":"2024-04-25T11:24:15.033963+0000","last_became_active":"2024-04-25T11:22:13.387160+0000","last_became_peered":"2024-04-25T11:22:13.387160+0000","last_unstale":"2024-04-25T11:24:15.033963+0000","last_undegraded":"2024-04-25T11:24:15.033963+0000","last_fullsized":"2024-04-25T11:24:15.033963+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:11.839065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029987+0000","last_change":"2024-04-25T11:20:53.708987+0000","last_active":"2024-04-25T11:24:15.029987+0000","last_peered":"2024-04-25T11:24:15.029987+0000","last_clean":"2024-04-25T11:24:15.029987+0000","last_became_active":"2024-04-25T11:20:53.704654+0000","last_became_peered":"2024-04-25T11:20:53.704654+0000","last_unstale":"2024-04-25T11:24:15.029987+0000","last_undegraded":"2024-04-25T11:24:15.029987+0000","last_fullsized":"2024-04-25T11:24:15.029987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_clean_scrub_stamp":"2024-04-25T11:17:24.025142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:24.174044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.818909+0000","last_change":"2024-04-25T11:22:14.413776+0000","last_active":"2024-04-25T11:24:14.818909+0000","last_peered":"2024-04-25T11:24:14.818909+0000","last_clean":"2024-04-25T11:24:14.818909+0000","last_became_active":"2024-04-25T11:22:14.413417+0000","last_became_peered":"2024-04-25T11:22:14.413417+0000","last_unstale":"2024-04-25T11:24:14.818909+0000","last_undegraded":"2024-04-25T11:24:14.818909+0000","last_fullsized":"2024-04-25T11:24:14.818909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:15.393246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030141+0000","last_change":"2024-04-25T11:22:13.404113+0000","last_active":"2024-04-25T11:24:15.030141+0000","last_peered":"2024-04-25T11:24:15.030141+0000","last_clean":"2024-04-25T11:24:15.030141+0000","last_became_active":"2024-04-25T11:22:13.403711+0000","last_became_peered":"2024-04-25T11:22:13.403711+0000","last_unstale":"2024-04-25T11:24:15.030141+0000","last_undegraded":"2024-04-25T11:24:15.030141+0000","last_fullsized":"2024-04-25T11:24:15.030141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:52.618167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860535+0000","last_change":"2024-04-25T11:22:13.404334+0000","last_active":"2024-04-25T11:24:14.860535+0000","last_peered":"2024-04-25T11:24:14.860535+0000","last_clean":"2024-04-25T11:24:14.860535+0000","last_became_active":"2024-04-25T11:22:13.403896+0000","last_became_peered":"2024-04-25T11:22:13.403896+0000","last_unstale":"2024-04-25T11:24:14.860535+0000","last_undegraded":"2024-04-25T11:24:14.860535+0000","last_fullsized":"2024-04-25T11:24:14.860535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:24.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819548+0000","last_change":"2024-04-25T11:22:14.406921+0000","last_active":"2024-04-25T11:24:14.819548+0000","last_peered":"2024-04-25T11:24:14.819548+0000","last_clean":"2024-04-25T11:24:14.819548+0000","last_became_active":"2024-04-25T11:22:14.406520+0000","last_became_peered":"2024-04-25T11:22:14.406520+0000","last_unstale":"2024-04-25T11:24:14.819548+0000","last_undegraded":"2024-04-25T11:24:14.819548+0000","last_fullsized":"2024-04-25T11:24:14.819548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:24.127805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'44","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.984378+0000","last_change":"2024-04-25T11:22:13.400870+0000","last_active":"2024-04-25T11:24:14.984378+0000","last_peered":"2024-04-25T11:24:14.984378+0000","last_clean":"2024-04-25T11:24:14.984378+0000","last_became_active":"2024-04-25T11:22:13.400479+0000","last_became_peered":"2024-04-25T11:22:13.400479+0000","last_unstale":"2024-04-25T11:24:14.984378+0000","last_undegraded":"2024-04-25T11:24:14.984378+0000","last_fullsized":"2024-04-25T11:24:14.984378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:12.975205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754879+0000","last_change":"2024-04-25T11:22:14.402782+0000","last_active":"2024-04-25T11:24:14.754879+0000","last_peered":"2024-04-25T11:24:14.754879+0000","last_clean":"2024-04-25T11:24:14.754879+0000","last_became_active":"2024-04-25T11:22:14.402368+0000","last_became_peered":"2024-04-25T11:22:14.402368+0000","last_unstale":"2024-04-25T11:24:14.754879+0000","last_undegraded":"2024-04-25T11:24:14.754879+0000","last_fullsized":"2024-04-25T11:24:14.754879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:49.897015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034079+0000","last_change":"2024-04-25T11:22:13.390229+0000","last_active":"2024-04-25T11:24:15.034079+0000","last_peered":"2024-04-25T11:24:15.034079+0000","last_clean":"2024-04-25T11:24:15.034079+0000","last_became_active":"2024-04-25T11:22:13.389825+0000","last_became_peered":"2024-04-25T11:22:13.389825+0000","last_unstale":"2024-04-25T11:24:15.034079+0000","last_undegraded":"2024-04-25T11:24:15.034079+0000","last_fullsized":"2024-04-25T11:24:15.034079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:50.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035284+0000","last_change":"2024-04-25T11:22:14.412066+0000","last_active":"2024-04-25T11:24:15.035284+0000","last_peered":"2024-04-25T11:24:15.035284+0000","last_clean":"2024-04-25T11:24:15.035284+0000","last_became_active":"2024-04-25T11:22:14.411707+0000","last_became_peered":"2024-04-25T11:22:14.411707+0000","last_unstale":"2024-04-25T11:24:15.035284+0000","last_undegraded":"2024-04-25T11:24:15.035284+0000","last_fullsized":"2024-04-25T11:24:15.035284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:13.274928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757021+0000","last_change":"2024-04-25T11:22:13.397644+0000","last_active":"2024-04-25T11:24:14.757021+0000","last_peered":"2024-04-25T11:24:14.757021+0000","last_clean":"2024-04-25T11:24:14.757021+0000","last_became_active":"2024-04-25T11:22:13.397240+0000","last_became_peered":"2024-04-25T11:22:13.397240+0000","last_unstale":"2024-04-25T11:24:14.757021+0000","last_undegraded":"2024-04-25T11:24:14.757021+0000","last_fullsized":"2024-04-25T11:24:14.757021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.927399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860161+0000","last_change":"2024-04-25T11:22:14.416191+0000","last_active":"2024-04-25T11:24:14.860161+0000","last_peered":"2024-04-25T11:24:14.860161+0000","last_clean":"2024-04-25T11:24:14.860161+0000","last_became_active":"2024-04-25T11:22:14.415537+0000","last_became_peered":"2024-04-25T11:22:14.415537+0000","last_unstale":"2024-04-25T11:24:14.860161+0000","last_undegraded":"2024-04-25T11:24:14.860161+0000","last_fullsized":"2024-04-25T11:24:14.860161+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:27.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754572+0000","last_change":"2024-04-25T11:22:13.390329+0000","last_active":"2024-04-25T11:24:14.754572+0000","last_peered":"2024-04-25T11:24:14.754572+0000","last_clean":"2024-04-25T11:24:14.754572+0000","last_became_active":"2024-04-25T11:22:13.389854+0000","last_became_peered":"2024-04-25T11:22:13.389854+0000","last_unstale":"2024-04-25T11:24:14.754572+0000","last_undegraded":"2024-04-25T11:24:14.754572+0000","last_fullsized":"2024-04-25T11:24:14.754572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:01.238826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105442+0000","last_change":"2024-04-25T11:22:14.395782+0000","last_active":"2024-04-25T11:24:15.105442+0000","last_peered":"2024-04-25T11:24:15.105442+0000","last_clean":"2024-04-25T11:24:15.105442+0000","last_became_active":"2024-04-25T11:22:14.395321+0000","last_became_peered":"2024-04-25T11:22:14.395321+0000","last_unstale":"2024-04-25T11:24:15.105442+0000","last_undegraded":"2024-04-25T11:24:15.105442+0000","last_fullsized":"2024-04-25T11:24:15.105442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:08.842424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030255+0000","last_change":"2024-04-25T11:22:13.401087+0000","last_active":"2024-04-25T11:24:15.030255+0000","last_peered":"2024-04-25T11:24:15.030255+0000","last_clean":"2024-04-25T11:24:15.030255+0000","last_became_active":"2024-04-25T11:22:13.400537+0000","last_became_peered":"2024-04-25T11:22:13.400537+0000","last_unstale":"2024-04-25T11:24:15.030255+0000","last_undegraded":"2024-04-25T11:24:15.030255+0000","last_fullsized":"2024-04-25T11:24:15.030255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:24.566260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754789+0000","last_change":"2024-04-25T11:22:14.399436+0000","last_active":"2024-04-25T11:24:14.754789+0000","last_peered":"2024-04-25T11:24:14.754789+0000","last_clean":"2024-04-25T11:24:14.754789+0000","last_became_active":"2024-04-25T11:22:14.398968+0000","last_became_peered":"2024-04-25T11:22:14.398968+0000","last_unstale":"2024-04-25T11:24:14.754789+0000","last_undegraded":"2024-04-25T11:24:14.754789+0000","last_fullsized":"2024-04-25T11:24:14.754789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:52.426381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860261+0000","last_change":"2024-04-25T11:22:56.420115+0000","last_active":"2024-04-25T11:24:14.860261+0000","last_peered":"2024-04-25T11:24:14.860261+0000","last_clean":"2024-04-25T11:24:14.860261+0000","last_became_active":"2024-04-25T11:22:56.414491+0000","last_became_peered":"2024-04-25T11:22:56.414491+0000","last_unstale":"2024-04-25T11:24:14.860261+0000","last_undegraded":"2024-04-25T11:24:14.860261+0000","last_fullsized":"2024-04-25T11:24:14.860261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:36.180143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030158+0000","last_change":"2024-04-25T11:22:14.403391+0000","last_active":"2024-04-25T11:24:15.030158+0000","last_peered":"2024-04-25T11:24:15.030158+0000","last_clean":"2024-04-25T11:24:15.030158+0000","last_became_active":"2024-04-25T11:22:14.402817+0000","last_became_peered":"2024-04-25T11:22:14.402817+0000","last_unstale":"2024-04-25T11:24:15.030158+0000","last_undegraded":"2024-04-25T11:24:15.030158+0000","last_fullsized":"2024-04-25T11:24:15.030158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:34.190216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030473+0000","last_change":"2024-04-25T11:22:13.394733+0000","last_active":"2024-04-25T11:24:15.030473+0000","last_peered":"2024-04-25T11:24:15.030473+0000","last_clean":"2024-04-25T11:24:15.030473+0000","last_became_active":"2024-04-25T11:22:13.394389+0000","last_became_peered":"2024-04-25T11:22:13.394389+0000","last_unstale":"2024-04-25T11:24:15.030473+0000","last_undegraded":"2024-04-25T11:24:15.030473+0000","last_fullsized":"2024-04-25T11:24:15.030473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.751957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030220+0000","last_change":"2024-04-25T11:22:14.398974+0000","last_active":"2024-04-25T11:24:15.030220+0000","last_peered":"2024-04-25T11:24:15.030220+0000","last_clean":"2024-04-25T11:24:15.030220+0000","last_became_active":"2024-04-25T11:22:14.396317+0000","last_became_peered":"2024-04-25T11:22:14.396317+0000","last_unstale":"2024-04-25T11:24:15.030220+0000","last_undegraded":"2024-04-25T11:24:15.030220+0000","last_fullsized":"2024-04-25T11:24:15.030220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:43.173266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'39","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.981862+0000","last_change":"2024-04-25T11:22:13.405081+0000","last_active":"2024-04-25T11:24:14.981862+0000","last_peered":"2024-04-25T11:24:14.981862+0000","last_clean":"2024-04-25T11:24:14.981862+0000","last_became_active":"2024-04-25T11:22:13.404160+0000","last_became_peered":"2024-04-25T11:22:13.404160+0000","last_unstale":"2024-04-25T11:24:14.981862+0000","last_undegraded":"2024-04-25T11:24:14.981862+0000","last_fullsized":"2024-04-25T11:24:14.981862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:33.591987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030083+0000","last_change":"2024-04-25T11:22:14.406014+0000","last_active":"2024-04-25T11:24:15.030083+0000","last_peered":"2024-04-25T11:24:15.030083+0000","last_clean":"2024-04-25T11:24:15.030083+0000","last_became_active":"2024-04-25T11:22:14.405609+0000","last_became_peered":"2024-04-25T11:22:14.405609+0000","last_unstale":"2024-04-25T11:24:15.030083+0000","last_undegraded":"2024-04-25T11:24:15.030083+0000","last_fullsized":"2024-04-25T11:24:15.030083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:55.357497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819656+0000","last_change":"2024-04-25T11:22:56.422584+0000","last_active":"2024-04-25T11:24:14.819656+0000","last_peered":"2024-04-25T11:24:14.819656+0000","last_clean":"2024-04-25T11:24:14.819656+0000","last_became_active":"2024-04-25T11:22:56.415765+0000","last_became_peered":"2024-04-25T11:22:56.415765+0000","last_unstale":"2024-04-25T11:24:14.819656+0000","last_undegraded":"2024-04-25T11:24:14.819656+0000","last_fullsized":"2024-04-25T11:24:14.819656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:31.321372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030327+0000","last_change":"2024-04-25T11:22:14.396359+0000","last_active":"2024-04-25T11:24:15.030327+0000","last_peered":"2024-04-25T11:24:15.030327+0000","last_clean":"2024-04-25T11:24:15.030327+0000","last_became_active":"2024-04-25T11:22:14.395818+0000","last_became_peered":"2024-04-25T11:22:14.395818+0000","last_unstale":"2024-04-25T11:24:15.030327+0000","last_undegraded":"2024-04-25T11:24:15.030327+0000","last_fullsized":"2024-04-25T11:24:15.030327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.964366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105549+0000","last_change":"2024-04-25T11:22:14.396700+0000","last_active":"2024-04-25T11:24:15.105549+0000","last_peered":"2024-04-25T11:24:15.105549+0000","last_clean":"2024-04-25T11:24:15.105549+0000","last_became_active":"2024-04-25T11:22:14.396353+0000","last_became_peered":"2024-04-25T11:22:14.396353+0000","last_unstale":"2024-04-25T11:24:15.105549+0000","last_undegraded":"2024-04-25T11:24:15.105549+0000","last_fullsized":"2024-04-25T11:24:15.105549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:23.570878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030189+0000","last_change":"2024-04-25T11:22:14.412317+0000","last_active":"2024-04-25T11:24:15.030189+0000","last_peered":"2024-04-25T11:24:15.030189+0000","last_clean":"2024-04-25T11:24:15.030189+0000","last_became_active":"2024-04-25T11:22:14.411940+0000","last_became_peered":"2024-04-25T11:22:14.411940+0000","last_unstale":"2024-04-25T11:24:15.030189+0000","last_undegraded":"2024-04-25T11:24:15.030189+0000","last_fullsized":"2024-04-25T11:24:15.030189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030093+0000","last_change":"2024-04-25T11:22:14.407779+0000","last_active":"2024-04-25T11:24:15.030093+0000","last_peered":"2024-04-25T11:24:15.030093+0000","last_clean":"2024-04-25T11:24:15.030093+0000","last_became_active":"2024-04-25T11:22:14.407443+0000","last_became_peered":"2024-04-25T11:22:14.407443+0000","last_unstale":"2024-04-25T11:24:15.030093+0000","last_undegraded":"2024-04-25T11:24:15.030093+0000","last_fullsized":"2024-04-25T11:24:15.030093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:00.316425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035088+0000","last_change":"2024-04-25T11:22:14.412005+0000","last_active":"2024-04-25T11:24:15.035088+0000","last_peered":"2024-04-25T11:24:15.035088+0000","last_clean":"2024-04-25T11:24:15.035088+0000","last_became_active":"2024-04-25T11:22:14.411626+0000","last_became_peered":"2024-04-25T11:22:14.411626+0000","last_unstale":"2024-04-25T11:24:15.035088+0000","last_undegraded":"2024-04-25T11:24:15.035088+0000","last_fullsized":"2024-04-25T11:24:15.035088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.320505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819541+0000","last_change":"2024-04-25T11:22:14.415812+0000","last_active":"2024-04-25T11:24:14.819541+0000","last_peered":"2024-04-25T11:24:14.819541+0000","last_clean":"2024-04-25T11:24:14.819541+0000","last_became_active":"2024-04-25T11:22:14.415455+0000","last_became_peered":"2024-04-25T11:22:14.415455+0000","last_unstale":"2024-04-25T11:24:14.819541+0000","last_undegraded":"2024-04-25T11:24:14.819541+0000","last_fullsized":"2024-04-25T11:24:14.819541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:55.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105568+0000","last_change":"2024-04-25T11:22:14.400892+0000","last_active":"2024-04-25T11:24:15.105568+0000","last_peered":"2024-04-25T11:24:15.105568+0000","last_clean":"2024-04-25T11:24:15.105568+0000","last_became_active":"2024-04-25T11:22:14.400526+0000","last_became_peered":"2024-04-25T11:22:14.400526+0000","last_unstale":"2024-04-25T11:24:15.105568+0000","last_undegraded":"2024-04-25T11:24:15.105568+0000","last_fullsized":"2024-04-25T11:24:15.105568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:20.123680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030774+0000","last_change":"2024-04-25T11:22:14.403134+0000","last_active":"2024-04-25T11:24:15.030774+0000","last_peered":"2024-04-25T11:24:15.030774+0000","last_clean":"2024-04-25T11:24:15.030774+0000","last_became_active":"2024-04-25T11:22:14.402795+0000","last_became_peered":"2024-04-25T11:22:14.402795+0000","last_unstale":"2024-04-25T11:24:15.030774+0000","last_undegraded":"2024-04-25T11:24:15.030774+0000","last_fullsized":"2024-04-25T11:24:15.030774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.496135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754736+0000","last_change":"2024-04-25T11:22:14.410963+0000","last_active":"2024-04-25T11:24:14.754736+0000","last_peered":"2024-04-25T11:24:14.754736+0000","last_clean":"2024-04-25T11:24:14.754736+0000","last_became_active":"2024-04-25T11:22:14.410555+0000","last_became_peered":"2024-04-25T11:22:14.410555+0000","last_unstale":"2024-04-25T11:24:14.754736+0000","last_undegraded":"2024-04-25T11:24:14.754736+0000","last_fullsized":"2024-04-25T11:24:14.754736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:56.505717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755883+0000","last_change":"2024-04-25T11:22:14.405094+0000","last_active":"2024-04-25T11:24:14.755883+0000","last_peered":"2024-04-25T11:24:14.755883+0000","last_clean":"2024-04-25T11:24:14.755883+0000","last_became_active":"2024-04-25T11:22:14.404749+0000","last_became_peered":"2024-04-25T11:22:14.404749+0000","last_unstale":"2024-04-25T11:24:14.755883+0000","last_undegraded":"2024-04-25T11:24:14.755883+0000","last_fullsized":"2024-04-25T11:24:14.755883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:44.129648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754497+0000","last_change":"2024-04-25T11:22:14.396868+0000","last_active":"2024-04-25T11:24:14.754497+0000","last_peered":"2024-04-25T11:24:14.754497+0000","last_clean":"2024-04-25T11:24:14.754497+0000","last_became_active":"2024-04-25T11:22:14.396421+0000","last_became_peered":"2024-04-25T11:22:14.396421+0000","last_unstale":"2024-04-25T11:24:14.754497+0000","last_undegraded":"2024-04-25T11:24:14.754497+0000","last_fullsized":"2024-04-25T11:24:14.754497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:24.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757123+0000","last_change":"2024-04-25T11:22:14.400510+0000","last_active":"2024-04-25T11:24:14.757123+0000","last_peered":"2024-04-25T11:24:14.757123+0000","last_clean":"2024-04-25T11:24:14.757123+0000","last_became_active":"2024-04-25T11:22:14.400037+0000","last_became_peered":"2024-04-25T11:22:14.400037+0000","last_unstale":"2024-04-25T11:24:14.757123+0000","last_undegraded":"2024-04-25T11:24:14.757123+0000","last_fullsized":"2024-04-25T11:24:14.757123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.293068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819323+0000","last_change":"2024-04-25T11:22:14.404415+0000","last_active":"2024-04-25T11:24:14.819323+0000","last_peered":"2024-04-25T11:24:14.819323+0000","last_clean":"2024-04-25T11:24:14.819323+0000","last_became_active":"2024-04-25T11:22:14.404032+0000","last_became_peered":"2024-04-25T11:22:14.404032+0000","last_unstale":"2024-04-25T11:24:14.819323+0000","last_undegraded":"2024-04-25T11:24:14.819323+0000","last_fullsized":"2024-04-25T11:24:14.819323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:03.318304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105520+0000","last_change":"2024-04-25T11:22:14.410650+0000","last_active":"2024-04-25T11:24:15.105520+0000","last_peered":"2024-04-25T11:24:15.105520+0000","last_clean":"2024-04-25T11:24:15.105520+0000","last_became_active":"2024-04-25T11:22:14.410216+0000","last_became_peered":"2024-04-25T11:22:14.410216+0000","last_unstale":"2024-04-25T11:24:15.105520+0000","last_undegraded":"2024-04-25T11:24:15.105520+0000","last_fullsized":"2024-04-25T11:24:15.105520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:28.364279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106839,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":599120,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":836,"num_read_kb":529,"num_write":290,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1797360,"data_compressed":81483,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645350,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":868352,"data_stored":419958,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841579,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1211507,"data_compressed":52368,"data_compressed_allocated":69632,"data_compressed_original":745472,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005104,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":812806,"data_compressed":27886,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201334,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":897024,"data_stored":812704,"data_compressed":27886,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":921600,"data_stored":1013403,"data_compressed":44353,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":864256,"data_stored":418979,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":486530,"data_compressed":10599,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":884736,"data_stored":420250,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":478974,"data_compressed":7674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":419290,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":410984,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":1143955,"data_compressed":50509,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":67758,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70730,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134698,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393932,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":202250,"data_compressed":8015,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:24:16.625 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-04-25T11:24:16.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:24:16.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.796+0000 7f06a44e7640 1 -- 172.21.15.80:0/2376656375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c103970 msgr2=0x7f069c103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.796+0000 7f06a44e7640 1 --2- 172.21.15.80:0/2376656375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c103970 0x7f069c103dc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f068c009900 tx=0x7f068c02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:16.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.797+0000 7f06a44e7640 1 -- 172.21.15.80:0/2376656375 shutdown_connections 2024-04-25T11:24:16.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.797+0000 7f06a44e7640 1 --2- 172.21.15.80:0/2376656375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c103970 0x7f069c103dc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.797+0000 7f06a44e7640 1 --2- 172.21.15.80:0/2376656375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f069c104450 0x7f069c10ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.797+0000 7f06a44e7640 1 --2- 172.21.15.80:0/2376656375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c102f90 0x7f069c1033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.797+0000 7f06a44e7640 1 -- 172.21.15.80:0/2376656375 >> 172.21.15.80:0/2376656375 conn(0x7f069c0fd330 msgr2=0x7f069c0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:16.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.797+0000 7f06a44e7640 1 -- 172.21.15.80:0/2376656375 shutdown_connections 2024-04-25T11:24:16.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.797+0000 7f06a44e7640 1 -- 172.21.15.80:0/2376656375 wait complete. 2024-04-25T11:24:16.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 Processor -- start 2024-04-25T11:24:16.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 -- start start 2024-04-25T11:24:16.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c102f90 0x7f069c199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f069c103970 0x7f069c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c104450 0x7f069c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f069c10e510 con 0x7f069c102f90 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f069c10e390 con 0x7f069c103970 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a44e7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f069c10e690 con 0x7f069c104450 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c102f90 0x7f069c199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c102f90 0x7f069c199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57536/0 (socket says 172.21.15.80:57536) 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 -- 172.21.15.80:0/907744541 learned_addr learned my addr 172.21.15.80:0/907744541 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a1a82640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f069c103970 0x7f069c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2a84640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c104450 0x7f069c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 -- 172.21.15.80:0/907744541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c104450 msgr2=0x7f069c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c104450 0x7f069c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 -- 172.21.15.80:0/907744541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f069c103970 msgr2=0x7f069c199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:16.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f069c103970 0x7f069c199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 -- 172.21.15.80:0/907744541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c1a0c80 con 0x7f069c102f90 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.798+0000 7f06a2283640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c102f90 0x7f069c199140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f069800e9f0 tx=0x7f069800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.799+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069800ccc0 con 0x7f069c102f90 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.799+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06980035f0 con 0x7f069c102f90 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.799+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069c1a0f70 con 0x7f069c102f90 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.799+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069800ce60 con 0x7f069c102f90 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.799+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069c1a1380 con 0x7f069c102f90 2024-04-25T11:24:16.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.800+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069c069310 con 0x7f069c102f90 2024-04-25T11:24:16.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.802+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 21) ==== 147332+0+0 (secure 0 0 0) 0x7f0698004030 con 0x7f069c102f90 2024-04-25T11:24:16.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.802+0000 7f06937fe640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f06880af8e0 0x7f06880b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:16.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.803+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f06980ded00 con 0x7f069c102f90 2024-04-25T11:24:16.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.803+0000 7f06a1a82640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f06880af8e0 0x7f06880b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:16.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.803+0000 7f06a1a82640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f06880af8e0 0x7f06880b1df0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f068c009230 tx=0x7f068c031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:16.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.808+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f06980a7ac0 con 0x7f069c102f90 2024-04-25T11:24:16.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:16.902+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 22) ==== 147640+0+0 (secure 0 0 0) 0x7f06980a3650 con 0x7f069c102f90 2024-04-25T11:24:17.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.020+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f069c062fe0 con 0x7f06880af8e0 2024-04-25T11:24:17.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.028+0000 7f06937fe640 1 -- 172.21.15.80:0/907744541 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258014 (secure 0 0 0) 0x7f069c062fe0 con 0x7f06880af8e0 2024-04-25T11:24:17.024 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:17.025 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-25T11:24:17.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f06880af8e0 msgr2=0x7f06880b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f06880af8e0 0x7f06880b1df0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f068c009230 tx=0x7f068c031400 comp rx=0 tx=0).stop 2024-04-25T11:24:17.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c102f90 msgr2=0x7f069c199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c102f90 0x7f069c199140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f069800e9f0 tx=0x7f069800eeb0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 shutdown_connections 2024-04-25T11:24:17.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f06880af8e0 0x7f06880b1df0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f069c104450 0x7f069c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f069c103970 0x7f069c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 --2- 172.21.15.80:0/907744541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069c102f90 0x7f069c199140 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 >> 172.21.15.80:0/907744541 conn(0x7f069c0fd330 msgr2=0x7f069c104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:17.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 shutdown_connections 2024-04-25T11:24:17.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.033+0000 7f06a44e7640 1 -- 172.21.15.80:0/907744541 wait complete. 2024-04-25T11:24:17.043 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-04-25T11:24:16.770492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189722,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":917,"num_read_kb":598,"num_write":415,"num_write_kb":3593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351544,"kb_used_data":10684,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124590280,"statfs":{"total":1151940427776,"available":1151580446720,"internally_reserved":0,"allocated":10940416,"data_stored":8049340,"data_compressed":262050,"data_compressed_allocated":352256,"data_compressed_original":3104768,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.983755"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105763+0000","last_change":"2024-04-25T11:22:14.408035+0000","last_active":"2024-04-25T11:24:15.105763+0000","last_peered":"2024-04-25T11:24:15.105763+0000","last_clean":"2024-04-25T11:24:15.105763+0000","last_became_active":"2024-04-25T11:22:14.407691+0000","last_became_peered":"2024-04-25T11:22:14.407691+0000","last_unstale":"2024-04-25T11:24:15.105763+0000","last_undegraded":"2024-04-25T11:24:15.105763+0000","last_fullsized":"2024-04-25T11:24:15.105763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:27.388402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035265+0000","last_change":"2024-04-25T11:22:14.415270+0000","last_active":"2024-04-25T11:24:15.035265+0000","last_peered":"2024-04-25T11:24:15.035265+0000","last_clean":"2024-04-25T11:24:15.035265+0000","last_became_active":"2024-04-25T11:22:14.413962+0000","last_became_peered":"2024-04-25T11:22:14.413962+0000","last_unstale":"2024-04-25T11:24:15.035265+0000","last_undegraded":"2024-04-25T11:24:15.035265+0000","last_fullsized":"2024-04-25T11:24:15.035265+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:31.160774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035041+0000","last_change":"2024-04-25T11:22:14.402643+0000","last_active":"2024-04-25T11:24:15.035041+0000","last_peered":"2024-04-25T11:24:15.035041+0000","last_clean":"2024-04-25T11:24:15.035041+0000","last_became_active":"2024-04-25T11:22:14.401940+0000","last_became_peered":"2024-04-25T11:22:14.401940+0000","last_unstale":"2024-04-25T11:24:15.035041+0000","last_undegraded":"2024-04-25T11:24:15.035041+0000","last_fullsized":"2024-04-25T11:24:15.035041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:47.270354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034182+0000","last_change":"2024-04-25T11:22:14.413726+0000","last_active":"2024-04-25T11:24:15.034182+0000","last_peered":"2024-04-25T11:24:15.034182+0000","last_clean":"2024-04-25T11:24:15.034182+0000","last_became_active":"2024-04-25T11:22:14.412971+0000","last_became_peered":"2024-04-25T11:22:14.412971+0000","last_unstale":"2024-04-25T11:24:15.034182+0000","last_undegraded":"2024-04-25T11:24:15.034182+0000","last_fullsized":"2024-04-25T11:24:15.034182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:42.017286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860304+0000","last_change":"2024-04-25T11:22:14.403390+0000","last_active":"2024-04-25T11:24:14.860304+0000","last_peered":"2024-04-25T11:24:14.860304+0000","last_clean":"2024-04-25T11:24:14.860304+0000","last_became_active":"2024-04-25T11:22:14.402999+0000","last_became_peered":"2024-04-25T11:22:14.402999+0000","last_unstale":"2024-04-25T11:24:14.860304+0000","last_undegraded":"2024-04-25T11:24:14.860304+0000","last_fullsized":"2024-04-25T11:24:14.860304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:59.283486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.867832+0000","last_change":"2024-04-25T11:22:56.415548+0000","last_active":"2024-04-25T11:24:14.867832+0000","last_peered":"2024-04-25T11:24:14.867832+0000","last_clean":"2024-04-25T11:24:14.867832+0000","last_became_active":"2024-04-25T11:22:56.414819+0000","last_became_peered":"2024-04-25T11:22:56.414819+0000","last_unstale":"2024-04-25T11:24:14.867832+0000","last_undegraded":"2024-04-25T11:24:14.867832+0000","last_fullsized":"2024-04-25T11:24:14.867832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:32.599336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029944+0000","last_change":"2024-04-25T11:22:14.404800+0000","last_active":"2024-04-25T11:24:15.029944+0000","last_peered":"2024-04-25T11:24:15.029944+0000","last_clean":"2024-04-25T11:24:15.029944+0000","last_became_active":"2024-04-25T11:22:14.404445+0000","last_became_peered":"2024-04-25T11:22:14.404445+0000","last_unstale":"2024-04-25T11:24:15.029944+0000","last_undegraded":"2024-04-25T11:24:15.029944+0000","last_fullsized":"2024-04-25T11:24:15.029944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:51.498081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857553+0000","last_change":"2024-04-25T11:22:56.415367+0000","last_active":"2024-04-25T11:24:14.857553+0000","last_peered":"2024-04-25T11:24:14.857553+0000","last_clean":"2024-04-25T11:24:14.857553+0000","last_became_active":"2024-04-25T11:22:56.414982+0000","last_became_peered":"2024-04-25T11:22:56.414982+0000","last_unstale":"2024-04-25T11:24:14.857553+0000","last_undegraded":"2024-04-25T11:24:14.857553+0000","last_fullsized":"2024-04-25T11:24:14.857553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:23.069726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757315+0000","last_change":"2024-04-25T11:22:14.410119+0000","last_active":"2024-04-25T11:24:14.757315+0000","last_peered":"2024-04-25T11:24:14.757315+0000","last_clean":"2024-04-25T11:24:14.757315+0000","last_became_active":"2024-04-25T11:22:14.409736+0000","last_became_peered":"2024-04-25T11:22:14.409736+0000","last_unstale":"2024-04-25T11:24:14.757315+0000","last_undegraded":"2024-04-25T11:24:14.757315+0000","last_fullsized":"2024-04-25T11:24:14.757315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:57.842921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868217+0000","last_change":"2024-04-25T11:22:14.416368+0000","last_active":"2024-04-25T11:24:14.868217+0000","last_peered":"2024-04-25T11:24:14.868217+0000","last_clean":"2024-04-25T11:24:14.868217+0000","last_became_active":"2024-04-25T11:22:14.415888+0000","last_became_peered":"2024-04-25T11:22:14.415888+0000","last_unstale":"2024-04-25T11:24:14.868217+0000","last_undegraded":"2024-04-25T11:24:14.868217+0000","last_fullsized":"2024-04-25T11:24:14.868217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:00.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030167+0000","last_change":"2024-04-25T11:22:14.402490+0000","last_active":"2024-04-25T11:24:15.030167+0000","last_peered":"2024-04-25T11:24:15.030167+0000","last_clean":"2024-04-25T11:24:15.030167+0000","last_became_active":"2024-04-25T11:22:14.402115+0000","last_became_peered":"2024-04-25T11:22:14.402115+0000","last_unstale":"2024-04-25T11:24:15.030167+0000","last_undegraded":"2024-04-25T11:24:15.030167+0000","last_fullsized":"2024-04-25T11:24:15.030167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:34.783230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034075+0000","last_change":"2024-04-25T11:22:14.420570+0000","last_active":"2024-04-25T11:24:15.034075+0000","last_peered":"2024-04-25T11:24:15.034075+0000","last_clean":"2024-04-25T11:24:15.034075+0000","last_became_active":"2024-04-25T11:22:14.420187+0000","last_became_peered":"2024-04-25T11:22:14.420187+0000","last_unstale":"2024-04-25T11:24:15.034075+0000","last_undegraded":"2024-04-25T11:24:15.034075+0000","last_fullsized":"2024-04-25T11:24:15.034075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:52.828114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819248+0000","last_change":"2024-04-25T11:22:14.414789+0000","last_active":"2024-04-25T11:24:14.819248+0000","last_peered":"2024-04-25T11:24:14.819248+0000","last_clean":"2024-04-25T11:24:14.819248+0000","last_became_active":"2024-04-25T11:22:14.414465+0000","last_became_peered":"2024-04-25T11:22:14.414465+0000","last_unstale":"2024-04-25T11:24:14.819248+0000","last_undegraded":"2024-04-25T11:24:14.819248+0000","last_fullsized":"2024-04-25T11:24:14.819248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:37.748045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034849+0000","last_change":"2024-04-25T11:22:14.413268+0000","last_active":"2024-04-25T11:24:15.034849+0000","last_peered":"2024-04-25T11:24:15.034849+0000","last_clean":"2024-04-25T11:24:15.034849+0000","last_became_active":"2024-04-25T11:22:14.412897+0000","last_became_peered":"2024-04-25T11:22:14.412897+0000","last_unstale":"2024-04-25T11:24:15.034849+0000","last_undegraded":"2024-04-25T11:24:15.034849+0000","last_fullsized":"2024-04-25T11:24:15.034849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:49.997236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034758+0000","last_change":"2024-04-25T11:22:14.411114+0000","last_active":"2024-04-25T11:24:15.034758+0000","last_peered":"2024-04-25T11:24:15.034758+0000","last_clean":"2024-04-25T11:24:15.034758+0000","last_became_active":"2024-04-25T11:22:14.410700+0000","last_became_peered":"2024-04-25T11:22:14.410700+0000","last_unstale":"2024-04-25T11:24:15.034758+0000","last_undegraded":"2024-04-25T11:24:15.034758+0000","last_fullsized":"2024-04-25T11:24:15.034758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:38.367214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756939+0000","last_change":"2024-04-25T11:22:14.408073+0000","last_active":"2024-04-25T11:24:14.756939+0000","last_peered":"2024-04-25T11:24:14.756939+0000","last_clean":"2024-04-25T11:24:14.756939+0000","last_became_active":"2024-04-25T11:22:14.406878+0000","last_became_peered":"2024-04-25T11:22:14.406878+0000","last_unstale":"2024-04-25T11:24:14.756939+0000","last_undegraded":"2024-04-25T11:24:14.756939+0000","last_fullsized":"2024-04-25T11:24:14.756939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:00.907528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105698+0000","last_change":"2024-04-25T11:22:14.406990+0000","last_active":"2024-04-25T11:24:15.105698+0000","last_peered":"2024-04-25T11:24:15.105698+0000","last_clean":"2024-04-25T11:24:15.105698+0000","last_became_active":"2024-04-25T11:22:14.406643+0000","last_became_peered":"2024-04-25T11:22:14.406643+0000","last_unstale":"2024-04-25T11:24:15.105698+0000","last_undegraded":"2024-04-25T11:24:15.105698+0000","last_fullsized":"2024-04-25T11:24:15.105698+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:15.226490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857915+0000","last_change":"2024-04-25T11:22:14.410651+0000","last_active":"2024-04-25T11:24:14.857915+0000","last_peered":"2024-04-25T11:24:14.857915+0000","last_clean":"2024-04-25T11:24:14.857915+0000","last_became_active":"2024-04-25T11:22:14.410299+0000","last_became_peered":"2024-04-25T11:22:14.410299+0000","last_unstale":"2024-04-25T11:24:14.857915+0000","last_undegraded":"2024-04-25T11:24:14.857915+0000","last_fullsized":"2024-04-25T11:24:14.857915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:50.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030468+0000","last_change":"2024-04-25T11:22:14.405714+0000","last_active":"2024-04-25T11:24:15.030468+0000","last_peered":"2024-04-25T11:24:15.030468+0000","last_clean":"2024-04-25T11:24:15.030468+0000","last_became_active":"2024-04-25T11:22:14.405376+0000","last_became_peered":"2024-04-25T11:22:14.405376+0000","last_unstale":"2024-04-25T11:24:15.030468+0000","last_undegraded":"2024-04-25T11:24:15.030468+0000","last_fullsized":"2024-04-25T11:24:15.030468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:18.538532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857780+0000","last_change":"2024-04-25T11:22:56.421708+0000","last_active":"2024-04-25T11:24:14.857780+0000","last_peered":"2024-04-25T11:24:14.857780+0000","last_clean":"2024-04-25T11:24:14.857780+0000","last_became_active":"2024-04-25T11:22:56.413182+0000","last_became_peered":"2024-04-25T11:22:56.413182+0000","last_unstale":"2024-04-25T11:24:14.857780+0000","last_undegraded":"2024-04-25T11:24:14.857780+0000","last_fullsized":"2024-04-25T11:24:14.857780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:30.235026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754711+0000","last_change":"2024-04-25T11:22:14.411893+0000","last_active":"2024-04-25T11:24:14.754711+0000","last_peered":"2024-04-25T11:24:14.754711+0000","last_clean":"2024-04-25T11:24:14.754711+0000","last_became_active":"2024-04-25T11:22:14.409727+0000","last_became_peered":"2024-04-25T11:22:14.409727+0000","last_unstale":"2024-04-25T11:24:14.754711+0000","last_undegraded":"2024-04-25T11:24:14.754711+0000","last_fullsized":"2024-04-25T11:24:14.754711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:41.961790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755143+0000","last_change":"2024-04-25T11:22:13.398983+0000","last_active":"2024-04-25T11:24:14.755143+0000","last_peered":"2024-04-25T11:24:14.755143+0000","last_clean":"2024-04-25T11:24:14.755143+0000","last_became_active":"2024-04-25T11:22:13.397819+0000","last_became_peered":"2024-04-25T11:22:13.397819+0000","last_unstale":"2024-04-25T11:24:14.755143+0000","last_undegraded":"2024-04-25T11:24:14.755143+0000","last_fullsized":"2024-04-25T11:24:14.755143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:19.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035122+0000","last_change":"2024-04-25T11:22:14.410589+0000","last_active":"2024-04-25T11:24:15.035122+0000","last_peered":"2024-04-25T11:24:15.035122+0000","last_clean":"2024-04-25T11:24:15.035122+0000","last_became_active":"2024-04-25T11:22:14.409921+0000","last_became_peered":"2024-04-25T11:22:14.409921+0000","last_unstale":"2024-04-25T11:24:15.035122+0000","last_undegraded":"2024-04-25T11:24:15.035122+0000","last_fullsized":"2024-04-25T11:24:15.035122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:59.251335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860673+0000","last_change":"2024-04-25T11:22:13.406244+0000","last_active":"2024-04-25T11:24:14.860673+0000","last_peered":"2024-04-25T11:24:14.860673+0000","last_clean":"2024-04-25T11:24:14.860673+0000","last_became_active":"2024-04-25T11:22:13.405902+0000","last_became_peered":"2024-04-25T11:22:13.405902+0000","last_unstale":"2024-04-25T11:24:14.860673+0000","last_undegraded":"2024-04-25T11:24:14.860673+0000","last_fullsized":"2024-04-25T11:24:14.860673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:05.862922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757145+0000","last_change":"2024-04-25T11:22:14.421110+0000","last_active":"2024-04-25T11:24:14.757145+0000","last_peered":"2024-04-25T11:24:14.757145+0000","last_clean":"2024-04-25T11:24:14.757145+0000","last_became_active":"2024-04-25T11:22:14.420705+0000","last_became_peered":"2024-04-25T11:22:14.420705+0000","last_unstale":"2024-04-25T11:24:14.757145+0000","last_undegraded":"2024-04-25T11:24:14.757145+0000","last_fullsized":"2024-04-25T11:24:14.757145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:57.353467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860508+0000","last_change":"2024-04-25T11:22:13.406063+0000","last_active":"2024-04-25T11:24:14.860508+0000","last_peered":"2024-04-25T11:24:14.860508+0000","last_clean":"2024-04-25T11:24:14.860508+0000","last_became_active":"2024-04-25T11:22:13.405690+0000","last_became_peered":"2024-04-25T11:22:13.405690+0000","last_unstale":"2024-04-25T11:24:14.860508+0000","last_undegraded":"2024-04-25T11:24:14.860508+0000","last_fullsized":"2024-04-25T11:24:14.860508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:34.296298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756308+0000","last_change":"2024-04-25T11:22:14.413077+0000","last_active":"2024-04-25T11:24:14.756308+0000","last_peered":"2024-04-25T11:24:14.756308+0000","last_clean":"2024-04-25T11:24:14.756308+0000","last_became_active":"2024-04-25T11:22:14.412712+0000","last_became_peered":"2024-04-25T11:22:14.412712+0000","last_unstale":"2024-04-25T11:24:14.756308+0000","last_undegraded":"2024-04-25T11:24:14.756308+0000","last_fullsized":"2024-04-25T11:24:14.756308+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:41.683840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'10","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.623578+0000","last_change":"2024-04-25T11:22:13.396239+0000","last_active":"2024-04-25T11:24:15.623578+0000","last_peered":"2024-04-25T11:24:15.623578+0000","last_clean":"2024-04-25T11:24:15.623578+0000","last_became_active":"2024-04-25T11:22:13.395653+0000","last_became_peered":"2024-04-25T11:22:13.395653+0000","last_unstale":"2024-04-25T11:24:15.623578+0000","last_undegraded":"2024-04-25T11:24:15.623578+0000","last_fullsized":"2024-04-25T11:24:15.623578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:05.218927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860174+0000","last_change":"2024-04-25T11:22:14.409052+0000","last_active":"2024-04-25T11:24:14.860174+0000","last_peered":"2024-04-25T11:24:14.860174+0000","last_clean":"2024-04-25T11:24:14.860174+0000","last_became_active":"2024-04-25T11:22:14.408580+0000","last_became_peered":"2024-04-25T11:22:14.408580+0000","last_unstale":"2024-04-25T11:24:14.860174+0000","last_undegraded":"2024-04-25T11:24:14.860174+0000","last_fullsized":"2024-04-25T11:24:14.860174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:14.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.867776+0000","last_change":"2024-04-25T11:22:13.399086+0000","last_active":"2024-04-25T11:24:14.867776+0000","last_peered":"2024-04-25T11:24:14.867776+0000","last_clean":"2024-04-25T11:24:14.867776+0000","last_became_active":"2024-04-25T11:22:13.398559+0000","last_became_peered":"2024-04-25T11:22:13.398559+0000","last_unstale":"2024-04-25T11:24:14.867776+0000","last_undegraded":"2024-04-25T11:24:14.867776+0000","last_fullsized":"2024-04-25T11:24:14.867776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:09.913470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857939+0000","last_change":"2024-04-25T11:22:56.416426+0000","last_active":"2024-04-25T11:24:14.857939+0000","last_peered":"2024-04-25T11:24:14.857939+0000","last_clean":"2024-04-25T11:24:14.857939+0000","last_became_active":"2024-04-25T11:22:56.415792+0000","last_became_peered":"2024-04-25T11:22:56.415792+0000","last_unstale":"2024-04-25T11:24:14.857939+0000","last_undegraded":"2024-04-25T11:24:14.857939+0000","last_fullsized":"2024-04-25T11:24:14.857939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:24.421846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,8],"acting":[9,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819026+0000","last_change":"2024-04-25T11:22:13.392703+0000","last_active":"2024-04-25T11:24:14.819026+0000","last_peered":"2024-04-25T11:24:14.819026+0000","last_clean":"2024-04-25T11:24:14.819026+0000","last_became_active":"2024-04-25T11:22:13.392337+0000","last_became_peered":"2024-04-25T11:22:13.392337+0000","last_unstale":"2024-04-25T11:24:14.819026+0000","last_undegraded":"2024-04-25T11:24:14.819026+0000","last_fullsized":"2024-04-25T11:24:14.819026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:33.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754470+0000","last_change":"2024-04-25T11:22:14.398526+0000","last_active":"2024-04-25T11:24:14.754470+0000","last_peered":"2024-04-25T11:24:14.754470+0000","last_clean":"2024-04-25T11:24:14.754470+0000","last_became_active":"2024-04-25T11:22:14.398083+0000","last_became_peered":"2024-04-25T11:22:14.398083+0000","last_unstale":"2024-04-25T11:24:14.754470+0000","last_undegraded":"2024-04-25T11:24:14.754470+0000","last_fullsized":"2024-04-25T11:24:14.754470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:03.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755970+0000","last_change":"2024-04-25T11:22:13.397599+0000","last_active":"2024-04-25T11:24:14.755970+0000","last_peered":"2024-04-25T11:24:14.755970+0000","last_clean":"2024-04-25T11:24:14.755970+0000","last_became_active":"2024-04-25T11:22:13.396748+0000","last_became_peered":"2024-04-25T11:22:13.396748+0000","last_unstale":"2024-04-25T11:24:14.755970+0000","last_undegraded":"2024-04-25T11:24:14.755970+0000","last_fullsized":"2024-04-25T11:24:14.755970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:31.012095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.857575+0000","last_change":"2024-04-25T11:22:14.404668+0000","last_active":"2024-04-25T11:24:14.857575+0000","last_peered":"2024-04-25T11:24:14.857575+0000","last_clean":"2024-04-25T11:24:14.857575+0000","last_became_active":"2024-04-25T11:22:14.404306+0000","last_became_peered":"2024-04-25T11:22:14.404306+0000","last_unstale":"2024-04-25T11:24:14.857575+0000","last_undegraded":"2024-04-25T11:24:14.857575+0000","last_fullsized":"2024-04-25T11:24:14.857575+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:16.430419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'5","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868252+0000","last_change":"2024-04-25T11:22:13.398240+0000","last_active":"2024-04-25T11:24:14.868252+0000","last_peered":"2024-04-25T11:24:14.868252+0000","last_clean":"2024-04-25T11:24:14.868252+0000","last_became_active":"2024-04-25T11:22:13.397875+0000","last_became_peered":"2024-04-25T11:22:13.397875+0000","last_unstale":"2024-04-25T11:24:14.868252+0000","last_undegraded":"2024-04-25T11:24:14.868252+0000","last_fullsized":"2024-04-25T11:24:14.868252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:29.007270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757419+0000","last_change":"2024-04-25T11:22:14.422075+0000","last_active":"2024-04-25T11:24:14.757419+0000","last_peered":"2024-04-25T11:24:14.757419+0000","last_clean":"2024-04-25T11:24:14.757419+0000","last_became_active":"2024-04-25T11:22:14.421699+0000","last_became_peered":"2024-04-25T11:22:14.421699+0000","last_unstale":"2024-04-25T11:24:14.757419+0000","last_undegraded":"2024-04-25T11:24:14.757419+0000","last_fullsized":"2024-04-25T11:24:14.757419+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030264+0000","last_change":"2024-04-25T11:22:13.398104+0000","last_active":"2024-04-25T11:24:15.030264+0000","last_peered":"2024-04-25T11:24:15.030264+0000","last_clean":"2024-04-25T11:24:15.030264+0000","last_became_active":"2024-04-25T11:22:13.397716+0000","last_became_peered":"2024-04-25T11:22:13.397716+0000","last_unstale":"2024-04-25T11:24:15.030264+0000","last_undegraded":"2024-04-25T11:24:15.030264+0000","last_fullsized":"2024-04-25T11:24:15.030264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035316+0000","last_change":"2024-04-25T11:22:14.413664+0000","last_active":"2024-04-25T11:24:15.035316+0000","last_peered":"2024-04-25T11:24:15.035316+0000","last_clean":"2024-04-25T11:24:15.035316+0000","last_became_active":"2024-04-25T11:22:14.412621+0000","last_became_peered":"2024-04-25T11:22:14.412621+0000","last_unstale":"2024-04-25T11:24:15.035316+0000","last_undegraded":"2024-04-25T11:24:15.035316+0000","last_fullsized":"2024-04-25T11:24:15.035316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:24.511828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756391+0000","last_change":"2024-04-25T11:22:13.397141+0000","last_active":"2024-04-25T11:24:14.756391+0000","last_peered":"2024-04-25T11:24:14.756391+0000","last_clean":"2024-04-25T11:24:14.756391+0000","last_became_active":"2024-04-25T11:22:13.396769+0000","last_became_peered":"2024-04-25T11:22:13.396769+0000","last_unstale":"2024-04-25T11:24:14.756391+0000","last_undegraded":"2024-04-25T11:24:14.756391+0000","last_fullsized":"2024-04-25T11:24:14.756391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:40.123906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757252+0000","last_change":"2024-04-25T11:22:14.412279+0000","last_active":"2024-04-25T11:24:14.757252+0000","last_peered":"2024-04-25T11:24:14.757252+0000","last_clean":"2024-04-25T11:24:14.757252+0000","last_became_active":"2024-04-25T11:22:14.410325+0000","last_became_peered":"2024-04-25T11:22:14.410325+0000","last_unstale":"2024-04-25T11:24:14.757252+0000","last_undegraded":"2024-04-25T11:24:14.757252+0000","last_fullsized":"2024-04-25T11:24:14.757252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:03.788349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'36","reported_seq":305,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.630689+0000","last_change":"2024-04-25T11:22:13.393664+0000","last_active":"2024-04-25T11:24:15.630689+0000","last_peered":"2024-04-25T11:24:15.630689+0000","last_clean":"2024-04-25T11:24:15.630689+0000","last_became_active":"2024-04-25T11:22:13.393279+0000","last_became_peered":"2024-04-25T11:22:13.393279+0000","last_unstale":"2024-04-25T11:24:15.630689+0000","last_undegraded":"2024-04-25T11:24:15.630689+0000","last_fullsized":"2024-04-25T11:24:15.630689+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.154853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":190,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860521+0000","last_change":"2024-04-25T11:22:14.399944+0000","last_active":"2024-04-25T11:24:14.860521+0000","last_peered":"2024-04-25T11:24:14.860521+0000","last_clean":"2024-04-25T11:24:14.860521+0000","last_became_active":"2024-04-25T11:22:14.399592+0000","last_became_peered":"2024-04-25T11:22:14.399592+0000","last_unstale":"2024-04-25T11:24:14.860521+0000","last_undegraded":"2024-04-25T11:24:14.860521+0000","last_fullsized":"2024-04-25T11:24:14.860521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:18.794517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030571+0000","last_change":"2024-04-25T11:22:13.398651+0000","last_active":"2024-04-25T11:24:15.030571+0000","last_peered":"2024-04-25T11:24:15.030571+0000","last_clean":"2024-04-25T11:24:15.030571+0000","last_became_active":"2024-04-25T11:22:13.398234+0000","last_became_peered":"2024-04-25T11:22:13.398234+0000","last_unstale":"2024-04-25T11:24:15.030571+0000","last_undegraded":"2024-04-25T11:24:15.030571+0000","last_fullsized":"2024-04-25T11:24:15.030571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:39.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819069+0000","last_change":"2024-04-25T11:22:14.404684+0000","last_active":"2024-04-25T11:24:14.819069+0000","last_peered":"2024-04-25T11:24:14.819069+0000","last_clean":"2024-04-25T11:24:14.819069+0000","last_became_active":"2024-04-25T11:22:14.404319+0000","last_became_peered":"2024-04-25T11:22:14.404319+0000","last_unstale":"2024-04-25T11:24:14.819069+0000","last_undegraded":"2024-04-25T11:24:14.819069+0000","last_fullsized":"2024-04-25T11:24:14.819069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:40.388670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756091+0000","last_change":"2024-04-25T11:22:13.397954+0000","last_active":"2024-04-25T11:24:14.756091+0000","last_peered":"2024-04-25T11:24:14.756091+0000","last_clean":"2024-04-25T11:24:14.756091+0000","last_became_active":"2024-04-25T11:22:13.397595+0000","last_became_peered":"2024-04-25T11:22:13.397595+0000","last_unstale":"2024-04-25T11:24:14.756091+0000","last_undegraded":"2024-04-25T11:24:14.756091+0000","last_fullsized":"2024-04-25T11:24:14.756091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:31.912201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030364+0000","last_change":"2024-04-25T11:22:14.411671+0000","last_active":"2024-04-25T11:24:15.030364+0000","last_peered":"2024-04-25T11:24:15.030364+0000","last_clean":"2024-04-25T11:24:15.030364+0000","last_became_active":"2024-04-25T11:22:14.411034+0000","last_became_peered":"2024-04-25T11:22:14.411034+0000","last_unstale":"2024-04-25T11:24:15.030364+0000","last_undegraded":"2024-04-25T11:24:15.030364+0000","last_fullsized":"2024-04-25T11:24:15.030364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:23.614652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'7","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.621751+0000","last_change":"2024-04-25T11:22:13.397193+0000","last_active":"2024-04-25T11:24:15.621751+0000","last_peered":"2024-04-25T11:24:15.621751+0000","last_clean":"2024-04-25T11:24:15.621751+0000","last_became_active":"2024-04-25T11:22:13.396319+0000","last_became_peered":"2024-04-25T11:22:13.396319+0000","last_unstale":"2024-04-25T11:24:15.621751+0000","last_undegraded":"2024-04-25T11:24:15.621751+0000","last_fullsized":"2024-04-25T11:24:15.621751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:21.140114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029922+0000","last_change":"2024-04-25T11:22:14.404123+0000","last_active":"2024-04-25T11:24:15.029922+0000","last_peered":"2024-04-25T11:24:15.029922+0000","last_clean":"2024-04-25T11:24:15.029922+0000","last_became_active":"2024-04-25T11:22:14.403751+0000","last_became_peered":"2024-04-25T11:22:14.403751+0000","last_unstale":"2024-04-25T11:24:15.029922+0000","last_undegraded":"2024-04-25T11:24:15.029922+0000","last_fullsized":"2024-04-25T11:24:15.029922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:22.361257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860145+0000","last_change":"2024-04-25T11:22:13.402801+0000","last_active":"2024-04-25T11:24:14.860145+0000","last_peered":"2024-04-25T11:24:14.860145+0000","last_clean":"2024-04-25T11:24:14.860145+0000","last_became_active":"2024-04-25T11:22:13.402417+0000","last_became_peered":"2024-04-25T11:22:13.402417+0000","last_unstale":"2024-04-25T11:24:14.860145+0000","last_undegraded":"2024-04-25T11:24:14.860145+0000","last_fullsized":"2024-04-25T11:24:14.860145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:55.551677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756039+0000","last_change":"2024-04-25T11:22:14.413947+0000","last_active":"2024-04-25T11:24:14.756039+0000","last_peered":"2024-04-25T11:24:14.756039+0000","last_clean":"2024-04-25T11:24:14.756039+0000","last_became_active":"2024-04-25T11:22:14.413549+0000","last_became_peered":"2024-04-25T11:22:14.413549+0000","last_unstale":"2024-04-25T11:24:14.756039+0000","last_undegraded":"2024-04-25T11:24:14.756039+0000","last_fullsized":"2024-04-25T11:24:14.756039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:42.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'3","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105714+0000","last_change":"2024-04-25T11:22:56.420875+0000","last_active":"2024-04-25T11:24:15.105714+0000","last_peered":"2024-04-25T11:24:15.105714+0000","last_clean":"2024-04-25T11:24:15.105714+0000","last_became_active":"2024-04-25T11:22:56.415615+0000","last_became_peered":"2024-04-25T11:22:56.415615+0000","last_unstale":"2024-04-25T11:24:15.105714+0000","last_undegraded":"2024-04-25T11:24:15.105714+0000","last_fullsized":"2024-04-25T11:24:15.105714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:55.053238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105629+0000","last_change":"2024-04-25T11:22:56.413403+0000","last_active":"2024-04-25T11:24:15.105629+0000","last_peered":"2024-04-25T11:24:15.105629+0000","last_clean":"2024-04-25T11:24:15.105629+0000","last_became_active":"2024-04-25T11:22:56.413002+0000","last_became_peered":"2024-04-25T11:22:56.413002+0000","last_unstale":"2024-04-25T11:24:15.105629+0000","last_undegraded":"2024-04-25T11:24:15.105629+0000","last_fullsized":"2024-04-25T11:24:15.105629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:42.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.858031+0000","last_change":"2024-04-25T11:22:13.394583+0000","last_active":"2024-04-25T11:24:14.858031+0000","last_peered":"2024-04-25T11:24:14.858031+0000","last_clean":"2024-04-25T11:24:14.858031+0000","last_became_active":"2024-04-25T11:22:13.394210+0000","last_became_peered":"2024-04-25T11:22:13.394210+0000","last_unstale":"2024-04-25T11:24:14.858031+0000","last_undegraded":"2024-04-25T11:24:14.858031+0000","last_fullsized":"2024-04-25T11:24:14.858031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:34.622567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868102+0000","last_change":"2024-04-25T11:22:14.404487+0000","last_active":"2024-04-25T11:24:14.868102+0000","last_peered":"2024-04-25T11:24:14.868102+0000","last_clean":"2024-04-25T11:24:14.868102+0000","last_became_active":"2024-04-25T11:22:14.404096+0000","last_became_peered":"2024-04-25T11:22:14.404096+0000","last_unstale":"2024-04-25T11:24:14.868102+0000","last_undegraded":"2024-04-25T11:24:14.868102+0000","last_fullsized":"2024-04-25T11:24:14.868102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:55.938011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030047+0000","last_change":"2024-04-25T11:22:13.397273+0000","last_active":"2024-04-25T11:24:15.030047+0000","last_peered":"2024-04-25T11:24:15.030047+0000","last_clean":"2024-04-25T11:24:15.030047+0000","last_became_active":"2024-04-25T11:22:13.396538+0000","last_became_peered":"2024-04-25T11:22:13.396538+0000","last_unstale":"2024-04-25T11:24:15.030047+0000","last_undegraded":"2024-04-25T11:24:15.030047+0000","last_fullsized":"2024-04-25T11:24:15.030047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:04.738107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.868002+0000","last_change":"2024-04-25T11:22:56.454081+0000","last_active":"2024-04-25T11:24:14.868002+0000","last_peered":"2024-04-25T11:24:14.868002+0000","last_clean":"2024-04-25T11:24:14.868002+0000","last_became_active":"2024-04-25T11:22:56.453729+0000","last_became_peered":"2024-04-25T11:22:56.453729+0000","last_unstale":"2024-04-25T11:24:14.868002+0000","last_undegraded":"2024-04-25T11:24:14.868002+0000","last_fullsized":"2024-04-25T11:24:14.868002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:55.124699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.756175+0000","last_change":"2024-04-25T11:22:14.411786+0000","last_active":"2024-04-25T11:24:14.756175+0000","last_peered":"2024-04-25T11:24:14.756175+0000","last_clean":"2024-04-25T11:24:14.756175+0000","last_became_active":"2024-04-25T11:22:14.411433+0000","last_became_peered":"2024-04-25T11:22:14.411433+0000","last_unstale":"2024-04-25T11:24:14.756175+0000","last_undegraded":"2024-04-25T11:24:14.756175+0000","last_fullsized":"2024-04-25T11:24:14.756175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:28.948581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034825+0000","last_change":"2024-04-25T11:22:13.396834+0000","last_active":"2024-04-25T11:24:15.034825+0000","last_peered":"2024-04-25T11:24:15.034825+0000","last_clean":"2024-04-25T11:24:15.034825+0000","last_became_active":"2024-04-25T11:22:13.396439+0000","last_became_peered":"2024-04-25T11:22:13.396439+0000","last_unstale":"2024-04-25T11:24:15.034825+0000","last_undegraded":"2024-04-25T11:24:15.034825+0000","last_fullsized":"2024-04-25T11:24:15.034825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:50.370793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755249+0000","last_change":"2024-04-25T11:22:14.404784+0000","last_active":"2024-04-25T11:24:14.755249+0000","last_peered":"2024-04-25T11:24:14.755249+0000","last_clean":"2024-04-25T11:24:14.755249+0000","last_became_active":"2024-04-25T11:22:14.404355+0000","last_became_peered":"2024-04-25T11:22:14.404355+0000","last_unstale":"2024-04-25T11:24:14.755249+0000","last_undegraded":"2024-04-25T11:24:14.755249+0000","last_fullsized":"2024-04-25T11:24:14.755249+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:04.698767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.033963+0000","last_change":"2024-04-25T11:22:13.389125+0000","last_active":"2024-04-25T11:24:15.033963+0000","last_peered":"2024-04-25T11:24:15.033963+0000","last_clean":"2024-04-25T11:24:15.033963+0000","last_became_active":"2024-04-25T11:22:13.387160+0000","last_became_peered":"2024-04-25T11:22:13.387160+0000","last_unstale":"2024-04-25T11:24:15.033963+0000","last_undegraded":"2024-04-25T11:24:15.033963+0000","last_fullsized":"2024-04-25T11:24:15.033963+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:11.839065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.029987+0000","last_change":"2024-04-25T11:20:53.708987+0000","last_active":"2024-04-25T11:24:15.029987+0000","last_peered":"2024-04-25T11:24:15.029987+0000","last_clean":"2024-04-25T11:24:15.029987+0000","last_became_active":"2024-04-25T11:20:53.704654+0000","last_became_peered":"2024-04-25T11:20:53.704654+0000","last_unstale":"2024-04-25T11:24:15.029987+0000","last_undegraded":"2024-04-25T11:24:15.029987+0000","last_fullsized":"2024-04-25T11:24:15.029987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:17:24.025142+0000","last_clean_scrub_stamp":"2024-04-25T11:17:24.025142+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:24.174044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.818909+0000","last_change":"2024-04-25T11:22:14.413776+0000","last_active":"2024-04-25T11:24:14.818909+0000","last_peered":"2024-04-25T11:24:14.818909+0000","last_clean":"2024-04-25T11:24:14.818909+0000","last_became_active":"2024-04-25T11:22:14.413417+0000","last_became_peered":"2024-04-25T11:22:14.413417+0000","last_unstale":"2024-04-25T11:24:14.818909+0000","last_undegraded":"2024-04-25T11:24:14.818909+0000","last_fullsized":"2024-04-25T11:24:14.818909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:15.393246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030141+0000","last_change":"2024-04-25T11:22:13.404113+0000","last_active":"2024-04-25T11:24:15.030141+0000","last_peered":"2024-04-25T11:24:15.030141+0000","last_clean":"2024-04-25T11:24:15.030141+0000","last_became_active":"2024-04-25T11:22:13.403711+0000","last_became_peered":"2024-04-25T11:22:13.403711+0000","last_unstale":"2024-04-25T11:24:15.030141+0000","last_undegraded":"2024-04-25T11:24:15.030141+0000","last_fullsized":"2024-04-25T11:24:15.030141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:52.618167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860535+0000","last_change":"2024-04-25T11:22:13.404334+0000","last_active":"2024-04-25T11:24:14.860535+0000","last_peered":"2024-04-25T11:24:14.860535+0000","last_clean":"2024-04-25T11:24:14.860535+0000","last_became_active":"2024-04-25T11:22:13.403896+0000","last_became_peered":"2024-04-25T11:22:13.403896+0000","last_unstale":"2024-04-25T11:24:14.860535+0000","last_undegraded":"2024-04-25T11:24:14.860535+0000","last_fullsized":"2024-04-25T11:24:14.860535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:24.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819548+0000","last_change":"2024-04-25T11:22:14.406921+0000","last_active":"2024-04-25T11:24:14.819548+0000","last_peered":"2024-04-25T11:24:14.819548+0000","last_clean":"2024-04-25T11:24:14.819548+0000","last_became_active":"2024-04-25T11:22:14.406520+0000","last_became_peered":"2024-04-25T11:22:14.406520+0000","last_unstale":"2024-04-25T11:24:14.819548+0000","last_undegraded":"2024-04-25T11:24:14.819548+0000","last_fullsized":"2024-04-25T11:24:14.819548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:24.127805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'44","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.984378+0000","last_change":"2024-04-25T11:22:13.400870+0000","last_active":"2024-04-25T11:24:14.984378+0000","last_peered":"2024-04-25T11:24:14.984378+0000","last_clean":"2024-04-25T11:24:14.984378+0000","last_became_active":"2024-04-25T11:22:13.400479+0000","last_became_peered":"2024-04-25T11:22:13.400479+0000","last_unstale":"2024-04-25T11:24:14.984378+0000","last_undegraded":"2024-04-25T11:24:14.984378+0000","last_fullsized":"2024-04-25T11:24:14.984378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:12.975205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754879+0000","last_change":"2024-04-25T11:22:14.402782+0000","last_active":"2024-04-25T11:24:14.754879+0000","last_peered":"2024-04-25T11:24:14.754879+0000","last_clean":"2024-04-25T11:24:14.754879+0000","last_became_active":"2024-04-25T11:22:14.402368+0000","last_became_peered":"2024-04-25T11:22:14.402368+0000","last_unstale":"2024-04-25T11:24:14.754879+0000","last_undegraded":"2024-04-25T11:24:14.754879+0000","last_fullsized":"2024-04-25T11:24:14.754879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:49.897015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.034079+0000","last_change":"2024-04-25T11:22:13.390229+0000","last_active":"2024-04-25T11:24:15.034079+0000","last_peered":"2024-04-25T11:24:15.034079+0000","last_clean":"2024-04-25T11:24:15.034079+0000","last_became_active":"2024-04-25T11:22:13.389825+0000","last_became_peered":"2024-04-25T11:22:13.389825+0000","last_unstale":"2024-04-25T11:24:15.034079+0000","last_undegraded":"2024-04-25T11:24:15.034079+0000","last_fullsized":"2024-04-25T11:24:15.034079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:50.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035284+0000","last_change":"2024-04-25T11:22:14.412066+0000","last_active":"2024-04-25T11:24:15.035284+0000","last_peered":"2024-04-25T11:24:15.035284+0000","last_clean":"2024-04-25T11:24:15.035284+0000","last_became_active":"2024-04-25T11:22:14.411707+0000","last_became_peered":"2024-04-25T11:22:14.411707+0000","last_unstale":"2024-04-25T11:24:15.035284+0000","last_undegraded":"2024-04-25T11:24:15.035284+0000","last_fullsized":"2024-04-25T11:24:15.035284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:13.274928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757021+0000","last_change":"2024-04-25T11:22:13.397644+0000","last_active":"2024-04-25T11:24:14.757021+0000","last_peered":"2024-04-25T11:24:14.757021+0000","last_clean":"2024-04-25T11:24:14.757021+0000","last_became_active":"2024-04-25T11:22:13.397240+0000","last_became_peered":"2024-04-25T11:22:13.397240+0000","last_unstale":"2024-04-25T11:24:14.757021+0000","last_undegraded":"2024-04-25T11:24:14.757021+0000","last_fullsized":"2024-04-25T11:24:14.757021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:25.927399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860161+0000","last_change":"2024-04-25T11:22:14.416191+0000","last_active":"2024-04-25T11:24:14.860161+0000","last_peered":"2024-04-25T11:24:14.860161+0000","last_clean":"2024-04-25T11:24:14.860161+0000","last_became_active":"2024-04-25T11:22:14.415537+0000","last_became_peered":"2024-04-25T11:22:14.415537+0000","last_unstale":"2024-04-25T11:24:14.860161+0000","last_undegraded":"2024-04-25T11:24:14.860161+0000","last_fullsized":"2024-04-25T11:24:14.860161+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:27.522666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754572+0000","last_change":"2024-04-25T11:22:13.390329+0000","last_active":"2024-04-25T11:24:14.754572+0000","last_peered":"2024-04-25T11:24:14.754572+0000","last_clean":"2024-04-25T11:24:14.754572+0000","last_became_active":"2024-04-25T11:22:13.389854+0000","last_became_peered":"2024-04-25T11:22:13.389854+0000","last_unstale":"2024-04-25T11:24:14.754572+0000","last_undegraded":"2024-04-25T11:24:14.754572+0000","last_fullsized":"2024-04-25T11:24:14.754572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:01.238826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105442+0000","last_change":"2024-04-25T11:22:14.395782+0000","last_active":"2024-04-25T11:24:15.105442+0000","last_peered":"2024-04-25T11:24:15.105442+0000","last_clean":"2024-04-25T11:24:15.105442+0000","last_became_active":"2024-04-25T11:22:14.395321+0000","last_became_peered":"2024-04-25T11:22:14.395321+0000","last_unstale":"2024-04-25T11:24:15.105442+0000","last_undegraded":"2024-04-25T11:24:15.105442+0000","last_fullsized":"2024-04-25T11:24:15.105442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:08.842424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030255+0000","last_change":"2024-04-25T11:22:13.401087+0000","last_active":"2024-04-25T11:24:15.030255+0000","last_peered":"2024-04-25T11:24:15.030255+0000","last_clean":"2024-04-25T11:24:15.030255+0000","last_became_active":"2024-04-25T11:22:13.400537+0000","last_became_peered":"2024-04-25T11:22:13.400537+0000","last_unstale":"2024-04-25T11:24:15.030255+0000","last_undegraded":"2024-04-25T11:24:15.030255+0000","last_fullsized":"2024-04-25T11:24:15.030255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:24.566260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754789+0000","last_change":"2024-04-25T11:22:14.399436+0000","last_active":"2024-04-25T11:24:14.754789+0000","last_peered":"2024-04-25T11:24:14.754789+0000","last_clean":"2024-04-25T11:24:14.754789+0000","last_became_active":"2024-04-25T11:22:14.398968+0000","last_became_peered":"2024-04-25T11:22:14.398968+0000","last_unstale":"2024-04-25T11:24:14.754789+0000","last_undegraded":"2024-04-25T11:24:14.754789+0000","last_fullsized":"2024-04-25T11:24:14.754789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:52.426381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.860261+0000","last_change":"2024-04-25T11:22:56.420115+0000","last_active":"2024-04-25T11:24:14.860261+0000","last_peered":"2024-04-25T11:24:14.860261+0000","last_clean":"2024-04-25T11:24:14.860261+0000","last_became_active":"2024-04-25T11:22:56.414491+0000","last_became_peered":"2024-04-25T11:22:56.414491+0000","last_unstale":"2024-04-25T11:24:14.860261+0000","last_undegraded":"2024-04-25T11:24:14.860261+0000","last_fullsized":"2024-04-25T11:24:14.860261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:36.180143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030158+0000","last_change":"2024-04-25T11:22:14.403391+0000","last_active":"2024-04-25T11:24:15.030158+0000","last_peered":"2024-04-25T11:24:15.030158+0000","last_clean":"2024-04-25T11:24:15.030158+0000","last_became_active":"2024-04-25T11:22:14.402817+0000","last_became_peered":"2024-04-25T11:22:14.402817+0000","last_unstale":"2024-04-25T11:24:15.030158+0000","last_undegraded":"2024-04-25T11:24:15.030158+0000","last_fullsized":"2024-04-25T11:24:15.030158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:34.190216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030473+0000","last_change":"2024-04-25T11:22:13.394733+0000","last_active":"2024-04-25T11:24:15.030473+0000","last_peered":"2024-04-25T11:24:15.030473+0000","last_clean":"2024-04-25T11:24:15.030473+0000","last_became_active":"2024-04-25T11:22:13.394389+0000","last_became_peered":"2024-04-25T11:22:13.394389+0000","last_unstale":"2024-04-25T11:24:15.030473+0000","last_undegraded":"2024-04-25T11:24:15.030473+0000","last_fullsized":"2024-04-25T11:24:15.030473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.751957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030220+0000","last_change":"2024-04-25T11:22:14.398974+0000","last_active":"2024-04-25T11:24:15.030220+0000","last_peered":"2024-04-25T11:24:15.030220+0000","last_clean":"2024-04-25T11:24:15.030220+0000","last_became_active":"2024-04-25T11:22:14.396317+0000","last_became_peered":"2024-04-25T11:22:14.396317+0000","last_unstale":"2024-04-25T11:24:15.030220+0000","last_undegraded":"2024-04-25T11:24:15.030220+0000","last_fullsized":"2024-04-25T11:24:15.030220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:43.173266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'39","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.981862+0000","last_change":"2024-04-25T11:22:13.405081+0000","last_active":"2024-04-25T11:24:14.981862+0000","last_peered":"2024-04-25T11:24:14.981862+0000","last_clean":"2024-04-25T11:24:14.981862+0000","last_became_active":"2024-04-25T11:22:13.404160+0000","last_became_peered":"2024-04-25T11:22:13.404160+0000","last_unstale":"2024-04-25T11:24:14.981862+0000","last_undegraded":"2024-04-25T11:24:14.981862+0000","last_fullsized":"2024-04-25T11:24:14.981862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:33.591987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030083+0000","last_change":"2024-04-25T11:22:14.406014+0000","last_active":"2024-04-25T11:24:15.030083+0000","last_peered":"2024-04-25T11:24:15.030083+0000","last_clean":"2024-04-25T11:24:15.030083+0000","last_became_active":"2024-04-25T11:22:14.405609+0000","last_became_peered":"2024-04-25T11:22:14.405609+0000","last_unstale":"2024-04-25T11:24:15.030083+0000","last_undegraded":"2024-04-25T11:24:15.030083+0000","last_fullsized":"2024-04-25T11:24:15.030083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:55.357497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819656+0000","last_change":"2024-04-25T11:22:56.422584+0000","last_active":"2024-04-25T11:24:14.819656+0000","last_peered":"2024-04-25T11:24:14.819656+0000","last_clean":"2024-04-25T11:24:14.819656+0000","last_became_active":"2024-04-25T11:22:56.415765+0000","last_became_peered":"2024-04-25T11:22:56.415765+0000","last_unstale":"2024-04-25T11:24:14.819656+0000","last_undegraded":"2024-04-25T11:24:14.819656+0000","last_fullsized":"2024-04-25T11:24:14.819656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:12.364735+0000","last_clean_scrub_stamp":"2024-04-25T11:22:12.364735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:31.321372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030327+0000","last_change":"2024-04-25T11:22:14.396359+0000","last_active":"2024-04-25T11:24:15.030327+0000","last_peered":"2024-04-25T11:24:15.030327+0000","last_clean":"2024-04-25T11:24:15.030327+0000","last_became_active":"2024-04-25T11:22:14.395818+0000","last_became_peered":"2024-04-25T11:22:14.395818+0000","last_unstale":"2024-04-25T11:24:15.030327+0000","last_undegraded":"2024-04-25T11:24:15.030327+0000","last_fullsized":"2024-04-25T11:24:15.030327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.964366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105549+0000","last_change":"2024-04-25T11:22:14.396700+0000","last_active":"2024-04-25T11:24:15.105549+0000","last_peered":"2024-04-25T11:24:15.105549+0000","last_clean":"2024-04-25T11:24:15.105549+0000","last_became_active":"2024-04-25T11:22:14.396353+0000","last_became_peered":"2024-04-25T11:22:14.396353+0000","last_unstale":"2024-04-25T11:24:15.105549+0000","last_undegraded":"2024-04-25T11:24:15.105549+0000","last_fullsized":"2024-04-25T11:24:15.105549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:23.570878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030189+0000","last_change":"2024-04-25T11:22:14.412317+0000","last_active":"2024-04-25T11:24:15.030189+0000","last_peered":"2024-04-25T11:24:15.030189+0000","last_clean":"2024-04-25T11:24:15.030189+0000","last_became_active":"2024-04-25T11:22:14.411940+0000","last_became_peered":"2024-04-25T11:22:14.411940+0000","last_unstale":"2024-04-25T11:24:15.030189+0000","last_undegraded":"2024-04-25T11:24:15.030189+0000","last_fullsized":"2024-04-25T11:24:15.030189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030093+0000","last_change":"2024-04-25T11:22:14.407779+0000","last_active":"2024-04-25T11:24:15.030093+0000","last_peered":"2024-04-25T11:24:15.030093+0000","last_clean":"2024-04-25T11:24:15.030093+0000","last_became_active":"2024-04-25T11:22:14.407443+0000","last_became_peered":"2024-04-25T11:22:14.407443+0000","last_unstale":"2024-04-25T11:24:15.030093+0000","last_undegraded":"2024-04-25T11:24:15.030093+0000","last_fullsized":"2024-04-25T11:24:15.030093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:00.316425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.035088+0000","last_change":"2024-04-25T11:22:14.412005+0000","last_active":"2024-04-25T11:24:15.035088+0000","last_peered":"2024-04-25T11:24:15.035088+0000","last_clean":"2024-04-25T11:24:15.035088+0000","last_became_active":"2024-04-25T11:22:14.411626+0000","last_became_peered":"2024-04-25T11:22:14.411626+0000","last_unstale":"2024-04-25T11:24:15.035088+0000","last_undegraded":"2024-04-25T11:24:15.035088+0000","last_fullsized":"2024-04-25T11:24:15.035088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.320505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819541+0000","last_change":"2024-04-25T11:22:14.415812+0000","last_active":"2024-04-25T11:24:14.819541+0000","last_peered":"2024-04-25T11:24:14.819541+0000","last_clean":"2024-04-25T11:24:14.819541+0000","last_became_active":"2024-04-25T11:22:14.415455+0000","last_became_peered":"2024-04-25T11:22:14.415455+0000","last_unstale":"2024-04-25T11:24:14.819541+0000","last_undegraded":"2024-04-25T11:24:14.819541+0000","last_fullsized":"2024-04-25T11:24:14.819541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:55.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105568+0000","last_change":"2024-04-25T11:22:14.400892+0000","last_active":"2024-04-25T11:24:15.105568+0000","last_peered":"2024-04-25T11:24:15.105568+0000","last_clean":"2024-04-25T11:24:15.105568+0000","last_became_active":"2024-04-25T11:22:14.400526+0000","last_became_peered":"2024-04-25T11:22:14.400526+0000","last_unstale":"2024-04-25T11:24:15.105568+0000","last_undegraded":"2024-04-25T11:24:15.105568+0000","last_fullsized":"2024-04-25T11:24:15.105568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:20.123680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.030774+0000","last_change":"2024-04-25T11:22:14.403134+0000","last_active":"2024-04-25T11:24:15.030774+0000","last_peered":"2024-04-25T11:24:15.030774+0000","last_clean":"2024-04-25T11:24:15.030774+0000","last_became_active":"2024-04-25T11:22:14.402795+0000","last_became_peered":"2024-04-25T11:22:14.402795+0000","last_unstale":"2024-04-25T11:24:15.030774+0000","last_undegraded":"2024-04-25T11:24:15.030774+0000","last_fullsized":"2024-04-25T11:24:15.030774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.496135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754736+0000","last_change":"2024-04-25T11:22:14.410963+0000","last_active":"2024-04-25T11:24:14.754736+0000","last_peered":"2024-04-25T11:24:14.754736+0000","last_clean":"2024-04-25T11:24:14.754736+0000","last_became_active":"2024-04-25T11:22:14.410555+0000","last_became_peered":"2024-04-25T11:22:14.410555+0000","last_unstale":"2024-04-25T11:24:14.754736+0000","last_undegraded":"2024-04-25T11:24:14.754736+0000","last_fullsized":"2024-04-25T11:24:14.754736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:56.505717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.755883+0000","last_change":"2024-04-25T11:22:14.405094+0000","last_active":"2024-04-25T11:24:14.755883+0000","last_peered":"2024-04-25T11:24:14.755883+0000","last_clean":"2024-04-25T11:24:14.755883+0000","last_became_active":"2024-04-25T11:22:14.404749+0000","last_became_peered":"2024-04-25T11:22:14.404749+0000","last_unstale":"2024-04-25T11:24:14.755883+0000","last_undegraded":"2024-04-25T11:24:14.755883+0000","last_fullsized":"2024-04-25T11:24:14.755883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:44.129648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.754497+0000","last_change":"2024-04-25T11:22:14.396868+0000","last_active":"2024-04-25T11:24:14.754497+0000","last_peered":"2024-04-25T11:24:14.754497+0000","last_clean":"2024-04-25T11:24:14.754497+0000","last_became_active":"2024-04-25T11:22:14.396421+0000","last_became_peered":"2024-04-25T11:22:14.396421+0000","last_unstale":"2024-04-25T11:24:14.754497+0000","last_undegraded":"2024-04-25T11:24:14.754497+0000","last_fullsized":"2024-04-25T11:24:14.754497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:24.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.757123+0000","last_change":"2024-04-25T11:22:14.400510+0000","last_active":"2024-04-25T11:24:14.757123+0000","last_peered":"2024-04-25T11:24:14.757123+0000","last_clean":"2024-04-25T11:24:14.757123+0000","last_became_active":"2024-04-25T11:22:14.400037+0000","last_became_peered":"2024-04-25T11:22:14.400037+0000","last_unstale":"2024-04-25T11:24:14.757123+0000","last_undegraded":"2024-04-25T11:24:14.757123+0000","last_fullsized":"2024-04-25T11:24:14.757123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.293068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:14.819323+0000","last_change":"2024-04-25T11:22:14.404415+0000","last_active":"2024-04-25T11:24:14.819323+0000","last_peered":"2024-04-25T11:24:14.819323+0000","last_clean":"2024-04-25T11:24:14.819323+0000","last_became_active":"2024-04-25T11:22:14.404032+0000","last_became_peered":"2024-04-25T11:22:14.404032+0000","last_unstale":"2024-04-25T11:24:14.819323+0000","last_undegraded":"2024-04-25T11:24:14.819323+0000","last_fullsized":"2024-04-25T11:24:14.819323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:03.318304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T11:24:15.105520+0000","last_change":"2024-04-25T11:22:14.410650+0000","last_active":"2024-04-25T11:24:15.105520+0000","last_peered":"2024-04-25T11:24:15.105520+0000","last_clean":"2024-04-25T11:24:15.105520+0000","last_became_active":"2024-04-25T11:22:14.410216+0000","last_became_peered":"2024-04-25T11:22:14.410216+0000","last_unstale":"2024-04-25T11:24:15.105520+0000","last_undegraded":"2024-04-25T11:24:15.105520+0000","last_fullsized":"2024-04-25T11:24:15.105520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T11:22:13.370606+0000","last_clean_scrub_stamp":"2024-04-25T11:22:13.370606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:28.364279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106839,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":599120,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":836,"num_read_kb":529,"num_write":290,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1797360,"data_compressed":81483,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645350,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":868352,"data_stored":419958,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841579,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1211507,"data_compressed":52368,"data_compressed_allocated":69632,"data_compressed_original":745472,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005104,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":812806,"data_compressed":27886,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201334,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":897024,"data_stored":812704,"data_compressed":27886,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":921600,"data_stored":1013403,"data_compressed":44353,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":864256,"data_stored":418979,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":486530,"data_compressed":10599,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":884736,"data_stored":420250,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":478974,"data_compressed":7674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":419290,"data_compressed":8740,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":410984,"data_compressed":5815,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":1143955,"data_compressed":50509,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":67758,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70730,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134698,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393932,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":202250,"data_compressed":8015,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:24:17.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:24:17.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:16 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/477611224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:17.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:16 smithi080 ceph-mon[29126]: [25/Apr/2024:11:24:16] ENGINE Bus STARTING 2024-04-25T11:24:17.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:16 smithi080 ceph-mon[29126]: [25/Apr/2024:11:24:16] ENGINE Serving on http://172.21.15.80:8765 2024-04-25T11:24:17.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:16 smithi080 ceph-mon[29126]: [25/Apr/2024:11:24:16] ENGINE Serving on https://172.21.15.80:7150 2024-04-25T11:24:17.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:16 smithi080 ceph-mon[29126]: [25/Apr/2024:11:24:16] ENGINE Bus STARTED 2024-04-25T11:24:17.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:16 smithi080 ceph-mon[29126]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:17.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:16 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/477611224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:17.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:16 smithi196 ceph-mon[32659]: [25/Apr/2024:11:24:16] ENGINE Bus STARTING 2024-04-25T11:24:17.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:16 smithi196 ceph-mon[32659]: [25/Apr/2024:11:24:16] ENGINE Serving on http://172.21.15.80:8765 2024-04-25T11:24:17.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:16 smithi196 ceph-mon[32659]: [25/Apr/2024:11:24:16] ENGINE Serving on https://172.21.15.80:7150 2024-04-25T11:24:17.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:16 smithi196 ceph-mon[32659]: [25/Apr/2024:11:24:16] ENGINE Bus STARTED 2024-04-25T11:24:17.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:16 smithi196 ceph-mon[32659]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 -- 172.21.15.80:0/2215968194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8102f30 msgr2=0x7feee8103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 --2- 172.21.15.80:0/2215968194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8102f30 0x7feee8103340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feedc009860 tx=0x7feedc02a340 comp rx=0 tx=0).stop 2024-04-25T11:24:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 -- 172.21.15.80:0/2215968194 shutdown_connections 2024-04-25T11:24:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 --2- 172.21.15.80:0/2215968194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 0x7feee810ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 --2- 172.21.15.80:0/2215968194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feee8103910 0x7feee8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 --2- 172.21.15.80:0/2215968194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8102f30 0x7feee8103340 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 -- 172.21.15.80:0/2215968194 >> 172.21.15.80:0/2215968194 conn(0x7feee80fd330 msgr2=0x7feee80ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 -- 172.21.15.80:0/2215968194 shutdown_connections 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 -- 172.21.15.80:0/2215968194 wait complete. 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 Processor -- start 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 -- start start 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.203+0000 7feeeeef9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feee8102f30 0x7feee81021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeeeef9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8103910 0x7feee819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeeeef9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 0x7feee81a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeeeef9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feee810e4e0 con 0x7feee8104450 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeeeef9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feee810e360 con 0x7feee8103910 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeeeef9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7feee810e660 con 0x7feee8102f30 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 0x7feee81a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 0x7feee81a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57574/0 (socket says 172.21.15.80:57574) 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 -- 172.21.15.80:0/4154306980 learned_addr learned my addr 172.21.15.80:0/4154306980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeecc95640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feee8102f30 0x7feee81021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feee7fff640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8103910 0x7feee819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 -- 172.21.15.80:0/4154306980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feee8102f30 msgr2=0x7feee81021d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feee8102f30 0x7feee81021d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 -- 172.21.15.80:0/4154306980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8103910 msgr2=0x7feee819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8103910 0x7feee819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 -- 172.21.15.80:0/4154306980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee81a1d80 con 0x7feee8104450 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeed496640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 0x7feee81a1560 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feee000efc0 tx=0x7feee000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:17.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feee5ffb640 1 -- 172.21.15.80:0/4154306980 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0003970 con 0x7feee8104450 2024-04-25T11:24:17.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee81a2070 con 0x7feee8104450 2024-04-25T11:24:17.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feee5ffb640 1 -- 172.21.15.80:0/4154306980 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee0004020 con 0x7feee8104450 2024-04-25T11:24:17.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.204+0000 7feee5ffb640 1 -- 172.21.15.80:0/4154306980 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee000b940 con 0x7feee8104450 2024-04-25T11:24:17.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.205+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee81a2570 con 0x7feee8104450 2024-04-25T11:24:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.206+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee81078d0 con 0x7feee8104450 2024-04-25T11:24:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.207+0000 7feee5ffb640 1 -- 172.21.15.80:0/4154306980 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 147640+0+0 (secure 0 0 0) 0x7feee001d020 con 0x7feee8104450 2024-04-25T11:24:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.208+0000 7feee5ffb640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7feed80afc60 0x7feed80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.208+0000 7feee5ffb640 1 -- 172.21.15.80:0/4154306980 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7feee00df4b0 con 0x7feee8104450 2024-04-25T11:24:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.208+0000 7feeecc95640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7feed80afc60 0x7feed80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.208+0000 7feeecc95640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7feed80afc60 0x7feed80b2170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feedc009830 tx=0x7feedc030450 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:17.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.212+0000 7feee5ffb640 1 -- 172.21.15.80:0/4154306980 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feee00a7d60 con 0x7feee8104450 2024-04-25T11:24:17.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:16 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/477611224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:17.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:16 smithi082 ceph-mon[32440]: [25/Apr/2024:11:24:16] ENGINE Bus STARTING 2024-04-25T11:24:17.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:16 smithi082 ceph-mon[32440]: [25/Apr/2024:11:24:16] ENGINE Serving on http://172.21.15.80:8765 2024-04-25T11:24:17.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:16 smithi082 ceph-mon[32440]: [25/Apr/2024:11:24:16] ENGINE Serving on https://172.21.15.80:7150 2024-04-25T11:24:17.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:16 smithi082 ceph-mon[32440]: [25/Apr/2024:11:24:16] ENGINE Bus STARTED 2024-04-25T11:24:17.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:16 smithi082 ceph-mon[32440]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:17.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.394+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feee802dd20 con 0x7feee8104450 2024-04-25T11:24:17.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.396+0000 7feee5ffb640 1 -- 172.21.15.80:0/4154306980 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+23057 (secure 0 0 0) 0x7feee00a7660 con 0x7feee8104450 2024-04-25T11:24:17.389 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:17.389 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":80,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:24:14.749798+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/4228038844":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1814218335":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/1536113811":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/4111395089":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7feed80afc60 msgr2=0x7feed80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7feed80afc60 0x7feed80b2170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feedc009830 tx=0x7feedc030450 comp rx=0 tx=0).stop 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 msgr2=0x7feee81a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 0x7feee81a1560 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feee000efc0 tx=0x7feee000c800 comp rx=0 tx=0).stop 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 shutdown_connections 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7feed80afc60 0x7feed80b2170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feee8104450 0x7feee81a1560 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee8103910 0x7feee819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 --2- 172.21.15.80:0/4154306980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feee8102f30 0x7feee81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 >> 172.21.15.80:0/4154306980 conn(0x7feee80fd330 msgr2=0x7feee8104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 shutdown_connections 2024-04-25T11:24:17.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.398+0000 7feeeeef9640 1 -- 172.21.15.80:0/4154306980 wait complete. 2024-04-25T11:24:17.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:24:17.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:24:17.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 -- 172.21.15.80:0/3934679966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8108920 msgr2=0x7ff4a810ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 --2- 172.21.15.80:0/3934679966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8108920 0x7ff4a810ad40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009ca0 tx=0x7ff4a002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 -- 172.21.15.80:0/3934679966 shutdown_connections 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 --2- 172.21.15.80:0/3934679966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8108920 0x7ff4a810ad40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 --2- 172.21.15.80:0/3934679966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4a8103c20 0x7ff4a8104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 --2- 172.21.15.80:0/3934679966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4a81029e0 0x7ff4a81036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 -- 172.21.15.80:0/3934679966 >> 172.21.15.80:0/3934679966 conn(0x7ff4a80fdbd0 msgr2=0x7ff4a8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 -- 172.21.15.80:0/3934679966 shutdown_connections 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.567+0000 7ff4afd96640 1 -- 172.21.15.80:0/3934679966 wait complete. 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 Processor -- start 2024-04-25T11:24:17.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 -- start start 2024-04-25T11:24:17.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4a81029e0 0x7ff4a81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8103c20 0x7ff4a8199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4a8108920 0x7ff4a81a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a810e4f0 con 0x7ff4a8103c20 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a810e370 con 0x7ff4a81029e0 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.568+0000 7ff4afd96640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a810e670 con 0x7ff4a8108920 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8103c20 0x7ff4a8199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8103c20 0x7ff4a8199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57592/0 (socket says 172.21.15.80:57592) 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 -- 172.21.15.80:0/760396536 learned_addr learned my addr 172.21.15.80:0/760396536 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4adb32640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4a81029e0 0x7ff4a81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ae333640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4a8108920 0x7ff4a81a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 -- 172.21.15.80:0/760396536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4a8108920 msgr2=0x7ff4a81a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4a8108920 0x7ff4a81a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 -- 172.21.15.80:0/760396536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4a81029e0 msgr2=0x7ff4a81993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4a81029e0 0x7ff4a81993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 -- 172.21.15.80:0/760396536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a81a0f30 con 0x7ff4a8103c20 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4adb32640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4a81029e0 0x7ff4a81993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4ad331640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8103c20 0x7ff4a8199930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff49800eb00 tx=0x7ff498009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff49effd640 1 -- 172.21.15.80:0/760396536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49801c070 con 0x7ff4a8103c20 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a8069ef0 con 0x7ff4a8103c20 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff49effd640 1 -- 172.21.15.80:0/760396536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff49800bc30 con 0x7ff4a8103c20 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff49effd640 1 -- 172.21.15.80:0/760396536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498016610 con 0x7ff4a8103c20 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.569+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a806a440 con 0x7ff4a8103c20 2024-04-25T11:24:17.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.570+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a806afe0 con 0x7ff4a8103c20 2024-04-25T11:24:17.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.573+0000 7ff49effd640 1 -- 172.21.15.80:0/760396536 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 147640+0+0 (secure 0 0 0) 0x7ff49801f070 con 0x7ff4a8103c20 2024-04-25T11:24:17.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.573+0000 7ff49effd640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4940afc60 0x7ff4940b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.574+0000 7ff4adb32640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4940afc60 0x7ff4940b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.574+0000 7ff49effd640 1 -- 172.21.15.80:0/760396536 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7ff4980e0860 con 0x7ff4a8103c20 2024-04-25T11:24:17.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.574+0000 7ff4adb32640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4940afc60 0x7ff4940b2170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4a81035e0 tx=0x7ff4a4005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:17.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.576+0000 7ff49effd640 1 -- 172.21.15.80:0/760396536 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff49800bde0 con 0x7ff4a8103c20 2024-04-25T11:24:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.765+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff4a8107440 con 0x7ff4a8103c20 2024-04-25T11:24:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.765+0000 7ff49effd640 1 -- 172.21.15.80:0/760396536 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7ff4980b1190 con 0x7ff4a8103c20 2024-04-25T11:24:17.758 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:24:17.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4940afc60 msgr2=0x7ff4940b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4940afc60 0x7ff4940b2170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4a81035e0 tx=0x7ff4a4005f90 comp rx=0 tx=0).stop 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8103c20 msgr2=0x7ff4a8199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8103c20 0x7ff4a8199930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff49800eb00 tx=0x7ff498009f20 comp rx=0 tx=0).stop 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 shutdown_connections 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4940afc60 0x7ff4940b2170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4a8103c20 0x7ff4a8199930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4a8108920 0x7ff4a81a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 --2- 172.21.15.80:0/760396536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4a81029e0 0x7ff4a81993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 >> 172.21.15.80:0/760396536 conn(0x7ff4a80fdbd0 msgr2=0x7ff4a8104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 shutdown_connections 2024-04-25T11:24:17.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.767+0000 7ff4afd96640 1 -- 172.21.15.80:0/760396536 wait complete. 2024-04-25T11:24:17.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:24:17.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.892+0000 7fe032692640 1 -- 172.21.15.80:0/1920090334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c1045e0 msgr2=0x7fe02c106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.892+0000 7fe032692640 1 --2- 172.21.15.80:0/1920090334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c1045e0 0x7fe02c106a00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009900 tx=0x7fe01c02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 -- 172.21.15.80:0/1920090334 shutdown_connections 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 --2- 172.21.15.80:0/1920090334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1098a0 0x7fe02c10bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 --2- 172.21.15.80:0/1920090334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c106f40 0x7fe02c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 --2- 172.21.15.80:0/1920090334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c1045e0 0x7fe02c106a00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 -- 172.21.15.80:0/1920090334 >> 172.21.15.80:0/1920090334 conn(0x7fe02c0fdbc0 msgr2=0x7fe02c100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 -- 172.21.15.80:0/1920090334 shutdown_connections 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 -- 172.21.15.80:0/1920090334 wait complete. 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 Processor -- start 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.893+0000 7fe032692640 1 -- start start 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe032692640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1045e0 0x7fe02c19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe032692640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c106f40 0x7fe02c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe032692640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c1098a0 0x7fe02c1a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe032692640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10f5f0 con 0x7fe02c106f40 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe032692640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10f470 con 0x7fe02c1045e0 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe032692640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10f770 con 0x7fe02c1098a0 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c106f40 0x7fe02c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c106f40 0x7fe02c19a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57610/0 (socket says 172.21.15.80:57610) 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 -- 172.21.15.80:0/378819794 learned_addr learned my addr 172.21.15.80:0/378819794 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02bfff640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1045e0 0x7fe02c19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe030c2f640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c1098a0 0x7fe02c1a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 -- 172.21.15.80:0/378819794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c1098a0 msgr2=0x7fe02c1a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c1098a0 0x7fe02c1a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 -- 172.21.15.80:0/378819794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1045e0 msgr2=0x7fe02c19a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1045e0 0x7fe02c19a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 -- 172.21.15.80:0/378819794 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c1a1da0 con 0x7fe02c106f40 2024-04-25T11:24:17.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02bfff640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1045e0 0x7fe02c19a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:17.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.894+0000 7fe02b7fe640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c106f40 0x7fe02c19a7a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe02000e9f0 tx=0x7fe02000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:17.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.897+0000 7fe0297fa640 1 -- 172.21.15.80:0/378819794 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02000cd80 con 0x7fe02c106f40 2024-04-25T11:24:17.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.897+0000 7fe0297fa640 1 -- 172.21.15.80:0/378819794 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0200054d0 con 0x7fe02c106f40 2024-04-25T11:24:17.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.897+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c1a2090 con 0x7fe02c106f40 2024-04-25T11:24:17.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.897+0000 7fe0297fa640 1 -- 172.21.15.80:0/378819794 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020010690 con 0x7fe02c106f40 2024-04-25T11:24:17.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.897+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c1a2590 con 0x7fe02c106f40 2024-04-25T11:24:17.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.899+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c0ff6e0 con 0x7fe02c106f40 2024-04-25T11:24:17.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.900+0000 7fe0297fa640 1 -- 172.21.15.80:0/378819794 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 147640+0+0 (secure 0 0 0) 0x7fe020010830 con 0x7fe02c106f40 2024-04-25T11:24:17.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.900+0000 7fe0297fa640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe0140afc60 0x7fe0140b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:17.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.900+0000 7fe02bfff640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe0140afc60 0x7fe0140b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:17.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.900+0000 7fe0297fa640 1 -- 172.21.15.80:0/378819794 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fe0200df460 con 0x7fe02c106f40 2024-04-25T11:24:17.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.901+0000 7fe02bfff640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe0140afc60 0x7fe0140b2170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009230 tx=0x7fe01c031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:17.905+0000 7fe0297fa640 1 -- 172.21.15.80:0/378819794 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe0200a7d10 con 0x7fe02c106f40 2024-04-25T11:24:18.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.097+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe02c0637a0 con 0x7fe02c106f40 2024-04-25T11:24:18.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.098+0000 7fe0297fa640 1 -- 172.21.15.80:0/378819794 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7fe0200a7610 con 0x7fe02c106f40 2024-04-25T11:24:18.091 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:24:18.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe0140afc60 msgr2=0x7fe0140b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe0140afc60 0x7fe0140b2170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009230 tx=0x7fe01c031400 comp rx=0 tx=0).stop 2024-04-25T11:24:18.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c106f40 msgr2=0x7fe02c19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c106f40 0x7fe02c19a7a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe02000e9f0 tx=0x7fe02000edf0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 shutdown_connections 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe0140afc60 0x7fe0140b2170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02c106f40 0x7fe02c19a7a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c1098a0 0x7fe02c1a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 --2- 172.21.15.80:0/378819794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1045e0 0x7fe02c19a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 >> 172.21.15.80:0/378819794 conn(0x7fe02c0fdbc0 msgr2=0x7fe02c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 shutdown_connections 2024-04-25T11:24:18.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.100+0000 7fe032692640 1 -- 172.21.15.80:0/378819794 wait complete. 2024-04-25T11:24:18.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.107 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4154306980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:18.108 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:17 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/760396536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:18.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4154306980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:18.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:17 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/760396536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:18.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.231+0000 7f4d5d900640 1 -- 172.21.15.80:0/1330516796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d58108920 msgr2=0x7f4d5810ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.231+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1330516796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d58108920 0x7f4d5810ad40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009ca0 tx=0x7f4d5002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.231+0000 7f4d5d900640 1 -- 172.21.15.80:0/1330516796 shutdown_connections 2024-04-25T11:24:18.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.231+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1330516796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d58108920 0x7f4d5810ad40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.231+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1330516796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d58103c20 0x7f4d58104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.231+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1330516796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d581029e0 0x7f4d581036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.231+0000 7f4d5d900640 1 -- 172.21.15.80:0/1330516796 >> 172.21.15.80:0/1330516796 conn(0x7f4d580fdbd0 msgr2=0x7f4d58100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 -- 172.21.15.80:0/1330516796 shutdown_connections 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 -- 172.21.15.80:0/1330516796 wait complete. 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 Processor -- start 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 -- start start 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d581029e0 0x7f4d5806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d58103c20 0x7f4d5819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d58108920 0x7f4d581a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5810e4f0 con 0x7f4d581029e0 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5810e370 con 0x7f4d58108920 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d5d900640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5810e670 con 0x7f4d58103c20 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d56ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d581029e0 0x7f4d5806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.232+0000 7f4d56ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d581029e0 0x7f4d5806a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57620/0 (socket says 172.21.15.80:57620) 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d56ffd640 1 -- 172.21.15.80:0/1083650558 learned_addr learned my addr 172.21.15.80:0/1083650558 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:18.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d577fe640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d58108920 0x7f4d581a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d4ffff640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d58103c20 0x7f4d5819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d56ffd640 1 -- 172.21.15.80:0/1083650558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d58103c20 msgr2=0x7f4d5819f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d56ffd640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d58103c20 0x7f4d5819f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d56ffd640 1 -- 172.21.15.80:0/1083650558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d58108920 msgr2=0x7f4d581a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d56ffd640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d58108920 0x7f4d581a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d56ffd640 1 -- 172.21.15.80:0/1083650558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d581a1fe0 con 0x7f4d581029e0 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d577fe640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d58108920 0x7f4d581a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:18.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.233+0000 7f4d56ffd640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d581029e0 0x7f4d5806a900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c970 tx=0x7f4d4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.235+0000 7f4d5c8fe640 1 -- 172.21.15.80:0/1083650558 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48004220 con 0x7f4d581029e0 2024-04-25T11:24:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.235+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d581a22d0 con 0x7f4d581029e0 2024-04-25T11:24:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.235+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d581a2870 con 0x7f4d581029e0 2024-04-25T11:24:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.236+0000 7f4d5c8fe640 1 -- 172.21.15.80:0/1083650558 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d480043c0 con 0x7f4d581029e0 2024-04-25T11:24:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.236+0000 7f4d5c8fe640 1 -- 172.21.15.80:0/1083650558 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4801d060 con 0x7f4d581029e0 2024-04-25T11:24:18.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.237+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d380052c0 con 0x7f4d581029e0 2024-04-25T11:24:18.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.238+0000 7f4d5c8fe640 1 -- 172.21.15.80:0/1083650558 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 147640+0+0 (secure 0 0 0) 0x7f4d480079b0 con 0x7f4d581029e0 2024-04-25T11:24:18.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.239+0000 7f4d5c8fe640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4d440afc60 0x7f4d440b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.239+0000 7f4d5c8fe640 1 -- 172.21.15.80:0/1083650558 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f4d480ded80 con 0x7f4d581029e0 2024-04-25T11:24:18.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.239+0000 7f4d4ffff640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4d440afc60 0x7f4d440b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.239+0000 7f4d4ffff640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4d440afc60 0x7f4d440b2170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4d5806a2a0 tx=0x7f4d4000b390 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:18.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.243+0000 7f4d5c8fe640 1 -- 172.21.15.80:0/1083650558 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4d48014030 con 0x7f4d581029e0 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:18.244 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4154306980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:18.245 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:17 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/760396536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:24:18.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.436+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4d38005880 con 0x7f4d581029e0 2024-04-25T11:24:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.437+0000 7f4d5c8fe640 1 -- 172.21.15.80:0/1083650558 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7f4d480a6fe0 con 0x7f4d581029e0 2024-04-25T11:24:18.430 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:24:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4d440afc60 msgr2=0x7f4d440b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4d440afc60 0x7f4d440b2170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4d5806a2a0 tx=0x7f4d4000b390 comp rx=0 tx=0).stop 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d581029e0 msgr2=0x7f4d5806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d581029e0 0x7f4d5806a900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c970 tx=0x7f4d4800ce30 comp rx=0 tx=0).stop 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 shutdown_connections 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4d440afc60 0x7f4d440b2170 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d58108920 0x7f4d581a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d58103c20 0x7f4d5819f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 --2- 172.21.15.80:0/1083650558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d581029e0 0x7f4d5806a900 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 >> 172.21.15.80:0/1083650558 conn(0x7f4d580fdbd0 msgr2=0x7f4d58104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 shutdown_connections 2024-04-25T11:24:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.439+0000 7f4d5d900640 1 -- 172.21.15.80:0/1083650558 wait complete. 2024-04-25T11:24:18.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.565+0000 7fb88ea30640 1 -- 172.21.15.80:0/1639421534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888103420 msgr2=0x7fb888103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.565+0000 7fb88ea30640 1 --2- 172.21.15.80:0/1639421534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888103420 0x7fb888103830 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00aa10 tx=0x7fb87c02b720 comp rx=0 tx=0).stop 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 -- 172.21.15.80:0/1639421534 shutdown_connections 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 --2- 172.21.15.80:0/1639421534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888103420 0x7fb888103830 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 --2- 172.21.15.80:0/1639421534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb888108120 0x7fb88810a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 --2- 172.21.15.80:0/1639421534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8881021e0 0x7fb888102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 -- 172.21.15.80:0/1639421534 >> 172.21.15.80:0/1639421534 conn(0x7fb8880fd3b0 msgr2=0x7fb8880ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 -- 172.21.15.80:0/1639421534 shutdown_connections 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 -- 172.21.15.80:0/1639421534 wait complete. 2024-04-25T11:24:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 Processor -- start 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.566+0000 7fb88ea30640 1 -- start start 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88ea30640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8881021e0 0x7fb888198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88ea30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb888103420 0x7fb888198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88ea30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888108120 0x7fb88819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88ea30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb88810d410 con 0x7fb888108120 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88ea30640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb88810d290 con 0x7fb888103420 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88ea30640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb88810d590 con 0x7fb8881021e0 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888108120 0x7fb88819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb887fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8881021e0 0x7fb888198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888108120 0x7fb88819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57632/0 (socket says 172.21.15.80:57632) 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 -- 172.21.15.80:0/4080938296 learned_addr learned my addr 172.21.15.80:0/4080938296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb8877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb888103420 0x7fb888198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 -- 172.21.15.80:0/4080938296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8881021e0 msgr2=0x7fb888198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8881021e0 0x7fb888198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 -- 172.21.15.80:0/4080938296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb888103420 msgr2=0x7fb888198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb888103420 0x7fb888198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 -- 172.21.15.80:0/4080938296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88819faf0 con 0x7fb888108120 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb88cfcd640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888108120 0x7fb88819f480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb88000eb10 tx=0x7fb88000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.567+0000 7fb8857fa640 1 -- 172.21.15.80:0/4080938296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880004b20 con 0x7fb888108120 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.568+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88819fde0 con 0x7fb888108120 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.568+0000 7fb8857fa640 1 -- 172.21.15.80:0/4080938296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb880004cc0 con 0x7fb888108120 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.568+0000 7fb8857fa640 1 -- 172.21.15.80:0/4080938296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880010670 con 0x7fb888108120 2024-04-25T11:24:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.568+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8881a01f0 con 0x7fb888108120 2024-04-25T11:24:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.569+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88806a1c0 con 0x7fb888108120 2024-04-25T11:24:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.570+0000 7fb8857fa640 1 -- 172.21.15.80:0/4080938296 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 147640+0+0 (secure 0 0 0) 0x7fb880005000 con 0x7fb888108120 2024-04-25T11:24:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.571+0000 7fb8857fa640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb8700afc60 0x7fb8700b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.571+0000 7fb8857fa640 1 -- 172.21.15.80:0/4080938296 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fb8800df7b0 con 0x7fb888108120 2024-04-25T11:24:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.571+0000 7fb887fff640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb8700afc60 0x7fb8700b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.571+0000 7fb887fff640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb8700afc60 0x7fb8700b2170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb888102de0 tx=0x7fb878005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.574+0000 7fb8857fa640 1 -- 172.21.15.80:0/4080938296 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb880053ff0 con 0x7fb888108120 2024-04-25T11:24:18.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.804+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb88802dc10 con 0x7fb888108120 2024-04-25T11:24:18.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.805+0000 7fb8857fa640 1 -- 172.21.15.80:0/4080938296 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7fb88806a1c0 con 0x7fb888108120 2024-04-25T11:24:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:18.798 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:24:12.817395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24521,24476,24499]},"id":1}]} 2024-04-25T11:24:18.798 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T11:24:18.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb8700afc60 msgr2=0x7fb8700b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb8700afc60 0x7fb8700b2170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb888102de0 tx=0x7fb878005f90 comp rx=0 tx=0).stop 2024-04-25T11:24:18.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888108120 msgr2=0x7fb88819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888108120 0x7fb88819f480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb88000eb10 tx=0x7fb88000c2d0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 shutdown_connections 2024-04-25T11:24:18.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb8700afc60 0x7fb8700b2170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb888108120 0x7fb88819f480 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb888103420 0x7fb888198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 --2- 172.21.15.80:0/4080938296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8881021e0 0x7fb888198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 >> 172.21.15.80:0/4080938296 conn(0x7fb8880fd3b0 msgr2=0x7fb888104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:18.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 shutdown_connections 2024-04-25T11:24:18.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.807+0000 7fb88ea30640 1 -- 172.21.15.80:0/4080938296 wait complete. 2024-04-25T11:24:18.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:24:18.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 -- 172.21.15.80:0/2430757996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 msgr2=0x7f4fdc104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 --2- 172.21.15.80:0/2430757996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc104010 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009900 tx=0x7f4fd002a410 comp rx=0 tx=0).stop 2024-04-25T11:24:18.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 -- 172.21.15.80:0/2430757996 shutdown_connections 2024-04-25T11:24:18.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 --2- 172.21.15.80:0/2430757996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc104010 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 --2- 172.21.15.80:0/2430757996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fdc108900 0x7f4fdc10ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 --2- 172.21.15.80:0/2430757996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc1029c0 0x7f4fdc1036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 -- 172.21.15.80:0/2430757996 >> 172.21.15.80:0/2430757996 conn(0x7f4fdc0fdbd0 msgr2=0x7f4fdc100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 -- 172.21.15.80:0/2430757996 shutdown_connections 2024-04-25T11:24:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 -- 172.21.15.80:0/2430757996 wait complete. 2024-04-25T11:24:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 Processor -- start 2024-04-25T11:24:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.930+0000 7f4fe231f640 1 -- start start 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fe231f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc1029c0 0x7f4fdc06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fe231f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fe231f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fdc108900 0x7f4fdc1a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fe231f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10e4f0 con 0x7f4fdc103c00 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fe231f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10e370 con 0x7f4fdc1029c0 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fe231f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10e670 con 0x7f4fdc108900 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57642/0 (socket says 172.21.15.80:57642) 2024-04-25T11:24:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc1029c0 0x7f4fdc06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/1325190739 learned_addr learned my addr 172.21.15.80:0/1325190739 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fe08bc640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fdc108900 0x7f4fdc1a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdbfff640 1 -- 172.21.15.80:0/1325190739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fdc108900 msgr2=0x7f4fdc1a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdbfff640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fdc108900 0x7f4fdc1a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdbfff640 1 -- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 msgr2=0x7f4fdc19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdbfff640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdbfff640 1 -- 172.21.15.80:0/1325190739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc1a1cf0 con 0x7f4fdc1029c0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.931+0000 7f4fdbfff640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc1029c0 0x7f4fdc06a920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc102290 tx=0x7f4fcc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.932+0000 7f4fd97fa640 1 -- 172.21.15.80:0/1325190739 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00cc40 con 0x7f4fdc1029c0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.932+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc1a1fe0 con 0x7f4fdc1029c0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.932+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc1a24a0 con 0x7f4fdc1029c0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.932+0000 7f4fd97fa640 1 -- 172.21.15.80:0/1325190739 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fcc0044d0 con 0x7f4fdc1029c0 2024-04-25T11:24:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.932+0000 7f4fd97fa640 1 -- 172.21.15.80:0/1325190739 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc003e30 con 0x7f4fdc1029c0 2024-04-25T11:24:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.933+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc107710 con 0x7f4fdc1029c0 2024-04-25T11:24:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.934+0000 7f4fd97fa640 1 -- 172.21.15.80:0/1325190739 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 147640+0+0 (secure 0 0 0) 0x7f4fcc0035f0 con 0x7f4fdc1029c0 2024-04-25T11:24:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.935+0000 7f4fd97fa640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4fc40afc60 0x7f4fc40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.935+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4fc40afc60 0x7f4fc40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.935+0000 7f4fd97fa640 1 -- 172.21.15.80:0/1325190739 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f4fcc0df6c0 con 0x7f4fdc1029c0 2024-04-25T11:24:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.935+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4fc40afc60 0x7f4fc40b2170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0031440 tx=0x7f4fd00314a0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:18.938+0000 7f4fd97fa640 1 -- 172.21.15.80:0/1325190739 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4fcc0a8000 con 0x7f4fdc1029c0 2024-04-25T11:24:19.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.127+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fdc02dcd0 con 0x7f4fdc1029c0 2024-04-25T11:24:19.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.129+0000 7f4fd97fa640 1 -- 172.21.15.80:0/1325190739 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+23057 (secure 0 0 0) 0x7f4fcc0a7900 con 0x7f4fdc1029c0 2024-04-25T11:24:19.123 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:19.123 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":80,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:24:14.749798+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/4228038844":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1814218335":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/1536113811":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/4111395089":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4fc40afc60 msgr2=0x7f4fc40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4fc40afc60 0x7f4fc40b2170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0031440 tx=0x7f4fd00314a0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc1029c0 msgr2=0x7f4fdc06a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc1029c0 0x7f4fdc06a920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc102290 tx=0x7f4fcc00ee50 comp rx=0 tx=0).stop 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 shutdown_connections 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4fc40afc60 0x7f4fc40b2170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc103c00 0x7f4fdc19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fdc108900 0x7f4fdc1a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 --2- 172.21.15.80:0/1325190739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc1029c0 0x7f4fdc06a920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 >> 172.21.15.80:0/1325190739 conn(0x7f4fdc0fdbd0 msgr2=0x7f4fdc1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.131+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 shutdown_connections 2024-04-25T11:24:19.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.132+0000 7f4fe231f640 1 -- 172.21.15.80:0/1325190739 wait complete. 2024-04-25T11:24:19.137 DEBUG:tasks.fwd_scrub:Yielding 2024-04-25T11:24:19.137 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T11:24:19.146 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T11:24:19.146 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:24:19.147 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-04-25T11:24:19.147 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-04-25T11:24:19.147 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:24:19.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:19.147 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:24:19.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.275+0000 7f0e01981640 1 -- 172.21.15.80:0/1665130369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df4097b60 msgr2=0x7f0df4097f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.275+0000 7f0e01981640 1 --2- 172.21.15.80:0/1665130369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df4097b60 0x7f0df4097f70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009900 tx=0x7f0df002a480 comp rx=0 tx=0).stop 2024-04-25T11:24:19.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.275+0000 7f0e01981640 1 -- 172.21.15.80:0/1665130369 shutdown_connections 2024-04-25T11:24:19.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.275+0000 7f0e01981640 1 --2- 172.21.15.80:0/1665130369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df40a0f70 0x7f0df40a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.275+0000 7f0e01981640 1 --2- 172.21.15.80:0/1665130369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df409e5c0 0x7f0df40a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.275+0000 7f0e01981640 1 --2- 172.21.15.80:0/1665130369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df4097b60 0x7f0df4097f70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.276+0000 7f0e01981640 1 -- 172.21.15.80:0/1665130369 >> 172.21.15.80:0/1665130369 conn(0x7f0df400b000 msgr2=0x7f0df400b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.276+0000 7f0e01981640 1 -- 172.21.15.80:0/1665130369 shutdown_connections 2024-04-25T11:24:19.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.276+0000 7f0e01981640 1 -- 172.21.15.80:0/1665130369 wait complete. 2024-04-25T11:24:19.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.276+0000 7f0e01981640 1 Processor -- start 2024-04-25T11:24:19.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.276+0000 7f0e01981640 1 -- start start 2024-04-25T11:24:19.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01981640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df4097b60 0x7f0df412d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01981640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df409e5c0 0x7f0df412dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01981640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40a0f70 0x7f0df4131e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01981640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40a6bd0 con 0x7f0df40a0f70 2024-04-25T11:24:19.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01981640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40a6a50 con 0x7f0df4097b60 2024-04-25T11:24:19.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01981640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40a6d50 con 0x7f0df409e5c0 2024-04-25T11:24:19.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e0097f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df4097b60 0x7f0df412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e0097f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df4097b60 0x7f0df412d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:47392/0 (socket says 172.21.15.80:47392) 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e0097f640 1 -- 172.21.15.80:0/3502330512 learned_addr learned my addr 172.21.15.80:0/3502330512 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01180640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40a0f70 0x7f0df4131e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0dfbfff640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df409e5c0 0x7f0df412dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01180640 1 -- 172.21.15.80:0/3502330512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df409e5c0 msgr2=0x7f0df412dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01180640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df409e5c0 0x7f0df412dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01180640 1 -- 172.21.15.80:0/3502330512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df4097b60 msgr2=0x7f0df412d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01180640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df4097b60 0x7f0df412d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e01180640 1 -- 172.21.15.80:0/3502330512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df41324b0 con 0x7f0df40a0f70 2024-04-25T11:24:19.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7fc9d0989640 1 -- 172.21.15.80:0/3784272046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 msgr2=0x7fc9cc101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3784272046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc101a10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009900 tx=0x7fc9bc02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:19.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7f0e0097f640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df4097b60 0x7f0df412d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:19.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7fc9d0989640 1 -- 172.21.15.80:0/3784272046 shutdown_connections 2024-04-25T11:24:19.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3784272046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9cc102600 0x7fc9cc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3784272046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9cc109de0 0x7fc9cc101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3784272046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc101a10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.277+0000 7fc9d0989640 1 -- 172.21.15.80:0/3784272046 >> 172.21.15.80:0/3784272046 conn(0x7fc9cc0fd800 msgr2=0x7fc9cc0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7fc9d0989640 1 -- 172.21.15.80:0/3784272046 shutdown_connections 2024-04-25T11:24:19.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7fc9d0989640 1 -- 172.21.15.80:0/3784272046 wait complete. 2024-04-25T11:24:19.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7f0e01180640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40a0f70 0x7f0df4131e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc069050 tx=0x7f0dfc07a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7f0df9ffb640 1 -- 172.21.15.80:0/3502330512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc06c170 con 0x7f0df40a0f70 2024-04-25T11:24:19.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7f0df9ffb640 1 -- 172.21.15.80:0/3502330512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc06c310 con 0x7f0df40a0f70 2024-04-25T11:24:19.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df41327a0 con 0x7f0df40a0f70 2024-04-25T11:24:19.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7f0df9ffb640 1 -- 172.21.15.80:0/3502330512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc088900 con 0x7f0df40a0f70 2024-04-25T11:24:19.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df4132c70 con 0x7f0df40a0f70 2024-04-25T11:24:19.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.278+0000 7fc9d0989640 1 Processor -- start 2024-04-25T11:24:19.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9d0989640 1 -- start start 2024-04-25T11:24:19.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9d0989640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc102bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9d0989640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9cc109de0 0x7fc9cc103130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9d0989640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9cc103670 0x7fc9cc1a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9d0989640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc113b30 con 0x7fc9cc109940 2024-04-25T11:24:19.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9d0989640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1139b0 con 0x7fc9cc103670 2024-04-25T11:24:19.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9d0989640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc113cb0 con 0x7fc9cc109de0 2024-04-25T11:24:19.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc102bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc102bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57690/0 (socket says 172.21.15.80:57690) 2024-04-25T11:24:19.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/3938800059 learned_addr learned my addr 172.21.15.80:0/3938800059 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9caffd640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9cc109de0 0x7fc9cc103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.279+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9cc103670 0x7fc9cc1a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df40048d0 con 0x7f0df40a0f70 2024-04-25T11:24:19.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9caffd640 1 -- 172.21.15.80:0/3938800059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9cc103670 msgr2=0x7fc9cc1a8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9caffd640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9cc103670 0x7fc9cc1a8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9caffd640 1 -- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 msgr2=0x7fc9cc102bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9caffd640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc102bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9caffd640 1 -- 172.21.15.80:0/3938800059 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc1a8900 con 0x7fc9cc109de0 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9caffd640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9cc109de0 0x7fc9cc103130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0755a0 tx=0x7fc9c000ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9c8ff9640 1 -- 172.21.15.80:0/3938800059 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0009e60 con 0x7fc9cc109de0 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc1a8bf0 con 0x7fc9cc109de0 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9c8ff9640 1 -- 172.21.15.80:0/3938800059 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c000ccc0 con 0x7fc9cc109de0 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9c8ff9640 1 -- 172.21.15.80:0/3938800059 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00187a0 con 0x7fc9cc109de0 2024-04-25T11:24:19.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.280+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc1a9140 con 0x7fc9cc109de0 2024-04-25T11:24:19.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.282+0000 7f0df9ffb640 1 -- 172.21.15.80:0/3502330512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f0dfc087030 con 0x7f0df40a0f70 2024-04-25T11:24:19.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.283+0000 7f0df9ffb640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0dec0afd70 0x7f0dec0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.283+0000 7f0e0097f640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0dec0afd70 0x7f0dec0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7f0df9ffb640 1 -- 172.21.15.80:0/3502330512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f0dfc14fd40 con 0x7f0df40a0f70 2024-04-25T11:24:19.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9c8ff9640 1 -- 172.21.15.80:0/3938800059 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fc9c0010430 con 0x7fc9cc109de0 2024-04-25T11:24:19.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 Processor -- start 2024-04-25T11:24:19.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 -- start start 2024-04-25T11:24:19.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a6c410 0x55aab7e0c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7f0e0097f640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0dec0afd70 0x7f0dec0b2280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0df0031440 tx=0x7f0df00058d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a43550 0x55aab7e0cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a4b730 0x55aab7e0d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aab7d72b00 con 0x55aab7a6c410 2024-04-25T11:24:19.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aab7d0e920 con 0x55aab7a43550 2024-04-25T11:24:19.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aab7d6eac0 con 0x55aab7a4b730 2024-04-25T11:24:19.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a6c410 0x55aab7e0c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a43550 0x55aab7e0cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a6c410 0x55aab7e0c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57694/0 (socket says 172.21.15.80:57694) 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a43550 0x55aab7e0cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:47412/0 (socket says 172.21.15.80:47412) 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9cbfff640 1 -- 172.21.15.80:0/2069197892 learned_addr learned my addr 172.21.15.80:0/2069197892 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.284+0000 7fc9caffd640 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a4b730 0x55aab7e0d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/2069197892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a4b730 msgr2=0x55aab7e0d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a4b730 0x55aab7e0d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/2069197892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a6c410 msgr2=0x55aab7e0c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a6c410 0x55aab7e0c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/2069197892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aab7b4c7e0 con 0x55aab7a43550 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a6c410 0x55aab7e0c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9c8ff9640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc9b40afd60 0x7fc9b40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a43550 0x55aab7e0cd20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc006010 tx=0x7fc9bc031480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ca1a3fe3da5648f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc9b40afd60 0x7fc9b40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9c8ff9640 1 -- 172.21.15.80:0/3938800059 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fc9c00df380 con 0x7fc9cc109de0 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9b1ffb640 1 -- 172.21.15.80:0/2069197892 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc035020 con 0x55aab7a43550 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9b1ffb640 1 -- 172.21.15.80:0/2069197892 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc041070 con 0x55aab7a43550 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.285+0000 7fc9b1ffb640 1 -- 172.21.15.80:0/2069197892 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0316d0 con 0x55aab7a43550 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2069197892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a43550 msgr2=0x55aab7e0cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a43550 0x55aab7e0cd20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc006010 tx=0x7fc9bc031480 comp rx=0 tx=0).stop 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc9b40afd60 0x7fc9b40b2270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x55aab7e09950 tx=0x7fc9c4009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2069197892 shutdown_connections 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a4b730 0x55aab7e0d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a43550 0x55aab7e0cd20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2069197892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a6c410 0x55aab7e0c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.286+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2069197892 >> 172.21.15.80:0/2069197892 conn(0x55aab7a60560 msgr2=0x55aab7e08f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2069197892 shutdown_connections 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2069197892 wait complete. 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 -- start start 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 Processor -- start 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a43550 0x55aab7e16e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e17370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e1cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aab7e19ad0 con 0x55aab7a43550 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aab7d0c5d0 con 0x55aab7a4b730 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.287+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aab7e19c50 con 0x55aab7a6c410 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9d8b70740 10 client.0 _ll_register_callbacks cb 0x55aab7cfa080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a43550 0x55aab7e16e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a43550 0x55aab7e16e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57696/0 (socket says 172.21.15.80:57696) 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/2945598957 learned_addr learned my addr 172.21.15.80:0/2945598957 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9caffd640 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e17370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/2945598957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 msgr2=0x55aab7e1cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e1cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 msgr2=0x55aab7e17370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e17370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/2945598957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aab7bacf70 con 0x55aab7a43550 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a43550 0x55aab7e16e30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc000c00 tx=0x7fc9bc0049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db4b1bc6d3132f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7f0df9ffb640 1 -- 172.21.15.80:0/3502330512 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0dfc117dd0 con 0x7f0df40a0f70 2024-04-25T11:24:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.288+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2945598957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc035040 con 0x55aab7a43550 2024-04-25T11:24:19.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9bc041070 con 0x55aab7a43550 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2945598957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fc9bc004040 con 0x55aab7a43550 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2945598957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc9bc004240 con 0x55aab7a43550 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 10 client.15495 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55aab7a44170 con 0x55aab7a43550 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2945598957 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc041070 con 0x55aab7a43550 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2945598957 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc9bc03a040 con 0x55aab7a43550 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 10 client.15495 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 10 client.15495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 20 client.15495 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7a2b1f0 0x55aab7e29010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 4 client.15495 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.289+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aab7d80710 con 0x55aab7a2b1f0 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.290+0000 7fc9caffd640 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7a2b1f0 0x55aab7e29010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.291+0000 7fc9caffd640 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7a2b1f0 0x55aab7e29010 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d3f5234fb9113 server_cookie=e95b5c2c3496ea38 in_seq=0 out_seq=0 2024-04-25T11:24:19.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.291+0000 7fc9aaffd640 10 client.15495 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.291+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2945598957 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aab7d80710 con 0x55aab7a2b1f0 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.291+0000 7fc9aaffd640 10 client.15495 handle_command_reply: tid=0 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.291+0000 7fc9d8b70740 1 client.15495 shutdown 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a43550 msgr2=0x55aab7e16e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a43550 0x55aab7e16e30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc000c00 tx=0x7fc9bc0049b0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 shutdown_connections 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7a2b1f0 0x55aab7e29010 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e1cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e17370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2945598957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a43550 0x55aab7e16e30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 >> 172.21.15.80:0/2945598957 conn(0x55aab7a60560 msgr2=0x55aab7e0e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9aaffd640 0 client.15495 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 shutdown_connections 2024-04-25T11:24:19.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2945598957 wait complete. 2024-04-25T11:24:19.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.292+0000 7fc9d8b70740 20 client.15495 trim_cache size 0 max 16384 2024-04-25T11:24:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 Processor -- start 2024-04-25T11:24:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 -- start start 2024-04-25T11:24:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a4b730 0x55aab7e10a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e15df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a00630 0x55aab7e0cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1b42b0 con 0x55aab7a4b730 2024-04-25T11:24:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1b1b80 con 0x55aab7a00630 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1af9d0 con 0x55aab7a6c410 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a4b730 0x55aab7e10a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a4b730 0x55aab7e10a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57702/0 (socket says 172.21.15.80:57702) 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/1111075109 learned_addr learned my addr 172.21.15.80:0/1111075109 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a00630 0x55aab7e0cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.311+0000 7fc9caffd640 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e15df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/1111075109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 msgr2=0x55aab7e15df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e15df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/1111075109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a00630 msgr2=0x55aab7e0cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a00630 0x55aab7e0cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9cb7fe640 1 -- 172.21.15.80:0/1111075109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aab7e046f0 con 0x55aab7a4b730 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a4b730 0x55aab7e10a40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc003690 tx=0x7fc9bc005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de0f7b581cb4454 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9b17fa640 1 -- 172.21.15.80:0/1111075109 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc035040 con 0x55aab7a4b730 2024-04-25T11:24:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9b17fa640 1 -- 172.21.15.80:0/1111075109 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc041070 con 0x55aab7a4b730 2024-04-25T11:24:19.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.312+0000 7fc9b17fa640 1 -- 172.21.15.80:0/1111075109 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc003950 con 0x55aab7a4b730 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 -- 172.21.15.80:0/1111075109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a4b730 msgr2=0x55aab7e10a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a4b730 0x55aab7e10a40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc003690 tx=0x7fc9bc005d50 comp rx=0 tx=0).stop 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 -- 172.21.15.80:0/1111075109 shutdown_connections 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a00630 0x55aab7e0cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e15df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/1111075109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a4b730 0x55aab7e10a40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 -- 172.21.15.80:0/1111075109 >> 172.21.15.80:0/1111075109 conn(0x55aab7a60560 msgr2=0x55aab7e0c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 -- 172.21.15.80:0/1111075109 shutdown_connections 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.313+0000 7fc9d8b70740 1 -- 172.21.15.80:0/1111075109 wait complete. 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.314+0000 7fc9d8b70740 1 -- start start 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.314+0000 7fc9d8b70740 1 Processor -- start 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a00630 0x55aab7e20760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e20ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9d8b70740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e8f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1b0040 con 0x55aab7a00630 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1b14b0 con 0x55aab7a4b730 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9d8b70740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1b0710 con 0x55aab7a6c410 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9d8b70740 10 client.0 _ll_register_callbacks cb 0x7fc9bc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a00630 0x55aab7e20760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e8f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e8f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:32914/0 (socket says 172.21.15.80:32914) 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 -- 172.21.15.80:0/2497036963 learned_addr learned my addr 172.21.15.80:0/2497036963 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a00630 0x55aab7e20760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57714/0 (socket says 172.21.15.80:57714) 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9caffd640 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e20ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 -- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 msgr2=0x55aab7e20ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e20ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 -- 172.21.15.80:0/2497036963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a00630 msgr2=0x55aab7e20760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a00630 0x55aab7e20760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cbfff640 1 -- 172.21.15.80:0/2497036963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aab7e8f670 con 0x55aab7a6c410 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.315+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a00630 0x55aab7e20760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.316+0000 7fc9cbfff640 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e8f130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4003f50 tx=0x7fc9c400fd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d96ba7c8effed14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.316+0000 7fc9aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.318+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2497036963 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4004440 con 0x55aab7a6c410 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2497036963 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fc9c4018030 con 0x55aab7a6c410 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9bc041070 con 0x55aab7a6c410 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2497036963 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc9c40045e0 con 0x55aab7a6c410 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 10 client.25147 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55aab7e907f0 con 0x55aab7a6c410 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2497036963 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc041070 con 0x55aab7a6c410 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2497036963 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc9c401e420 con 0x55aab7a6c410 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 10 client.25147 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 10 client.25147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 20 client.25147 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7e91020 0x55aab7e93440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 4 client.25147 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:24:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.319+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aab7d7a580 con 0x55aab7e91020 2024-04-25T11:24:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.320+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7e91020 0x55aab7e93440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.320+0000 7fc9aaffd640 10 client.25147 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.320+0000 7fc9cb7fe640 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7e91020 0x55aab7e93440 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34942ba285297db4 server_cookie=d81848d1644baf35 in_seq=0 out_seq=0 2024-04-25T11:24:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9aaffd640 1 -- 172.21.15.80:0/2497036963 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aab7d7a580 con 0x55aab7e91020 2024-04-25T11:24:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9aaffd640 10 client.25147 handle_command_reply: tid=0 2024-04-25T11:24:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 client.25147 shutdown 2024-04-25T11:24:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 msgr2=0x55aab7e8f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e8f130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4003f50 tx=0x7fc9c400fd10 comp rx=0 tx=0).stop 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 shutdown_connections 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aab7e91020 0x55aab7e93440 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aab7a6c410 0x55aab7e8f130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aab7a4b730 0x55aab7e20ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9aaffd640 0 client.25147 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 --2- 172.21.15.80:0/2497036963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aab7a00630 0x55aab7e20760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.321+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 >> 172.21.15.80:0/2497036963 conn(0x55aab7a60560 msgr2=0x55aab7e15b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 shutdown_connections 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d8b70740 1 -- 172.21.15.80:0/2497036963 wait complete. 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d8b70740 20 client.25147 trim_cache size 0 max 16384 2024-04-25T11:24:19.316 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:19.317 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:24:19.317 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "72f16730-1ab3-4aa5-89b2-38418d7d3423", 2024-04-25T11:24:19.317 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:24:19.317 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc9b40afd60 msgr2=0x7fc9b40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc9b40afd60 0x7fc9b40b2270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x55aab7e09950 tx=0x7fc9c4009500 comp rx=0 tx=0).stop 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9cc109de0 msgr2=0x7fc9cc103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9cc109de0 0x7fc9cc103130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0755a0 tx=0x7fc9c000ed90 comp rx=0 tx=0).stop 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 shutdown_connections 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc9b40afd60 0x7fc9b40b2270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9cc103670 0x7fc9cc1a8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9cc109de0 0x7fc9cc103130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 --2- 172.21.15.80:0/3938800059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9cc109940 0x7fc9cc102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.322+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 >> 172.21.15.80:0/3938800059 conn(0x7fc9cc0fd800 msgr2=0x7fc9cc0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.323+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 shutdown_connections 2024-04-25T11:24:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.323+0000 7fc9d0989640 1 -- 172.21.15.80:0/3938800059 wait complete. 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/378819794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.327 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.328 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1083650558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.329 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.330 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4080938296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:19.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:24:19.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:24:19.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/378819794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-25T11:24:19.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:24:19.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1083650558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:19.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.443 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4080938296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 -- 172.21.15.80:0/3421409547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de4108a40 msgr2=0x7f5de41025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/3421409547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de4108a40 0x7f5de41025d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009900 tx=0x7f5dd402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 -- 172.21.15.80:0/3421409547 shutdown_connections 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/3421409547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5de410d3a0 0x7f5de410f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/3421409547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de4102b10 0x7f5de4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/3421409547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de4108a40 0x7f5de41025d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 -- 172.21.15.80:0/3421409547 >> 172.21.15.80:0/3421409547 conn(0x7f5de4078180 msgr2=0x7f5de40785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 -- 172.21.15.80:0/3421409547 shutdown_connections 2024-04-25T11:24:19.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.452+0000 7f5dea5a8640 1 -- 172.21.15.80:0/3421409547 wait complete. 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 Processor -- start 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 -- start start 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5de4102b10 0x7f5de41995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de4108a40 0x7f5de4199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de410d3a0 0x7f5de419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4112c00 con 0x7f5de410d3a0 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4112a80 con 0x7f5de4108a40 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5dea5a8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4112d80 con 0x7f5de4102b10 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.453+0000 7f5de8b45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de410d3a0 0x7f5de419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de8b45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de410d3a0 0x7f5de419de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57724/0 (socket says 172.21.15.80:57724) 2024-04-25T11:24:19.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de8b45640 1 -- 172.21.15.80:0/2361537081 learned_addr learned my addr 172.21.15.80:0/2361537081 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de37fe640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de4108a40 0x7f5de4199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de3fff640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5de4102b10 0x7f5de41995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de37fe640 1 -- 172.21.15.80:0/2361537081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5de4102b10 msgr2=0x7f5de41995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de37fe640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5de4102b10 0x7f5de41995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de37fe640 1 -- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de410d3a0 msgr2=0x7f5de419de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de37fe640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de410d3a0 0x7f5de419de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de37fe640 1 -- 172.21.15.80:0/2361537081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de419e440 con 0x7f5de4108a40 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de8b45640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de410d3a0 0x7f5de419de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de3fff640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5de4102b10 0x7f5de41995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de37fe640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de4108a40 0x7f5de4199b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5de4069de0 tx=0x7f5dd800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de17fa640 1 -- 172.21.15.80:0/2361537081 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800cc40 con 0x7f5de4108a40 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de419e730 con 0x7f5de4108a40 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de17fa640 1 -- 172.21.15.80:0/2361537081 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd800cde0 con 0x7f5de4108a40 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5de17fa640 1 -- 172.21.15.80:0/2361537081 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8010430 con 0x7f5de4108a40 2024-04-25T11:24:19.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.454+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de41a60b0 con 0x7f5de4108a40 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de17fa640 1 -- 172.21.15.80:0/2361537081 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f5dd80105d0 con 0x7f5de4108a40 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 Processor -- start 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 -- start start 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b6cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b6d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b6d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555c49ad0d80 con 0x555c497a96b0 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c49a8a8b0 con 0x555c497a14d0 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5df1459740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555c49accd40 con 0x555c497ca390 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b6d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b6d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de17fa640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5dcc0afcf0 0x7f5dcc0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b6d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:47468/0 (socket says 172.21.15.80:47468) 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de3fff640 1 -- 172.21.15.80:0/900723646 learned_addr learned my addr 172.21.15.80:0/900723646 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de8b45640 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b6cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.457+0000 7f5de8b45640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5dcc0afcf0 0x7f5dcc0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de3fff640 1 -- 172.21.15.80:0/900723646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 msgr2=0x555c49b6cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de17fa640 1 -- 172.21.15.80:0/2361537081 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f5dd80df5d0 con 0x7f5de4108a40 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de3fff640 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b6cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de3fff640 1 -- 172.21.15.80:0/900723646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 msgr2=0x555c49b6d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de3fff640 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b6d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de3fff640 1 -- 172.21.15.80:0/900723646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c49a5ba40 con 0x555c497a14d0 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de8b45640 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b6cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de3fff640 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b6d060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009900 tx=0x7f5dd40095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bcb61e23be2a824 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5de8b45640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5dcc0afcf0 0x7f5dcc0b2200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009aa0 tx=0x7f5ddc004ab0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5dca7fc640 1 -- 172.21.15.80:0/900723646 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4040070 con 0x555c497a14d0 2024-04-25T11:24:19.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5dca7fc640 1 -- 172.21.15.80:0/900723646 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd40316a0 con 0x555c497a14d0 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.458+0000 7f5dca7fc640 1 -- 172.21.15.80:0/900723646 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4035040 con 0x555c497a14d0 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 -- 172.21.15.80:0/900723646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 msgr2=0x555c49b6d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b6d060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009900 tx=0x7f5dd40095f0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 -- 172.21.15.80:0/900723646 shutdown_connections 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b6d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b6d060 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 --2- 172.21.15.80:0/900723646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b6cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 -- 172.21.15.80:0/900723646 >> 172.21.15.80:0/900723646 conn(0x555c497be4e0 msgr2=0x555c49b69420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 -- 172.21.15.80:0/900723646 shutdown_connections 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 -- 172.21.15.80:0/900723646 wait complete. 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.459+0000 7f5df1459740 1 -- start start 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 1 Processor -- start 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b79be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b85830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555c49b7c380 con 0x555c497a96b0 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c49a57d10 con 0x555c497a14d0 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555c49b7c500 con 0x555c497ca390 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5df1459740 10 client.0 _ll_register_callbacks cb 0x555c49a84210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b79be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b79be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57732/0 (socket says 172.21.15.80:57732) 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de37fe640 1 -- 172.21.15.80:0/881402934 learned_addr learned my addr 172.21.15.80:0/881402934 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de3fff640 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de8b45640 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b85830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de3fff640 1 -- 172.21.15.80:0/881402934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 msgr2=0x555c49b85830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de3fff640 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b85830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de3fff640 1 -- 172.21.15.80:0/881402934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 msgr2=0x555c49b79be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de3fff640 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b79be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de3fff640 1 -- 172.21.15.80:0/881402934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c498ac7d0 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5de3fff640 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b796a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5dd402a930 tx=0x7f5dd402ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d03140ab6442ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.460+0000 7f5dc37fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5dc37fe640 1 -- 172.21.15.80:0/881402934 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd404b020 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5dc37fe640 1 -- 172.21.15.80:0/881402934 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f5dd4004040 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd40316a0 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5dc37fe640 1 -- 172.21.15.80:0/881402934 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5dd4056050 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 10 client.25154 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555c497e23f0 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5dc37fe640 1 -- 172.21.15.80:0/881402934 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd40316a0 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5dc37fe640 1 -- 172.21.15.80:0/881402934 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f5dd4004770 con 0x555c497a14d0 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 10 client.25154 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 10 client.25154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 20 client.25154 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c49788f60 0x555c49b8b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 4 client.25154 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:19.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c49ade990 con 0x555c49788f60 2024-04-25T11:24:19.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.461+0000 7f5de37fe640 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c49788f60 0x555c49b8b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.462+0000 7f5dc37fe640 10 client.25154 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.462+0000 7f5de37fe640 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c49788f60 0x555c49b8b8a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df1654a6e9c96298 server_cookie=6223a8f89dc7ae3e in_seq=0 out_seq=0 2024-04-25T11:24:19.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.462+0000 7f5dc37fe640 1 -- 172.21.15.80:0/881402934 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555c49ade990 con 0x555c49788f60 2024-04-25T11:24:19.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.462+0000 7f5dc37fe640 10 client.25154 handle_command_reply: tid=0 2024-04-25T11:24:19.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.462+0000 7f5df1459740 1 client.25154 shutdown 2024-04-25T11:24:19.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 msgr2=0x555c49b796a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b796a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5dd402a930 tx=0x7f5dd402ab90 comp rx=0 tx=0).stop 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 shutdown_connections 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c49788f60 0x555c49b8b8a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a96b0 0x555c49b79be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497ca390 0x555c49b85830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5dc37fe640 0 client.25154 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 --2- 172.21.15.80:0/881402934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a14d0 0x555c49b796a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 >> 172.21.15.80:0/881402934 conn(0x555c497be4e0 msgr2=0x555c49b6e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 shutdown_connections 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 1 -- 172.21.15.80:0/881402934 wait complete. 2024-04-25T11:24:19.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.463+0000 7f5df1459740 20 client.25154 trim_cache size 0 max 16384 2024-04-25T11:24:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 Processor -- start 2024-04-25T11:24:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 -- start start 2024-04-25T11:24:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a14d0 0x555c49b680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a96b0 0x555c49b68620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497ca390 0x555c49b8e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5de41afe60 con 0x555c497a14d0 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5de41ad730 con 0x555c497ca390 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5df1459740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5de41ab580 con 0x555c497a96b0 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a14d0 0x555c49b680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a14d0 0x555c49b680e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57748/0 (socket says 172.21.15.80:57748) 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5de3fff640 1 -- 172.21.15.80:0/752141326 learned_addr learned my addr 172.21.15.80:0/752141326 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5de8b45640 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497ca390 0x555c49b8e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.484+0000 7f5de37fe640 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a96b0 0x555c49b68620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5de3fff640 1 -- 172.21.15.80:0/752141326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a96b0 msgr2=0x555c49b68620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5de3fff640 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a96b0 0x555c49b68620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5de3fff640 1 -- 172.21.15.80:0/752141326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497ca390 msgr2=0x555c49b8e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5de3fff640 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497ca390 0x555c49b8e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5de3fff640 1 -- 172.21.15.80:0/752141326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c49b6f290 con 0x555c497a14d0 2024-04-25T11:24:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5de3fff640 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a14d0 0x555c49b680e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009900 tx=0x7f5dd4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86aed0ea6373bfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5dc9ffb640 1 -- 172.21.15.80:0/752141326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd404b070 con 0x555c497a14d0 2024-04-25T11:24:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5dc9ffb640 1 -- 172.21.15.80:0/752141326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd40050d0 con 0x555c497a14d0 2024-04-25T11:24:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.485+0000 7f5dc9ffb640 1 -- 172.21.15.80:0/752141326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4035070 con 0x555c497a14d0 2024-04-25T11:24:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 -- 172.21.15.80:0/752141326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a14d0 msgr2=0x555c49b680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a14d0 0x555c49b680e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009900 tx=0x7f5dd4031400 comp rx=0 tx=0).stop 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 -- 172.21.15.80:0/752141326 shutdown_connections 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497ca390 0x555c49b8e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a96b0 0x555c49b68620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 --2- 172.21.15.80:0/752141326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497a14d0 0x555c49b680e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 -- 172.21.15.80:0/752141326 >> 172.21.15.80:0/752141326 conn(0x555c497be4e0 msgr2=0x555c49b679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 -- 172.21.15.80:0/752141326 shutdown_connections 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 -- 172.21.15.80:0/752141326 wait complete. 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.486+0000 7f5df1459740 1 -- start start 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 1 Processor -- start 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a14d0 0x555c49b8dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a96b0 0x555c49b8e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497ca390 0x555c49beb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5de41abbf0 con 0x555c497ca390 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5de41ad060 con 0x555c497a96b0 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5de41ac2c0 con 0x555c497a14d0 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5df1459740 10 client.0 _ll_register_callbacks cb 0x7f5dd80dcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497ca390 0x555c49beb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497ca390 0x555c49beb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57750/0 (socket says 172.21.15.80:57750) 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 -- 172.21.15.80:0/408887153 learned_addr learned my addr 172.21.15.80:0/408887153 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de37fe640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a96b0 0x555c49b8e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de3fff640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a14d0 0x555c49b8dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 -- 172.21.15.80:0/408887153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a14d0 msgr2=0x555c49b8dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a14d0 0x555c49b8dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 -- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a96b0 msgr2=0x555c49b8e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a96b0 0x555c49b8e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de8b45640 1 -- 172.21.15.80:0/408887153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c497a20f0 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.487+0000 7f5de3fff640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a14d0 0x555c49b8dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5de8b45640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497ca390 0x555c49beb9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0106e0 tx=0x7f5ddc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0993343d1881487 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5dc37fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5dc37fe640 1 -- 172.21.15.80:0/408887153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc004d20 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5dc37fe640 1 -- 172.21.15.80:0/408887153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f5ddc022800 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd40050d0 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5dc37fe640 1 -- 172.21.15.80:0/408887153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5ddc022a00 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 10 client.15519 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555c49a914b0 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5dc37fe640 1 -- 172.21.15.80:0/408887153 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd40050d0 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5dc37fe640 1 -- 172.21.15.80:0/408887153 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f5ddc029030 con 0x555c497ca390 2024-04-25T11:24:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 10 client.15519 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 20 client.15519 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c4975e3a0 0x555c49bf56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 4 client.15519 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.488+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c49ad8800 con 0x555c4975e3a0 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.489+0000 7f5de3fff640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c4975e3a0 0x555c49bf56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.489+0000 7f5dc37fe640 10 client.15519 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.489+0000 7f5de3fff640 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c4975e3a0 0x555c49bf56f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15fe4bbe7c44b8c7 server_cookie=c3b4c9461546ea0 in_seq=0 out_seq=0 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.489+0000 7f5dc37fe640 1 -- 172.21.15.80:0/408887153 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555c49ad8800 con 0x555c4975e3a0 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.489+0000 7f5dc37fe640 10 client.15519 handle_command_reply: tid=0 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.489+0000 7f5df1459740 1 client.15519 shutdown 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497ca390 msgr2=0x555c49beb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497ca390 0x555c49beb9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0106e0 tx=0x7f5ddc004a40 comp rx=0 tx=0).stop 2024-04-25T11:24:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 shutdown_connections 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555c4975e3a0 0x555c49bf56f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555c497ca390 0x555c49beb9a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c497a96b0 0x555c49b8e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 --2- 172.21.15.80:0/408887153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555c497a14d0 0x555c49b8dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dc37fe640 0 client.15519 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 >> 172.21.15.80:0/408887153 conn(0x555c497be4e0 msgr2=0x555c49b68400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 shutdown_connections 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 1 -- 172.21.15.80:0/408887153 wait complete. 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5df1459740 20 client.15519 trim_cache size 0 max 16384 2024-04-25T11:24:19.489 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: "72f16730-1ab3-4aa5-89b2-38418d7d3423": { 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "72f16730-1ab3-4aa5-89b2-38418d7d3423", 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:24:19.490 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5dcc0afcf0 msgr2=0x7f5dcc0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5dcc0afcf0 0x7f5dcc0b2200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009aa0 tx=0x7f5ddc004ab0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de4108a40 msgr2=0x7f5de4199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de4108a40 0x7f5de4199b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5de4069de0 tx=0x7f5dd800ee50 comp rx=0 tx=0).stop 2024-04-25T11:24:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 shutdown_connections 2024-04-25T11:24:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5dcc0afcf0 0x7f5dcc0b2200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5de410d3a0 0x7f5de419de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de4108a40 0x7f5de4199b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 --2- 172.21.15.80:0/2361537081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5de4102b10 0x7f5de41995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.490+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 >> 172.21.15.80:0/2361537081 conn(0x7f5de4078180 msgr2=0x7f5de41040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.491+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 shutdown_connections 2024-04-25T11:24:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.491+0000 7f5dea5a8640 1 -- 172.21.15.80:0/2361537081 wait complete. 2024-04-25T11:24:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.495+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f0df4096c00 con 0x7f0df40a0f70 2024-04-25T11:24:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.499+0000 7f0df9ffb640 1 -- 172.21.15.80:0/3502330512 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7f0dfc11c0d0 con 0x7f0df40a0f70 2024-04-25T11:24:19.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/378819794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:19.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-25T11:24:19.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-25T11:24:19.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-25T11:24:19.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1083650558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:24:19.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T11:24:19.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4080938296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:19.497 INFO:tasks.cephfs.filesystem:scrub status for tag:72f16730-1ab3-4aa5-89b2-38418d7d3423 - {'path': '/', 'tag': '72f16730-1ab3-4aa5-89b2-38418d7d3423', 'options': 'recursive,force'} 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0dec0afd70 msgr2=0x7f0dec0b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0dec0afd70 0x7f0dec0b2280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0df0031440 tx=0x7f0df00058d0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40a0f70 msgr2=0x7f0df4131e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40a0f70 0x7f0df4131e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc069050 tx=0x7f0dfc07a920 comp rx=0 tx=0).stop 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 shutdown_connections 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0dec0afd70 0x7f0dec0b2280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0df40a0f70 0x7f0df4131e70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df409e5c0 0x7f0df412dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 --2- 172.21.15.80:0/3502330512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df4097b60 0x7f0df412d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 >> 172.21.15.80:0/3502330512 conn(0x7f0df400b000 msgr2=0x7f0df4094080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 shutdown_connections 2024-04-25T11:24:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.502+0000 7f0e01981640 1 -- 172.21.15.80:0/3502330512 wait complete. 2024-04-25T11:24:19.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 -- 172.21.15.80:0/3904573260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 msgr2=0x7f4f101128c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 --2- 172.21.15.80:0/3904573260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f101128c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009ca0 tx=0x7f4f0802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 -- 172.21.15.80:0/3904573260 shutdown_connections 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 --2- 172.21.15.80:0/3904573260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f101128c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 --2- 172.21.15.80:0/3904573260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f1010db40 0x7f4f1010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 --2- 172.21.15.80:0/3904573260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f10102900 0x7f4f10102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 -- 172.21.15.80:0/3904573260 >> 172.21.15.80:0/3904573260 conn(0x7f4f100fe260 msgr2=0x7f4f10100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 -- 172.21.15.80:0/3904573260 shutdown_connections 2024-04-25T11:24:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.666+0000 7f4f16564640 1 -- 172.21.15.80:0/3904573260 wait complete. 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 Processor -- start 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 -- start start 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f10102900 0x7f4f101a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f1010db40 0x7f4f101a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f1019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10115f40 con 0x7f4f101104a0 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10115dc0 con 0x7f4f10102900 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.667+0000 7f4f16564640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101160c0 con 0x7f4f1010db40 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f1019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f1019c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57782/0 (socket says 172.21.15.80:57782) 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 -- 172.21.15.80:0/2290776846 learned_addr learned my addr 172.21.15.80:0/2290776846 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f0f7fe640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f1010db40 0x7f4f101a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f0ffff640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f10102900 0x7f4f101a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 -- 172.21.15.80:0/2290776846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f1010db40 msgr2=0x7f4f101a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f1010db40 0x7f4f101a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 -- 172.21.15.80:0/2290776846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f10102900 msgr2=0x7f4f101a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f10102900 0x7f4f101a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 -- 172.21.15.80:0/2290776846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1019ce70 con 0x7f4f101104a0 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f14b01640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f1019c740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005e30 tx=0x7f4f08009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f0d7fa640 1 -- 172.21.15.80:0/2290776846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08003b70 con 0x7f4f101104a0 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f0d7fa640 1 -- 172.21.15.80:0/2290776846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f08003d10 con 0x7f4f101104a0 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1019d0a0 con 0x7f4f101104a0 2024-04-25T11:24:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f0d7fa640 1 -- 172.21.15.80:0/2290776846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0802fa80 con 0x7f4f101104a0 2024-04-25T11:24:19.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.668+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f101a9360 con 0x7f4f101104a0 2024-04-25T11:24:19.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.669+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f10075650 con 0x7f4f101104a0 2024-04-25T11:24:19.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.671+0000 7f4f0d7fa640 1 -- 172.21.15.80:0/2290776846 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f4f0802fc20 con 0x7f4f101104a0 2024-04-25T11:24:19.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.671+0000 7f4f0d7fa640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ef80afce0 0x7f4ef80b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.671+0000 7f4f0ffff640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ef80afce0 0x7f4ef80b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.671+0000 7f4f0d7fa640 1 -- 172.21.15.80:0/2290776846 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f4f081006e0 con 0x7f4f101104a0 2024-04-25T11:24:19.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.672+0000 7f4f0ffff640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ef80afce0 0x7f4ef80b21f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009b60 tx=0x7f4f00005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.675+0000 7f4f0d7fa640 1 -- 172.21.15.80:0/2290776846 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4f080c8fc0 con 0x7f4f101104a0 2024-04-25T11:24:19.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.854+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f4f101a9530 con 0x7f4f101104a0 2024-04-25T11:24:19.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.859+0000 7f4f0d7fa640 1 -- 172.21.15.80:0/2290776846 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f4f080c88c0 con 0x7f4f101104a0 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ef80afce0 msgr2=0x7f4ef80b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ef80afce0 0x7f4ef80b21f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009b60 tx=0x7f4f00005f90 comp rx=0 tx=0).stop 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 msgr2=0x7f4f1019c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f1019c740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005e30 tx=0x7f4f08009360 comp rx=0 tx=0).stop 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 shutdown_connections 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ef80afce0 0x7f4ef80b21f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f101104a0 0x7f4f1019c740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f1010db40 0x7f4f101a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 --2- 172.21.15.80:0/2290776846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f10102900 0x7f4f101a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 >> 172.21.15.80:0/2290776846 conn(0x7f4f100fe260 msgr2=0x7f4f1010f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 shutdown_connections 2024-04-25T11:24:19.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.862+0000 7f4f16564640 1 -- 172.21.15.80:0/2290776846 wait complete. 2024-04-25T11:24:19.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-25T11:24:19.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 -- 172.21.15.80:0/2482618839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 msgr2=0x7f9b40103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 --2- 172.21.15.80:0/2482618839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b40103720 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009ca0 tx=0x7f9b3802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 -- 172.21.15.80:0/2482618839 shutdown_connections 2024-04-25T11:24:19.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 --2- 172.21.15.80:0/2482618839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b401042d0 0x7f9b401106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 --2- 172.21.15.80:0/2482618839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b4010a020 0x7f9b40103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 --2- 172.21.15.80:0/2482618839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b40103720 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 -- 172.21.15.80:0/2482618839 >> 172.21.15.80:0/2482618839 conn(0x7f9b40079270 msgr2=0x7f9b400796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 -- 172.21.15.80:0/2482618839 shutdown_connections 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.986+0000 7f9b486b6640 1 -- 172.21.15.80:0/2482618839 wait complete. 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 Processor -- start 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 -- start start 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b401042d0 0x7f9b4019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b4019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b4010a020 0x7f9b4019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113d70 con 0x7f9b40109b80 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113bf0 con 0x7f9b401042d0 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b486b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113ef0 con 0x7f9b4010a020 2024-04-25T11:24:19.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b4019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b46452640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b401042d0 0x7f9b4019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b4019ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57798/0 (socket says 172.21.15.80:57798) 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 -- 172.21.15.80:0/994796798 learned_addr learned my addr 172.21.15.80:0/994796798 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b46c53640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b4010a020 0x7f9b4019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 -- 172.21.15.80:0/994796798 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b4010a020 msgr2=0x7f9b4019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b4010a020 0x7f9b4019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 -- 172.21.15.80:0/994796798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b401042d0 msgr2=0x7f9b4019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b401042d0 0x7f9b4019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.987+0000 7f9b45c51640 1 -- 172.21.15.80:0/994796798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4019f620 con 0x7f9b40109b80 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.988+0000 7f9b45c51640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b4019ad70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000e9f0 tx=0x7f9b3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.988+0000 7f9b377fe640 1 -- 172.21.15.80:0/994796798 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000ccc0 con 0x7f9b40109b80 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.988+0000 7f9b377fe640 1 -- 172.21.15.80:0/994796798 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b300035f0 con 0x7f9b40109b80 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.988+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4019f910 con 0x7f9b40109b80 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.988+0000 7f9b377fe640 1 -- 172.21.15.80:0/994796798 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000ce60 con 0x7f9b40109b80 2024-04-25T11:24:19.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.988+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4019fe10 con 0x7f9b40109b80 2024-04-25T11:24:19.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.989+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4006a110 con 0x7f9b40109b80 2024-04-25T11:24:19.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.990+0000 7f9b377fe640 1 -- 172.21.15.80:0/994796798 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f9b30004000 con 0x7f9b40109b80 2024-04-25T11:24:19.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.991+0000 7f9b377fe640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9b2c0afce0 0x7f9b2c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:19.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.991+0000 7f9b46452640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9b2c0afce0 0x7f9b2c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:19.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.991+0000 7f9b377fe640 1 -- 172.21.15.80:0/994796798 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f9b300df5a0 con 0x7f9b40109b80 2024-04-25T11:24:19.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.991+0000 7f9b46452640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9b2c0afce0 0x7f9b2c0b21f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9b38005e30 tx=0x7f9b38009360 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:19.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:19.995+0000 7f9b377fe640 1 -- 172.21.15.80:0/994796798 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9b4019fe10 con 0x7f9b40109b80 2024-04-25T11:24:20.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1325190739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:20.129 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3502330512' entity='client.admin' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2290776846' entity='client.admin' 2024-04-25T11:24:20.130 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:20.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:20.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.197+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9b401080b0 con 0x7f9b2c0afce0 2024-04-25T11:24:20.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.227+0000 7f9b377fe640 1 -- 172.21.15.80:0/994796798 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9b401080b0 con 0x7f9b2c0afce0 2024-04-25T11:24:20.220 INFO:teuthology.orchestra.run.smithi080.stdout:Schedule set for path / 2024-04-25T11:24:20.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9b2c0afce0 msgr2=0x7f9b2c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9b2c0afce0 0x7f9b2c0b21f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9b38005e30 tx=0x7f9b38009360 comp rx=0 tx=0).stop 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 msgr2=0x7f9b4019ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b4019ad70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000e9f0 tx=0x7f9b3000edf0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 shutdown_connections 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9b2c0afce0 0x7f9b2c0b21f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b40109b80 0x7f9b4019ad70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b4010a020 0x7f9b4019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 --2- 172.21.15.80:0/994796798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b401042d0 0x7f9b4019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 >> 172.21.15.80:0/994796798 conn(0x7f9b40079270 msgr2=0x7f9b40105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 shutdown_connections 2024-04-25T11:24:20.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.229+0000 7f9b486b6640 1 -- 172.21.15.80:0/994796798 wait complete. 2024-04-25T11:24:20.233 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-25T11:24:20.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 -- 172.21.15.80:0/75646505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39601020a0 msgr2=0x7f39601024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 --2- 172.21.15.80:0/75646505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39601020a0 0x7f39601024b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3954009900 tx=0x7f395402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:20.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 -- 172.21.15.80:0/75646505 shutdown_connections 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 --2- 172.21.15.80:0/75646505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39601020a0 0x7f39601024b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 --2- 172.21.15.80:0/75646505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396010e5a0 0x7f39601109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 --2- 172.21.15.80:0/75646505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3960109bf0 0x7f3960101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 -- 172.21.15.80:0/75646505 >> 172.21.15.80:0/75646505 conn(0x7f39600778b0 msgr2=0x7f3960077cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 -- 172.21.15.80:0/75646505 shutdown_connections 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 -- 172.21.15.80:0/75646505 wait complete. 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.351+0000 7f3965296640 1 Processor -- start 2024-04-25T11:24:20.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f3965296640 1 -- start start 2024-04-25T11:24:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f3965296640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39601020a0 0x7f396019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f3965296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3960109bf0 0x7f396019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f3965296640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396010e5a0 0x7f396019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f3965296640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3960113d60 con 0x7f3960109bf0 2024-04-25T11:24:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f3965296640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3960113be0 con 0x7f396010e5a0 2024-04-25T11:24:20.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f3965296640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3960113ee0 con 0x7f39601020a0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3960109bf0 0x7f396019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3960109bf0 0x7f396019acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57806/0 (socket says 172.21.15.80:57806) 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 -- 172.21.15.80:0/2683970727 learned_addr learned my addr 172.21.15.80:0/2683970727 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395effd640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39601020a0 0x7f396019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395f7fe640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396010e5a0 0x7f396019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 -- 172.21.15.80:0/2683970727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39601020a0 msgr2=0x7f396019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39601020a0 0x7f396019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 -- 172.21.15.80:0/2683970727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396010e5a0 msgr2=0x7f396019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396010e5a0 0x7f396019efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.352+0000 7f395e7fc640 1 -- 172.21.15.80:0/2683970727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396019f5e0 con 0x7f3960109bf0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.353+0000 7f395e7fc640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3960109bf0 0x7f396019acc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3954032fd0 tx=0x7f3954031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.353+0000 7f3947fff640 1 -- 172.21.15.80:0/2683970727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395403f030 con 0x7f3960109bf0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.353+0000 7f3947fff640 1 -- 172.21.15.80:0/2683970727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3954004490 con 0x7f3960109bf0 2024-04-25T11:24:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.353+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396019f870 con 0x7f3960109bf0 2024-04-25T11:24:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.353+0000 7f3947fff640 1 -- 172.21.15.80:0/2683970727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954035070 con 0x7f3960109bf0 2024-04-25T11:24:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.353+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396019fd60 con 0x7f3960109bf0 2024-04-25T11:24:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.354+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3960050740 con 0x7f3960109bf0 2024-04-25T11:24:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.356+0000 7f3947fff640 1 -- 172.21.15.80:0/2683970727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f3954042030 con 0x7f3960109bf0 2024-04-25T11:24:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.356+0000 7f3947fff640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f39480afce0 0x7f39480b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.356+0000 7f395effd640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f39480afce0 0x7f39480b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.357+0000 7f3947fff640 1 -- 172.21.15.80:0/2683970727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f39540ffa10 con 0x7f3960109bf0 2024-04-25T11:24:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.357+0000 7f395effd640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f39480afce0 0x7f39480b21f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3960075510 tx=0x7f3950009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.360+0000 7f3947fff640 1 -- 172.21.15.80:0/2683970727 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f39540c8150 con 0x7f3960109bf0 2024-04-25T11:24:20.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:20.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1325190739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.441 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3502330512' entity='client.admin' 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2290776846' entity='client.admin' 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:20.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: Updating smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: Updating smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: Updating smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1325190739' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:24:20.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3502330512' entity='client.admin' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2290776846' entity='client.admin' 2024-04-25T11:24:20.495 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:24:20.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:24:20.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:24:20.496 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:24:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.560+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f396010d3c0 con 0x7f39480afce0 2024-04-25T11:24:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.586+0000 7f3947fff640 1 -- 172.21.15.80:0/2683970727 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f396010d3c0 con 0x7f39480afce0 2024-04-25T11:24:20.579 INFO:teuthology.orchestra.run.smithi080.stdout:Retention added to path / 2024-04-25T11:24:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f39480afce0 msgr2=0x7f39480b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f39480afce0 0x7f39480b21f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3960075510 tx=0x7f3950009500 comp rx=0 tx=0).stop 2024-04-25T11:24:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3960109bf0 msgr2=0x7f396019acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3960109bf0 0x7f396019acc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3954032fd0 tx=0x7f3954031a20 comp rx=0 tx=0).stop 2024-04-25T11:24:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 shutdown_connections 2024-04-25T11:24:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f39480afce0 0x7f39480b21f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3960109bf0 0x7f396019acc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396010e5a0 0x7f396019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 --2- 172.21.15.80:0/2683970727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39601020a0 0x7f396019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 >> 172.21.15.80:0/2683970727 conn(0x7f39600778b0 msgr2=0x7f396010a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 shutdown_connections 2024-04-25T11:24:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.588+0000 7f3965296640 1 -- 172.21.15.80:0/2683970727 wait complete. 2024-04-25T11:24:20.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T11:24:20.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 -- 172.21.15.80:0/2696805954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 msgr2=0x7f7ea810f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 --2- 172.21.15.80:0/2696805954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea810f570 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009900 tx=0x7f7ea402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 -- 172.21.15.80:0/2696805954 shutdown_connections 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 --2- 172.21.15.80:0/2696805954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea810f570 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 --2- 172.21.15.80:0/2696805954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea81072c0 0x7f7ea81076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 --2- 172.21.15.80:0/2696805954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea8103400 0x7f7ea8103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 -- 172.21.15.80:0/2696805954 >> 172.21.15.80:0/2696805954 conn(0x7f7ea80fd8a0 msgr2=0x7f7ea80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 -- 172.21.15.80:0/2696805954 shutdown_connections 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.708+0000 7f7eafa51640 1 -- 172.21.15.80:0/2696805954 wait complete. 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 Processor -- start 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 -- start start 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea8103400 0x7f7ea8199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea81072c0 0x7f7ea8199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea819de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea8112cc0 con 0x7f7ea8107d40 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea8112b40 con 0x7f7ea8103400 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eafa51640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea8112e40 con 0x7f7ea81072c0 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea819de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea819de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57838/0 (socket says 172.21.15.80:57838) 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 -- 172.21.15.80:0/3607705543 learned_addr learned my addr 172.21.15.80:0/3607705543 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eacfec640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea81072c0 0x7f7ea8199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7ead7ed640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea8103400 0x7f7ea8199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 -- 172.21.15.80:0/3607705543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea81072c0 msgr2=0x7f7ea8199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea81072c0 0x7f7ea8199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 -- 172.21.15.80:0/3607705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea8103400 msgr2=0x7f7ea8199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea8103400 0x7f7ea8199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eadfee640 1 -- 172.21.15.80:0/3607705543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea819e480 con 0x7f7ea8107d40 2024-04-25T11:24:20.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7ead7ed640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea8103400 0x7f7ea8199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.709+0000 7f7eacfec640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea81072c0 0x7f7ea8199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.710+0000 7f7eadfee640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea819de40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009a20 tx=0x7f7ea4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.710+0000 7f7e9e7fc640 1 -- 172.21.15.80:0/3607705543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4046070 con 0x7f7ea8107d40 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.710+0000 7f7e9e7fc640 1 -- 172.21.15.80:0/3607705543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ea4003aa0 con 0x7f7ea8107d40 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.710+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea819e710 con 0x7f7ea8107d40 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.710+0000 7f7e9e7fc640 1 -- 172.21.15.80:0/3607705543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4035050 con 0x7f7ea8107d40 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.710+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea819ec80 con 0x7f7ea8107d40 2024-04-25T11:24:20.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.711+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea8050740 con 0x7f7ea8107d40 2024-04-25T11:24:20.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.712+0000 7f7e9e7fc640 1 -- 172.21.15.80:0/3607705543 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f7ea4049070 con 0x7f7ea8107d40 2024-04-25T11:24:20.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.713+0000 7f7e9e7fc640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7e940afce0 0x7f7e940b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:20.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.713+0000 7f7ead7ed640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7e940afce0 0x7f7e940b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:20.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.713+0000 7f7e9e7fc640 1 -- 172.21.15.80:0/3607705543 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f7ea41010b0 con 0x7f7ea8107d40 2024-04-25T11:24:20.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.713+0000 7f7ead7ed640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7e940afce0 0x7f7e940b21f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7ea806b730 tx=0x7f7ea00073c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:20.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.716+0000 7f7e9e7fc640 1 -- 172.21.15.80:0/3607705543 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7ea40c97f0 con 0x7f7ea8107d40 2024-04-25T11:24:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.919+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f7ea810a6c0 con 0x7f7e940afce0 2024-04-25T11:24:20.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.928+0000 7f7e9e7fc640 1 -- 172.21.15.80:0/3607705543 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f7ea810a6c0 con 0x7f7e940afce0 2024-04-25T11:24:20.921 INFO:teuthology.orchestra.run.smithi080.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T11:24:20", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-25T11:24:20.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7e940afce0 msgr2=0x7f7e940b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7e940afce0 0x7f7e940b21f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7ea806b730 tx=0x7f7ea00073c0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 msgr2=0x7f7ea819de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea819de40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009a20 tx=0x7f7ea4004270 comp rx=0 tx=0).stop 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 shutdown_connections 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7e940afce0 0x7f7e940b21f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ea8107d40 0x7f7ea819de40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ea81072c0 0x7f7ea8199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 --2- 172.21.15.80:0/3607705543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea8103400 0x7f7ea8199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 >> 172.21.15.80:0/3607705543 conn(0x7f7ea80fd8a0 msgr2=0x7f7ea8105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 shutdown_connections 2024-04-25T11:24:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:20.930+0000 7f7eafa51640 1 -- 172.21.15.80:0/3607705543 wait complete. 2024-04-25T11:24:20.934 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.051+0000 7fd1782b6640 1 -- 172.21.15.80:0/131478398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1701042a0 msgr2=0x7fd170110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.051+0000 7fd1782b6640 1 --2- 172.21.15.80:0/131478398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1701042a0 0x7fd170110670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd168009ca0 tx=0x7fd16802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- 172.21.15.80:0/131478398 shutdown_connections 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 --2- 172.21.15.80:0/131478398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1701042a0 0x7fd170110670 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 --2- 172.21.15.80:0/131478398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd170109ff0 0x7fd170103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 --2- 172.21.15.80:0/131478398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd170109b50 0x7fd1701036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- 172.21.15.80:0/131478398 >> 172.21.15.80:0/131478398 conn(0x7fd1700ff230 msgr2=0x7fd170101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- 172.21.15.80:0/131478398 shutdown_connections 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- 172.21.15.80:0/131478398 wait complete. 2024-04-25T11:24:21.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 Processor -- start 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- start start 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1701042a0 0x7fd17019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd170109b50 0x7fd17019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd170109ff0 0x7fd17019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd170113d40 con 0x7fd170109ff0 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd170113bc0 con 0x7fd1701042a0 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.052+0000 7fd1782b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd170113ec0 con 0x7fd170109b50 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd170109ff0 0x7fd17019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd170109ff0 0x7fd17019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57844/0 (socket says 172.21.15.80:57844) 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 -- 172.21.15.80:0/1656281490 learned_addr learned my addr 172.21.15.80:0/1656281490 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd175851640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd170109b50 0x7fd17019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176052640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1701042a0 0x7fd17019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 -- 172.21.15.80:0/1656281490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd170109b50 msgr2=0x7fd17019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd170109b50 0x7fd17019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 -- 172.21.15.80:0/1656281490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1701042a0 msgr2=0x7fd17019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1701042a0 0x7fd17019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 -- 172.21.15.80:0/1656281490 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17019f550 con 0x7fd170109ff0 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd176853640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd170109ff0 0x7fd17019ef10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd168005cc0 tx=0x7fd16802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd1677fe640 1 -- 172.21.15.80:0/1656281490 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168003bf0 con 0x7fd170109ff0 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd1677fe640 1 -- 172.21.15.80:0/1656281490 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd168003d90 con 0x7fd170109ff0 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17019f7e0 con 0x7fd170109ff0 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd1677fe640 1 -- 172.21.15.80:0/1656281490 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16802fbc0 con 0x7fd170109ff0 2024-04-25T11:24:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.053+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17019fd30 con 0x7fd170109ff0 2024-04-25T11:24:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.054+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd170050740 con 0x7fd170109ff0 2024-04-25T11:24:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.056+0000 7fd1677fe640 1 -- 172.21.15.80:0/1656281490 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fd16802fd60 con 0x7fd170109ff0 2024-04-25T11:24:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.056+0000 7fd1677fe640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd15c0afd60 0x7fd15c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.057+0000 7fd176052640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd15c0afd60 0x7fd15c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.057+0000 7fd1677fe640 1 -- 172.21.15.80:0/1656281490 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fd168100ad0 con 0x7fd170109ff0 2024-04-25T11:24:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.057+0000 7fd176052640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd15c0afd60 0x7fd15c0b2270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd16c005fd0 tx=0x7fd16c00b590 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:21.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.060+0000 7fd1677fe640 1 -- 172.21.15.80:0/1656281490 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd1680c92c0 con 0x7fd170109ff0 2024-04-25T11:24:21.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.262+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fd170062fe0 con 0x7fd15c0afd60 2024-04-25T11:24:21.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.270+0000 7fd1677fe640 1 -- 172.21.15.80:0/1656281490 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fd170062fe0 con 0x7fd15c0afd60 2024-04-25T11:24:21.263 INFO:teuthology.orchestra.run.smithi080.stdout:/ 1m 6m3h 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd15c0afd60 msgr2=0x7fd15c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd15c0afd60 0x7fd15c0b2270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd16c005fd0 tx=0x7fd16c00b590 comp rx=0 tx=0).stop 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd170109ff0 msgr2=0x7fd17019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd170109ff0 0x7fd17019ef10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd168005cc0 tx=0x7fd16802f380 comp rx=0 tx=0).stop 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 shutdown_connections 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd15c0afd60 0x7fd15c0b2270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd170109ff0 0x7fd17019ef10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd170109b50 0x7fd17019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 --2- 172.21.15.80:0/1656281490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1701042a0 0x7fd17019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:21.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 >> 172.21.15.80:0/1656281490 conn(0x7fd1700ff230 msgr2=0x7fd170106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:21.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 shutdown_connections 2024-04-25T11:24:21.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:21.272+0000 7fd1782b6640 1 -- 172.21.15.80:0/1656281490 wait complete. 2024-04-25T11:24:21.274 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:21 smithi080 ceph-mon[29126]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:21.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-25T11:24:21.300 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-25T11:24:21.310 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-25T11:24:21.326 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:24:21.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-25T11:24:21.342 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T11:24:21.355 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:24:21.355 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T11:24:21.355 INFO:tasks.workunit:timeout=3h 2024-04-25T11:24:21.355 INFO:tasks.workunit:cleanup=True 2024-04-25T11:24:21.355 DEBUG:teuthology.orchestra.run.smithi080:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 73h/115d Inode: 1099511628283 Links: 2 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-25 11:22:19.863347478 +0000 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-25 11:22:19.863347478 +0000 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-25 11:24:12.080201200 +0000 2024-04-25T11:24:21.370 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-25 11:22:19.863347478 +0000 2024-04-25T11:24:21.371 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T11:24:21.371 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T11:24:21.439 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T11:24:21.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:21 smithi196 ceph-mon[32659]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:21.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:21 smithi082 ceph-mon[32440]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:21.494 INFO:tasks.workunit.client.0.smithi080.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T11:24:22.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:22 smithi080 ceph-mon[29126]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:22 smithi080 ceph-mon[29126]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:22.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:22 smithi080 ceph-mon[29126]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:22 smithi080 ceph-mon[29126]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:22 smithi196 ceph-mon[32659]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:22 smithi196 ceph-mon[32659]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:22.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:22 smithi196 ceph-mon[32659]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:22 smithi196 ceph-mon[32659]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:22 smithi082 ceph-mon[32440]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:22 smithi082 ceph-mon[32440]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T11:24:22.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:22 smithi082 ceph-mon[32440]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:22.494 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:22 smithi082 ceph-mon[32440]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:24:23.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:23 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:24:23.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:23 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:24:23.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:23 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:24:24.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:24 smithi080 ceph-mon[29126]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-04-25T11:24:24.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:24 smithi196 ceph-mon[32659]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-04-25T11:24:24.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:24 smithi082 ceph-mon[32440]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-04-25T11:24:26.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:26 smithi080 ceph-mon[29126]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 24 op/s 2024-04-25T11:24:26.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:26 smithi196 ceph-mon[32659]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 24 op/s 2024-04-25T11:24:26.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:26 smithi082 ceph-mon[32440]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 24 op/s 2024-04-25T11:24:28.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:28 smithi080 ceph-mon[29126]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 KiB/s wr, 25 op/s 2024-04-25T11:24:28.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:28 smithi196 ceph-mon[32659]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 KiB/s wr, 25 op/s 2024-04-25T11:24:28.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:28 smithi082 ceph-mon[32440]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 KiB/s wr, 25 op/s 2024-04-25T11:24:30.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:30 smithi080 ceph-mon[29126]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T11:24:30.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:30 smithi196 ceph-mon[32659]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T11:24:30.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:30 smithi082 ceph-mon[32440]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T11:24:32.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:32 smithi080 ceph-mon[29126]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T11:24:32.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:32 smithi196 ceph-mon[32659]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T11:24:32.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:32 smithi082 ceph-mon[32440]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T11:24:34.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:34 smithi080 ceph-mon[29126]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 25 op/s 2024-04-25T11:24:34.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:34 smithi196 ceph-mon[32659]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 25 op/s 2024-04-25T11:24:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 -- 172.21.15.80:0/2863077065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 msgr2=0x7fd150110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 --2- 172.21.15.80:0/2863077065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd150110670 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd148009ca0 tx=0x7fd14802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 -- 172.21.15.80:0/2863077065 shutdown_connections 2024-04-25T11:24:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 --2- 172.21.15.80:0/2863077065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd150110670 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 --2- 172.21.15.80:0/2863077065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd150109ff0 0x7fd150103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 --2- 172.21.15.80:0/2863077065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd150109b50 0x7fd1501036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 -- 172.21.15.80:0/2863077065 >> 172.21.15.80:0/2863077065 conn(0x7fd1500ff230 msgr2=0x7fd150101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 -- 172.21.15.80:0/2863077065 shutdown_connections 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.498+0000 7fd1573b2640 1 -- 172.21.15.80:0/2863077065 wait complete. 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 Processor -- start 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 -- start start 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd15019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd150109b50 0x7fd15019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd150109ff0 0x7fd15019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd150113d40 con 0x7fd1501042a0 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd150113bc0 con 0x7fd150109b50 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.499+0000 7fd1573b2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd150113ec0 con 0x7fd150109ff0 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd15019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd15019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49286/0 (socket says 172.21.15.80:49286) 2024-04-25T11:24:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 -- 172.21.15.80:0/757325512 learned_addr learned my addr 172.21.15.80:0/757325512 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15494d640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd150109b50 0x7fd15019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15594f640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd150109ff0 0x7fd15019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 -- 172.21.15.80:0/757325512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd150109ff0 msgr2=0x7fd15019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd150109ff0 0x7fd15019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 -- 172.21.15.80:0/757325512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd150109b50 msgr2=0x7fd15019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd150109b50 0x7fd15019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 -- 172.21.15.80:0/757325512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15019f4e0 con 0x7fd1501042a0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd15514e640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd15019a700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00d7a0 tx=0x7fd14c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd1427fc640 1 -- 172.21.15.80:0/757325512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c017070 con 0x7fd1501042a0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd1427fc640 1 -- 172.21.15.80:0/757325512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd14c009c30 con 0x7fd1501042a0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15019f7d0 con 0x7fd1501042a0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd1427fc640 1 -- 172.21.15.80:0/757325512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00f620 con 0x7fd1501042a0 2024-04-25T11:24:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.500+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15019fd20 con 0x7fd1501042a0 2024-04-25T11:24:34.498 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:34 smithi082 ceph-mon[32440]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 25 op/s 2024-04-25T11:24:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.503+0000 7fd1427fc640 1 -- 172.21.15.80:0/757325512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fd14c01a070 con 0x7fd1501042a0 2024-04-25T11:24:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.503+0000 7fd15e25d740 1 Processor -- start 2024-04-25T11:24:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.503+0000 7fd15e25d740 1 -- start start 2024-04-25T11:24:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512261b0 0x5623515c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511fd2f0 0x5623515c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x5623515c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15e25d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56235152c460 con 0x5623512261b0 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15e25d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623514e6590 con 0x5623511fd2f0 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15e25d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562351528420 con 0x5623512054d0 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512261b0 0x5623515c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512261b0 0x5623515c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49296/0 (socket says 172.21.15.80:49296) 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 -- 172.21.15.80:0/2096672283 learned_addr learned my addr 172.21.15.80:0/2096672283 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15494d640 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x5623515c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd1427fc640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd13c0afce0 0x7fd13c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15514e640 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511fd2f0 0x5623515c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 -- 172.21.15.80:0/2096672283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 msgr2=0x5623515c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x5623515c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 -- 172.21.15.80:0/2096672283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511fd2f0 msgr2=0x5623515c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511fd2f0 0x5623515c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 -- 172.21.15.80:0/2096672283 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623514f30d0 con 0x5623512261b0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15494d640 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x5623515c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15514e640 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511fd2f0 0x5623515c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd13c0afce0 0x7fd13c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd1427fc640 1 -- 172.21.15.80:0/757325512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fd14c0dec10 con 0x7fd1501042a0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.504+0000 7fd15594f640 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512261b0 0x5623515c5af0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd148005e30 tx=0x7fd148009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42444fd01c97ccb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.505+0000 7fd13b7fe640 1 -- 172.21.15.80:0/2096672283 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148003e40 con 0x5623512261b0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.505+0000 7fd13b7fe640 1 -- 172.21.15.80:0/2096672283 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd148036070 con 0x5623512261b0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.505+0000 7fd13b7fe640 1 -- 172.21.15.80:0/2096672283 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14802f980 con 0x5623512261b0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.505+0000 7fd15594f640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd13c0afce0 0x7fd13c0b21f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5623515c75a0 tx=0x7fd148048000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 -- 172.21.15.80:0/2096672283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512261b0 msgr2=0x5623515c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512261b0 0x5623515c5af0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd148005e30 tx=0x7fd148009950 comp rx=0 tx=0).stop 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 -- 172.21.15.80:0/2096672283 shutdown_connections 2024-04-25T11:24:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x5623515c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511fd2f0 0x5623515c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2096672283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512261b0 0x5623515c5af0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 -- 172.21.15.80:0/2096672283 >> 172.21.15.80:0/2096672283 conn(0x56235121a300 msgr2=0x5623515c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 -- 172.21.15.80:0/2096672283 shutdown_connections 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 -- 172.21.15.80:0/2096672283 wait complete. 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 -- start start 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.506+0000 7fd15e25d740 1 Processor -- start 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511fd2f0 0x5623515d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512054d0 0x5623515d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512261b0 0x5623515cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15e25d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5623515d2aa0 con 0x5623512054d0 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15e25d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623514b3b60 con 0x5623512261b0 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15e25d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5623515d2c20 con 0x5623511fd2f0 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15e25d740 10 client.0 _ll_register_callbacks cb 0x5623514d82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512054d0 0x5623515d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512054d0 0x5623515d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49310/0 (socket says 172.21.15.80:49310) 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 -- 172.21.15.80:0/240810748 learned_addr learned my addr 172.21.15.80:0/240810748 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15594f640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512261b0 0x5623515cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15514e640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511fd2f0 0x5623515d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 -- 172.21.15.80:0/240810748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511fd2f0 msgr2=0x5623515d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511fd2f0 0x5623515d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 -- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512261b0 msgr2=0x5623515cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512261b0 0x5623515cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 -- 172.21.15.80:0/240810748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56235123e210 con 0x5623512054d0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15514e640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511fd2f0 0x5623515d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd15494d640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512054d0 0x5623515d2050 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd144012750 tx=0x7fd144012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd1664071de6495 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd138ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.507+0000 7fd138ff9640 1 -- 172.21.15.80:0/240810748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144004260 con 0x5623512054d0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd138ff9640 1 -- 172.21.15.80:0/240810748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fd144004400 con 0x5623512054d0 2024-04-25T11:24:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd148036070 con 0x5623512054d0 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd138ff9640 1 -- 172.21.15.80:0/240810748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd144010930 con 0x5623512054d0 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 10 client.15561 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56235130a620 con 0x5623512054d0 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd138ff9640 1 -- 172.21.15.80:0/240810748 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd148036070 con 0x5623512054d0 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd138ff9640 1 -- 172.21.15.80:0/240810748 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fd144019070 con 0x5623512054d0 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 10 client.15561 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 20 client.15561 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623511e4d80 0x5623515e2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 4 client.15561 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56235153a070 con 0x5623511e4d80 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.508+0000 7fd15514e640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623511e4d80 0x5623515e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.509+0000 7fd15514e640 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623511e4d80 0x5623515e2750 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4802f151d257c685 server_cookie=1d790d07f6a93c32 in_seq=0 out_seq=0 2024-04-25T11:24:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.509+0000 7fd138ff9640 10 client.15561 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd138ff9640 1 -- 172.21.15.80:0/240810748 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56235153a070 con 0x5623511e4d80 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd138ff9640 10 client.15561 handle_command_reply: tid=0 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 client.15561 shutdown 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512054d0 msgr2=0x5623515d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512054d0 0x5623515d2050 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd144012750 tx=0x7fd144012c10 comp rx=0 tx=0).stop 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 shutdown_connections 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623511e4d80 0x5623515e2750 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623512054d0 0x5623515d2050 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512261b0 0x5623515cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 --2- 172.21.15.80:0/240810748 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511fd2f0 0x5623515d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd138ff9640 0 client.15561 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 >> 172.21.15.80:0/240810748 conn(0x56235121a300 msgr2=0x5623515c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 shutdown_connections 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 1 -- 172.21.15.80:0/240810748 wait complete. 2024-04-25T11:24:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.510+0000 7fd15e25d740 20 client.15561 trim_cache size 0 max 16384 2024-04-25T11:24:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.525+0000 7fd15e25d740 1 Processor -- start 2024-04-25T11:24:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.525+0000 7fd15e25d740 1 -- start start 2024-04-25T11:24:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.525+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511e4d80 0x5623515d8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.525+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x5623515ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.525+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512054d0 0x5623515cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.525+0000 7fd15e25d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501b2230 con 0x5623511fd2f0 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.525+0000 7fd15e25d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501afb00 con 0x5623512054d0 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15e25d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501ad950 con 0x5623511e4d80 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x5623515ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x5623515ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49322/0 (socket says 172.21.15.80:49322) 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 -- 172.21.15.80:0/637663102 learned_addr learned my addr 172.21.15.80:0/637663102 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15514e640 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511e4d80 0x5623515d8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 -- 172.21.15.80:0/637663102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511e4d80 msgr2=0x5623515d8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511e4d80 0x5623515d8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15594f640 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512054d0 0x5623515cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 -- 172.21.15.80:0/637663102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512054d0 msgr2=0x5623515cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512054d0 0x5623515cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 -- 172.21.15.80:0/637663102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623515c69d0 con 0x5623511fd2f0 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15594f640 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512054d0 0x5623515cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd15494d640 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x5623515ce880 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd14400a3f0 tx=0x7fd144005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1176cd49d76488f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd13affd640 1 -- 172.21.15.80:0/637663102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14401b6b0 con 0x5623511fd2f0 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd13affd640 1 -- 172.21.15.80:0/637663102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1440052c0 con 0x5623511fd2f0 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.526+0000 7fd13affd640 1 -- 172.21.15.80:0/637663102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144003850 con 0x5623511fd2f0 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 -- 172.21.15.80:0/637663102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 msgr2=0x5623515ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x5623515ce880 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd14400a3f0 tx=0x7fd144005800 comp rx=0 tx=0).stop 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 -- 172.21.15.80:0/637663102 shutdown_connections 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x5623515ce880 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623512054d0 0x5623515cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 --2- 172.21.15.80:0/637663102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623511e4d80 0x5623515d8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 -- 172.21.15.80:0/637663102 >> 172.21.15.80:0/637663102 conn(0x56235121a300 msgr2=0x5623515c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 -- 172.21.15.80:0/637663102 shutdown_connections 2024-04-25T11:24:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 -- 172.21.15.80:0/637663102 wait complete. 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 -- start start 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.527+0000 7fd15e25d740 1 Processor -- start 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511e4d80 0x562351647c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x562351648180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15e25d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x562351642030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15e25d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501adfc0 con 0x5623511fd2f0 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15e25d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501af430 con 0x5623511e4d80 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15e25d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501ae690 con 0x5623512054d0 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15e25d740 10 client.0 _ll_register_callbacks cb 0x7fd144005e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x562351648180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x562351648180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49338/0 (socket says 172.21.15.80:49338) 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 -- 172.21.15.80:0/2421038046 learned_addr learned my addr 172.21.15.80:0/2421038046 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15514e640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511e4d80 0x562351647c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15594f640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x562351642030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 -- 172.21.15.80:0/2421038046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 msgr2=0x562351642030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x562351642030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 -- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511e4d80 msgr2=0x562351647c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511e4d80 0x562351647c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 -- 172.21.15.80:0/2421038046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562351642640 con 0x5623511fd2f0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15514e640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511e4d80 0x562351647c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd15494d640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x562351648180 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd144005f30 tx=0x7fd144010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c933bf8123f7bd29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.528+0000 7fd138ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd138ff9640 1 -- 172.21.15.80:0/2421038046 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14403b060 con 0x5623511fd2f0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd138ff9640 1 -- 172.21.15.80:0/2421038046 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fd14401b8c0 con 0x5623511fd2f0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1440052c0 con 0x5623511fd2f0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd138ff9640 1 -- 172.21.15.80:0/2421038046 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd14401bac0 con 0x5623511fd2f0 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 10 client.15567 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56235164f260 con 0x5623511fd2f0 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd138ff9640 1 -- 172.21.15.80:0/2421038046 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1440052c0 con 0x5623511fd2f0 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd138ff9640 1 -- 172.21.15.80:0/2421038046 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fd144019040 con 0x5623511fd2f0 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 10 client.15567 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 10 client.15567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 20 client.15567 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623512261b0 0x562351651920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 4 client.15567 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562351533ee0 con 0x5623512261b0 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.529+0000 7fd15514e640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623512261b0 0x562351651920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.530+0000 7fd138ff9640 10 client.15567 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.530+0000 7fd15514e640 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623512261b0 0x562351651920 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdbcb43308c59344 server_cookie=a7b656d34925cb36 in_seq=0 out_seq=0 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.541+0000 7fd138ff9640 1 -- 172.21.15.80:0/2421038046 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562351533ee0 con 0x5623512261b0 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.541+0000 7fd138ff9640 10 client.15567 handle_command_reply: tid=0 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.541+0000 7fd15e25d740 1 client.15567 shutdown 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 msgr2=0x562351648180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x562351648180 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd144005f30 tx=0x7fd144010ce0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 shutdown_connections 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5623512261b0 0x562351651920 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623511fd2f0 0x562351648180 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5623512054d0 0x562351642030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd138ff9640 0 client.15567 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 --2- 172.21.15.80:0/2421038046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623511e4d80 0x562351647c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 >> 172.21.15.80:0/2421038046 conn(0x56235121a300 msgr2=0x5623515c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 shutdown_connections 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 1 -- 172.21.15.80:0/2421038046 wait complete. 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd15e25d740 20 client.15567 trim_cache size 0 max 16384 2024-04-25T11:24:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:24:34.538 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:24:34.538 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:24:34.538 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd13c0afce0 msgr2=0x7fd13c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd13c0afce0 0x7fd13c0b21f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5623515c75a0 tx=0x7fd148048000 comp rx=0 tx=0).stop 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 msgr2=0x7fd15019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd15019a700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00d7a0 tx=0x7fd14c00dc60 comp rx=0 tx=0).stop 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 shutdown_connections 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd13c0afce0 0x7fd13c0b21f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd150109ff0 0x7fd15019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd150109b50 0x7fd15019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 --2- 172.21.15.80:0/757325512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1501042a0 0x7fd15019a700 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.542+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 >> 172.21.15.80:0/757325512 conn(0x7fd1500ff230 msgr2=0x7fd150106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.543+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 shutdown_connections 2024-04-25T11:24:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:34.543+0000 7fd1573b2640 1 -- 172.21.15.80:0/757325512 wait complete. 2024-04-25T11:24:36.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:36 smithi080 ceph-mon[29126]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:24:36.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:36 smithi196 ceph-mon[32659]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:24:36.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:36 smithi082 ceph-mon[32440]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:24:38.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:38 smithi080 ceph-mon[29126]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-04-25T11:24:38.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:38 smithi196 ceph-mon[32659]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-04-25T11:24:38.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:38 smithi082 ceph-mon[32440]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-04-25T11:24:40.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:40 smithi080 ceph-mon[29126]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:40.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:40 smithi196 ceph-mon[32659]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:40.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:40 smithi082 ceph-mon[32440]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:42.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:42 smithi080 ceph-mon[29126]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:42.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:42 smithi196 ceph-mon[32659]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:42.646 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:42 smithi082 ceph-mon[32440]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:44.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:44 smithi080 ceph-mon[29126]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-25T11:24:44.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:44 smithi196 ceph-mon[32659]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-25T11:24:44.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:44 smithi082 ceph-mon[32440]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-25T11:24:46.378 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:46 smithi080 ceph-mon[29126]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:46.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:46 smithi196 ceph-mon[32659]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:46.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:46 smithi082 ceph-mon[32440]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T11:24:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 -- 172.21.15.80:0/3804630979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f41031e0 msgr2=0x7f57f410f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 --2- 172.21.15.80:0/3804630979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f41031e0 0x7f57f410f5b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009ca0 tx=0x7f57ec02a8e0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 -- 172.21.15.80:0/3804630979 shutdown_connections 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 --2- 172.21.15.80:0/3804630979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f41031e0 0x7f57f410f5b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 --2- 172.21.15.80:0/3804630979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f4108f30 0x7f57f4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 --2- 172.21.15.80:0/3804630979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f4108a90 0x7f57f4102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 -- 172.21.15.80:0/3804630979 >> 172.21.15.80:0/3804630979 conn(0x7f57f4078080 msgr2=0x7f57f40784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 -- 172.21.15.80:0/3804630979 shutdown_connections 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.648+0000 7f57facf2640 1 -- 172.21.15.80:0/3804630979 wait complete. 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 Processor -- start 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 -- start start 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f41031e0 0x7f57f41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f4108a90 0x7f57f4199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f4108f30 0x7f57f419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57f4112d80 con 0x7f57f4108f30 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57f4112c00 con 0x7f57f41031e0 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57facf2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57f4112f00 con 0x7f57f4108a90 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57f928f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f4108f30 0x7f57f419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57f928f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f4108f30 0x7f57f419dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35250/0 (socket says 172.21.15.80:35250) 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57f928f640 1 -- 172.21.15.80:0/2977313990 learned_addr learned my addr 172.21.15.80:0/2977313990 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f4108a90 0x7f57f4199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.649+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f41031e0 0x7f57f41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f928f640 1 -- 172.21.15.80:0/2977313990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f4108a90 msgr2=0x7f57f4199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f928f640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f4108a90 0x7f57f4199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f928f640 1 -- 172.21.15.80:0/2977313990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f41031e0 msgr2=0x7f57f41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f928f640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f41031e0 0x7f57f41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f928f640 1 -- 172.21.15.80:0/2977313990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f419e620 con 0x7f57f4108f30 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f4108a90 0x7f57f4199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f928f640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f4108f30 0x7f57f419dfe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005cc0 tx=0x7f57ec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f1ffb640 1 -- 172.21.15.80:0/2977313990 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec004040 con 0x7f57f4108f30 2024-04-25T11:24:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f1ffb640 1 -- 172.21.15.80:0/2977313990 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57ec004690 con 0x7f57f4108f30 2024-04-25T11:24:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f419e8b0 con 0x7f57f4108f30 2024-04-25T11:24:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57f1ffb640 1 -- 172.21.15.80:0/2977313990 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec030e20 con 0x7f57f4108f30 2024-04-25T11:24:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.650+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f419ee00 con 0x7f57f4108f30 2024-04-25T11:24:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.653+0000 7f5801ba2740 1 Processor -- start 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.653+0000 7f57f1ffb640 1 -- 172.21.15.80:0/2977313990 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f57ec0305e0 con 0x7f57f4108f30 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f5801ba2740 1 -- start start 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbb7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbb8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbb8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f5801ba2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557a1cb1e460 con 0x557a1c7f74d0 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f5801ba2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557a1cad8590 con 0x557a1c7ef2f0 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f5801ba2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557a1cb1a420 con 0x557a1c8181b0 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbb8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbb8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35252/0 (socket says 172.21.15.80:35252) 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 -- 172.21.15.80:0/2103605569 learned_addr learned my addr 172.21.15.80:0/2103605569 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbb7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbb8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f1ffb640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e40afce0 0x7f57e40b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 -- 172.21.15.80:0/2103605569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 msgr2=0x557a1cbb7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbb7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 -- 172.21.15.80:0/2103605569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 msgr2=0x557a1cbb8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbb8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f3fff640 1 -- 172.21.15.80:0/2103605569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a1cae50d0 con 0x557a1c7f74d0 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f928f640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e40afce0 0x7f57e40b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.654+0000 7f57f1ffb640 1 -- 172.21.15.80:0/2977313990 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f57ec100680 con 0x7f57f4108f30 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.655+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbb8570 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f57e0006e10 tx=0x7f57e000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd67f597b2bd3989 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.655+0000 7f57deffd640 1 -- 172.21.15.80:0/2103605569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0018430 con 0x557a1c7f74d0 2024-04-25T11:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.655+0000 7f57deffd640 1 -- 172.21.15.80:0/2103605569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e0018a80 con 0x557a1c7f74d0 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.655+0000 7f57deffd640 1 -- 172.21.15.80:0/2103605569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0017760 con 0x557a1c7f74d0 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 -- 172.21.15.80:0/2103605569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 msgr2=0x557a1cbb8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f57f928f640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e40afce0 0x7f57e40b21f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0fde90 tx=0x7f57ec02a8e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbb8570 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f57e0006e10 tx=0x7f57e000a330 comp rx=0 tx=0).stop 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 -- 172.21.15.80:0/2103605569 shutdown_connections 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbb8570 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbb8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2103605569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbb7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 -- 172.21.15.80:0/2103605569 >> 172.21.15.80:0/2103605569 conn(0x557a1c80c300 msgr2=0x557a1cbb42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 -- 172.21.15.80:0/2103605569 shutdown_connections 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 -- 172.21.15.80:0/2103605569 wait complete. 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 -- start start 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.656+0000 7f5801ba2740 1 Processor -- start 2024-04-25T11:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbc2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbc80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f5801ba2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557a1cbc4bc0 con 0x557a1c7f74d0 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f5801ba2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557a1caa5b60 con 0x557a1c7ef2f0 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f5801ba2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557a1cbc4d40 con 0x557a1c8181b0 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f5801ba2740 10 client.0 _ll_register_callbacks cb 0x557a1caca2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbc2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbc2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35266/0 (socket says 172.21.15.80:35266) 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 -- 172.21.15.80:0/2484717385 learned_addr learned my addr 172.21.15.80:0/2484717385 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbc80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 -- 172.21.15.80:0/2484717385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 msgr2=0x557a1cbc80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbc80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 -- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 msgr2=0x557a1cbc21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 -- 172.21.15.80:0/2484717385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a1c830210 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbc80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbc2750 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f57e800bf60 tx=0x7f57e800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de21b781f6aa05eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.657+0000 7f57d3fff640 1 -- 172.21.15.80:0/2484717385 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8018020 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f57d3fff640 1 -- 172.21.15.80:0/2484717385 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f57e8014660 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57e0018a80 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f57d3fff640 1 -- 172.21.15.80:0/2484717385 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f57e8023050 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 10 client.15579 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557a1c8fc620 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f57d3fff640 1 -- 172.21.15.80:0/2484717385 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e0018a80 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f57d3fff640 1 -- 172.21.15.80:0/2484717385 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f57e80139f0 con 0x557a1c7f74d0 2024-04-25T11:24:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 10 client.15579 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 20 client.15579 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7d6d80 0x557a1cbd47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 4 client.15579 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a1cb2c070 con 0x557a1c7d6d80 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.658+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7d6d80 0x557a1cbd47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.659+0000 7f57d3fff640 10 client.15579 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.659+0000 7f57f3fff640 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7d6d80 0x557a1cbd47e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa1af34ef65214a server_cookie=5e527a87f88c6aa9 in_seq=0 out_seq=0 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f57d3fff640 1 -- 172.21.15.80:0/2484717385 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557a1cb2c070 con 0x557a1c7d6d80 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f57d3fff640 10 client.15579 handle_command_reply: tid=0 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 client.15579 shutdown 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 msgr2=0x557a1cbc2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbc2750 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f57e800bf60 tx=0x7f57e800bf90 comp rx=0 tx=0).stop 2024-04-25T11:24:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 shutdown_connections 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7d6d80 0x557a1cbd47e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbc2750 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c8181b0 0x557a1cbc80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f57d3fff640 0 client.15579 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 --2- 172.21.15.80:0/2484717385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 >> 172.21.15.80:0/2484717385 conn(0x557a1c80c300 msgr2=0x557a1cbb9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 shutdown_connections 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 1 -- 172.21.15.80:0/2484717385 wait complete. 2024-04-25T11:24:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.660+0000 7f5801ba2740 20 client.15579 trim_cache size 0 max 16384 2024-04-25T11:24:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.675+0000 7f5801ba2740 1 Processor -- start 2024-04-25T11:24:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.675+0000 7f5801ba2740 1 -- start start 2024-04-25T11:24:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7f74d0 0x557a1cbd9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 0x557a1cbda520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f5801ba2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41b1220 con 0x557a1c7ef2f0 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f5801ba2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41aeaf0 con 0x557a1c8181b0 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f5801ba2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41ac940 con 0x557a1c7f74d0 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35278/0 (socket says 172.21.15.80:35278) 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 -- 172.21.15.80:0/1456103242 learned_addr learned my addr 172.21.15.80:0/1456103242 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7f74d0 0x557a1cbd9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 -- 172.21.15.80:0/1456103242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7f74d0 msgr2=0x557a1cbd9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7f74d0 0x557a1cbd9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 -- 172.21.15.80:0/1456103242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 msgr2=0x557a1cbda520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 0x557a1cbda520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 -- 172.21.15.80:0/1456103242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a1cbc84f0 con 0x557a1c7ef2f0 2024-04-25T11:24:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57f3fff640 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc7fb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f57e0017450 tx=0x7f57e00173e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89a3c3149668bf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.676+0000 7f57de7fc640 1 -- 172.21.15.80:0/1456103242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e002f070 con 0x557a1c7ef2f0 2024-04-25T11:24:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f57de7fc640 1 -- 172.21.15.80:0/1456103242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e0018ae0 con 0x557a1c7ef2f0 2024-04-25T11:24:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f57de7fc640 1 -- 172.21.15.80:0/1456103242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0017d20 con 0x557a1c7ef2f0 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 -- 172.21.15.80:0/1456103242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7ef2f0 msgr2=0x557a1cbc7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc7fb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f57e0017450 tx=0x7f57e00173e0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 -- 172.21.15.80:0/1456103242 shutdown_connections 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 0x557a1cbda520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7f74d0 0x557a1cbd9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1456103242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc7fb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 -- 172.21.15.80:0/1456103242 >> 172.21.15.80:0/1456103242 conn(0x557a1c80c300 msgr2=0x557a1cbc08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 -- 172.21.15.80:0/1456103242 shutdown_connections 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.677+0000 7f5801ba2740 1 -- 172.21.15.80:0/1456103242 wait complete. 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 -- start start 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 Processor -- start 2024-04-25T11:24:47.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 0x557a1cbca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41acfb0 con 0x557a1c7f74d0 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41ae420 con 0x557a1c8181b0 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41ad680 con 0x557a1c7ef2f0 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f5801ba2740 10 client.0 _ll_register_callbacks cb 0x7f57e800b240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f57f8a8e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f57f8a8e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35284/0 (socket says 172.21.15.80:35284) 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f57f8a8e640 1 -- 172.21.15.80:0/1738241544 learned_addr learned my addr 172.21.15.80:0/1738241544 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.678+0000 7f57f3fff640 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57f3fff640 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 0x557a1cbca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57f8a8e640 1 -- 172.21.15.80:0/1738241544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7ef2f0 msgr2=0x557a1cbc9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57f8a8e640 1 -- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 msgr2=0x557a1cbca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 0x557a1cbca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57f8a8e640 1 -- 172.21.15.80:0/1738241544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a1cc3bd40 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57f8a8e640 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbca3e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x557a1cbae690 tx=0x7f57e80135f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f84c7cf4ebc1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57d3fff640 1 -- 172.21.15.80:0/1738241544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8018040 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57d3fff640 1 -- 172.21.15.80:0/1738241544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f57e8013b70 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57e0018ae0 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57d3fff640 1 -- 172.21.15.80:0/1738241544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f57e800fb00 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f5801ba2740 10 client.15585 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557a1cc3cfd0 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.679+0000 7f57d3fff640 1 -- 172.21.15.80:0/1738241544 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e0018ae0 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f57d3fff640 1 -- 172.21.15.80:0/1738241544 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f57e802f590 con 0x557a1c7f74d0 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f5801ba2740 10 client.15585 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:47.678 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f5801ba2740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f5801ba2740 20 client.15585 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7ac1c0 0x557a1cc3f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f5801ba2740 4 client.15585 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:24:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a1cb25ee0 con 0x557a1c7ac1c0 2024-04-25T11:24:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f57f3fff640 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7ac1c0 0x557a1cc3f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f57d3fff640 10 client.15585 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:47.679 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.680+0000 7f57f3fff640 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7ac1c0 0x557a1cc3f790 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c80cc7145daa334 server_cookie=7e29cc285b8f86dd in_seq=0 out_seq=0 2024-04-25T11:24:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f57d3fff640 1 -- 172.21.15.80:0/1738241544 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a1cb25ee0 con 0x557a1c7ac1c0 2024-04-25T11:24:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f57d3fff640 10 client.15585 handle_command_reply: tid=0 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 client.15585 shutdown 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 msgr2=0x557a1cbca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbca3e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x557a1cbae690 tx=0x7f57e80135f0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 shutdown_connections 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557a1c7ac1c0 0x557a1cc3f790 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557a1c7f74d0 0x557a1cbca3e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1c8181b0 0x557a1cbca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f57d3fff640 0 client.15585 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 --2- 172.21.15.80:0/1738241544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557a1c7ef2f0 0x557a1cbc9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.684+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 >> 172.21.15.80:0/1738241544 conn(0x557a1c80c300 msgr2=0x557a1cbc34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 shutdown_connections 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f5801ba2740 1 -- 172.21.15.80:0/1738241544 wait complete. 2024-04-25T11:24:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f5801ba2740 20 client.15585 trim_cache size 0 max 16384 2024-04-25T11:24:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:24:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:24:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:24:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e40afce0 msgr2=0x7f57e40b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e40afce0 0x7f57e40b21f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0fde90 tx=0x7f57ec02a8e0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f4108f30 msgr2=0x7f57f419dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f4108f30 0x7f57f419dfe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005cc0 tx=0x7f57ec003ba0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 shutdown_connections 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e40afce0 0x7f57e40b21f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f4108f30 0x7f57f419dfe0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f4108a90 0x7f57f4199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 --2- 172.21.15.80:0/2977313990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f41031e0 0x7f57f41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 >> 172.21.15.80:0/2977313990 conn(0x7f57f4078080 msgr2=0x7f57f40ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 shutdown_connections 2024-04-25T11:24:47.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:24:47.685+0000 7f57facf2640 1 -- 172.21.15.80:0/2977313990 wait complete. 2024-04-25T11:24:48.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:48 smithi196 ceph-mon[32659]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-25T11:24:48.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:48 smithi082 ceph-mon[32440]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-25T11:24:48.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:48 smithi080 ceph-mon[29126]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-25T11:24:49.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:24:49.498 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:24:49.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 -- 172.21.15.80:0/3275614209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f369810e570 msgr2=0x7f3698110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 --2- 172.21.15.80:0/3275614209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f369810e570 0x7f3698110990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3690009ca0 tx=0x7f369002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 -- 172.21.15.80:0/3275614209 shutdown_connections 2024-04-25T11:24:49.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 --2- 172.21.15.80:0/3275614209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f369810e570 0x7f3698110990 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 --2- 172.21.15.80:0/3275614209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3698102070 0x7f3698102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 --2- 172.21.15.80:0/3275614209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3698109bc0 0x7f3698101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 -- 172.21.15.80:0/3275614209 >> 172.21.15.80:0/3275614209 conn(0x7f3698077920 msgr2=0x7f3698077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 -- 172.21.15.80:0/3275614209 shutdown_connections 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 -- 172.21.15.80:0/3275614209 wait complete. 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 Processor -- start 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.628+0000 7f369dcb1640 1 -- start start 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f369dcb1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3698102070 0x7f3698102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f369dcb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3698109bc0 0x7f3698103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f369dcb1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f369810e570 0x7f3698103790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f369dcb1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3698113d30 con 0x7f3698109bc0 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f369dcb1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3698113bb0 con 0x7f3698102070 2024-04-25T11:24:49.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f369dcb1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3698113eb0 con 0x7f369810e570 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3698109bc0 0x7f3698103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3698109bc0 0x7f3698103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35300/0 (socket says 172.21.15.80:35300) 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 -- 172.21.15.80:0/1097918079 learned_addr learned my addr 172.21.15.80:0/1097918079 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f3697fff640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f369810e570 0x7f3698103790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f36977fe640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3698102070 0x7f3698102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 -- 172.21.15.80:0/1097918079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f369810e570 msgr2=0x7f3698103790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f369810e570 0x7f3698103790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 -- 172.21.15.80:0/1097918079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3698102070 msgr2=0x7f3698102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3698102070 0x7f3698102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f368effd640 1 -- 172.21.15.80:0/1097918079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36981a89c0 con 0x7f3698109bc0 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.629+0000 7f36977fe640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3698102070 0x7f3698102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.630+0000 7f368effd640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3698109bc0 0x7f3698103250 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f368000d770 tx=0x7f368000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.630+0000 7f36957fa640 1 -- 172.21.15.80:0/1097918079 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680017070 con 0x7f3698109bc0 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.630+0000 7f36957fa640 1 -- 172.21.15.80:0/1097918079 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3680009c30 con 0x7f3698109bc0 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.630+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36981a8cb0 con 0x7f3698109bc0 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.630+0000 7f36957fa640 1 -- 172.21.15.80:0/1097918079 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368000f620 con 0x7f3698109bc0 2024-04-25T11:24:49.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.630+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36981a91b0 con 0x7f3698109bc0 2024-04-25T11:24:49.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.632+0000 7f36957fa640 1 -- 172.21.15.80:0/1097918079 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f368001a070 con 0x7f3698109bc0 2024-04-25T11:24:49.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.632+0000 7f36a47fd740 1 Processor -- start 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.632+0000 7f36a47fd740 1 -- start start 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7cdfca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7cdfcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36a47fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562f7cd62d80 con 0x562f7ca5c390 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36a47fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f7cd1c8b0 con 0x562f7ca334d0 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36a47fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562f7cd5ed40 con 0x562f7ca3b6b0 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7cdfca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7cdfca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35308/0 (socket says 172.21.15.80:35308) 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 -- 172.21.15.80:0/3742340197 learned_addr learned my addr 172.21.15.80:0/3742340197 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36957fa640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36840afcf0 0x7f36840b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36977fe640 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7cdfcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f368effd640 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 -- 172.21.15.80:0/3742340197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 msgr2=0x562f7ce098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce098f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 -- 172.21.15.80:0/3742340197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 msgr2=0x562f7cdfcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7cdfcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 -- 172.21.15.80:0/3742340197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7cceda40 con 0x562f7ca5c390 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36977fe640 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7cdfcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f368effd640 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f36957fa640 1 -- 172.21.15.80:0/1097918079 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f36800ded70 con 0x7f3698109bc0 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36840afcf0 0x7f36840b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.633+0000 7f3697fff640 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7cdfca60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3690035000 tx=0x7f36900099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baad98164b0446ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.634+0000 7f368dffb640 1 -- 172.21.15.80:0/3742340197 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690042040 con 0x562f7ca5c390 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.634+0000 7f368dffb640 1 -- 172.21.15.80:0/3742340197 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3690036070 con 0x562f7ca5c390 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.634+0000 7f368dffb640 1 -- 172.21.15.80:0/3742340197 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369002f660 con 0x562f7ca5c390 2024-04-25T11:24:49.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.634+0000 7f36a47fd740 1 -- 172.21.15.80:0/3742340197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 msgr2=0x562f7cdfca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.634+0000 7f3697fff640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36840afcf0 0x7f36840b2200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f369004b000 tx=0x7f369004c000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.634+0000 7f36a47fd740 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7cdfca60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3690035000 tx=0x7f36900099b0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- 172.21.15.80:0/3742340197 shutdown_connections 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7cdfcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 --2- 172.21.15.80:0/3742340197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7cdfca60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- 172.21.15.80:0/3742340197 >> 172.21.15.80:0/3742340197 conn(0x562f7ca504e0 msgr2=0x562f7cdf9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- 172.21.15.80:0/3742340197 shutdown_connections 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- 172.21.15.80:0/3742340197 wait complete. 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- start start 2024-04-25T11:24:49.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 Processor -- start 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7ce075f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce07b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562f7ce09f80 con 0x562f7ca5c390 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f7cce9d10 con 0x562f7ca334d0 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.635+0000 7f36a47fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562f7ce0a100 con 0x562f7ca3b6b0 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f36a47fd740 10 client.0 _ll_register_callbacks cb 0x562f7cd16210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35320/0 (socket says 172.21.15.80:35320) 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f368effd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce07b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 -- 172.21.15.80:0/489463001 learned_addr learned my addr 172.21.15.80:0/489463001 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f36977fe640 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7ce075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 -- 172.21.15.80:0/489463001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 msgr2=0x562f7ce07b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce07b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 -- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 msgr2=0x562f7ce075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7ce075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 -- 172.21.15.80:0/489463001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7cb3e7d0 con 0x562f7ca5c390 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f368effd640 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce07b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3697fff640 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d3d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3690009a20 tx=0x7f3690004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c805041be290e1c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3676ffd640 1 -- 172.21.15.80:0/489463001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369005f060 con 0x562f7ca5c390 2024-04-25T11:24:49.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f3676ffd640 1 -- 172.21.15.80:0/489463001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f3690004040 con 0x562f7ca5c390 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.636+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3690036070 con 0x562f7ca5c390 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f3676ffd640 1 -- 172.21.15.80:0/489463001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3690055070 con 0x562f7ca5c390 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 10 client.15597 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562f7ca743f0 con 0x562f7ca5c390 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f3676ffd640 1 -- 172.21.15.80:0/489463001 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3690036070 con 0x562f7ca5c390 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f3676ffd640 1 -- 172.21.15.80:0/489463001 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f36900305c0 con 0x562f7ca5c390 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 10 client.15597 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 20 client.15597 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7ca1af60 0x562f7ce19430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 4 client.15597 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f7cd70990 con 0x562f7ca1af60 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.637+0000 7f36977fe640 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7ca1af60 0x562f7ce19430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.638+0000 7f3676ffd640 10 client.15597 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.638+0000 7f36977fe640 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7ca1af60 0x562f7ce19430 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ce56ecc02063353 server_cookie=f8ac57ac92b26e93 in_seq=0 out_seq=0 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.638+0000 7f3676ffd640 1 -- 172.21.15.80:0/489463001 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562f7cd70990 con 0x562f7ca1af60 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.638+0000 7f3676ffd640 10 client.15597 handle_command_reply: tid=0 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.638+0000 7f36a47fd740 1 client.15597 shutdown 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 msgr2=0x562f7ce0d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d3d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3690009a20 tx=0x7f3690004630 comp rx=0 tx=0).stop 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 shutdown_connections 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7ca1af60 0x562f7ce19430 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d3d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca3b6b0 0x562f7ce07b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 --2- 172.21.15.80:0/489463001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca334d0 0x562f7ce075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f3676ffd640 0 client.15597 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 >> 172.21.15.80:0/489463001 conn(0x562f7ca504e0 msgr2=0x562f7cdfe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:49.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 shutdown_connections 2024-04-25T11:24:49.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 1 -- 172.21.15.80:0/489463001 wait complete. 2024-04-25T11:24:49.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.639+0000 7f36a47fd740 20 client.15597 trim_cache size 0 max 16384 2024-04-25T11:24:49.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 Processor -- start 2024-04-25T11:24:49.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 -- start start 2024-04-25T11:24:49.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce09230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca3b6b0 0x562f7ce0d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f36981b4510 con 0x562f7ca5c390 2024-04-25T11:24:49.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36981b1de0 con 0x562f7ca3b6b0 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36a47fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f36981afc30 con 0x562f7ca334d0 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35326/0 (socket says 172.21.15.80:35326) 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 -- 172.21.15.80:0/2136055515 learned_addr learned my addr 172.21.15.80:0/2136055515 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f368effd640 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca3b6b0 0x562f7ce0d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f36977fe640 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce09230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 -- 172.21.15.80:0/2136055515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 msgr2=0x562f7ce09230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce09230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 -- 172.21.15.80:0/2136055515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca3b6b0 msgr2=0x562f7ce0d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca3b6b0 0x562f7ce0d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 -- 172.21.15.80:0/2136055515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7ca340f0 con 0x562f7ca5c390 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f368effd640 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca3b6b0 0x562f7ce0d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:49.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.657+0000 7f3697fff640 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d900 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3690030990 tx=0x7f369002f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0122c7b922dfbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f368d7fa640 1 -- 172.21.15.80:0/2136055515 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690042070 con 0x562f7ca5c390 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f368d7fa640 1 -- 172.21.15.80:0/2136055515 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3690036070 con 0x562f7ca5c390 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f368d7fa640 1 -- 172.21.15.80:0/2136055515 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369005f040 con 0x562f7ca5c390 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 -- 172.21.15.80:0/2136055515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 msgr2=0x562f7ce0d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d900 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3690030990 tx=0x7f369002f310 comp rx=0 tx=0).stop 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 -- 172.21.15.80:0/2136055515 shutdown_connections 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca5c390 0x562f7ce0d900 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca3b6b0 0x562f7ce0d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2136055515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce09230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 -- 172.21.15.80:0/2136055515 >> 172.21.15.80:0/2136055515 conn(0x562f7ca504e0 msgr2=0x562f7ce08b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.658+0000 7f36a47fd740 1 -- 172.21.15.80:0/2136055515 shutdown_connections 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 -- 172.21.15.80:0/2136055515 wait complete. 2024-04-25T11:24:49.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 -- start start 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 Processor -- start 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce14020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca3b6b0 0x562f7ce123a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca5c390 0x562f7ce12960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f36981b02a0 con 0x562f7ca3b6b0 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36981b1710 con 0x562f7ca5c390 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f36981b0970 con 0x562f7ca334d0 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f36a47fd740 10 client.0 _ll_register_callbacks cb 0x7f3690009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f368effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca3b6b0 0x562f7ce123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f368effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca3b6b0 0x562f7ce123a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35338/0 (socket says 172.21.15.80:35338) 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.659+0000 7f368effd640 1 -- 172.21.15.80:0/2944708318 learned_addr learned my addr 172.21.15.80:0/2944708318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f36977fe640 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce14020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f3697fff640 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca5c390 0x562f7ce12960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f368effd640 1 -- 172.21.15.80:0/2944708318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 msgr2=0x562f7ce14020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f368effd640 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce14020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f368effd640 1 -- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca5c390 msgr2=0x562f7ce12960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f368effd640 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca5c390 0x562f7ce12960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f368effd640 1 -- 172.21.15.80:0/2944708318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7cd234b0 con 0x562f7ca3b6b0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f368effd640 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca3b6b0 0x562f7ce123a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f36800dc440 tx=0x7f368000df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734a555fdd2e8c41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f3676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f3676ffd640 1 -- 172.21.15.80:0/2944708318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680021040 con 0x562f7ca3b6b0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3690036070 con 0x562f7ca3b6b0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f3676ffd640 1 -- 172.21.15.80:0/2944708318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f36800dcdd0 con 0x562f7ca3b6b0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f3676ffd640 1 -- 172.21.15.80:0/2944708318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f36800a66a0 con 0x562f7ca3b6b0 2024-04-25T11:24:49.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f36a47fd740 10 client.15603 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562f7ce80340 con 0x562f7ca3b6b0 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f3676ffd640 1 -- 172.21.15.80:0/2944708318 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3690036070 con 0x562f7ca3b6b0 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.660+0000 7f3676ffd640 1 -- 172.21.15.80:0/2944708318 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f36800a2020 con 0x562f7ca3b6b0 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36a47fd740 10 client.15603 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36a47fd740 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36a47fd740 20 client.15603 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7c9f03a0 0x562f7ce82ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36a47fd740 4 client.15603 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f7cdfd330 con 0x562f7c9f03a0 2024-04-25T11:24:49.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36977fe640 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7c9f03a0 0x562f7ce82ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f3676ffd640 10 client.15603 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36977fe640 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7c9f03a0 0x562f7ce82ad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dca4acae0c0425c server_cookie=cfc2eb714cd688e9 in_seq=0 out_seq=0 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f3676ffd640 1 -- 172.21.15.80:0/2944708318 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562f7cdfd330 con 0x562f7c9f03a0 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f3676ffd640 10 client.15603 handle_command_reply: tid=0 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.661+0000 7f36a47fd740 1 client.15603 shutdown 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca3b6b0 msgr2=0x562f7ce123a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca3b6b0 0x562f7ce123a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f36800dc440 tx=0x7f368000df10 comp rx=0 tx=0).stop 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 shutdown_connections 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562f7c9f03a0 0x562f7ce82ad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562f7ca3b6b0 0x562f7ce123a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7ca5c390 0x562f7ce12960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f3676ffd640 0 client.15603 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:49.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 --2- 172.21.15.80:0/2944708318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562f7ca334d0 0x562f7ce14020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 >> 172.21.15.80:0/2944708318 conn(0x562f7ca504e0 msgr2=0x562f7ce09400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 shutdown_connections 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 1 -- 172.21.15.80:0/2944708318 wait complete. 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f36a47fd740 20 client.15603 trim_cache size 0 max 16384 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:24:49.663 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:49.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36840afcf0 msgr2=0x7f36840b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36840afcf0 0x7f36840b2200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f369004b000 tx=0x7f369004c000 comp rx=0 tx=0).stop 2024-04-25T11:24:49.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3698109bc0 msgr2=0x7f3698103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3698109bc0 0x7f3698103250 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f368000d770 tx=0x7f368000dc30 comp rx=0 tx=0).stop 2024-04-25T11:24:49.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 shutdown_connections 2024-04-25T11:24:49.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36840afcf0 0x7f36840b2200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3698109bc0 0x7f3698103250 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f369810e570 0x7f3698103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.662+0000 7f369dcb1640 1 --2- 172.21.15.80:0/1097918079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3698102070 0x7f3698102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.663+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 >> 172.21.15.80:0/1097918079 conn(0x7f3698077920 msgr2=0x7f369810a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:49.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.663+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 shutdown_connections 2024-04-25T11:24:49.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.663+0000 7f369dcb1640 1 -- 172.21.15.80:0/1097918079 wait complete. 2024-04-25T11:24:49.667 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:24:49.668 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:24:49.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 -- 172.21.15.80:0/954144454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc1027d0 msgr2=0x7fd6cc110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 --2- 172.21.15.80:0/954144454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc1027d0 0x7fd6cc110650 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009900 tx=0x7fd6bc02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:49.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 -- 172.21.15.80:0/954144454 shutdown_connections 2024-04-25T11:24:49.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 --2- 172.21.15.80:0/954144454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc1027d0 0x7fd6cc110650 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 --2- 172.21.15.80:0/954144454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6cc109fd0 0x7fd6cc102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 --2- 172.21.15.80:0/954144454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc109b30 0x7fd6cc101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 -- 172.21.15.80:0/954144454 >> 172.21.15.80:0/954144454 conn(0x7fd6cc0fd850 msgr2=0x7fd6cc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:49.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 -- 172.21.15.80:0/954144454 shutdown_connections 2024-04-25T11:24:49.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.782+0000 7fd6d1634640 1 -- 172.21.15.80:0/954144454 wait complete. 2024-04-25T11:24:49.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 Processor -- start 2024-04-25T11:24:49.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 -- start start 2024-04-25T11:24:49.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc109b30 0x7fd6cc199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6cc19a440 0x7fd6cc19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc19ec60 0x7fd6cc19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc113d40 con 0x7fd6cc19ec60 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc113bc0 con 0x7fd6cc109b30 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6d1634640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc113ec0 con 0x7fd6cc19a440 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc19ec60 0x7fd6cc19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc19ec60 0x7fd6cc19f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35358/0 (socket says 172.21.15.80:35358) 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 -- 172.21.15.80:0/539435497 learned_addr learned my addr 172.21.15.80:0/539435497 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6caffd640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc109b30 0x7fd6cc199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6ca7fc640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6cc19a440 0x7fd6cc19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 -- 172.21.15.80:0/539435497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6cc19a440 msgr2=0x7fd6cc19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6cc19a440 0x7fd6cc19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 -- 172.21.15.80:0/539435497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc109b30 msgr2=0x7fd6cc199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc109b30 0x7fd6cc199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:49.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6cb7fe640 1 -- 172.21.15.80:0/539435497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc1a69d0 con 0x7fd6cc19ec60 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6ca7fc640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6cc19a440 0x7fd6cc19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.783+0000 7fd6caffd640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc109b30 0x7fd6cc199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.784+0000 7fd6cb7fe640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc19ec60 0x7fd6cc19f070 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc004770 tx=0x7fd6bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.784+0000 7fd6b3fff640 1 -- 172.21.15.80:0/539435497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc03f030 con 0x7fd6cc19ec60 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.784+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc1a6ba0 con 0x7fd6cc19ec60 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.784+0000 7fd6b3fff640 1 -- 172.21.15.80:0/539435497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6bc003aa0 con 0x7fd6cc19ec60 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.784+0000 7fd6b3fff640 1 -- 172.21.15.80:0/539435497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc035070 con 0x7fd6cc19ec60 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.784+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc1a7000 con 0x7fd6cc19ec60 2024-04-25T11:24:49.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.785+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6cc06a190 con 0x7fd6cc19ec60 2024-04-25T11:24:49.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.786+0000 7fd6b3fff640 1 -- 172.21.15.80:0/539435497 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fd6bc042030 con 0x7fd6cc19ec60 2024-04-25T11:24:49.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.787+0000 7fd6b3fff640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd6b40afcf0 0x7fd6b40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:49.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.787+0000 7fd6caffd640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd6b40afcf0 0x7fd6b40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:49.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.787+0000 7fd6b3fff640 1 -- 172.21.15.80:0/539435497 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fd6bc0ffc40 con 0x7fd6cc19ec60 2024-04-25T11:24:49.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.787+0000 7fd6caffd640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd6b40afcf0 0x7fd6b40b2200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4005fd0 tx=0x7fd6c400b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:49.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:49.791+0000 7fd6b3fff640 1 -- 172.21.15.80:0/539435497 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd6bc0c8380 con 0x7fd6cc19ec60 2024-04-25T11:24:50.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.008+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6cc1a72c0 con 0x7fd6cc19ec60 2024-04-25T11:24:50.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.009+0000 7fd6b3fff640 1 -- 172.21.15.80:0/539435497 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7fd6bc0d0400 con 0x7fd6cc19ec60 2024-04-25T11:24:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:24:50.003 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:24:12.817395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2620156093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2620156093},{"type":"v1","addr":"172.21.15.196:6837","nonce":2620156093}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24521,24476,24499]},"id":1}]} 2024-04-25T11:24:50.003 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-04-25T11:24:50.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd6b40afcf0 msgr2=0x7fd6b40b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd6b40afcf0 0x7fd6b40b2200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4005fd0 tx=0x7fd6c400b5f0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc19ec60 msgr2=0x7fd6cc19f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc19ec60 0x7fd6cc19f070 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc004770 tx=0x7fd6bc004270 comp rx=0 tx=0).stop 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 shutdown_connections 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd6b40afcf0 0x7fd6b40b2200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6cc19ec60 0x7fd6cc19f070 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6cc19a440 0x7fd6cc19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 --2- 172.21.15.80:0/539435497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6cc109b30 0x7fd6cc199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 >> 172.21.15.80:0/539435497 conn(0x7fd6cc0fd850 msgr2=0x7fd6cc107200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 shutdown_connections 2024-04-25T11:24:50.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.011+0000 7fd6d1634640 1 -- 172.21.15.80:0/539435497 wait complete. 2024-04-25T11:24:50.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 -- 172.21.15.80:0/3787179765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 msgr2=0x7fac24102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 --2- 172.21.15.80:0/3787179765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac24102170 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fac14009900 tx=0x7fac1402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 -- 172.21.15.80:0/3787179765 shutdown_connections 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 --2- 172.21.15.80:0/3787179765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac24102170 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 --2- 172.21.15.80:0/3787179765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac241027e0 0x7fac24110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 --2- 172.21.15.80:0/3787179765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac24109b40 0x7fac24101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 -- 172.21.15.80:0/3787179765 >> 172.21.15.80:0/3787179765 conn(0x7fac24077920 msgr2=0x7fac24077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 -- 172.21.15.80:0/3787179765 shutdown_connections 2024-04-25T11:24:50.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 -- 172.21.15.80:0/3787179765 wait complete. 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 Processor -- start 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.135+0000 7fac2c308640 1 -- start start 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2c308640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac241027e0 0x7fac2419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2c308640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac24109b40 0x7fac2419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2c308640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac2419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2c308640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fac24113d30 con 0x7fac24109fe0 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2c308640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac24113bb0 con 0x7fac24109b40 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2c308640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fac24113eb0 con 0x7fac241027e0 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac2419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac2419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35380/0 (socket says 172.21.15.80:35380) 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 -- 172.21.15.80:0/1118654154 learned_addr learned my addr 172.21.15.80:0/1118654154 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac241027e0 0x7fac2419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac298a3640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac24109b40 0x7fac2419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 -- 172.21.15.80:0/1118654154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac241027e0 msgr2=0x7fac2419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac241027e0 0x7fac2419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 -- 172.21.15.80:0/1118654154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac24109b40 msgr2=0x7fac2419ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac24109b40 0x7fac2419ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 -- 172.21.15.80:0/1118654154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2419f650 con 0x7fac24109fe0 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac241027e0 0x7fac2419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac298a3640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac24109b40 0x7fac2419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac2a8a5640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac2419f010 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c970 tx=0x7fac1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.136+0000 7fac1b7fe640 1 -- 172.21.15.80:0/1118654154 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c007bb0 con 0x7fac24109fe0 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.137+0000 7fac1b7fe640 1 -- 172.21.15.80:0/1118654154 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac1c007d50 con 0x7fac24109fe0 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.137+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2419f940 con 0x7fac24109fe0 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.137+0000 7fac1b7fe640 1 -- 172.21.15.80:0/1118654154 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c004e60 con 0x7fac24109fe0 2024-04-25T11:24:50.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.137+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2419fe40 con 0x7fac24109fe0 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.140+0000 7fac331b6740 1 Processor -- start 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.140+0000 7fac1b7fe640 1 -- 172.21.15.80:0/1118654154 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fac1c005020 con 0x7fac24109fe0 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.140+0000 7fac331b6740 1 -- start start 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac331b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d49a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac331b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d49ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac331b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d4a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac331b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56290d3ffd80 con 0x56290d0d86b0 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac331b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56290d3b9a20 con 0x56290d0f9390 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac331b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56290d3fbd40 con 0x56290d0d04d0 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac298a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d4a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac1b7fe640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fac100afcf0 0x7fac100b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac298a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d4a76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35386/0 (socket says 172.21.15.80:35386) 2024-04-25T11:24:50.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac298a3640 1 -- 172.21.15.80:0/2190757155 learned_addr learned my addr 172.21.15.80:0/2190757155 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d49ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac298a3640 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d49a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a8a5640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fac100afcf0 0x7fac100b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac1b7fe640 1 -- 172.21.15.80:0/1118654154 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fac1c0def10 con 0x7fac24109fe0 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a0a4640 1 -- 172.21.15.80:0/2190757155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 msgr2=0x56290d49a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d49a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a0a4640 1 -- 172.21.15.80:0/2190757155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 msgr2=0x56290d4a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d4a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a0a4640 1 -- 172.21.15.80:0/2190757155 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290d3c4c30 con 0x56290d0d04d0 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.141+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d49ad50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac2000adf0 tx=0x7fac2000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac5f36c08cb0b85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.142+0000 7fac2a8a5640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fac100afcf0 0x7fac100b2200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0dc610 tx=0x7fac1c09b840 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.142+0000 7fac18bfe640 1 -- 172.21.15.80:0/2190757155 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20004b20 con 0x56290d0d04d0 2024-04-25T11:24:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.142+0000 7fac18bfe640 1 -- 172.21.15.80:0/2190757155 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac20004cc0 con 0x56290d0d04d0 2024-04-25T11:24:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.142+0000 7fac18bfe640 1 -- 172.21.15.80:0/2190757155 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac200054e0 con 0x56290d0d04d0 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 -- 172.21.15.80:0/2190757155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 msgr2=0x56290d49ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d49ad50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac2000adf0 tx=0x7fac2000f730 comp rx=0 tx=0).stop 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 -- 172.21.15.80:0/2190757155 shutdown_connections 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d4a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d49ad50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 --2- 172.21.15.80:0/2190757155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d49a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 -- 172.21.15.80:0/2190757155 >> 172.21.15.80:0/2190757155 conn(0x56290d0ed4e0 msgr2=0x56290d496fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 -- 172.21.15.80:0/2190757155 shutdown_connections 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.143+0000 7fac331b6740 1 -- 172.21.15.80:0/2190757155 wait complete. 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 -- start start 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 Processor -- start 2024-04-25T11:24:50.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0f9390 0x56290d4b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56290d4a7d90 con 0x56290d0f9390 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56290d386dc0 con 0x56290d0d86b0 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56290d4a7f10 con 0x56290d0d04d0 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac331b6740 10 client.0 _ll_register_callbacks cb 0x56290d3a2600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac298a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0f9390 0x56290d4b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac298a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0f9390 0x56290d4b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35398/0 (socket says 172.21.15.80:35398) 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac298a3640 1 -- 172.21.15.80:0/3480576040 learned_addr learned my addr 172.21.15.80:0/3480576040 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.144+0000 7fac298a3640 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac298a3640 1 -- 172.21.15.80:0/3480576040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 msgr2=0x56290d4a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac298a3640 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac298a3640 1 -- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 msgr2=0x56290d4a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac298a3640 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac298a3640 1 -- 172.21.15.80:0/3480576040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290d1113f0 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac298a3640 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0f9390 0x56290d4b1210 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fac14033000 tx=0x7fac1402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae64427536ffd4e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac0dffb640 1 -- 172.21.15.80:0/3480576040 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14035040 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac0dffb640 1 -- 172.21.15.80:0/3480576040 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fac140037f0 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac20004cc0 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac0dffb640 1 -- 172.21.15.80:0/3480576040 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fac14052050 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac331b6740 10 client.15621 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56290d1db7d0 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac0dffb640 1 -- 172.21.15.80:0/3480576040 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac20004cc0 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac0dffb640 1 -- 172.21.15.80:0/3480576040 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fac1403a070 con 0x56290d0f9390 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac331b6740 10 client.15621 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.145+0000 7fac331b6740 10 client.15621 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.146+0000 7fac331b6740 20 client.15621 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:50.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.146+0000 7fac331b6740 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d0b7f60 0x56290d4b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.146+0000 7fac331b6740 4 client.15621 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.146+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56290d40d990 con 0x56290d0b7f60 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.146+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d0b7f60 0x56290d4b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.146+0000 7fac0dffb640 10 client.15621 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.146+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d0b7f60 0x56290d4b7610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8473b92a81369931 server_cookie=6e643b7fb36d2ad5 in_seq=0 out_seq=0 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac0dffb640 1 -- 172.21.15.80:0/3480576040 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56290d40d990 con 0x56290d0b7f60 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac0dffb640 10 client.15621 handle_command_reply: tid=0 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 client.15621 shutdown 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0f9390 msgr2=0x56290d4b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0f9390 0x56290d4b1210 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fac14033000 tx=0x7fac1402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 shutdown_connections 2024-04-25T11:24:50.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d0b7f60 0x56290d4b7610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0f9390 0x56290d4b1210 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac0dffb640 0 client.15621 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 --2- 172.21.15.80:0/3480576040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 >> 172.21.15.80:0/3480576040 conn(0x56290d0ed4e0 msgr2=0x56290d49c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 shutdown_connections 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.147+0000 7fac331b6740 1 -- 172.21.15.80:0/3480576040 wait complete. 2024-04-25T11:24:50.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.148+0000 7fac331b6740 20 client.15621 trim_cache size 0 max 16384 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 Processor -- start 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 -- start start 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d496ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d4b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fac241b2380 con 0x56290d0d86b0 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac241afc50 con 0x56290d0f9390 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac331b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fac241adaa0 con 0x56290d0d04d0 2024-04-25T11:24:50.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac2a0a4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d496ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac2a0a4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d496ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35400/0 (socket says 172.21.15.80:35400) 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac2a0a4640 1 -- 172.21.15.80:0/3901664930 learned_addr learned my addr 172.21.15.80:0/3901664930 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.161+0000 7fac298a3640 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d4b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac298a3640 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac2a0a4640 1 -- 172.21.15.80:0/3901664930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 msgr2=0x56290d4a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac2a0a4640 1 -- 172.21.15.80:0/3901664930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 msgr2=0x56290d4b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d4b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac2a0a4640 1 -- 172.21.15.80:0/3901664930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290d4a5f80 con 0x56290d0d86b0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac298a3640 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d496ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac20013020 tx=0x7fac2000aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22e403ccc40dea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac0ffff640 1 -- 172.21.15.80:0/3901664930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20004be0 con 0x56290d0d86b0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac0ffff640 1 -- 172.21.15.80:0/3901664930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac20004d80 con 0x56290d0d86b0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac0ffff640 1 -- 172.21.15.80:0/3901664930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20005680 con 0x56290d0d86b0 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac331b6740 1 -- 172.21.15.80:0/3901664930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 msgr2=0x56290d496ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.162+0000 7fac331b6740 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d496ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac20013020 tx=0x7fac2000aa90 comp rx=0 tx=0).stop 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- 172.21.15.80:0/3901664930 shutdown_connections 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d86b0 0x56290d496ed0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0f9390 0x56290d4b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 --2- 172.21.15.80:0/3901664930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0d04d0 0x56290d4a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- 172.21.15.80:0/3901664930 >> 172.21.15.80:0/3901664930 conn(0x56290d0ed4e0 msgr2=0x56290d4967c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- 172.21.15.80:0/3901664930 shutdown_connections 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- 172.21.15.80:0/3901664930 wait complete. 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- start start 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 Processor -- start 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d04d0 0x56290d4ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0f9390 0x56290d4a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fac241ae110 con 0x56290d0d04d0 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac241af580 con 0x56290d0d86b0 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fac241ae7e0 con 0x56290d0f9390 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac331b6740 10 client.0 _ll_register_callbacks cb 0x7fac14004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac298a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d04d0 0x56290d4ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac298a3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d04d0 0x56290d4ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35412/0 (socket says 172.21.15.80:35412) 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.163+0000 7fac298a3640 1 -- 172.21.15.80:0/2712048076 learned_addr learned my addr 172.21.15.80:0/2712048076 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac298a3640 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0f9390 0x56290d4a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac298a3640 1 -- 172.21.15.80:0/2712048076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0f9390 msgr2=0x56290d4a8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac298a3640 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0f9390 0x56290d4a8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac298a3640 1 -- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 msgr2=0x56290d4a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac298a3640 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac298a3640 1 -- 172.21.15.80:0/2712048076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290d4a9290 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac298a3640 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d04d0 0x56290d4ad4c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fac1403ed60 tx=0x7fac1402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0709ead01c41d5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac0dffb640 1 -- 172.21.15.80:0/2712048076 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14035040 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac0dffb640 1 -- 172.21.15.80:0/2712048076 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fac140035f0 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac20004d80 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac0dffb640 1 -- 172.21.15.80:0/2712048076 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fac1403e930 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 10 client.15627 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56290d51f530 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac0dffb640 1 -- 172.21.15.80:0/2712048076 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac20004d80 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac0dffb640 1 -- 172.21.15.80:0/2712048076 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fac1403a050 con 0x56290d0d04d0 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 10 client.15627 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 10 client.15627 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 20 client.15627 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d08d3a0 0x56290d521c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 4 client.15627 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.164+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56290d407800 con 0x56290d08d3a0 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d08d3a0 0x56290d521c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac0dffb640 10 client.15627 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac2a0a4640 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d08d3a0 0x56290d521c90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdec4e0752403b44 server_cookie=48495e3070695c44 in_seq=0 out_seq=0 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac0dffb640 1 -- 172.21.15.80:0/2712048076 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56290d407800 con 0x56290d08d3a0 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac0dffb640 10 client.15627 handle_command_reply: tid=0 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 client.15627 shutdown 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d04d0 msgr2=0x56290d4ad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d04d0 0x56290d4ad4c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fac1403ed60 tx=0x7fac1402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 shutdown_connections 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x56290d08d3a0 0x56290d521c90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56290d0f9390 0x56290d4a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56290d0d86b0 0x56290d4a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac0dffb640 0 client.15627 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:24:50.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 --2- 172.21.15.80:0/2712048076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56290d0d04d0 0x56290d4ad4c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 >> 172.21.15.80:0/2712048076 conn(0x56290d0ed4e0 msgr2=0x56290d495610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.165+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 shutdown_connections 2024-04-25T11:24:50.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac331b6740 1 -- 172.21.15.80:0/2712048076 wait complete. 2024-04-25T11:24:50.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac331b6740 20 client.15627 trim_cache size 0 max 16384 2024-04-25T11:24:50.166 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:24:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fac100afcf0 msgr2=0x7fac100b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fac100afcf0 0x7fac100b2200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0dc610 tx=0x7fac1c09b840 comp rx=0 tx=0).stop 2024-04-25T11:24:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 msgr2=0x7fac2419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac2419f010 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c970 tx=0x7fac1c00ce30 comp rx=0 tx=0).stop 2024-04-25T11:24:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 shutdown_connections 2024-04-25T11:24:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fac100afcf0 0x7fac100b2200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac24109fe0 0x7fac2419f010 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac24109b40 0x7fac2419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 --2- 172.21.15.80:0/1118654154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac241027e0 0x7fac2419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 >> 172.21.15.80:0/1118654154 conn(0x7fac24077920 msgr2=0x7fac24105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 shutdown_connections 2024-04-25T11:24:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.166+0000 7fac2c308640 1 -- 172.21.15.80:0/1118654154 wait complete. 2024-04-25T11:24:50.171 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:24:50.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 -- 172.21.15.80:0/3587072878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109fb0 msgr2=0x7fca74103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 --2- 172.21.15.80:0/3587072878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109fb0 0x7fca74103bf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fca68009900 tx=0x7fca6802a410 comp rx=0 tx=0).stop 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 -- 172.21.15.80:0/3587072878 shutdown_connections 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 --2- 172.21.15.80:0/3587072878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109fb0 0x7fca74103bf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 --2- 172.21.15.80:0/3587072878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca74104260 0x7fca74110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 --2- 172.21.15.80:0/3587072878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74109b10 0x7fca741036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 -- 172.21.15.80:0/3587072878 >> 172.21.15.80:0/3587072878 conn(0x7fca740ff210 msgr2=0x7fca74101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 -- 172.21.15.80:0/3587072878 shutdown_connections 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 -- 172.21.15.80:0/3587072878 wait complete. 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 Processor -- start 2024-04-25T11:24:50.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.287+0000 7fca79cb1640 1 -- start start 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca79cb1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74104260 0x7fca741a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca79cb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109b10 0x7fca741a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca79cb1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca74109fb0 0x7fca7419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca79cb1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fca74113d00 con 0x7fca74109b10 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca79cb1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca74113b80 con 0x7fca74104260 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca79cb1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fca74113e80 con 0x7fca74109fb0 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109b10 0x7fca741a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109b10 0x7fca741a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35432/0 (socket says 172.21.15.80:35432) 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 -- 172.21.15.80:0/2327664664 learned_addr learned my addr 172.21.15.80:0/2327664664 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca737fe640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74104260 0x7fca741a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca73fff640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca74109fb0 0x7fca7419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 -- 172.21.15.80:0/2327664664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca74109fb0 msgr2=0x7fca7419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca74109fb0 0x7fca7419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 -- 172.21.15.80:0/2327664664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74104260 msgr2=0x7fca741a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74104260 0x7fca741a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 -- 172.21.15.80:0/2327664664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7419acc0 con 0x7fca74109b10 2024-04-25T11:24:50.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca72ffd640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109b10 0x7fca741a0a40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fca6802a930 tx=0x7fca68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.288+0000 7fca70ff9640 1 -- 172.21.15.80:0/2327664664 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6803f030 con 0x7fca74109b10 2024-04-25T11:24:50.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.289+0000 7fca70ff9640 1 -- 172.21.15.80:0/2327664664 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca68003aa0 con 0x7fca74109b10 2024-04-25T11:24:50.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.289+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7419af50 con 0x7fca74109b10 2024-04-25T11:24:50.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.289+0000 7fca70ff9640 1 -- 172.21.15.80:0/2327664664 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68035070 con 0x7fca74109b10 2024-04-25T11:24:50.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.289+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7419b440 con 0x7fca74109b10 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 Processor -- start 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 -- start start 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca70ff9640 1 -- 172.21.15.80:0/2327664664 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fca68042030 con 0x7fca74109b10 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f6064c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6064cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f606596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558f605b1d80 con 0x558f602824d0 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558f6056ba20 con 0x558f602ab390 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.291+0000 7fca80c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558f605add40 con 0x558f6028a6b0 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6064cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6064cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35444/0 (socket says 172.21.15.80:35444) 2024-04-25T11:24:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 -- 172.21.15.80:0/4099155033 learned_addr learned my addr 172.21.15.80:0/4099155033 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca73fff640 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f6064c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca72ffd640 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f606596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 -- 172.21.15.80:0/4099155033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 msgr2=0x558f606596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f606596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 -- 172.21.15.80:0/4099155033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 msgr2=0x558f6064c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f6064c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca70ff9640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fca5c0afcf0 0x7fca5c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 -- 172.21.15.80:0/4099155033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f60576c30 con 0x558f602824d0 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca72ffd640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fca5c0afcf0 0x7fca5c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca737fe640 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6064cd50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fca6400bc10 tx=0x7fca6400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c1c503fbd7ce67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca70ff9640 1 -- 172.21.15.80:0/2327664664 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fca680ff950 con 0x7fca74109b10 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca59ffb640 1 -- 172.21.15.80:0/4099155033 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64015070 con 0x558f602824d0 2024-04-25T11:24:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca59ffb640 1 -- 172.21.15.80:0/4099155033 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca640118f0 con 0x558f602824d0 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.292+0000 7fca59ffb640 1 -- 172.21.15.80:0/4099155033 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64010770 con 0x558f602824d0 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 -- 172.21.15.80:0/4099155033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 msgr2=0x558f6064cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca72ffd640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fca5c0afcf0 0x7fca5c0b2200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca680fd050 tx=0x7fca680ea040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6064cd50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fca6400bc10 tx=0x7fca6400f730 comp rx=0 tx=0).stop 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 -- 172.21.15.80:0/4099155033 shutdown_connections 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6064cd50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f606596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 --2- 172.21.15.80:0/4099155033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f6064c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 -- 172.21.15.80:0/4099155033 >> 172.21.15.80:0/4099155033 conn(0x558f6029f4e0 msgr2=0x558f60648fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 -- 172.21.15.80:0/4099155033 shutdown_connections 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.293+0000 7fca80c3a740 1 -- 172.21.15.80:0/4099155033 wait complete. 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 -- start start 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 Processor -- start 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f606572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f60657830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f60663210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558f60659d90 con 0x558f602824d0 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558f60538dc0 con 0x558f602ab390 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558f60659f10 con 0x558f6028a6b0 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca80c3a740 10 client.0 _ll_register_callbacks cb 0x558f60554600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca73fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f606572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca73fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f606572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35450/0 (socket says 172.21.15.80:35450) 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca73fff640 1 -- 172.21.15.80:0/1989060981 learned_addr learned my addr 172.21.15.80:0/1989060981 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca737fe640 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f60657830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.294+0000 7fca73fff640 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f60663210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca73fff640 1 -- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 msgr2=0x558f60657830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca73fff640 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f60657830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca73fff640 1 -- 172.21.15.80:0/1989060981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 msgr2=0x558f60663210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca73fff640 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f60663210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca73fff640 1 -- 172.21.15.80:0/1989060981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f602c33f0 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca73fff640 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f606572f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fca6c007650 tx=0x7fca6c007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384437312bf705d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca52ffd640 1 -- 172.21.15.80:0/1989060981 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c013130 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca52ffd640 1 -- 172.21.15.80:0/1989060981 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fca6c003970 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca640118f0 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca52ffd640 1 -- 172.21.15.80:0/1989060981 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fca6c025050 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 10 client.15639 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558f6038d7d0 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca52ffd640 1 -- 172.21.15.80:0/1989060981 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca640118f0 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca52ffd640 1 -- 172.21.15.80:0/1989060981 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fca6c0104c0 con 0x558f602824d0 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 10 client.15639 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:50.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 10 client.15639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 20 client.15639 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f60269f60 0x558f606697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.295+0000 7fca80c3a740 4 client.15639 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.296+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f605bf990 con 0x558f60269f60 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.296+0000 7fca737fe640 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f60269f60 0x558f606697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.296+0000 7fca737fe640 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f60269f60 0x558f606697c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=676ca05bfb7720ed server_cookie=e95af8cc01a01078 in_seq=0 out_seq=0 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.296+0000 7fca52ffd640 10 client.15639 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca52ffd640 1 -- 172.21.15.80:0/1989060981 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558f605bf990 con 0x558f60269f60 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca52ffd640 10 client.15639 handle_command_reply: tid=0 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 client.15639 shutdown 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 msgr2=0x558f606572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f606572f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fca6c007650 tx=0x7fca6c007a30 comp rx=0 tx=0).stop 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 shutdown_connections 2024-04-25T11:24:50.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f60269f60 0x558f606697c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f60663210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca52ffd640 0 client.15639 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f60657830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 --2- 172.21.15.80:0/1989060981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f606572f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 >> 172.21.15.80:0/1989060981 conn(0x558f6029f4e0 msgr2=0x558f6064e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.297+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 shutdown_connections 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.298+0000 7fca80c3a740 1 -- 172.21.15.80:0/1989060981 wait complete. 2024-04-25T11:24:50.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.298+0000 7fca80c3a740 20 client.15639 trim_cache size 0 max 16384 2024-04-25T11:24:50.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 Processor -- start 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 -- start start 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f60662e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f60651510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f60651a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fca741b2260 con 0x558f602824d0 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca741afb30 con 0x558f602ab390 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca80c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fca741ad980 con 0x558f6028a6b0 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca73fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f60662e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca73fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f60662e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35458/0 (socket says 172.21.15.80:35458) 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.311+0000 7fca73fff640 1 -- 172.21.15.80:0/2415568230 learned_addr learned my addr 172.21.15.80:0/2415568230 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca73fff640 1 -- 172.21.15.80:0/2415568230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 msgr2=0x558f60651510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca73fff640 1 --2- 172.21.15.80:0/2415568230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f60651510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca73fff640 1 -- 172.21.15.80:0/2415568230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 msgr2=0x558f60651a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca73fff640 1 --2- 172.21.15.80:0/2415568230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f60651a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca73fff640 1 -- 172.21.15.80:0/2415568230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f60649bb0 con 0x558f602824d0 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca73fff640 1 --2- 172.21.15.80:0/2415568230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f60662e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca6c010010 tx=0x7fca6c0074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cd0fde846933c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca597fa640 1 -- 172.21.15.80:0/2415568230 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c02f070 con 0x558f602824d0 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca597fa640 1 -- 172.21.15.80:0/2415568230 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca6c007680 con 0x558f602824d0 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.312+0000 7fca597fa640 1 -- 172.21.15.80:0/2415568230 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00e780 con 0x558f602824d0 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 -- 172.21.15.80:0/2415568230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 msgr2=0x558f60662e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 --2- 172.21.15.80:0/2415568230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f60662e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca6c010010 tx=0x7fca6c0074a0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 -- 172.21.15.80:0/2415568230 shutdown_connections 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 --2- 172.21.15.80:0/2415568230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f60651a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 --2- 172.21.15.80:0/2415568230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f60651510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 --2- 172.21.15.80:0/2415568230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f60662e70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 -- 172.21.15.80:0/2415568230 >> 172.21.15.80:0/2415568230 conn(0x558f6029f4e0 msgr2=0x558f60647610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 -- 172.21.15.80:0/2415568230 shutdown_connections 2024-04-25T11:24:50.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 -- 172.21.15.80:0/2415568230 wait complete. 2024-04-25T11:24:50.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 -- start start 2024-04-25T11:24:50.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 Processor -- start 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6065f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f6065f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.313+0000 7fca80c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f6065a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca80c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fca741adff0 con 0x558f602824d0 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca80c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca741af460 con 0x558f602ab390 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca80c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fca741ae6c0 con 0x558f6028a6b0 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca80c3a740 10 client.0 _ll_register_callbacks cb 0x7fca6c007940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6065f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6065f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35470/0 (socket says 172.21.15.80:35470) 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 -- 172.21.15.80:0/910530653 learned_addr learned my addr 172.21.15.80:0/910530653 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca737fe640 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f6065f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 -- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 msgr2=0x558f6065f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f6065f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 -- 172.21.15.80:0/910530653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 msgr2=0x558f6065a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f6065a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 -- 172.21.15.80:0/910530653 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f6065ac30 con 0x558f602824d0 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca737fe640 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f6065f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca73fff640 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6065f0b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fca6c013740 tx=0x7fca6c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8592eeaecedf19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca52ffd640 1 -- 172.21.15.80:0/910530653 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c02f020 con 0x558f602824d0 2024-04-25T11:24:50.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca52ffd640 1 -- 172.21.15.80:0/910530653 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fca6c0104a0 con 0x558f602824d0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558f605b9800 con 0x558f602824d0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca52ffd640 1 -- 172.21.15.80:0/910530653 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fca6c03a050 con 0x558f602824d0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca80c3a740 10 client.15645 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.314+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558f606d1410 con 0x558f602824d0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca52ffd640 1 -- 172.21.15.80:0/910530653 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558f605b9800 con 0x558f602824d0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca52ffd640 1 -- 172.21.15.80:0/910530653 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fca6c00eb70 con 0x558f602824d0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca80c3a740 10 client.15645 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca80c3a740 10 client.15645 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca80c3a740 20 client.15645 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca80c3a740 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f6023f3a0 0x558f606d3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca80c3a740 4 client.15645 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f60534610 con 0x558f6023f3a0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca737fe640 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f6023f3a0 0x558f606d3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca52ffd640 10 client.15645 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.315+0000 7fca737fe640 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f6023f3a0 0x558f606d3b30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2efd5e8a3c9ea563 server_cookie=b5f416107fdd65b in_seq=0 out_seq=0 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca52ffd640 1 -- 172.21.15.80:0/910530653 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f60534610 con 0x558f6023f3a0 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca52ffd640 10 client.15645 handle_command_reply: tid=0 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 client.15645 shutdown 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 msgr2=0x558f6065f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6065f0b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fca6c013740 tx=0x7fca6c010d20 comp rx=0 tx=0).stop 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 shutdown_connections 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x558f6023f3a0 0x558f606d3b30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f602ab390 0x558f6065a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558f6028a6b0 0x558f6065f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca52ffd640 0 client.15645 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 --2- 172.21.15.80:0/910530653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558f602824d0 0x558f6065f0b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 >> 172.21.15.80:0/910530653 conn(0x558f6029f4e0 msgr2=0x558f60656940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 shutdown_connections 2024-04-25T11:24:50.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 1 -- 172.21.15.80:0/910530653 wait complete. 2024-04-25T11:24:50.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca80c3a740 20 client.15645 trim_cache size 0 max 16384 2024-04-25T11:24:50.317 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fca5c0afcf0 msgr2=0x7fca5c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca79cb1640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fca5c0afcf0 0x7fca5c0b2200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca680fd050 tx=0x7fca680ea040 comp rx=0 tx=0).stop 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109b10 msgr2=0x7fca741a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.316+0000 7fca79cb1640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109b10 0x7fca741a0a40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fca6802a930 tx=0x7fca68004270 comp rx=0 tx=0).stop 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 shutdown_connections 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fca5c0afcf0 0x7fca5c0b2200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca74109b10 0x7fca741a0a40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fca74109fb0 0x7fca7419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 --2- 172.21.15.80:0/2327664664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca74104260 0x7fca741a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 >> 172.21.15.80:0/2327664664 conn(0x7fca740ff210 msgr2=0x7fca7410f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 shutdown_connections 2024-04-25T11:24:50.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.317+0000 7fca79cb1640 1 -- 172.21.15.80:0/2327664664 wait complete. 2024-04-25T11:24:50.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:50 smithi080 ceph-mon[29126]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:50.320 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:50 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/539435497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:50.321 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:24:50.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 -- 172.21.15.80:0/2152125994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb33410e550 msgr2=0x7fb334110970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 --2- 172.21.15.80:0/2152125994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb33410e550 0x7fb334110970 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009900 tx=0x7fb32c02a410 comp rx=0 tx=0).stop 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 -- 172.21.15.80:0/2152125994 shutdown_connections 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 --2- 172.21.15.80:0/2152125994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb33410e550 0x7fb334110970 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 --2- 172.21.15.80:0/2152125994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb334102050 0x7fb334102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 --2- 172.21.15.80:0/2152125994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb334109ba0 0x7fb334101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 -- 172.21.15.80:0/2152125994 >> 172.21.15.80:0/2152125994 conn(0x7fb334077880 msgr2=0x7fb334077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 -- 172.21.15.80:0/2152125994 shutdown_connections 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 -- 172.21.15.80:0/2152125994 wait complete. 2024-04-25T11:24:50.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.438+0000 7fb33914d640 1 Processor -- start 2024-04-25T11:24:50.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33914d640 1 -- start start 2024-04-25T11:24:50.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33914d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb334102050 0x7fb33419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33914d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb334109ba0 0x7fb33419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33914d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb33410e550 0x7fb33419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33914d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb334113d10 con 0x7fb334102050 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33914d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb334113b90 con 0x7fb33410e550 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33914d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb334113e90 con 0x7fb334109ba0 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb334102050 0x7fb33419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb334102050 0x7fb33419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35488/0 (socket says 172.21.15.80:35488) 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 -- 172.21.15.80:0/3938184761 learned_addr learned my addr 172.21.15.80:0/3938184761 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33359e640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb33410e550 0x7fb33419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33259c640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb334109ba0 0x7fb33419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 -- 172.21.15.80:0/3938184761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb334109ba0 msgr2=0x7fb33419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb334109ba0 0x7fb33419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 -- 172.21.15.80:0/3938184761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb33410e550 msgr2=0x7fb33419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb33410e550 0x7fb33419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 -- 172.21.15.80:0/3938184761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33419f570 con 0x7fb334102050 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33359e640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb33410e550 0x7fb33419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb33259c640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb334109ba0 0x7fb33419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.439+0000 7fb332d9d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb334102050 0x7fb33419a710 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb32400cce0 tx=0x7fb32400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.440+0000 7fb31bfff640 1 -- 172.21.15.80:0/3938184761 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324003990 con 0x7fb334102050 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.440+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33419f860 con 0x7fb334102050 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.440+0000 7fb31bfff640 1 -- 172.21.15.80:0/3938184761 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb324004020 con 0x7fb334102050 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.440+0000 7fb31bfff640 1 -- 172.21.15.80:0/3938184761 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32400f6b0 con 0x7fb334102050 2024-04-25T11:24:50.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.440+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3341a71e0 con 0x7fb334102050 2024-04-25T11:24:50.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:50 smithi196 ceph-mon[32659]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:50.442 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:50 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/539435497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:50.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 Processor -- start 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb31bfff640 1 -- 172.21.15.80:0/3938184761 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fb324003b30 con 0x7fb334102050 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 -- start start 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eef4645d80 con 0x55eef43164d0 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eef45ffa20 con 0x55eef431e6b0 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.442+0000 7fb340003740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55eef4641d40 con 0x55eef433f390 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46e0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35504/0 (socket says 172.21.15.80:35504) 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 -- 172.21.15.80:0/3711078408 learned_addr learned my addr 172.21.15.80:0/3711078408 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb33359e640 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb33259c640 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb31bfff640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb31c0afcf0 0x7fb31c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 -- 172.21.15.80:0/3711078408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 msgr2=0x55eef46e06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46e06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 -- 172.21.15.80:0/3711078408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 msgr2=0x55eef46f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 -- 172.21.15.80:0/3711078408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef460ac30 con 0x55eef43164d0 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb33259c640 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb33359e640 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb33359e640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb31c0afcf0 0x7fb31c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb31bfff640 1 -- 172.21.15.80:0/3938184761 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fb3240df6c0 con 0x7fb334102050 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb332d9d640 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46e0c00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb3240dcd00 tx=0x7fb324020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6781826ab12de4b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb3197fa640 1 -- 172.21.15.80:0/3711078408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240a7050 con 0x55eef43164d0 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb3197fa640 1 -- 172.21.15.80:0/3711078408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3240a7210 con 0x55eef43164d0 2024-04-25T11:24:50.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb3197fa640 1 -- 172.21.15.80:0/3711078408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240a6e70 con 0x55eef43164d0 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.443+0000 7fb33359e640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb31c0afcf0 0x7fb31c0b2200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb32c031440 tx=0x7fb32c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 -- 172.21.15.80:0/3711078408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 msgr2=0x55eef46e0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46e0c00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb3240dcd00 tx=0x7fb324020000 comp rx=0 tx=0).stop 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 -- 172.21.15.80:0/3711078408 shutdown_connections 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46e0c00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 --2- 172.21.15.80:0/3711078408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 -- 172.21.15.80:0/3711078408 >> 172.21.15.80:0/3711078408 conn(0x55eef43334e0 msgr2=0x55eef46dcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 -- 172.21.15.80:0/3711078408 shutdown_connections 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.444+0000 7fb340003740 1 -- 172.21.15.80:0/3711078408 wait complete. 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 -- start start 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 Processor -- start 2024-04-25T11:24:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef43164d0 0x55eef46ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46efb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef433f390 0x55eef46fb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eef46f2140 con 0x55eef433f390 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eef45ccdc0 con 0x55eef431e6b0 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55eef46f22c0 con 0x55eef43164d0 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb340003740 10 client.0 _ll_register_callbacks cb 0x55eef45e8600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef433f390 0x55eef46fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef433f390 0x55eef46fb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35510/0 (socket says 172.21.15.80:35510) 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 -- 172.21.15.80:0/4128405499 learned_addr learned my addr 172.21.15.80:0/4128405499 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb332d9d640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef43164d0 0x55eef46ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33259c640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 -- 172.21.15.80:0/4128405499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef43164d0 msgr2=0x55eef46ef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef43164d0 0x55eef46ef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 -- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 msgr2=0x55eef46efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46efb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33359e640 1 -- 172.21.15.80:0/4128405499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef43573f0 con 0x55eef433f390 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb33259c640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.445+0000 7fb332d9d640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef43164d0 0x55eef46ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb33359e640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef433f390 0x55eef46fb680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb32c033000 tx=0x7fb32c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467eb191357dd5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb316ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb316ff5640 1 -- 172.21.15.80:0/4128405499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c04d020 con 0x55eef433f390 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb316ff5640 1 -- 172.21.15.80:0/4128405499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fb32c005450 con 0x55eef433f390 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3240a7210 con 0x55eef433f390 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb316ff5640 1 -- 172.21.15.80:0/4128405499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb32c058050 con 0x55eef433f390 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 10 client.15657 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55eef44217d0 con 0x55eef433f390 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb316ff5640 1 -- 172.21.15.80:0/4128405499 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3240a7210 con 0x55eef433f390 2024-04-25T11:24:50.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb316ff5640 1 -- 172.21.15.80:0/4128405499 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fb32c003710 con 0x55eef433f390 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 10 client.15657 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 20 client.15657 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42fdf60 0x55eef4701b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 4 client.15657 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.446+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eef4653990 con 0x55eef42fdf60 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.447+0000 7fb332d9d640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42fdf60 0x55eef4701b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.447+0000 7fb316ff5640 10 client.15657 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.447+0000 7fb332d9d640 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42fdf60 0x55eef4701b00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea89731e21a76362 server_cookie=711f074413b1a1ef in_seq=0 out_seq=0 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb316ff5640 1 -- 172.21.15.80:0/4128405499 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55eef4653990 con 0x55eef42fdf60 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb316ff5640 10 client.15657 handle_command_reply: tid=0 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 client.15657 shutdown 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef433f390 msgr2=0x55eef46fb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef433f390 0x55eef46fb680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb32c033000 tx=0x7fb32c005a20 comp rx=0 tx=0).stop 2024-04-25T11:24:50.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 shutdown_connections 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42fdf60 0x55eef4701b00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef433f390 0x55eef46fb680 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb316ff5640 0 client.15657 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 --2- 172.21.15.80:0/4128405499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef43164d0 0x55eef46ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 >> 172.21.15.80:0/4128405499 conn(0x55eef43334e0 msgr2=0x55eef46e24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 shutdown_connections 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 1 -- 172.21.15.80:0/4128405499 wait complete. 2024-04-25T11:24:50.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.448+0000 7fb340003740 20 client.15657 trim_cache size 0 max 16384 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.461+0000 7fb340003740 1 Processor -- start 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.461+0000 7fb340003740 1 -- start start 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb340003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46fb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb340003740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46edc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb340003740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb340003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341b0190 con 0x55eef43164d0 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb340003740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ada60 con 0x55eef431e6b0 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb340003740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ab8d0 con 0x55eef433f390 2024-04-25T11:24:50.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46fb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35520/0 (socket says 172.21.15.80:35520) 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 -- 172.21.15.80:0/4154102403 learned_addr learned my addr 172.21.15.80:0/4154102403 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb33359e640 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 -- 172.21.15.80:0/4154102403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 msgr2=0x55eef46ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46ee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 -- 172.21.15.80:0/4154102403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 msgr2=0x55eef46edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 -- 172.21.15.80:0/4154102403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef46e1fa0 con 0x55eef43164d0 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb33359e640 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb332d9d640 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46fb260 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb3240b0030 tx=0x7fb324000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9dcf3b44aab1f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb318ff9640 1 -- 172.21.15.80:0/4154102403 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240a7050 con 0x55eef43164d0 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb318ff9640 1 -- 172.21.15.80:0/4154102403 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3240a7210 con 0x55eef43164d0 2024-04-25T11:24:50.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.462+0000 7fb318ff9640 1 -- 172.21.15.80:0/4154102403 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240041d0 con 0x55eef43164d0 2024-04-25T11:24:50.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 -- 172.21.15.80:0/4154102403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 msgr2=0x55eef46fb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46fb260 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb3240b0030 tx=0x7fb324000f40 comp rx=0 tx=0).stop 2024-04-25T11:24:50.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 -- 172.21.15.80:0/4154102403 shutdown_connections 2024-04-25T11:24:50.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef433f390 0x55eef46ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef431e6b0 0x55eef46edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 --2- 172.21.15.80:0/4154102403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46fb260 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 -- 172.21.15.80:0/4154102403 >> 172.21.15.80:0/4154102403 conn(0x55eef43334e0 msgr2=0x55eef46ef5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 -- 172.21.15.80:0/4154102403 shutdown_connections 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 -- 172.21.15.80:0/4154102403 wait complete. 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 -- start start 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.463+0000 7fb340003740 1 Processor -- start 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46f4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef431e6b0 0x55eef46f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef433f390 0x55eef4767e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341abf20 con 0x55eef43164d0 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ad390 con 0x55eef433f390 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ac5f0 con 0x55eef431e6b0 2024-04-25T11:24:50.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 10 client.0 _ll_register_callbacks cb 0x7fb32c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35532/0 (socket says 172.21.15.80:35532) 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 -- 172.21.15.80:0/774682206 learned_addr learned my addr 172.21.15.80:0/774682206 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 -- 172.21.15.80:0/774682206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef431e6b0 msgr2=0x55eef46f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb33359e640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef433f390 0x55eef4767e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb33259c640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef431e6b0 0x55eef46f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef431e6b0 0x55eef46f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 -- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef433f390 msgr2=0x55eef4767e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef433f390 0x55eef4767e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 -- 172.21.15.80:0/774682206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef46eaf80 con 0x55eef43164d0 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb33259c640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef431e6b0 0x55eef46f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb33359e640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef433f390 0x55eef4767e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb332d9d640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46f4560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb3240a7690 tx=0x7fb3240044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca40fd4fb8a67da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:50.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb316ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb316ff5640 1 -- 172.21.15.80:0/774682206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32401d030 con 0x55eef43164d0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb316ff5640 1 -- 172.21.15.80:0/774682206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fb3240900b0 con 0x55eef43164d0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.464+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3240a7210 con 0x55eef43164d0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb316ff5640 1 -- 172.21.15.80:0/774682206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb3240a7050 con 0x55eef43164d0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 10 client.15663 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55eef4769180 con 0x55eef43164d0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb316ff5640 1 -- 172.21.15.80:0/774682206 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3240a7210 con 0x55eef43164d0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb316ff5640 1 -- 172.21.15.80:0/774682206 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fb3240e50d0 con 0x55eef43164d0 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 10 client.15663 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 20 client.15663 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42d33a0 0x55eef476b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:50.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 4 client.15663 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eef464d800 con 0x55eef42d33a0 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.465+0000 7fb33259c640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42d33a0 0x55eef476b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb316ff5640 10 client.15663 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb33259c640 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42d33a0 0x55eef476b210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3979b7626607283a server_cookie=750fa152561399ab in_seq=0 out_seq=0 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb316ff5640 1 -- 172.21.15.80:0/774682206 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eef464d800 con 0x55eef42d33a0 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb316ff5640 10 client.15663 handle_command_reply: tid=0 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 client.15663 shutdown 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 msgr2=0x55eef46f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46f4560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb3240a7690 tx=0x7fb3240044d0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 shutdown_connections 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55eef42d33a0 0x55eef476b210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eef433f390 0x55eef4767e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55eef431e6b0 0x55eef46f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb316ff5640 0 client.15663 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:50.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 --2- 172.21.15.80:0/774682206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eef43164d0 0x55eef46f4560 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 >> 172.21.15.80:0/774682206 conn(0x55eef43334e0 msgr2=0x55eef46ef4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 shutdown_connections 2024-04-25T11:24:50.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 1 -- 172.21.15.80:0/774682206 wait complete. 2024-04-25T11:24:50.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.466+0000 7fb340003740 20 client.15663 trim_cache size 0 max 16384 2024-04-25T11:24:50.467 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:24:50.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb31c0afcf0 msgr2=0x7fb31c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb31c0afcf0 0x7fb31c0b2200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb32c031440 tx=0x7fb32c009260 comp rx=0 tx=0).stop 2024-04-25T11:24:50.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb334102050 msgr2=0x7fb33419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:50.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb334102050 0x7fb33419a710 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb32400cce0 tx=0x7fb32400a620 comp rx=0 tx=0).stop 2024-04-25T11:24:50.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 shutdown_connections 2024-04-25T11:24:50.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb31c0afcf0 0x7fb31c0b2200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb33410e550 0x7fb33419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb334109ba0 0x7fb33419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 --2- 172.21.15.80:0/3938184761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb334102050 0x7fb33419a710 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 >> 172.21.15.80:0/3938184761 conn(0x7fb334077880 msgr2=0x7fb3341051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 shutdown_connections 2024-04-25T11:24:50.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:50.467+0000 7fb33914d640 1 -- 172.21.15.80:0/3938184761 wait complete. 2024-04-25T11:24:50.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:50 smithi082 ceph-mon[32440]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:50.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:50 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/539435497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:24:51.472 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:24:51.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:24:51.473 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:24:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 -- 172.21.15.80:0/3226016361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010b650 msgr2=0x7f02d010da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 --2- 172.21.15.80:0/3226016361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010b650 0x7f02d010da70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 -- 172.21.15.80:0/3226016361 shutdown_connections 2024-04-25T11:24:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 --2- 172.21.15.80:0/3226016361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010b650 0x7f02d010da70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 --2- 172.21.15.80:0/3226016361 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02d010e040 0x7f02d0110530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 --2- 172.21.15.80:0/3226016361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d0104bf0 0x7f02d0105000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 -- 172.21.15.80:0/3226016361 >> 172.21.15.80:0/3226016361 conn(0x7f02d0078100 msgr2=0x7f02d0078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 -- 172.21.15.80:0/3226016361 shutdown_connections 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.608+0000 7f02d7234640 1 -- 172.21.15.80:0/3226016361 wait complete. 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 Processor -- start 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 -- start start 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02d0104bf0 0x7f02d019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d010b650 0x7f02d019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010e040 0x7f02d019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0113ca0 con 0x7f02d010e040 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0113b20 con 0x7f02d010b650 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d7234640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0113e20 con 0x7f02d0104bf0 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010e040 0x7f02d019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010e040 0x7f02d019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35538/0 (socket says 172.21.15.80:35538) 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 -- 172.21.15.80:0/80934125 learned_addr learned my addr 172.21.15.80:0/80934125 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02cffff640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d010b650 0x7f02d019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 -- 172.21.15.80:0/80934125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02d0104bf0 msgr2=0x7f02d019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02d0104bf0 0x7f02d019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 -- 172.21.15.80:0/80934125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d010b650 msgr2=0x7f02d019acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d010b650 0x7f02d019acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.609+0000 7f02d57d1640 1 -- 172.21.15.80:0/80934125 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d019f5c0 con 0x7f02d010e040 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.610+0000 7f02d57d1640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010e040 0x7f02d019ef80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f02c800eaa0 tx=0x7f02c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.610+0000 7f02cdffb640 1 -- 172.21.15.80:0/80934125 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c800cdb0 con 0x7f02d010e040 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.610+0000 7f02cdffb640 1 -- 172.21.15.80:0/80934125 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c8005020 con 0x7f02d010e040 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.610+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d019f8b0 con 0x7f02d010e040 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.610+0000 7f02cdffb640 1 -- 172.21.15.80:0/80934125 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c80116d0 con 0x7f02d010e040 2024-04-25T11:24:51.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.610+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d01a7230 con 0x7f02d010e040 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 Processor -- start 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02cdffb640 1 -- 172.21.15.80:0/80934125 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f02c80051d0 con 0x7f02d010e040 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 -- start start 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb8e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 0x56488cb8eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 0x56488cb8f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56488caf4b00 con 0x56488c7ee410 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56488ca90920 con 0x56488c7cd730 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02de1c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56488caf0ac0 con 0x56488c7c5550 2024-04-25T11:24:51.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb8e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb8e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35544/0 (socket says 172.21.15.80:35544) 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.613+0000 7f02cffff640 1 -- 172.21.15.80:0/4166004745 learned_addr learned my addr 172.21.15.80:0/4166004745 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cdffb640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f02b80afcf0 0x7f02b80b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cffff640 1 -- 172.21.15.80:0/4166004745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 msgr2=0x56488cb8eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cffff640 1 --2- 172.21.15.80:0/4166004745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 0x56488cb8eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cffff640 1 -- 172.21.15.80:0/4166004745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 msgr2=0x56488cb8f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02d57d1640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f02b80afcf0 0x7f02b80b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cffff640 1 --2- 172.21.15.80:0/4166004745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 0x56488cb8f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cffff640 1 -- 172.21.15.80:0/4166004745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56488c8ce7e0 con 0x56488c7ee410 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cdffb640 1 -- 172.21.15.80:0/80934125 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f02c80df390 con 0x7f02d010e040 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02cffff640 1 --2- 172.21.15.80:0/4166004745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb8e620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c4032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435cffa40fb523c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02b6ffd640 1 -- 172.21.15.80:0/4166004745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4035040 con 0x56488c7ee410 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02b6ffd640 1 -- 172.21.15.80:0/4166004745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c40316a0 con 0x56488c7ee410 2024-04-25T11:24:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02b6ffd640 1 -- 172.21.15.80:0/4166004745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4004750 con 0x56488c7ee410 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.614+0000 7f02d57d1640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f02b80afcf0 0x7f02b80b2200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02c80dca30 tx=0x7f02c8075e70 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 -- 172.21.15.80:0/4166004745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 msgr2=0x56488cb8e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 --2- 172.21.15.80:0/4166004745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb8e620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c4032df0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 -- 172.21.15.80:0/4166004745 shutdown_connections 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 --2- 172.21.15.80:0/4166004745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 0x56488cb8f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 --2- 172.21.15.80:0/4166004745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 0x56488cb8eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 --2- 172.21.15.80:0/4166004745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb8e620 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 -- 172.21.15.80:0/4166004745 >> 172.21.15.80:0/4166004745 conn(0x56488c7e2560 msgr2=0x56488cb8add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 -- 172.21.15.80:0/4166004745 shutdown_connections 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.615+0000 7f02de1c3740 1 -- 172.21.15.80:0/4166004745 wait complete. 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 -- start start 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 Processor -- start 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 0x56488cb98c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 0x56488cb991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb9ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56488cb9b910 con 0x56488c7ee410 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56488ca8e5d0 con 0x56488c7cd730 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56488cb9ba90 con 0x56488c7c5550 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02de1c3740 10 client.0 _ll_register_callbacks cb 0x56488ca7c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb9ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb9ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35558/0 (socket says 172.21.15.80:35558) 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02cffff640 1 -- 172.21.15.80:0/2888250131 learned_addr learned my addr 172.21.15.80:0/2888250131 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02cffff640 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 0x56488cb98c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.616+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 0x56488cb991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02cffff640 1 -- 172.21.15.80:0/2888250131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 msgr2=0x56488cb98c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02cffff640 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 0x56488cb98c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02cffff640 1 -- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 msgr2=0x56488cb991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02cffff640 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 0x56488cb991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02cffff640 1 -- 172.21.15.80:0/2888250131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56488c92ef70 con 0x56488c7ee410 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02cffff640 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb9ed90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f02c4005700 tx=0x7f02c4005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a4595f053ec185 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02affff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02affff640 1 -- 172.21.15.80:0/2888250131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4035030 con 0x56488c7ee410 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c40316a0 con 0x56488c7ee410 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02affff640 1 -- 172.21.15.80:0/2888250131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f02c4004050 con 0x56488c7ee410 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02affff640 1 -- 172.21.15.80:0/2888250131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f02c4004250 con 0x56488c7ee410 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02de1c3740 10 client.15675 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56488c7c6170 con 0x56488c7ee410 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02affff640 1 -- 172.21.15.80:0/2888250131 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c40316a0 con 0x56488c7ee410 2024-04-25T11:24:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.617+0000 7f02affff640 1 -- 172.21.15.80:0/2888250131 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f02c4003660 con 0x56488c7ee410 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02de1c3740 10 client.15675 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02de1c3740 10 client.15675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02de1c3740 20 client.15675 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ad1f0 0x56488cbaae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02de1c3740 4 client.15675 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56488cb02710 con 0x56488c7ad1f0 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ad1f0 0x56488cbaae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02affff640 10 client.15675 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.618+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ad1f0 0x56488cbaae50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220b0d8a7f206fc1 server_cookie=dad8168055fdb39d in_seq=0 out_seq=0 2024-04-25T11:24:51.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02affff640 1 -- 172.21.15.80:0/2888250131 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56488cb02710 con 0x56488c7ad1f0 2024-04-25T11:24:51.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02affff640 10 client.15675 handle_command_reply: tid=0 2024-04-25T11:24:51.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 client.15675 shutdown 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 msgr2=0x56488cb9ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb9ed90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f02c4005700 tx=0x7f02c4005330 comp rx=0 tx=0).stop 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 shutdown_connections 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ad1f0 0x56488cbaae50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7ee410 0x56488cb9ed90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02affff640 0 client.15675 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7cd730 0x56488cb991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2888250131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7c5550 0x56488cb98c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.619+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 >> 172.21.15.80:0/2888250131 conn(0x56488c7e2560 msgr2=0x56488cb8e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.620+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 shutdown_connections 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.620+0000 7f02de1c3740 1 -- 172.21.15.80:0/2888250131 wait complete. 2024-04-25T11:24:51.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.620+0000 7f02de1c3740 20 client.15675 trim_cache size 0 max 16384 2024-04-25T11:24:51.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 Processor -- start 2024-04-25T11:24:51.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 -- start start 2024-04-25T11:24:51.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cb89ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cb8eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 0x56488cb9ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01b22d0 con 0x56488c7c5550 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01afba0 con 0x56488c7ad1f0 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02de1c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01ad9f0 con 0x56488c7cd730 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cb8eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cb8eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35572/0 (socket says 172.21.15.80:35572) 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 -- 172.21.15.80:0/3322771311 learned_addr learned my addr 172.21.15.80:0/3322771311 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02cffff640 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cb89ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 -- 172.21.15.80:0/3322771311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 msgr2=0x56488cb9ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 0x56488cb9ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 -- 172.21.15.80:0/3322771311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 msgr2=0x56488cb89ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cb89ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 -- 172.21.15.80:0/3322771311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56488cb8fc10 con 0x56488c7c5550 2024-04-25T11:24:51.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02cffff640 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cb89ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.638+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cb8eac0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x56488cb8bd60 tx=0x7f02c0005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce49da056c224f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02b67fc640 1 -- 172.21.15.80:0/3322771311 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c001b070 con 0x56488c7c5550 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02b67fc640 1 -- 172.21.15.80:0/3322771311 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c0017770 con 0x56488c7c5550 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02b67fc640 1 -- 172.21.15.80:0/3322771311 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c000fb50 con 0x56488c7c5550 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 -- 172.21.15.80:0/3322771311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 msgr2=0x56488cb8eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cb8eac0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x56488cb8bd60 tx=0x7f02c0005d70 comp rx=0 tx=0).stop 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 -- 172.21.15.80:0/3322771311 shutdown_connections 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cb8eac0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 0x56488cb9ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 --2- 172.21.15.80:0/3322771311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cb89ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 -- 172.21.15.80:0/3322771311 >> 172.21.15.80:0/3322771311 conn(0x56488c7e2560 msgr2=0x56488cb8e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 -- 172.21.15.80:0/3322771311 shutdown_connections 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.639+0000 7f02de1c3740 1 -- 172.21.15.80:0/3322771311 wait complete. 2024-04-25T11:24:51.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 -- start start 2024-04-25T11:24:51.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 Processor -- start 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cba2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cba3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 0x56488cba38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01ae060 con 0x56488c7c5550 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01af4d0 con 0x56488c7ad1f0 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01ae730 con 0x56488c7cd730 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02de1c3740 10 client.0 _ll_register_callbacks cb 0x7f02c4005060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02d4fd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cba3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02d4fd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cba3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35580/0 (socket says 172.21.15.80:35580) 2024-04-25T11:24:51.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.640+0000 7f02d4fd0640 1 -- 172.21.15.80:0/2016235467 learned_addr learned my addr 172.21.15.80:0/2016235467 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02cffff640 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 0x56488cba38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02cffff640 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cba2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02d4fd0640 1 -- 172.21.15.80:0/2016235467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 msgr2=0x56488cba38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 0x56488cba38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02d4fd0640 1 -- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 msgr2=0x56488cba2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cba2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02d4fd0640 1 -- 172.21.15.80:0/2016235467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56488cc12000 con 0x56488c7c5550 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02d4fd0640 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cba3360 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02c0017920 tx=0x7f02c0017950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85f97da965a7527 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02affff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02affff640 1 -- 172.21.15.80:0/2016235467 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c001b050 con 0x56488c7c5550 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02affff640 1 -- 172.21.15.80:0/2016235467 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f02c00172c0 con 0x56488c7c5550 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c0017770 con 0x56488c7c5550 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02affff640 1 -- 172.21.15.80:0/2016235467 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f02c0017500 con 0x56488c7c5550 2024-04-25T11:24:51.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02de1c3740 10 client.15681 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.641+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56488cc131f0 con 0x56488c7c5550 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02affff640 1 -- 172.21.15.80:0/2016235467 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c0017770 con 0x56488c7c5550 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02affff640 1 -- 172.21.15.80:0/2016235467 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f02c0017ce0 con 0x56488c7c5550 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02de1c3740 10 client.15681 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02de1c3740 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02de1c3740 20 client.15681 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ee410 0x56488cc15970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02de1c3740 4 client.15681 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56488cafc580 con 0x56488c7ee410 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02cffff640 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ee410 0x56488cc15970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02cffff640 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ee410 0x56488cc15970 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=467bd5853e101657 server_cookie=3f176282b42c46e2 in_seq=0 out_seq=0 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.642+0000 7f02affff640 10 client.15681 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02affff640 1 -- 172.21.15.80:0/2016235467 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56488cafc580 con 0x56488c7ee410 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02affff640 10 client.15681 handle_command_reply: tid=0 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 client.15681 shutdown 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 msgr2=0x56488cba3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cba3360 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02c0017920 tx=0x7f02c0017950 comp rx=0 tx=0).stop 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 shutdown_connections 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56488c7ee410 0x56488cc15970 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56488c7c5550 0x56488cba3360 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56488c7cd730 0x56488cba38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02affff640 0 client.15681 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 --2- 172.21.15.80:0/2016235467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56488c7ad1f0 0x56488cba2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 >> 172.21.15.80:0/2016235467 conn(0x56488c7e2560 msgr2=0x56488cb89c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 shutdown_connections 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 1 -- 172.21.15.80:0/2016235467 wait complete. 2024-04-25T11:24:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.644+0000 7f02de1c3740 20 client.15681 trim_cache size 0 max 16384 2024-04-25T11:24:51.644 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:24:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "0cf22d83-c91f-494b-964d-41f2523ee7e5", 2024-04-25T11:24:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:24:51.644 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f02b80afcf0 msgr2=0x7f02b80b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f02b80afcf0 0x7f02b80b2200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02c80dca30 tx=0x7f02c8075e70 comp rx=0 tx=0).stop 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010e040 msgr2=0x7f02d019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010e040 0x7f02d019ef80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f02c800eaa0 tx=0x7f02c800ef60 comp rx=0 tx=0).stop 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 shutdown_connections 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f02b80afcf0 0x7f02b80b2200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02d010e040 0x7f02d019ef80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d010b650 0x7f02d019acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 --2- 172.21.15.80:0/80934125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02d0104bf0 0x7f02d019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 >> 172.21.15.80:0/80934125 conn(0x7f02d0078100 msgr2=0x7f02d0101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 shutdown_connections 2024-04-25T11:24:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.645+0000 7f02d7234640 1 -- 172.21.15.80:0/80934125 wait complete. 2024-04-25T11:24:51.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:24:51.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:24:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 -- 172.21.15.80:0/998593588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108a10 msgr2=0x7f2854102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 --2- 172.21.15.80:0/998593588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108a10 0x7f2854102610 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2844009900 tx=0x7f284402a410 comp rx=0 tx=0).stop 2024-04-25T11:24:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 -- 172.21.15.80:0/998593588 shutdown_connections 2024-04-25T11:24:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 --2- 172.21.15.80:0/998593588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28541031c0 0x7f285410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 --2- 172.21.15.80:0/998593588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2854108eb0 0x7f2854102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 --2- 172.21.15.80:0/998593588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108a10 0x7f2854102610 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 -- 172.21.15.80:0/998593588 >> 172.21.15.80:0/998593588 conn(0x7f28540781b0 msgr2=0x7f28540785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.766+0000 7f28592f0640 1 -- 172.21.15.80:0/998593588 shutdown_connections 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 -- 172.21.15.80:0/998593588 wait complete. 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 Processor -- start 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 -- start start 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28541031c0 0x7f2854199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2854108a10 0x7f2854199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108eb0 0x7f285419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2854112c10 con 0x7f2854108eb0 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2854112a90 con 0x7f2854108a10 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.767+0000 7f28592f0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2854112d90 con 0x7f28541031c0 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108eb0 0x7f285419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108eb0 0x7f285419de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35604/0 (socket says 172.21.15.80:35604) 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 -- 172.21.15.80:0/396763370 learned_addr learned my addr 172.21.15.80:0/396763370 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f2852ffd640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28541031c0 0x7f2854199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f284bfff640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2854108a10 0x7f2854199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 -- 172.21.15.80:0/396763370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28541031c0 msgr2=0x7f2854199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28541031c0 0x7f2854199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 -- 172.21.15.80:0/396763370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2854108a10 msgr2=0x7f2854199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2854108a10 0x7f2854199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 -- 172.21.15.80:0/396763370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285419e490 con 0x7f2854108eb0 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f2852ffd640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28541031c0 0x7f2854199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f284bfff640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2854108a10 0x7f2854199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28537fe640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108eb0 0x7f285419de50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f284c00eb10 tx=0x7f284c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f2850ff9640 1 -- 172.21.15.80:0/396763370 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c004b20 con 0x7f2854108eb0 2024-04-25T11:24:51.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f2850ff9640 1 -- 172.21.15.80:0/396763370 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f284c004cc0 con 0x7f2854108eb0 2024-04-25T11:24:51.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f2850ff9640 1 -- 172.21.15.80:0/396763370 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c010670 con 0x7f2854108eb0 2024-04-25T11:24:51.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285419e780 con 0x7f2854108eb0 2024-04-25T11:24:51.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.768+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28541a6100 con 0x7f2854108eb0 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.771+0000 7f286019c740 1 Processor -- start 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.771+0000 7f2850ff9640 1 -- 172.21.15.80:0/396763370 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7f284c005020 con 0x7f2854108eb0 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.771+0000 7f286019c740 1 -- start start 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f286019c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eb10390 0x55be7eeb0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f286019c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eeb0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f286019c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f286019c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55be7ee16d80 con 0x55be7eaef6b0 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f286019c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55be7edd08b0 con 0x55be7eb10390 2024-04-25T11:24:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f286019c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55be7ee12d40 con 0x55be7eae74d0 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35616/0 (socket says 172.21.15.80:35616) 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 -- 172.21.15.80:0/3884802375 learned_addr learned my addr 172.21.15.80:0/3884802375 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eb10390 0x55be7eeb0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f2850ff9640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28400afcf0 0x7f28400b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f2852ffd640 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eeb0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 -- 172.21.15.80:0/3884802375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 msgr2=0x55be7eeb0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eeb0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 -- 172.21.15.80:0/3884802375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eb10390 msgr2=0x55be7eeb0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eb10390 0x55be7eeb0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f28537fe640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28400afcf0 0x7f28400b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f284bfff640 1 -- 172.21.15.80:0/3884802375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be7eda1a40 con 0x55be7eaef6b0 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f2852ffd640 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eeb0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.772+0000 7f2850ff9640 1 -- 172.21.15.80:0/396763370 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f284c0df8a0 con 0x7f2854108eb0 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.773+0000 7f284bfff640 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebfb00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f283c0127b0 tx=0x7f283c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815ccaebe0ab7acf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.773+0000 7f28497fa640 1 -- 172.21.15.80:0/3884802375 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c012d30 con 0x55be7eaef6b0 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.773+0000 7f28497fa640 1 -- 172.21.15.80:0/3884802375 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f283c005020 con 0x55be7eaef6b0 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.773+0000 7f28497fa640 1 -- 172.21.15.80:0/3884802375 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c0049c0 con 0x55be7eaef6b0 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- 172.21.15.80:0/3884802375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 msgr2=0x55be7eebfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f28537fe640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28400afcf0 0x7f28400b2200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f284c0dcfa0 tx=0x7f284c00efd0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebfb00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f283c0127b0 tx=0x7f283c0096c0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- 172.21.15.80:0/3884802375 shutdown_connections 2024-04-25T11:24:51.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebfb00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eeb0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 --2- 172.21.15.80:0/3884802375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eb10390 0x55be7eeb0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- 172.21.15.80:0/3884802375 >> 172.21.15.80:0/3884802375 conn(0x55be7eb044e0 msgr2=0x55be7eead210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- 172.21.15.80:0/3884802375 shutdown_connections 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- 172.21.15.80:0/3884802375 wait complete. 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- start start 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 Processor -- start 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eebd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eb10390 0x55be7eec3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55be7eec01f0 con 0x55be7eaef6b0 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55be7ed9dd10 con 0x55be7eae74d0 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.774+0000 7f286019c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55be7eec0370 con 0x55be7eb10390 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f286019c740 10 client.0 _ll_register_callbacks cb 0x55be7edca210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35618/0 (socket says 172.21.15.80:35618) 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 -- 172.21.15.80:0/2059628654 learned_addr learned my addr 172.21.15.80:0/2059628654 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f284bfff640 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eb10390 0x55be7eec3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f284bfff640 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eebd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 -- 172.21.15.80:0/2059628654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eb10390 msgr2=0x55be7eec3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eb10390 0x55be7eec3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 -- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 msgr2=0x55be7eebd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eebd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 -- 172.21.15.80:0/2059628654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be7ebf27d0 con 0x55be7eaef6b0 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebdd50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7220170f6915564a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f283a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f283a7fc640 1 -- 172.21.15.80:0/2059628654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844035070 con 0x55be7eaef6b0 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f283a7fc640 1 -- 172.21.15.80:0/2059628654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f2844004240 con 0x55be7eaef6b0 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f283c005020 con 0x55be7eaef6b0 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f283a7fc640 1 -- 172.21.15.80:0/2059628654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2844004440 con 0x55be7eaef6b0 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f286019c740 10 client.15693 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:51.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.775+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55be7eb283f0 con 0x55be7eaef6b0 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f283a7fc640 1 -- 172.21.15.80:0/2059628654 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f283c005020 con 0x55be7eaef6b0 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f283a7fc640 1 -- 172.21.15.80:0/2059628654 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f28440049c0 con 0x55be7eaef6b0 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f286019c740 10 client.15693 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f286019c740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f286019c740 20 client.15693 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f286019c740 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eacef60 0x55be7eecf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f286019c740 4 client.15693 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be7ee24990 con 0x55be7eacef60 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f284bfff640 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eacef60 0x55be7eecf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f283a7fc640 10 client.15693 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.776+0000 7f284bfff640 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eacef60 0x55be7eecf880 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=973b4a8d8e4c5c12 server_cookie=4d0b446609434d1c in_seq=0 out_seq=0 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f283a7fc640 1 -- 172.21.15.80:0/2059628654 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55be7ee24990 con 0x55be7eacef60 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f283a7fc640 10 client.15693 handle_command_reply: tid=0 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 client.15693 shutdown 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 msgr2=0x55be7eebdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebdd50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844031750 comp rx=0 tx=0).stop 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 shutdown_connections 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eacef60 0x55be7eecf880 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eaef6b0 0x55be7eebdd50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eb10390 0x55be7eec3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f283a7fc640 0 client.15693 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 --2- 172.21.15.80:0/2059628654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eebd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 >> 172.21.15.80:0/2059628654 conn(0x55be7eb044e0 msgr2=0x55be7eeb26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 shutdown_connections 2024-04-25T11:24:51.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 1 -- 172.21.15.80:0/2059628654 wait complete. 2024-04-25T11:24:51.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.777+0000 7f286019c740 20 client.15693 trim_cache size 0 max 16384 2024-04-25T11:24:51.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.795+0000 7f286019c740 1 Processor -- start 2024-04-25T11:24:51.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.795+0000 7f286019c740 1 -- start start 2024-04-25T11:24:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.795+0000 7f286019c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eed5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.795+0000 7f286019c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eaef6b0 0x55be7eed5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.795+0000 7f286019c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f286019c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f28541b0030 con 0x55be7eb10390 2024-04-25T11:24:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f286019c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f28541ad900 con 0x55be7eaef6b0 2024-04-25T11:24:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f286019c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f28541ab750 con 0x55be7eae74d0 2024-04-25T11:24:51.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35624/0 (socket says 172.21.15.80:35624) 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 -- 172.21.15.80:0/2914465753 learned_addr learned my addr 172.21.15.80:0/2914465753 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eaef6b0 0x55be7eed5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eed5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 -- 172.21.15.80:0/2914465753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 msgr2=0x55be7eed5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eed5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 -- 172.21.15.80:0/2914465753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eaef6b0 msgr2=0x55be7eed5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eaef6b0 0x55be7eed5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 -- 172.21.15.80:0/2914465753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be7eae80f0 con 0x55be7eb10390 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eaef6b0 0x55be7eed5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f284bfff640 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb2680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55be7eeae250 tx=0x7f283c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2054ccdbbd582e69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f2848ff9640 1 -- 172.21.15.80:0/2914465753 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c012050 con 0x55be7eb10390 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f2848ff9640 1 -- 172.21.15.80:0/2914465753 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f283c0121f0 con 0x55be7eb10390 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.796+0000 7f2848ff9640 1 -- 172.21.15.80:0/2914465753 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c010c00 con 0x55be7eb10390 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 -- 172.21.15.80:0/2914465753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 msgr2=0x55be7eeb2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb2680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55be7eeae250 tx=0x7f283c014040 comp rx=0 tx=0).stop 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 -- 172.21.15.80:0/2914465753 shutdown_connections 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb2680 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eaef6b0 0x55be7eed5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 --2- 172.21.15.80:0/2914465753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eae74d0 0x55be7eed5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 -- 172.21.15.80:0/2914465753 >> 172.21.15.80:0/2914465753 conn(0x55be7eb044e0 msgr2=0x55be7eebbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 -- 172.21.15.80:0/2914465753 shutdown_connections 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 -- 172.21.15.80:0/2914465753 wait complete. 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.797+0000 7f286019c740 1 -- start start 2024-04-25T11:24:51.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 1 Processor -- start 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eec9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eaef6b0 0x55be7eeca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f28541abdc0 con 0x55be7eb10390 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f28541ad230 con 0x55be7eae74d0 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f28541ac490 con 0x55be7eaef6b0 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f286019c740 10 client.0 _ll_register_callbacks cb 0x7f283c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35634/0 (socket says 172.21.15.80:35634) 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 -- 172.21.15.80:0/2790727674 learned_addr learned my addr 172.21.15.80:0/2790727674 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eec9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eaef6b0 0x55be7eeca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 -- 172.21.15.80:0/2790727674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eaef6b0 msgr2=0x55be7eeca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eaef6b0 0x55be7eeca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 -- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 msgr2=0x55be7eec9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eec9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 -- 172.21.15.80:0/2790727674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be7edd74b0 con 0x55be7eb10390 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f284bfff640 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb4330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55be7eeb5790 tx=0x7f283c017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf3194bd039aedd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.798+0000 7f283a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f283a7fc640 1 -- 172.21.15.80:0/2790727674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c010940 con 0x55be7eb10390 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f283a7fc640 1 -- 172.21.15.80:0/2790727674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7f283c010ae0 con 0x55be7eb10390 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f283c0121f0 con 0x55be7eb10390 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f283a7fc640 1 -- 172.21.15.80:0/2790727674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f283c010ce0 con 0x55be7eb10390 2024-04-25T11:24:51.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 10 client.15699 fetch_fsmap learned FSMap version 22 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55be7eec7e00 con 0x55be7eb10390 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f283a7fc640 1 -- 172.21.15.80:0/2790727674 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f283c0121f0 con 0x55be7eb10390 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f283a7fc640 1 -- 172.21.15.80:0/2790727674 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f283c0037b0 con 0x55be7eb10390 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 10 client.15699 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 20 client.15699 populate_metadata read hostname 'smithi080' 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eaa43a0 0x55be7ef3c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 4 client.15699 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be7ee1e800 con 0x55be7eaa43a0 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.799+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eaa43a0 0x55be7ef3c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f283a7fc640 10 client.15699 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f2852ffd640 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eaa43a0 0x55be7ef3c000 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0cd7b86a19f411b server_cookie=4111dd99f390e436 in_seq=0 out_seq=0 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f283a7fc640 1 -- 172.21.15.80:0/2790727674 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55be7ee1e800 con 0x55be7eaa43a0 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f283a7fc640 10 client.15699 handle_command_reply: tid=0 2024-04-25T11:24:51.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 client.15699 shutdown 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 msgr2=0x55be7eeb4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb4330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55be7eeb5790 tx=0x7f283c017040 comp rx=0 tx=0).stop 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 shutdown_connections 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55be7eaa43a0 0x55be7ef3c000 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55be7eb10390 0x55be7eeb4330 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55be7eaef6b0 0x55be7eeca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 --2- 172.21.15.80:0/2790727674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be7eae74d0 0x55be7eec9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f283a7fc640 0 client.15699 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 >> 172.21.15.80:0/2790727674 conn(0x55be7eb044e0 msgr2=0x55be7eeb2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 shutdown_connections 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 1 -- 172.21.15.80:0/2790727674 wait complete. 2024-04-25T11:24:51.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.800+0000 7f286019c740 20 client.15699 trim_cache size 0 max 16384 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "0cf22d83-c91f-494b-964d-41f2523ee7e5": { 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "0cf22d83-c91f-494b-964d-41f2523ee7e5", 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:24:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:24:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:24:51.803 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:24:51.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28400afcf0 msgr2=0x7f28400b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28400afcf0 0x7f28400b2200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f284c0dcfa0 tx=0x7f284c00efd0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108eb0 msgr2=0x7f285419de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108eb0 0x7f285419de50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f284c00eb10 tx=0x7f284c00c2d0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 shutdown_connections 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28400afcf0 0x7f28400b2200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2854108eb0 0x7f285419de50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2854108a10 0x7f2854199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 --2- 172.21.15.80:0/396763370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28541031c0 0x7f2854199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 >> 172.21.15.80:0/396763370 conn(0x7f28540781b0 msgr2=0x7f28541040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 shutdown_connections 2024-04-25T11:24:51.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:24:51.801+0000 7f28592f0640 1 -- 172.21.15.80:0/396763370 wait complete. 2024-04-25T11:24:51.806 INFO:tasks.cephfs.filesystem:scrub status for tag:0cf22d83-c91f-494b-964d-41f2523ee7e5 - {'path': '/', 'tag': '0cf22d83-c91f-494b-964d-41f2523ee7e5', 'options': 'recursive,force'} 2024-04-25T11:24:52.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:52 smithi196 ceph-mon[32659]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:52.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:52 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:24:52.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:52 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:52.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:52 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:24:52.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:52 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:52.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:52 smithi082 ceph-mon[32440]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:52.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:52 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:24:52.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:52 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:52.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:52 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:24:52.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:52 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:52.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:52 smithi080 ceph-mon[29126]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:24:52.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:52 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:24:52.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:52 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:52.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:52 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:24:52.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:52 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:24:53.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:53 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:24:53.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:53 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:24:53.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:53 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:24:54.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:54 smithi196 ceph-mon[32659]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:24:54.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:54 smithi082 ceph-mon[32440]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:24:54.529 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:54 smithi080 ceph-mon[29126]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:24:56.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:56 smithi196 ceph-mon[32659]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T11:24:56.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:56 smithi082 ceph-mon[32440]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T11:24:56.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:56 smithi080 ceph-mon[29126]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T11:24:58.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:24:58 smithi196 ceph-mon[32659]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T11:24:58.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:24:58 smithi082 ceph-mon[32440]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T11:24:58.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:24:58 smithi080 ceph-mon[29126]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T11:25:00.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:00 smithi196 ceph-mon[32659]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T11:25:00.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:00 smithi082 ceph-mon[32440]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T11:25:00.593 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:00 smithi080 ceph-mon[29126]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 -- 172.21.15.80:0/2915560880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108f00 msgr2=0x7fe6a0102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/2915560880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108f00 0x7fe6a0102b50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe688009900 tx=0x7fe68802a410 comp rx=0 tx=0).stop 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 -- 172.21.15.80:0/2915560880 shutdown_connections 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/2915560880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108f00 0x7fe6a0102b50 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/2915560880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a01031c0 0x7fe6a010f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/2915560880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6a0108a60 0x7fe6a0102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 -- 172.21.15.80:0/2915560880 >> 172.21.15.80:0/2915560880 conn(0x7fe6a00781b0 msgr2=0x7fe6a00785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 -- 172.21.15.80:0/2915560880 shutdown_connections 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.795+0000 7fe6a56d8640 1 -- 172.21.15.80:0/2915560880 wait complete. 2024-04-25T11:25:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 Processor -- start 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 -- start start 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a01031c0 0x7fe6a0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108a60 0x7fe6a0199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6a0108f00 0x7fe6a019df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0112c80 con 0x7fe6a0108a60 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0112b00 con 0x7fe6a01031c0 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe6a56d8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0112e00 con 0x7fe6a0108f00 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108a60 0x7fe6a0199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108a60 0x7fe6a0199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49072/0 (socket says 172.21.15.80:49072) 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe697fff640 1 -- 172.21.15.80:0/3292436252 learned_addr learned my addr 172.21.15.80:0/3292436252 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6a0108f00 0x7fe6a019df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.796+0000 7fe69effd640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a01031c0 0x7fe6a0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe697fff640 1 -- 172.21.15.80:0/3292436252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6a0108f00 msgr2=0x7fe6a019df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe697fff640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6a0108f00 0x7fe6a019df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe697fff640 1 -- 172.21.15.80:0/3292436252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a01031c0 msgr2=0x7fe6a0199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe697fff640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a01031c0 0x7fe6a0199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe697fff640 1 -- 172.21.15.80:0/3292436252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a019e580 con 0x7fe6a0108a60 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe697fff640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108a60 0x7fe6a0199c80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe688006010 tx=0x7fe688004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe69cff9640 1 -- 172.21.15.80:0/3292436252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68803f030 con 0x7fe6a0108a60 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe69cff9640 1 -- 172.21.15.80:0/3292436252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe688003aa0 con 0x7fe6a0108a60 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a019e810 con 0x7fe6a0108a60 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe69cff9640 1 -- 172.21.15.80:0/3292436252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688035070 con 0x7fe6a0108a60 2024-04-25T11:25:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.797+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a019ed00 con 0x7fe6a0108a60 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.799+0000 7fe69cff9640 1 -- 172.21.15.80:0/3292436252 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 147696+0+0 (secure 0 0 0) 0x7fe688042030 con 0x7fe6a0108a60 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 Processor -- start 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 -- start start 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfde980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfdeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfdf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555cedf45460 con 0x555cedc3f1b0 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555cedeff590 con 0x555cedc1e4d0 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe6ac584740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555cedf41420 con 0x555cedc162f0 2024-04-25T11:25:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfde980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe69cff9640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe68c0afce0 0x7fe68c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfde980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49080/0 (socket says 172.21.15.80:49080) 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe69f7fe640 1 -- 172.21.15.80:0/3254242354 learned_addr learned my addr 172.21.15.80:0/3254242354 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe69effd640 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfdeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe68c0afce0 0x7fe68c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.800+0000 7fe697fff640 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfdf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69cff9640 1 -- 172.21.15.80:0/3292436252 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fe6880ff5c0 con 0x7fe6a0108a60 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69f7fe640 1 -- 172.21.15.80:0/3254242354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 msgr2=0x555cedfdeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfdeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69f7fe640 1 -- 172.21.15.80:0/3254242354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 msgr2=0x555cedfdf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfdf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69f7fe640 1 -- 172.21.15.80:0/3254242354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cedf0c0d0 con 0x555cedc3f1b0 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe697fff640 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfdf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfde980 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe698014e70 tx=0x7fe6980117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10859d1ba604cf0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe68c0afce0 0x7fe68c0b21f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe698011cb0 tx=0x7fe69801c000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe6957fa640 1 -- 172.21.15.80:0/3254242354 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698022070 con 0x555cedc3f1b0 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe6957fa640 1 -- 172.21.15.80:0/3254242354 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe69800ac70 con 0x555cedc3f1b0 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.801+0000 7fe6957fa640 1 -- 172.21.15.80:0/3254242354 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698004280 con 0x555cedc3f1b0 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 -- 172.21.15.80:0/3254242354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 msgr2=0x555cedfde980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfde980 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe698014e70 tx=0x7fe6980117b0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 -- 172.21.15.80:0/3254242354 shutdown_connections 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfdf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfdeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 --2- 172.21.15.80:0/3254242354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfde980 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 -- 172.21.15.80:0/3254242354 >> 172.21.15.80:0/3254242354 conn(0x555cedc33300 msgr2=0x555cedfdb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 -- 172.21.15.80:0/3254242354 shutdown_connections 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.802+0000 7fe6ac584740 1 -- 172.21.15.80:0/3254242354 wait complete. 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 -- start start 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 Processor -- start 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfeb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555cedfede30 con 0x555cedc3f1b0 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555cedeccb60 con 0x555cedc1e4d0 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555cedfedfb0 con 0x555cedc162f0 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe6ac584740 10 client.0 _ll_register_callbacks cb 0x555cedef12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfeb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfeb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49090/0 (socket says 172.21.15.80:49090) 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 -- 172.21.15.80:0/1753246173 learned_addr learned my addr 172.21.15.80:0/1753246173 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe697fff640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69effd640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 -- 172.21.15.80:0/1753246173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 msgr2=0x555cedfece90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfece90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 -- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 msgr2=0x555cedfed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69f7fe640 1 -- 172.21.15.80:0/1753246173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cedc57210 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.803+0000 7fe69effd640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfeb2a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe69800a4d0 tx=0x7fe69800a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f272b2b7469f5a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6867fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6867fc640 1 -- 172.21.15.80:0/1753246173 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69802a070 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6867fc640 1 -- 172.21.15.80:0/1753246173 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fe698003b70 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555cedf53070 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6867fc640 1 -- 172.21.15.80:0/1753246173 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe698022050 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 10 client.15717 fetch_fsmap learned FSMap version 22 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555cedd23620 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6867fc640 1 -- 172.21.15.80:0/1753246173 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555cedf53070 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6867fc640 1 -- 172.21.15.80:0/1753246173 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe69801d070 con 0x555cedc3f1b0 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 10 client.15717 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 20 client.15717 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedbfdd80 0x555cedffd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 4 client.15717 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.804+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cedf4cee0 con 0x555cedbfdd80 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.805+0000 7fe69effd640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedbfdd80 0x555cedffd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.805+0000 7fe69effd640 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedbfdd80 0x555cedffd8d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140450d1fe9b28e3 server_cookie=10fff7c2e5c6ba75 in_seq=0 out_seq=0 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.805+0000 7fe6867fc640 10 client.15717 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6867fc640 1 -- 172.21.15.80:0/1753246173 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555cedf4cee0 con 0x555cedbfdd80 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6867fc640 10 client.15717 handle_command_reply: tid=0 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 client.15717 shutdown 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 msgr2=0x555cedfeb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfeb2a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe69800a4d0 tx=0x7fe69800a500 comp rx=0 tx=0).stop 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 shutdown_connections 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedbfdd80 0x555cedffd8d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc3f1b0 0x555cedfeb2a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6867fc640 0 client.15717 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1753246173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 >> 172.21.15.80:0/1753246173 conn(0x555cedc33300 msgr2=0x555cedfe07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 shutdown_connections 2024-04-25T11:25:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 1 -- 172.21.15.80:0/1753246173 wait complete. 2024-04-25T11:25:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.806+0000 7fe6ac584740 20 client.15717 trim_cache size 0 max 16384 2024-04-25T11:25:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 Processor -- start 2024-04-25T11:25:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 -- start start 2024-04-25T11:25:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedbfdd80 0x555cedfdf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfe4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfe51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01b01a0 con 0x555cedbfdd80 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01ada70 con 0x555cedc1e4d0 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe6ac584740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01ab8c0 con 0x555cedc162f0 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe69effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedbfdd80 0x555cedfdf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe69effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedbfdd80 0x555cedfdf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49106/0 (socket says 172.21.15.80:49106) 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe69effd640 1 -- 172.21.15.80:0/1891548145 learned_addr learned my addr 172.21.15.80:0/1891548145 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.821+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfe51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe697fff640 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfe4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe69effd640 1 -- 172.21.15.80:0/1891548145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 msgr2=0x555cedfe4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe69effd640 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfe4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe69effd640 1 -- 172.21.15.80:0/1891548145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 msgr2=0x555cedfe51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe69effd640 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfe51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe69effd640 1 -- 172.21.15.80:0/1891548145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cedfd6a60 con 0x555cedbfdd80 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe69effd640 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedbfdd80 0x555cedfdf350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe6a006c590 tx=0x7fe690005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8369849aff67ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe694ff9640 1 -- 172.21.15.80:0/1891548145 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690004310 con 0x555cedbfdd80 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe694ff9640 1 -- 172.21.15.80:0/1891548145 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6900044b0 con 0x555cedbfdd80 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.822+0000 7fe694ff9640 1 -- 172.21.15.80:0/1891548145 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690003850 con 0x555cedbfdd80 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 -- 172.21.15.80:0/1891548145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedbfdd80 msgr2=0x555cedfdf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedbfdd80 0x555cedfdf350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe6a006c590 tx=0x7fe690005f90 comp rx=0 tx=0).stop 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 -- 172.21.15.80:0/1891548145 shutdown_connections 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedfe51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedc162f0 0x555cedfe4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 --2- 172.21.15.80:0/1891548145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedbfdd80 0x555cedfdf350 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 -- 172.21.15.80:0/1891548145 >> 172.21.15.80:0/1891548145 conn(0x555cedc33300 msgr2=0x555cedfe4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 -- 172.21.15.80:0/1891548145 shutdown_connections 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 -- 172.21.15.80:0/1891548145 wait complete. 2024-04-25T11:25:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 -- start start 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.823+0000 7fe6ac584740 1 Processor -- start 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedbfdd80 0x555cee000d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc162f0 0x555cedffe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedffe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01abf30 con 0x555cedc162f0 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01ad3a0 con 0x555cedc1e4d0 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01ac600 con 0x555cedbfdd80 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 10 client.0 _ll_register_callbacks cb 0x7fe690009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc162f0 0x555cedffe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc162f0 0x555cedffe0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49108/0 (socket says 172.21.15.80:49108) 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 -- 172.21.15.80:0/2755922603 learned_addr learned my addr 172.21.15.80:0/2755922603 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe69f7fe640 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedffe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe69effd640 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedbfdd80 0x555cee000d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 -- 172.21.15.80:0/2755922603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedbfdd80 msgr2=0x555cee000d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedbfdd80 0x555cee000d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 -- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 msgr2=0x555cedffe600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedffe600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 -- 172.21.15.80:0/2755922603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cedffec40 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe697fff640 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc162f0 0x555cedffe0c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe6880fcd40 tx=0x7fe68803b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4172d18eacaa0bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6867fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6867fc640 1 -- 172.21.15.80:0/2755922603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688049040 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6867fc640 1 -- 172.21.15.80:0/2755922603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fe6880c7910 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.824+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6900044b0 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6867fc640 1 -- 172.21.15.80:0/2755922603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe6880c6e20 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 10 client.15723 fetch_fsmap learned FSMap version 22 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555cee067bc0 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6867fc640 1 -- 172.21.15.80:0/2755922603 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6900044b0 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6867fc640 1 -- 172.21.15.80:0/2755922603 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe6880cffd0 con 0x555cedc162f0 2024-04-25T11:25:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 10 client.15723 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 20 client.15723 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedc3f1b0 0x555cee06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 4 client.15723 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cedec85f0 con 0x555cedc3f1b0 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.825+0000 7fe69effd640 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedc3f1b0 0x555cee06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.826+0000 7fe69effd640 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedc3f1b0 0x555cee06a3a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44603a7801bd9b6c server_cookie=5d093d701f1dba0d in_seq=0 out_seq=0 2024-04-25T11:25:00.823 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:00.826+0000 7fe6867fc640 10 client.15723 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:00.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:25:00 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:25:00.599+0000 7fc4a0b89700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:25:00.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:25:00 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:25:00.599+0000 7fc4a0b89700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:25:00.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:25:00 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:25:00.599+0000 7fc4a0b89700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:25:00.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:25:00 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:25:00.599+0000 7fc4a0b89700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:25:00.878 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:25:00 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:25:00.599+0000 7fc4a0b89700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T11:25:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:01.176+0000 7fe69cff9640 1 -- 172.21.15.80:0/3292436252 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7fe688005040 con 0x7fe6a0108a60 2024-04-25T11:25:02.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:02 smithi196 ceph-mon[32659]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-25T11:25:02.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:02 smithi196 ceph-mon[32659]: mgrmap e24: x(active, since 46s), standbys: y, z 2024-04-25T11:25:02.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:02 smithi082 ceph-mon[32440]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-25T11:25:02.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:02 smithi082 ceph-mon[32440]: mgrmap e24: x(active, since 46s), standbys: y, z 2024-04-25T11:25:02.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:02 smithi080 ceph-mon[29126]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-04-25T11:25:02.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:02 smithi080 ceph-mon[29126]: mgrmap e24: x(active, since 46s), standbys: y, z 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.858+0000 7fe6867fc640 1 -- 172.21.15.80:0/2755922603 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cedec85f0 con 0x555cedc3f1b0 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.858+0000 7fe6867fc640 10 client.15723 handle_command_reply: tid=0 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.858+0000 7fe6ac584740 1 client.15723 shutdown 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc162f0 msgr2=0x555cedffe0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc162f0 0x555cedffe0c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe6880fcd40 tx=0x7fe68803b5d0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 shutdown_connections 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555cedc3f1b0 0x555cee06a3a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555cedc162f0 0x555cedffe0c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cedc1e4d0 0x555cedffe600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 --2- 172.21.15.80:0/2755922603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555cedbfdd80 0x555cee000d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6867fc640 0 client.15723 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 >> 172.21.15.80:0/2755922603 conn(0x555cedc33300 msgr2=0x555cedfe4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 shutdown_connections 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 1 -- 172.21.15.80:0/2755922603 wait complete. 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.859+0000 7fe6ac584740 20 client.15723 trim_cache size 0 max 16384 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:25:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe68c0afce0 msgr2=0x7fe68c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe68c0afce0 0x7fe68c0b21f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe698011cb0 tx=0x7fe69801c000 comp rx=0 tx=0).stop 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108a60 msgr2=0x7fe6a0199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108a60 0x7fe6a0199c80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe688006010 tx=0x7fe688004060 comp rx=0 tx=0).stop 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 shutdown_connections 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe68c0afce0 0x7fe68c0b21f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6a0108a60 0x7fe6a0199c80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6a0108f00 0x7fe6a019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 --2- 172.21.15.80:0/3292436252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a01031c0 0x7fe6a0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 >> 172.21.15.80:0/3292436252 conn(0x7fe6a00781b0 msgr2=0x7fe6a0104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 shutdown_connections 2024-04-25T11:25:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:02.860+0000 7fe6a56d8640 1 -- 172.21.15.80:0/3292436252 wait complete. 2024-04-25T11:25:04.161 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: *** Caught signal (Segmentation fault) ** 2024-04-25T11:25:04.161 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: in thread 7f65b30e1700 thread_name:md_log_replay 2024-04-25T11:25:04.161 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T11:25:04.161 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65c44a2d20] 2024-04-25T11:25:04.161 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_find_before_node(unsigned long, unsigned long const&, unsigned long) const+0x1a) [0x561cb9ef73f2] 2024-04-25T11:25:04.161 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 3: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_erase(std::integral_constant, unsigned long const&)+0x2a) [0x561cb9ef78a2] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 4: (MDSTableClient::got_journaled_ack(unsigned long)+0x3df) [0x561cb9ef1f19] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 5: (ETableClient::replay(MDSRank*)+0x5f) [0x561cb9bb34d9] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 6: (MDLog::_replay_thread()+0x1f38) [0x561cb9f57c4a] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 7: (MDLog::ReplayThread::entry()+0x11) [0x561cb9f6109b] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 8: (Thread::entry_wrapper()+0x43) [0x7f65c58f472d] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 9: (Thread::_entry_func(void*)+0xd) [0x7f65c58f4749] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f65c44981ca] 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 11: clone() 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T11:25:03.711+0000 7f65b30e1700 -1 *** Caught signal (Segmentation fault) ** 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: in thread 7f65b30e1700 thread_name:md_log_replay 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T11:25:04.162 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65c44a2d20] 2024-04-25T11:25:04.163 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_find_before_node(unsigned long, unsigned long const&, unsigned long) const+0x1a) [0x561cb9ef73f2] 2024-04-25T11:25:04.163 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 3: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_erase(std::integral_constant, unsigned long const&)+0x2a) [0x561cb9ef78a2] 2024-04-25T11:25:04.163 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 4: (MDSTableClient::got_journaled_ack(unsigned long)+0x3df) [0x561cb9ef1f19] 2024-04-25T11:25:04.163 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 5: (ETableClient::replay(MDSRank*)+0x5f) [0x561cb9bb34d9] 2024-04-25T11:25:04.163 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 6: (MDLog::_replay_thread()+0x1f38) [0x561cb9f57c4a] 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 7: (MDLog::ReplayThread::entry()+0x11) [0x561cb9f6109b] 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 8: (Thread::entry_wrapper()+0x43) [0x7f65c58f472d] 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 9: (Thread::_entry_func(void*)+0xd) [0x7f65c58f4749] 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f65c44981ca] 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 11: clone() 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 0> 2024-04-25T11:25:03.711+0000 7f65b30e1700 -1 *** Caught signal (Segmentation fault) ** 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: in thread 7f65b30e1700 thread_name:md_log_replay 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65c44a2d20] 2024-04-25T11:25:04.164 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_find_before_node(unsigned long, unsigned long const&, unsigned long) const+0x1a) [0x561cb9ef73f2] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 3: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_erase(std::integral_constant, unsigned long const&)+0x2a) [0x561cb9ef78a2] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 4: (MDSTableClient::got_journaled_ack(unsigned long)+0x3df) [0x561cb9ef1f19] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 5: (ETableClient::replay(MDSRank*)+0x5f) [0x561cb9bb34d9] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 6: (MDLog::_replay_thread()+0x1f38) [0x561cb9f57c4a] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 7: (MDLog::ReplayThread::entry()+0x11) [0x561cb9f6109b] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 8: (Thread::entry_wrapper()+0x43) [0x7f65c58f472d] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 9: (Thread::_entry_func(void*)+0xd) [0x7f65c58f4749] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f65c44981ca] 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 11: clone() 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 0> 2024-04-25T11:25:03.711+0000 7f65b30e1700 -1 *** Caught signal (Segmentation fault) ** 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: in thread 7f65b30e1700 thread_name:md_log_replay 2024-04-25T11:25:04.165 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65c44a2d20] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_find_before_node(unsigned long, unsigned long const&, unsigned long) const+0x1a) [0x561cb9ef73f2] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 3: (std::_Hashtable, std::__detail::_Identity, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits >::_M_erase(std::integral_constant, unsigned long const&)+0x2a) [0x561cb9ef78a2] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 4: (MDSTableClient::got_journaled_ack(unsigned long)+0x3df) [0x561cb9ef1f19] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 5: (ETableClient::replay(MDSRank*)+0x5f) [0x561cb9bb34d9] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 6: (MDLog::_replay_thread()+0x1f38) [0x561cb9f57c4a] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 7: (MDLog::ReplayThread::entry()+0x11) [0x561cb9f6109b] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 8: (Thread::entry_wrapper()+0x43) [0x7f65c58f472d] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 9: (Thread::_entry_func(void*)+0xd) [0x7f65c58f4749] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f65c44981ca] 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 11: clone() 2024-04-25T11:25:04.166 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-25T11:25:04.167 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T11:25:04.167 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:03 smithi196 podman[66924]: 2024-04-25 11:25:03.771365254 +0000 UTC m=+0.022578080 container died fd0fbdd31f9daabce8fcde593a15e18448ea97865f01ab4128e1d93a639cb1be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-04-25T11:25:04.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:04 smithi196 ceph-mon[32659]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-04-25T11:25:04.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:04 smithi082 ceph-mon[32440]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-04-25T11:25:04.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:04 smithi080 ceph-mon[29126]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-04-25T11:25:04.939 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:04 smithi196 podman[66924]: 2024-04-25 11:25:04.611630583 +0000 UTC m=+0.862843402 container remove fd0fbdd31f9daabce8fcde593a15e18448ea97865f01ab4128e1d93a639cb1be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-25T11:25:04.939 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:04 smithi196 systemd[1]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=139/n/a 2024-04-25T11:25:04.939 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:04 smithi196 systemd[1]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-25T11:25:06.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:06 smithi196 ceph-mon[32659]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-04-25T11:25:06.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:06 smithi082 ceph-mon[32440]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-04-25T11:25:06.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:06 smithi080 ceph-mon[29126]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-04-25T11:25:08.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:08 smithi196 ceph-mon[32659]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-04-25T11:25:08.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:08 smithi082 ceph-mon[32440]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-04-25T11:25:08.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:08 smithi080 ceph-mon[29126]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-04-25T11:25:10.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:10 smithi196 ceph-mon[32659]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-04-25T11:25:10.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:10 smithi082 ceph-mon[32440]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-04-25T11:25:10.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:10 smithi080 ceph-mon[29126]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-04-25T11:25:12.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:12 smithi196 ceph-mon[32659]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-04-25T11:25:12.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:12 smithi082 ceph-mon[32440]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-04-25T11:25:12.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:12 smithi080 ceph-mon[29126]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-04-25T11:25:14.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:14 smithi196 ceph-mon[32659]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-04-25T11:25:14.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:14 smithi082 ceph-mon[32440]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-04-25T11:25:14.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:14 smithi080 ceph-mon[29126]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-04-25T11:25:15.204 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:14 smithi196 systemd[1]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 1. 2024-04-25T11:25:15.204 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:14 smithi196 systemd[1]: Stopped Ceph mds.c for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:25:15.205 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:14 smithi196 systemd[1]: Starting Ceph mds.c for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:25:15.205 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 podman[67029]: 2024-04-25 11:25:15.085300111 +0000 UTC m=+0.018467934 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:25:15.457 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 podman[67029]: 2024-04-25 11:25:15.212376919 +0000 UTC m=+0.145544769 container create 159950ffb95a36bdd18707015299870ed598c36b515b4919c705a178ef86bbcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T11:25:15.457 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 podman[67029]: 2024-04-25 11:25:15.465027642 +0000 UTC m=+0.398195456 container init 159950ffb95a36bdd18707015299870ed598c36b515b4919c705a178ef86bbcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T11:25:15.939 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 podman[67029]: 2024-04-25 11:25:15.467840731 +0000 UTC m=+0.401008544 container start 159950ffb95a36bdd18707015299870ed598c36b515b4919c705a178ef86bbcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T11:25:15.939 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 ceph-mds[67048]: -- 172.21.15.196:0/771830254 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564dfd74da40 con 0x564dfd795a80 2024-04-25T11:25:15.939 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[67044]: starting mds.c at 2024-04-25T11:25:15.940 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 bash[67029]: 159950ffb95a36bdd18707015299870ed598c36b515b4919c705a178ef86bbcd 2024-04-25T11:25:15.940 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:25:15 smithi196 systemd[1]: Started Ceph mds.c for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:25:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 -- 172.21.15.80:0/68309186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108f20 msgr2=0x7fa7c4102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 --2- 172.21.15.80:0/68309186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108f20 0x7fa7c4102b60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009900 tx=0x7fa7b402a410 comp rx=0 tx=0).stop 2024-04-25T11:25:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 -- 172.21.15.80:0/68309186 shutdown_connections 2024-04-25T11:25:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 --2- 172.21.15.80:0/68309186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108f20 0x7fa7c4102b60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 --2- 172.21.15.80:0/68309186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c41031d0 0x7fa7c410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 --2- 172.21.15.80:0/68309186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7c4108a80 0x7fa7c4102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 -- 172.21.15.80:0/68309186 >> 172.21.15.80:0/68309186 conn(0x7fa7c4078150 msgr2=0x7fa7c4078590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 -- 172.21.15.80:0/68309186 shutdown_connections 2024-04-25T11:25:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.960+0000 7fa7cc384640 1 -- 172.21.15.80:0/68309186 wait complete. 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 Processor -- start 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 -- start start 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7c41031d0 0x7fa7c41996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108a80 0x7fa7c4199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c4108f20 0x7fa7c419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4112c70 con 0x7fa7c4108a80 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4112af0 con 0x7fa7c4108f20 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7cc384640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4112df0 con 0x7fa7c41031d0 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.961+0000 7fa7c991f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108a80 0x7fa7c4199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108a80 0x7fa7c4199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41578/0 (socket says 172.21.15.80:41578) 2024-04-25T11:25:15.956 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 -- 172.21.15.80:0/1494568203 learned_addr learned my addr 172.21.15.80:0/1494568203 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7ca120640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7c41031d0 0x7fa7c41996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7ca921640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c4108f20 0x7fa7c419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 -- 172.21.15.80:0/1494568203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7c41031d0 msgr2=0x7fa7c41996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7c41031d0 0x7fa7c41996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 -- 172.21.15.80:0/1494568203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c4108f20 msgr2=0x7fa7c419def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c4108f20 0x7fa7c419def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 -- 172.21.15.80:0/1494568203 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c419e530 con 0x7fa7c4108a80 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7c991f640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108a80 0x7fa7c4199c30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa7b402a930 tx=0x7fa7b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7bb7fe640 1 -- 172.21.15.80:0/1494568203 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b403f030 con 0x7fa7c4108a80 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c419e7c0 con 0x7fa7c4108a80 2024-04-25T11:25:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7bb7fe640 1 -- 172.21.15.80:0/1494568203 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7b4003aa0 con 0x7fa7c4108a80 2024-04-25T11:25:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7bb7fe640 1 -- 172.21.15.80:0/1494568203 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4035070 con 0x7fa7c4108a80 2024-04-25T11:25:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.962+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c419ed00 con 0x7fa7c4108a80 2024-04-25T11:25:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.965+0000 7fa7d3233740 1 Processor -- start 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7d3233740 1 -- start start 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7bb7fe640 1 -- 172.21.15.80:0/1494568203 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7fa7b4042030 con 0x7fa7c4108a80 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1f41b0 0x560c7a59c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1cb2f0 0x560c7a593900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1d34d0 0x560c7a593e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7d3233740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560c7a4fa460 con 0x560c7a1cb2f0 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7d3233740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560c7a4b4590 con 0x560c7a1d34d0 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7d3233740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560c7a4f6420 con 0x560c7a1f41b0 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7ca120640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1cb2f0 0x560c7a593900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7ca120640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1cb2f0 0x560c7a593900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41584/0 (socket says 172.21.15.80:41584) 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7ca120640 1 -- 172.21.15.80:0/3122007257 learned_addr learned my addr 172.21.15.80:0/3122007257 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7ca921640 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1f41b0 0x560c7a59c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7c991f640 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1d34d0 0x560c7a593e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7ca120640 1 -- 172.21.15.80:0/3122007257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1f41b0 msgr2=0x560c7a59c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.966+0000 7fa7ca120640 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1f41b0 0x560c7a59c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7ca120640 1 -- 172.21.15.80:0/3122007257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1d34d0 msgr2=0x560c7a593e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7ca120640 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1d34d0 0x560c7a593e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7ca120640 1 -- 172.21.15.80:0/3122007257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7a4c10d0 con 0x560c7a1cb2f0 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7ca921640 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1f41b0 0x560c7a59c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7ca120640 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1cb2f0 0x560c7a593900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000b690 tx=0x7fa7c000bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1909aa692eff9a55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7bb7fe640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa7b00afe70 0x7fa7b00b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7bb7fe640 1 -- 172.21.15.80:0/1494568203 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fa7b40ff640 con 0x7fa7c4108a80 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.967+0000 7fa7ca921640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa7b00afe70 0x7fa7b00b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7b8bfe640 1 -- 172.21.15.80:0/3122007257 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0003bd0 con 0x560c7a1cb2f0 2024-04-25T11:25:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7b8bfe640 1 -- 172.21.15.80:0/3122007257 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c0015070 con 0x560c7a1cb2f0 2024-04-25T11:25:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7b8bfe640 1 -- 172.21.15.80:0/3122007257 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0004d40 con 0x560c7a1cb2f0 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7d3233740 1 -- 172.21.15.80:0/3122007257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1cb2f0 msgr2=0x560c7a593900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7d3233740 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1cb2f0 0x560c7a593900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000b690 tx=0x7fa7c000bb50 comp rx=0 tx=0).stop 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7ca921640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa7b00afe70 0x7fa7b00b2380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x560c7a590cd0 tx=0x7fa7bc0096a0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7d3233740 1 -- 172.21.15.80:0/3122007257 shutdown_connections 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7d3233740 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1cb2f0 0x560c7a593900 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7d3233740 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1d34d0 0x560c7a593e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.968+0000 7fa7d3233740 1 --2- 172.21.15.80:0/3122007257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1f41b0 0x560c7a59c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.969+0000 7fa7d3233740 1 -- 172.21.15.80:0/3122007257 >> 172.21.15.80:0/3122007257 conn(0x560c7a1e8300 msgr2=0x560c7a5902a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.969+0000 7fa7d3233740 1 -- 172.21.15.80:0/3122007257 shutdown_connections 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.969+0000 7fa7d3233740 1 -- 172.21.15.80:0/3122007257 wait complete. 2024-04-25T11:25:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.969+0000 7fa7d3233740 1 -- start start 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.969+0000 7fa7d3233740 1 Processor -- start 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a5a3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7d3233740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560c7a594620 con 0x560c7a1f41b0 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7d3233740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560c7a481b60 con 0x560c7a1cb2f0 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7d3233740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560c7a59cf30 con 0x560c7a1d34d0 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7d3233740 10 client.0 _ll_register_callbacks cb 0x560c7a4a62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5a9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41586/0 (socket says 172.21.15.80:41586) 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 -- 172.21.15.80:0/1738401462 learned_addr learned my addr 172.21.15.80:0/1738401462 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7c991f640 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a5a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca120640 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 -- 172.21.15.80:0/1738401462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 msgr2=0x560c7a5a3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a5a3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 -- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 msgr2=0x560c7a5a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 -- 172.21.15.80:0/1738401462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c7a20c210 con 0x560c7a1f41b0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7ca921640 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5a9040 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009d60 tx=0x7fa7bc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f1910c43111c66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.970+0000 7fa7adffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7adffb640 1 -- 172.21.15.80:0/1738401462 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011d50 con 0x560c7a1f41b0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7adffb640 1 -- 172.21.15.80:0/1738401462 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fa7bc029420 con 0x560c7a1f41b0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7c0015070 con 0x560c7a1f41b0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7adffb640 1 -- 172.21.15.80:0/1738401462 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa7bc029620 con 0x560c7a1f41b0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7d3233740 10 client.15741 fetch_fsmap learned FSMap version 22 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560c7a2d8620 con 0x560c7a1f41b0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7adffb640 1 -- 172.21.15.80:0/1738401462 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c0015070 con 0x560c7a1f41b0 2024-04-25T11:25:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.971+0000 7fa7adffb640 1 -- 172.21.15.80:0/1738401462 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa7bc0337a0 con 0x560c7a1f41b0 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7d3233740 10 client.15741 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7d3233740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7d3233740 20 client.15741 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7d3233740 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1b2d80 0x560c7a5c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7d3233740 4 client.15741 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c7a508070 con 0x560c7a1b2d80 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7ca120640 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1b2d80 0x560c7a5c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7adffb640 10 client.15741 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.972+0000 7fa7ca120640 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1b2d80 0x560c7a5c18d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c61d945c67a0c30 server_cookie=38199933d0cca1e0 in_seq=0 out_seq=0 2024-04-25T11:25:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.973+0000 7fa7adffb640 1 -- 172.21.15.80:0/1738401462 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560c7a508070 con 0x560c7a1b2d80 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.973+0000 7fa7adffb640 10 client.15741 handle_command_reply: tid=0 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.973+0000 7fa7d3233740 1 client.15741 shutdown 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.973+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 msgr2=0x560c7a5a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.973+0000 7fa7d3233740 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5a9040 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009d60 tx=0x7fa7bc004ab0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 shutdown_connections 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1b2d80 0x560c7a5c18d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5a9040 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a5a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 --2- 172.21.15.80:0/1738401462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7adffb640 0 client.15741 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 >> 172.21.15.80:0/1738401462 conn(0x560c7a1e8300 msgr2=0x560c7a58e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 shutdown_connections 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 1 -- 172.21.15.80:0/1738401462 wait complete. 2024-04-25T11:25:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:15.974+0000 7fa7d3233740 20 client.15741 trim_cache size 0 max 16384 2024-04-25T11:25:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 Processor -- start 2024-04-25T11:25:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 -- start start 2024-04-25T11:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a58af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c41b0170 con 0x560c7a1f41b0 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c41ada40 con 0x560c7a1cb2f0 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7d3233740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c41ab890 con 0x560c7a1d34d0 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7ca921640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7ca921640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41598/0 (socket says 172.21.15.80:41598) 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7ca921640 1 -- 172.21.15.80:0/569501666 learned_addr learned my addr 172.21.15.80:0/569501666 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7c991f640 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a58af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.003+0000 7fa7ca120640 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7ca921640 1 -- 172.21.15.80:0/569501666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 msgr2=0x560c7a58af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7ca921640 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a58af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7ca921640 1 -- 172.21.15.80:0/569501666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 msgr2=0x560c7a5a2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7ca921640 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7ca921640 1 -- 172.21.15.80:0/569501666 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7a59c920 con 0x560c7a1f41b0 2024-04-25T11:25:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7c991f640 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a58af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7ca921640 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5995d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc000f80 tx=0x7fa7bc005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457068f09832b4d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7affff640 1 -- 172.21.15.80:0/569501666 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc033e30 con 0x560c7a1f41b0 2024-04-25T11:25:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7affff640 1 -- 172.21.15.80:0/569501666 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7bc024030 con 0x560c7a1f41b0 2024-04-25T11:25:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.004+0000 7fa7affff640 1 -- 172.21.15.80:0/569501666 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0206e0 con 0x560c7a1f41b0 2024-04-25T11:25:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 -- 172.21.15.80:0/569501666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 msgr2=0x560c7a5995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5995d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc000f80 tx=0x7fa7bc005c50 comp rx=0 tx=0).stop 2024-04-25T11:25:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 -- 172.21.15.80:0/569501666 shutdown_connections 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1f41b0 0x560c7a5995d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1d34d0 0x560c7a58af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 --2- 172.21.15.80:0/569501666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1cb2f0 0x560c7a5a2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 -- 172.21.15.80:0/569501666 >> 172.21.15.80:0/569501666 conn(0x560c7a1e8300 msgr2=0x560c7a5a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 -- 172.21.15.80:0/569501666 shutdown_connections 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.005+0000 7fa7d3233740 1 -- 172.21.15.80:0/569501666 wait complete. 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 -- start start 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 Processor -- start 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1cb2f0 0x560c7a5d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1d34d0 0x560c7a5d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1f41b0 0x560c7a5d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c41abf00 con 0x560c7a1d34d0 2024-04-25T11:25:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c41ad370 con 0x560c7a1f41b0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c41ac5d0 con 0x560c7a1cb2f0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7d3233740 10 client.0 _ll_register_callbacks cb 0x7fa7bc0098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7c991f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1d34d0 0x560c7a5d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7c991f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1d34d0 0x560c7a5d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41606/0 (socket says 172.21.15.80:41606) 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7c991f640 1 -- 172.21.15.80:0/681455750 learned_addr learned my addr 172.21.15.80:0/681455750 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7ca120640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1cb2f0 0x560c7a5d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.006+0000 7fa7ca921640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1f41b0 0x560c7a5d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7ca120640 1 -- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1f41b0 msgr2=0x560c7a5d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7ca120640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1f41b0 0x560c7a5d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7ca120640 1 -- 172.21.15.80:0/681455750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1d34d0 msgr2=0x560c7a5d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7ca120640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1d34d0 0x560c7a5d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7ca120640 1 -- 172.21.15.80:0/681455750 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c7a5d0c70 con 0x560c7a1cb2f0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7c991f640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1d34d0 0x560c7a5d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7ca120640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1cb2f0 0x560c7a5d2dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0004880 tx=0x7fa7c000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87703ce0159a8f38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7adffb640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7adffb640 1 -- 172.21.15.80:0/681455750 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0003de0 con 0x560c7a1cb2f0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7bc024030 con 0x560c7a1cb2f0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7adffb640 1 -- 172.21.15.80:0/681455750 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8506+0+0 (secure 0 0 0) 0x7fa7c0011440 con 0x560c7a1cb2f0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7adffb640 1 -- 172.21.15.80:0/681455750 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa7c0011660 con 0x560c7a1cb2f0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7d3233740 10 client.25324 fetch_fsmap learned FSMap version 22 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.007+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560c7a6296c0 con 0x560c7a1cb2f0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7adffb640 1 -- 172.21.15.80:0/681455750 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7bc024030 con 0x560c7a1cb2f0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7adffb640 1 -- 172.21.15.80:0/681455750 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa7c0019540 con 0x560c7a1cb2f0 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7d3233740 10 client.25324 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7d3233740 10 client.25324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7d3233740 20 client.25324 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7d3233740 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1881c0 0x560c7a62bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7d3233740 4 client.25324 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:25:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560c7a501ee0 con 0x560c7a1881c0 2024-04-25T11:25:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.008+0000 7fa7c991f640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1881c0 0x560c7a62bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.009+0000 7fa7adffb640 10 client.25324 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.009+0000 7fa7c991f640 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1881c0 0x560c7a62bcc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b689dd9b504369e1 server_cookie=fe92d2eeb866e8f in_seq=0 out_seq=0 2024-04-25T11:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.012+0000 7fa7adffb640 1 -- 172.21.15.80:0/681455750 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560c7a501ee0 con 0x560c7a1881c0 2024-04-25T11:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.012+0000 7fa7adffb640 10 client.25324 handle_command_reply: tid=0 2024-04-25T11:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.012+0000 7fa7d3233740 1 client.25324 shutdown 2024-04-25T11:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.012+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1cb2f0 msgr2=0x560c7a5d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1cb2f0 0x560c7a5d2dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0004880 tx=0x7fa7c000be30 comp rx=0 tx=0).stop 2024-04-25T11:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 shutdown_connections 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560c7a1881c0 0x560c7a62bcc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c7a1d34d0 0x560c7a5d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7adffb640 0 client.25324 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560c7a1f41b0 0x560c7a5d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 --2- 172.21.15.80:0/681455750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560c7a1cb2f0 0x560c7a5d2dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 >> 172.21.15.80:0/681455750 conn(0x560c7a1e8300 msgr2=0x560c7a5995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 shutdown_connections 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 1 -- 172.21.15.80:0/681455750 wait complete. 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7d3233740 20 client.25324 trim_cache size 0 max 16384 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:25:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:25:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa7b00afe70 msgr2=0x7fa7b00b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa7b00afe70 0x7fa7b00b2380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x560c7a590cd0 tx=0x7fa7bc0096a0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108a80 msgr2=0x7fa7c4199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108a80 0x7fa7c4199c30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa7b402a930 tx=0x7fa7b4004270 comp rx=0 tx=0).stop 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 shutdown_connections 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa7b00afe70 0x7fa7b00b2380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7c4108a80 0x7fa7c4199c30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.013+0000 7fa7cc384640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c4108f20 0x7fa7c419def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.014+0000 7fa7cc384640 1 --2- 172.21.15.80:0/1494568203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7c41031d0 0x7fa7c41996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.014+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 >> 172.21.15.80:0/1494568203 conn(0x7fa7c4078150 msgr2=0x7fa7c4101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.014+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 shutdown_connections 2024-04-25T11:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:16.014+0000 7fa7cc384640 1 -- 172.21.15.80:0/1494568203 wait complete. 2024-04-25T11:25:16.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:16 smithi196 ceph-mon[32659]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-25T11:25:16.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:16 smithi196 ceph-mon[32659]: daemon mds.c restarted 2024-04-25T11:25:16.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:16 smithi082 ceph-mon[32440]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-25T11:25:16.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:16 smithi082 ceph-mon[32440]: daemon mds.c restarted 2024-04-25T11:25:16.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:16 smithi080 ceph-mon[29126]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-25T11:25:16.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:16 smithi080 ceph-mon[29126]: daemon mds.c restarted 2024-04-25T11:25:17.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:17 smithi196 ceph-mon[32659]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T11:25:17.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:17 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6836/2667891296,v1:172.21.15.196:6837/2667891296] up:boot 2024-04-25T11:25:17.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:17 smithi196 ceph-mon[32659]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-04-25T11:25:17.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:17 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:25:17.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:17 smithi196 ceph-mon[32659]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:25:17.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:17 smithi082 ceph-mon[32440]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T11:25:17.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:17 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6836/2667891296,v1:172.21.15.196:6837/2667891296] up:boot 2024-04-25T11:25:17.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:17 smithi082 ceph-mon[32440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-04-25T11:25:17.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:17 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:25:17.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:17 smithi082 ceph-mon[32440]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:25:17.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:17 smithi080 ceph-mon[29126]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T11:25:17.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:17 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6836/2667891296,v1:172.21.15.196:6837/2667891296] up:boot 2024-04-25T11:25:17.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:17 smithi080 ceph-mon[29126]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-04-25T11:25:17.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:17 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:25:17.628 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:17 smithi080 ceph-mon[29126]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T11:25:18.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:18 smithi082 ceph-mon[32440]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-25T11:25:18.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:18 smithi080 ceph-mon[29126]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-25T11:25:18.689 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:18 smithi196 ceph-mon[32659]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-25T11:25:20.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:20 smithi082 ceph-mon[32440]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-25T11:25:20.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:20 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:25:20.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:20 smithi080 ceph-mon[29126]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-25T11:25:20.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:20 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:25:20.689 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:20 smithi196 ceph-mon[32659]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-25T11:25:20.689 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:20 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:25:21.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:25:21.807 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:25:21.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-04-25T11:25:21.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:25:21.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:25:21.828 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.927+0000 7fd334415640 1 -- 172.21.15.80:0/2214276342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c107450 msgr2=0x7fd32c10ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.927+0000 7fd334415640 1 --2- 172.21.15.80:0/2214276342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c107450 0x7fd32c10ebf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd324009ca0 tx=0x7fd32402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 -- 172.21.15.80:0/2214276342 shutdown_connections 2024-04-25T11:25:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 --2- 172.21.15.80:0/2214276342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c107450 0x7fd32c10ebf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 --2- 172.21.15.80:0/2214276342 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd32c106990 0x7fd32c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 --2- 172.21.15.80:0/2214276342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32c102400 0x7fd32c102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 -- 172.21.15.80:0/2214276342 >> 172.21.15.80:0/2214276342 conn(0x7fd32c077880 msgr2=0x7fd32c077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 -- 172.21.15.80:0/2214276342 shutdown_connections 2024-04-25T11:25:21.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 -- 172.21.15.80:0/2214276342 wait complete. 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.928+0000 7fd334415640 1 Processor -- start 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd334415640 1 -- start start 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd334415640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c102400 0x7fd32c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd334415640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32c106990 0x7fd32c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd334415640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd32c107450 0x7fd32c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd334415640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c111ae0 con 0x7fd32c102400 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd334415640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c111960 con 0x7fd32c106990 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd334415640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c111c60 con 0x7fd32c107450 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd3321b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c102400 0x7fd32c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd3321b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c102400 0x7fd32c19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47328/0 (socket says 172.21.15.80:47328) 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd3321b1640 1 -- 172.21.15.80:0/2822950890 learned_addr learned my addr 172.21.15.80:0/2822950890 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:21.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd3319b0640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32c106990 0x7fd32c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd3329b2640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd32c107450 0x7fd32c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd3321b1640 1 -- 172.21.15.80:0/2822950890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd32c107450 msgr2=0x7fd32c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.929+0000 7fd3321b1640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd32c107450 0x7fd32c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3321b1640 1 -- 172.21.15.80:0/2822950890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32c106990 msgr2=0x7fd32c19ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3321b1640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32c106990 0x7fd32c19ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3321b1640 1 -- 172.21.15.80:0/2822950890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c19f610 con 0x7fd32c102400 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3319b0640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32c106990 0x7fd32c19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3321b1640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c102400 0x7fd32c19a7b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd32800ea60 tx=0x7fd32800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3237fe640 1 -- 172.21.15.80:0/2822950890 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32800cde0 con 0x7fd32c102400 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c19f900 con 0x7fd32c102400 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3237fe640 1 -- 172.21.15.80:0/2822950890 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3280035f0 con 0x7fd32c102400 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd3237fe640 1 -- 172.21.15.80:0/2822950890 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328010690 con 0x7fd32c102400 2024-04-25T11:25:21.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.930+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c1a7280 con 0x7fd32c102400 2024-04-25T11:25:21.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 Processor -- start 2024-04-25T11:25:21.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 -- start start 2024-04-25T11:25:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffb98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffb9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffcad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56325ff1fd80 con 0x56325fbf86b0 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56325fed98b0 con 0x56325fbf04d0 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.933+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56325ff1bd40 con 0x56325fc19390 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffcad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffcad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47332/0 (socket says 172.21.15.80:47332) 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 -- 172.21.15.80:0/2521701718 learned_addr learned my addr 172.21.15.80:0/2521701718 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3329b2640 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffb98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 -- 172.21.15.80:0/2521701718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 msgr2=0x56325ffb98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffb98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3237fe640 1 -- 172.21.15.80:0/2822950890 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7fd3280037a0 con 0x7fd32c102400 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 -- 172.21.15.80:0/2521701718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 msgr2=0x56325ffb9e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffb9e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 -- 172.21.15.80:0/2521701718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325feaaa40 con 0x56325fbf86b0 2024-04-25T11:25:21.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd3319b0640 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffcad00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00e500 tx=0x7fd31c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381c9ad65b81425c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:21.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.934+0000 7fd320bfe640 1 -- 172.21.15.80:0/2521701718 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c004310 con 0x56325fbf86b0 2024-04-25T11:25:21.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.935+0000 7fd320bfe640 1 -- 172.21.15.80:0/2521701718 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd31c0044b0 con 0x56325fbf86b0 2024-04-25T11:25:21.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.935+0000 7fd320bfe640 1 -- 172.21.15.80:0/2521701718 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00da90 con 0x56325fbf86b0 2024-04-25T11:25:21.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.935+0000 7fd3237fe640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3180afd80 0x7fd3180b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.935+0000 7fd3329b2640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3180afd80 0x7fd3180b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.935+0000 7fd3237fe640 1 -- 172.21.15.80:0/2822950890 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd3280df680 con 0x7fd32c102400 2024-04-25T11:25:21.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.935+0000 7fd33b3a6740 1 -- 172.21.15.80:0/2521701718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 msgr2=0x56325ffcad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.935+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffcad00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00e500 tx=0x7fd31c005f90 comp rx=0 tx=0).stop 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 -- 172.21.15.80:0/2521701718 shutdown_connections 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffcad00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffb9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/2521701718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffb98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 -- 172.21.15.80:0/2521701718 >> 172.21.15.80:0/2521701718 conn(0x56325fc0d4e0 msgr2=0x56325ffb6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd3329b2640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3180afd80 0x7fd3180b2290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x56325ffb6c00 tx=0x7fd324005c30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 -- 172.21.15.80:0/2521701718 shutdown_connections 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 -- 172.21.15.80:0/2521701718 wait complete. 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 -- start start 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.936+0000 7fd33b3a6740 1 Processor -- start 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffc89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffc8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffd4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56325ffcb440 con 0x56325fbf86b0 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56325fea6d10 con 0x56325fbf04d0 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56325ffcb5c0 con 0x56325fc19390 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd33b3a6740 10 client.0 _ll_register_callbacks cb 0x56325fed3210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3319b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffc8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3319b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffc8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47338/0 (socket says 172.21.15.80:47338) 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3321b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffc89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3319b0640 1 -- 172.21.15.80:0/3908251810 learned_addr learned my addr 172.21.15.80:0/3908251810 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3329b2640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffd4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3321b1640 1 -- 172.21.15.80:0/3908251810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 msgr2=0x56325ffd4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3321b1640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffd4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3321b1640 1 -- 172.21.15.80:0/3908251810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 msgr2=0x56325ffc8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3321b1640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffc8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3321b1640 1 -- 172.21.15.80:0/3908251810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56325fcfb7d0 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3329b2640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffd4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3319b0640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffc8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.937+0000 7fd3321b1640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffc89a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3280dcc60 tx=0x7fd3280a6ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc06d08856b0ef04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd315ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd315ffb640 1 -- 172.21.15.80:0/3908251810 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3280a7ce0 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd31c0044b0 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd315ffb640 1 -- 172.21.15.80:0/3908251810 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd3280a3870 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd315ffb640 1 -- 172.21.15.80:0/3908251810 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd3280a75e0 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 10 client.25334 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56325fc313f0 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd315ffb640 1 -- 172.21.15.80:0/3908251810 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd31c0044b0 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd315ffb640 1 -- 172.21.15.80:0/3908251810 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd3280a2f50 con 0x56325fbf04d0 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 10 client.25334 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 10 client.25334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:21.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 20 client.25334 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:21.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbd7f60 0x56325ffdab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 4 client.25334 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:21.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.938+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56325ff2d990 con 0x56325fbd7f60 2024-04-25T11:25:21.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.939+0000 7fd3319b0640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbd7f60 0x56325ffdab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.939+0000 7fd315ffb640 10 client.25334 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:21.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.939+0000 7fd3319b0640 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbd7f60 0x56325ffdab30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb054e6fc6b804c server_cookie=4ffd6dff4e8ce301 in_seq=0 out_seq=0 2024-04-25T11:25:21.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd315ffb640 1 -- 172.21.15.80:0/3908251810 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56325ff2d990 con 0x56325fbd7f60 2024-04-25T11:25:21.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd315ffb640 10 client.25334 handle_command_reply: tid=0 2024-04-25T11:25:21.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 client.25334 shutdown 2024-04-25T11:25:21.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 msgr2=0x56325ffc89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffc89a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3280dcc60 tx=0x7fd3280a6ff0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 shutdown_connections 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbd7f60 0x56325ffdab30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd315ffb640 0 client.25334 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf86b0 0x56325ffc8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x56325ffd4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/3908251810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf04d0 0x56325ffc89a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 >> 172.21.15.80:0/3908251810 conn(0x56325fc0d4e0 msgr2=0x56325ffbb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 shutdown_connections 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 1 -- 172.21.15.80:0/3908251810 wait complete. 2024-04-25T11:25:21.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.940+0000 7fd33b3a6740 20 client.25334 trim_cache size 0 max 16384 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:25:21.939 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 Processor -- start 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 -- start start 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbd7f60 0x56325ffc76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fbf04d0 0x56325ffd08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffd0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c1b00e0 con 0x56325fbd7f60 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c1ad9b0 con 0x56325fbf86b0 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd33b3a6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c1ab800 con 0x56325fbf04d0 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd3321b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbd7f60 0x56325ffc76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd3321b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbd7f60 0x56325ffc76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47346/0 (socket says 172.21.15.80:47346) 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd3319b0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fbf04d0 0x56325ffd08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.958+0000 7fd3321b1640 1 -- 172.21.15.80:0/1723813556 learned_addr learned my addr 172.21.15.80:0/1723813556 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3329b2640 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffd0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3321b1640 1 -- 172.21.15.80:0/1723813556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fbf04d0 msgr2=0x56325ffd08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3321b1640 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fbf04d0 0x56325ffd08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3321b1640 1 -- 172.21.15.80:0/1723813556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 msgr2=0x56325ffd0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3321b1640 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffd0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3321b1640 1 -- 172.21.15.80:0/1723813556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325fbf10f0 con 0x56325fbd7f60 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3329b2640 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffd0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd3321b1640 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbd7f60 0x56325ffc76d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd3280a72e0 tx=0x7fd3280a7060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6b62e28aa5d1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd317fff640 1 -- 172.21.15.80:0/1723813556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3280ab990 con 0x56325fbd7f60 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd317fff640 1 -- 172.21.15.80:0/1723813556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3280a7ce0 con 0x56325fbd7f60 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.959+0000 7fd317fff640 1 -- 172.21.15.80:0/1723813556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3280dd1a0 con 0x56325fbd7f60 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 -- 172.21.15.80:0/1723813556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbd7f60 msgr2=0x56325ffc76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbd7f60 0x56325ffc76d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd3280a72e0 tx=0x7fd3280a7060 comp rx=0 tx=0).stop 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 -- 172.21.15.80:0/1723813556 shutdown_connections 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffd0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fbf04d0 0x56325ffd08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/1723813556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbd7f60 0x56325ffc76d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 -- 172.21.15.80:0/1723813556 >> 172.21.15.80:0/1723813556 conn(0x56325fc0d4e0 msgr2=0x56325ffc9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 -- 172.21.15.80:0/1723813556 shutdown_connections 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 -- 172.21.15.80:0/1723813556 wait complete. 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.960+0000 7fd33b3a6740 1 -- start start 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 1 Processor -- start 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf04d0 0x56325ffcbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffcc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x563260040e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd3321b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf04d0 0x56325ffcbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd3321b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf04d0 0x56325ffcbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47360/0 (socket says 172.21.15.80:47360) 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd3321b1640 1 -- 172.21.15.80:0/4025104439 learned_addr learned my addr 172.21.15.80:0/4025104439 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c1abe70 con 0x56325fbf04d0 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c1ad2e0 con 0x56325fbf86b0 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c1ac540 con 0x56325fc19390 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd3319b0640 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffcc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd33b3a6740 10 client.0 _ll_register_callbacks cb 0x7fd328003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.961+0000 7fd3329b2640 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x563260040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd3321b1640 1 -- 172.21.15.80:0/4025104439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 msgr2=0x563260040e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd3321b1640 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x563260040e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd3321b1640 1 -- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 msgr2=0x56325ffcc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd3321b1640 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffcc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd3321b1640 1 -- 172.21.15.80:0/4025104439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56325fee04b0 con 0x56325fbf04d0 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd3321b1640 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf04d0 0x56325ffcbb50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd3280a7570 tx=0x7fd3280dd170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86326cc8984060a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd315ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd315ffb640 1 -- 172.21.15.80:0/4025104439 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3280dd1e0 con 0x56325fbf04d0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd315ffb640 1 -- 172.21.15.80:0/4025104439 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd3280a6a50 con 0x56325fbf04d0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3280a7ce0 con 0x56325fbf04d0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd315ffb640 1 -- 172.21.15.80:0/4025104439 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd3280b0440 con 0x56325fbf04d0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd33b3a6740 10 client.15765 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5632600422b0 con 0x56325fbf04d0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.962+0000 7fd315ffb640 1 -- 172.21.15.80:0/4025104439 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3280a7ce0 con 0x56325fbf04d0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd315ffb640 1 -- 172.21.15.80:0/4025104439 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd3280c83a0 con 0x56325fbf04d0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd33b3a6740 10 client.15765 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd33b3a6740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd33b3a6740 20 client.15765 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbad3a0 0x5632600447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd33b3a6740 4 client.15765 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56325ff27800 con 0x56325fbad3a0 2024-04-25T11:25:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd3319b0640 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbad3a0 0x5632600447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd315ffb640 10 client.15765 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.963+0000 7fd3319b0640 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbad3a0 0x5632600447f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf033b0b1e608b8 server_cookie=433e9c1bf9fcbfab in_seq=0 out_seq=0 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd315ffb640 1 -- 172.21.15.80:0/4025104439 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56325ff27800 con 0x56325fbad3a0 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd315ffb640 10 client.15765 handle_command_reply: tid=0 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 client.15765 shutdown 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf04d0 msgr2=0x56325ffcbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf04d0 0x56325ffcbb50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd3280a7570 tx=0x7fd3280dd170 comp rx=0 tx=0).stop 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 shutdown_connections 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56325fbad3a0 0x5632600447f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56325fc19390 0x563260040e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56325fbf86b0 0x56325ffcc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd315ffb640 0 client.15765 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 --2- 172.21.15.80:0/4025104439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56325fbf04d0 0x56325ffcbb50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 >> 172.21.15.80:0/4025104439 conn(0x56325fc0d4e0 msgr2=0x56325ffca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 shutdown_connections 2024-04-25T11:25:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 1 -- 172.21.15.80:0/4025104439 wait complete. 2024-04-25T11:25:21.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.964+0000 7fd33b3a6740 20 client.15765 trim_cache size 0 max 16384 2024-04-25T11:25:21.965 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:25:21.965 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:25:21.965 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:25:21.965 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3180afd80 msgr2=0x7fd3180b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3180afd80 0x7fd3180b2290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x56325ffb6c00 tx=0x7fd324005c30 comp rx=0 tx=0).stop 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c102400 msgr2=0x7fd32c19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c102400 0x7fd32c19a7b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd32800ea60 tx=0x7fd32800ef20 comp rx=0 tx=0).stop 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 shutdown_connections 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3180afd80 0x7fd3180b2290 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd32c107450 0x7fd32c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd32c106990 0x7fd32c19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 --2- 172.21.15.80:0/2822950890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd32c102400 0x7fd32c19a7b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 >> 172.21.15.80:0/2822950890 conn(0x7fd32c077880 msgr2=0x7fd32c0ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:21.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 shutdown_connections 2024-04-25T11:25:21.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:21.965+0000 7fd334415640 1 -- 172.21.15.80:0/2822950890 wait complete. 2024-04-25T11:25:21.972 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:25:21.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:25:21.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:21.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-04-25T11:25:21.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:25:21.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:25:21.994 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 -- 172.21.15.80:0/1357555019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff98102af0 msgr2=0x7eff98102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 --2- 172.21.15.80:0/1357555019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff98102af0 0x7eff98102f00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00d910 tx=0x7eff8c02c380 comp rx=0 tx=0).stop 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 -- 172.21.15.80:0/1357555019 shutdown_connections 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 --2- 172.21.15.80:0/1357555019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff98102af0 0x7eff98102f00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 --2- 172.21.15.80:0/1357555019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff9810d380 0x7eff9810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 --2- 172.21.15.80:0/1357555019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff98108a20 0x7eff981025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 -- 172.21.15.80:0/1357555019 >> 172.21.15.80:0/1357555019 conn(0x7eff98078110 msgr2=0x7eff98078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 -- 172.21.15.80:0/1357555019 shutdown_connections 2024-04-25T11:25:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.186+0000 7eff9e964640 1 -- 172.21.15.80:0/1357555019 wait complete. 2024-04-25T11:25:22.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.187+0000 7eff9e964640 1 Processor -- start 2024-04-25T11:25:22.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.187+0000 7eff9e964640 1 -- start start 2024-04-25T11:25:22.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff9e964640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff98108a20 0x7eff98198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff9e964640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff9810d380 0x7eff98198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff9e964640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff9819cdc0 0x7eff9819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff9810d380 0x7eff98198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff9810d380 0x7eff98198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47378/0 (socket says 172.21.15.80:47378) 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff977fe640 1 -- 172.21.15.80:0/3711993250 learned_addr learned my addr 172.21.15.80:0/3711993250 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff9cf01640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff9819cdc0 0x7eff9819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff9e964640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7eff98111b20 con 0x7eff9810d380 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff981119a0 con 0x7eff98108a20 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7eff98111ca0 con 0x7eff9819cdc0 2024-04-25T11:25:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.188+0000 7eff97fff640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff98108a20 0x7eff98198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff977fe640 1 -- 172.21.15.80:0/3711993250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff9819cdc0 msgr2=0x7eff9819d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff977fe640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff9819cdc0 0x7eff9819d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff977fe640 1 -- 172.21.15.80:0/3711993250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff98108a20 msgr2=0x7eff98198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff977fe640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff98108a20 0x7eff98198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff977fe640 1 -- 172.21.15.80:0/3711993250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9819d8d0 con 0x7eff9810d380 2024-04-25T11:25:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff977fe640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff9810d380 0x7eff98198bc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009230 tx=0x7eff8c034a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff957fa640 1 -- 172.21.15.80:0/3711993250 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c034e40 con 0x7eff9810d380 2024-04-25T11:25:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff957fa640 1 -- 172.21.15.80:0/3711993250 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8c02cd80 con 0x7eff9810d380 2024-04-25T11:25:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9819db60 con 0x7eff9810d380 2024-04-25T11:25:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff957fa640 1 -- 172.21.15.80:0/3711993250 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c033520 con 0x7eff9810d380 2024-04-25T11:25:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.189+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff981a52a0 con 0x7eff9810d380 2024-04-25T11:25:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.191+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff98103cd0 con 0x7eff9810d380 2024-04-25T11:25:22.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.193+0000 7eff957fa640 1 -- 172.21.15.80:0/3711993250 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7eff8c043020 con 0x7eff9810d380 2024-04-25T11:25:22.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.194+0000 7eff957fa640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7eff800afe00 0x7eff800b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.194+0000 7eff957fa640 1 -- 172.21.15.80:0/3711993250 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7eff8c0fe810 con 0x7eff9810d380 2024-04-25T11:25:22.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.194+0000 7eff97fff640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7eff800afe00 0x7eff800b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.195+0000 7eff97fff640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7eff800afe00 0x7eff800b2310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff98103a20 tx=0x7eff88005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.201+0000 7eff957fa640 1 -- 172.21.15.80:0/3711993250 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7eff8c0c7000 con 0x7eff9810d380 2024-04-25T11:25:22.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.649+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff981998f0 con 0x7eff9810d380 2024-04-25T11:25:22.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.650+0000 7eff957fa640 1 -- 172.21.15.80:0/3711993250 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7eff8c0c6900 con 0x7eff9810d380 2024-04-25T11:25:22.643 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:25:22.644 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:25:22.644 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:25:22.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7eff800afe00 msgr2=0x7eff800b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7eff800afe00 0x7eff800b2310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff98103a20 tx=0x7eff88005f90 comp rx=0 tx=0).stop 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff9810d380 msgr2=0x7eff98198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff9810d380 0x7eff98198bc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009230 tx=0x7eff8c034a40 comp rx=0 tx=0).stop 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 shutdown_connections 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7eff800afe00 0x7eff800b2310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff9810d380 0x7eff98198bc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff9819cdc0 0x7eff9819d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 --2- 172.21.15.80:0/3711993250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff98108a20 0x7eff98198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 >> 172.21.15.80:0/3711993250 conn(0x7eff98078110 msgr2=0x7eff981040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 shutdown_connections 2024-04-25T11:25:22.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.653+0000 7eff9e964640 1 -- 172.21.15.80:0/3711993250 wait complete. 2024-04-25T11:25:22.662 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:25:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.828+0000 7ffba4b72640 1 -- 172.21.15.80:0/408500551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 msgr2=0x7ffba01050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.828+0000 7ffba4b72640 1 --2- 172.21.15.80:0/408500551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba01050a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffb90009900 tx=0x7ffb9002a480 comp rx=0 tx=0).stop 2024-04-25T11:25:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.828+0000 7ffba4b72640 1 -- 172.21.15.80:0/408500551 shutdown_connections 2024-04-25T11:25:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.828+0000 7ffba4b72640 1 --2- 172.21.15.80:0/408500551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffba010e050 0x7ffba0110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.828+0000 7ffba4b72640 1 --2- 172.21.15.80:0/408500551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffba010b6f0 0x7ffba010db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.828+0000 7ffba4b72640 1 --2- 172.21.15.80:0/408500551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba01050a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.828+0000 7ffba4b72640 1 -- 172.21.15.80:0/408500551 >> 172.21.15.80:0/408500551 conn(0x7ffba0078100 msgr2=0x7ffba0078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.829+0000 7ffba4b72640 1 -- 172.21.15.80:0/408500551 shutdown_connections 2024-04-25T11:25:22.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.829+0000 7ffba4b72640 1 -- 172.21.15.80:0/408500551 wait complete. 2024-04-25T11:25:22.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.829+0000 7ffba4b72640 1 Processor -- start 2024-04-25T11:25:22.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.829+0000 7ffba4b72640 1 -- start start 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffba4b72640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffba4b72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffba010b6f0 0x7ffba019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffba4b72640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffba010e050 0x7ffba019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffba4b72640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffba0113cb0 con 0x7ffba0104c90 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffba4b72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffba0113b30 con 0x7ffba010b6f0 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffba4b72640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffba0113e30 con 0x7ffba010e050 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47384/0 (socket says 172.21.15.80:47384) 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 -- 172.21.15.80:0/1882761397 learned_addr learned my addr 172.21.15.80:0/1882761397 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffba010b6f0 0x7ffba019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffba010e050 0x7ffba019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 -- 172.21.15.80:0/1882761397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffba010e050 msgr2=0x7ffba019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffba010e050 0x7ffba019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 -- 172.21.15.80:0/1882761397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffba010b6f0 msgr2=0x7ffba019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffba010b6f0 0x7ffba019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 -- 172.21.15.80:0/1882761397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba019f5b0 con 0x7ffba0104c90 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.830+0000 7ffb9e59c640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba019a750 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffb90005940 tx=0x7ffb90004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.831+0000 7ffb8f7fe640 1 -- 172.21.15.80:0/1882761397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9003f030 con 0x7ffba0104c90 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.831+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba019f840 con 0x7ffba0104c90 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.831+0000 7ffb8f7fe640 1 -- 172.21.15.80:0/1882761397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb90003aa0 con 0x7ffba0104c90 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.831+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba019fd80 con 0x7ffba0104c90 2024-04-25T11:25:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.831+0000 7ffb8f7fe640 1 -- 172.21.15.80:0/1882761397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9003f030 con 0x7ffba0104c90 2024-04-25T11:25:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.834+0000 7ffbaba25740 1 Processor -- start 2024-04-25T11:25:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.834+0000 7ffbaba25740 1 -- start start 2024-04-25T11:25:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d891b390 0x55a5d8cbc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cbcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffbaba25740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8c21d80 con 0x55a5d891b390 2024-04-25T11:25:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffbaba25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8bdba20 con 0x55a5d88f24d0 2024-04-25T11:25:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffbaba25740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8c1dd40 con 0x55a5d88fa6b0 2024-04-25T11:25:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d891b390 0x55a5d8cbc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d891b390 0x55a5d8cbc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47386/0 (socket says 172.21.15.80:47386) 2024-04-25T11:25:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/520779268 learned_addr learned my addr 172.21.15.80:0/520779268 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb8f7fe640 1 -- 172.21.15.80:0/1882761397 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7ffb90042030 con 0x7ffba0104c90 2024-04-25T11:25:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/520779268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88fa6b0 msgr2=0x55a5d8cc96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/520779268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 msgr2=0x55a5d8cbcd50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cbcd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/520779268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d8be6c30 con 0x55a5d891b390 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.835+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d891b390 0x55a5d8cbc810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009eb0 tx=0x7ffb98010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cde05d8552ccf87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.836+0000 7ffb8cff9640 1 -- 172.21.15.80:0/520779268 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98016070 con 0x55a5d891b390 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.836+0000 7ffb8cff9640 1 -- 172.21.15.80:0/520779268 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb98004d20 con 0x55a5d891b390 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.836+0000 7ffb8f7fe640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb880b0180 0x7ffb880b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.836+0000 7ffb8cff9640 1 -- 172.21.15.80:0/520779268 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980127d0 con 0x55a5d891b390 2024-04-25T11:25:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.836+0000 7ffb9e59c640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb880b0180 0x7ffb880b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffb8f7fe640 1 -- 172.21.15.80:0/1882761397 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffb90040070 con 0x7ffba0104c90 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffb9e59c640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb880b0180 0x7ffb880b2690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb900fc700 tx=0x7ffb900f5840 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 -- 172.21.15.80:0/520779268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d891b390 msgr2=0x55a5d8cbc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d891b390 0x55a5d8cbc810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009eb0 tx=0x7ffb98010740 comp rx=0 tx=0).stop 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 -- 172.21.15.80:0/520779268 shutdown_connections 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cbcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 --2- 172.21.15.80:0/520779268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d891b390 0x55a5d8cbc810 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 -- 172.21.15.80:0/520779268 >> 172.21.15.80:0/520779268 conn(0x55a5d890f4e0 msgr2=0x55a5d8cb8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 -- 172.21.15.80:0/520779268 shutdown_connections 2024-04-25T11:25:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.837+0000 7ffbaba25740 1 -- 172.21.15.80:0/520779268 wait complete. 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 -- start start 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 Processor -- start 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cc6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8cd3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8cc9e30 con 0x55a5d88fa6b0 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8ba8dc0 con 0x55a5d88f24d0 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8cc9fb0 con 0x55a5d891b390 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffbaba25740 10 client.0 _ll_register_callbacks cb 0x55a5d8bc4600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffb9dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffb9dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47400/0 (socket says 172.21.15.80:47400) 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/2171447527 learned_addr learned my addr 172.21.15.80:0/2171447527 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.838+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8cd3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cc6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/2171447527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 msgr2=0x55a5d8cd3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8cd3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 msgr2=0x55a5d8cc6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cc6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/2171447527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d89333f0 con 0x55a5d88fa6b0 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cc6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc7450 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffb94012a70 tx=0x7ffb94012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81d6fb228ad1916 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb85ffb640 1 -- 172.21.15.80:0/2171447527 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940121d0 con 0x55a5d88fa6b0 2024-04-25T11:25:22.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffb85ffb640 1 -- 172.21.15.80:0/2171447527 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffb94004050 con 0x55a5d88fa6b0 2024-04-25T11:25:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.839+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb98004d20 con 0x55a5d88fa6b0 2024-04-25T11:25:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.840+0000 7ffb85ffb640 1 -- 172.21.15.80:0/2171447527 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffb94004250 con 0x55a5d88fa6b0 2024-04-25T11:25:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.840+0000 7ffbaba25740 10 client.15783 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.840+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5d89fd7d0 con 0x55a5d88fa6b0 2024-04-25T11:25:22.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.840+0000 7ffb85ffb640 1 -- 172.21.15.80:0/2171447527 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb98004d20 con 0x55a5d88fa6b0 2024-04-25T11:25:22.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffb85ffb640 1 -- 172.21.15.80:0/2171447527 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffb940038c0 con 0x55a5d88fa6b0 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffbaba25740 10 client.15783 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffbaba25740 10 client.15783 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffbaba25740 20 client.15783 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffbaba25740 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88d9f60 0x55a5d8cd9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffbaba25740 4 client.15783 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5d8c2f990 con 0x55a5d88d9f60 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88d9f60 0x55a5d8cd9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffb85ffb640 10 client.15783 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.841+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88d9f60 0x55a5d8cd9690 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cacd5b79352ebc7d server_cookie=8e3307f237d37f5b in_seq=0 out_seq=0 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffb85ffb640 1 -- 172.21.15.80:0/2171447527 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a5d8c2f990 con 0x55a5d88d9f60 2024-04-25T11:25:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffb85ffb640 10 client.15783 handle_command_reply: tid=0 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 client.15783 shutdown 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 msgr2=0x55a5d8cc7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc7450 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffb94012a70 tx=0x7ffb94012f30 comp rx=0 tx=0).stop 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 shutdown_connections 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88d9f60 0x55a5d8cd9690 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc7450 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8cd3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 --2- 172.21.15.80:0/2171447527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cc6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 >> 172.21.15.80:0/2171447527 conn(0x55a5d890f4e0 msgr2=0x55a5d8cbe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.842+0000 7ffb85ffb640 0 client.15783 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.843+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 shutdown_connections 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.843+0000 7ffbaba25740 1 -- 172.21.15.80:0/2171447527 wait complete. 2024-04-25T11:25:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.843+0000 7ffbaba25740 20 client.15783 trim_cache size 0 max 16384 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffbaba25740 1 Processor -- start 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffbaba25740 1 -- start start 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88f24d0 0x55a5d8cb90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffb9ed9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88f24d0 0x55a5d8cb90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffb9dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffb9ed9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88f24d0 0x55a5d8cb90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:37350/0 (socket says 172.21.15.80:37350) 2024-04-25T11:25:22.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.869+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/3903275647 learned_addr learned my addr 172.21.15.80:0/3903275647 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffbaba25740 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d891b390 0x55a5d8cb7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01b4490 con 0x55a5d88fa6b0 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01b1d60 con 0x55a5d891b390 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01afbb0 con 0x55a5d88f24d0 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/3903275647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d891b390 msgr2=0x55a5d8cb7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d891b390 0x55a5d8cb7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/3903275647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 msgr2=0x55a5d8cc1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb9ed9d640 1 -- 172.21.15.80:0/3903275647 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d88da190 con 0x55a5d88f24d0 2024-04-25T11:25:22.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:22.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88f24d0 0x55a5d8cb90f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb98010c40 tx=0x7ffb98005a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b48eaf7338cf17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.870+0000 7ffb87fff640 1 -- 172.21.15.80:0/3903275647 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98016040 con 0x55a5d88f24d0 2024-04-25T11:25:22.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.871+0000 7ffb87fff640 1 -- 172.21.15.80:0/3903275647 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9802c070 con 0x55a5d88f24d0 2024-04-25T11:25:22.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.871+0000 7ffb87fff640 1 -- 172.21.15.80:0/3903275647 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9802d670 con 0x55a5d88f24d0 2024-04-25T11:25:22.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88f24d0 msgr2=0x55a5d8cb90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88f24d0 0x55a5d8cb90f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb98010c40 tx=0x7ffb98005a70 comp rx=0 tx=0).stop 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 shutdown_connections 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cc1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d891b390 0x55a5d8cb7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 --2- 172.21.15.80:0/3903275647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d88f24d0 0x55a5d8cb90f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 >> 172.21.15.80:0/3903275647 conn(0x55a5d890f4e0 msgr2=0x55a5d8cb7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 shutdown_connections 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 -- 172.21.15.80:0/3903275647 wait complete. 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 -- start start 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.872+0000 7ffbaba25740 1 Processor -- start 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffbaba25740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8d3f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffbaba25740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01b0220 con 0x55a5d88fa6b0 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffbaba25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01b1690 con 0x55a5d88f24d0 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffbaba25740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01b08f0 con 0x55a5d891b390 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffbaba25740 10 client.0 _ll_register_callbacks cb 0x7ffb94009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47418/0 (socket says 172.21.15.80:47418) 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/1766561299 learned_addr learned my addr 172.21.15.80:0/1766561299 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8d3f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/1766561299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 msgr2=0x55a5d8d3f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8d3f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 msgr2=0x55a5d8cca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9dd9b640 1 -- 172.21.15.80:0/1766561299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d8ccafd0 con 0x55a5d88fa6b0 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.873+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffb9dd9b640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cca7e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55a5d8cc84e0 tx=0x7ffb940043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7beb564a3f30d864 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffb85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffb85ffb640 1 -- 172.21.15.80:0/1766561299 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94029040 con 0x55a5d88fa6b0 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffb85ffb640 1 -- 172.21.15.80:0/1766561299 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffb940121d0 con 0x55a5d88fa6b0 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb9802c070 con 0x55a5d88fa6b0 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffb85ffb640 1 -- 172.21.15.80:0/1766561299 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffb9403a050 con 0x55a5d88fa6b0 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffbaba25740 10 client.15789 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.874+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5d8d40ec0 con 0x55a5d88fa6b0 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffb85ffb640 1 -- 172.21.15.80:0/1766561299 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb94005040 con 0x55a5d88fa6b0 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffb85ffb640 1 -- 172.21.15.80:0/1766561299 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffb94035030 con 0x55a5d88fa6b0 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffbaba25740 10 client.15789 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffbaba25740 10 client.15789 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffbaba25740 20 client.15789 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffbaba25740 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88af3a0 0x55a5d8d43700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffbaba25740 4 client.15789 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ffb9802c070 con 0x55a5d88af3a0 2024-04-25T11:25:22.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.875+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88af3a0 0x55a5d8d43700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffb9ed9d640 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88af3a0 0x55a5d8d43700 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bde85a2b4b512310 server_cookie=bd721a76a6895aea in_seq=0 out_seq=0 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffb85ffb640 10 client.15789 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffb85ffb640 1 -- 172.21.15.80:0/1766561299 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ffb9802c070 con 0x55a5d88af3a0 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffb85ffb640 10 client.15789 handle_command_reply: tid=0 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 client.15789 shutdown 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 msgr2=0x55a5d8cca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cca7e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55a5d8cc84e0 tx=0x7ffb940043f0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 shutdown_connections 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a5d88af3a0 0x55a5d8d43700 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffb85ffb640 0 client.15789 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a5d88fa6b0 0x55a5d8cca7e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a5d891b390 0x55a5d8d3f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 --2- 172.21.15.80:0/1766561299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5d88f24d0 0x55a5d8cca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 >> 172.21.15.80:0/1766561299 conn(0x55a5d890f4e0 msgr2=0x55a5d8cc85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 shutdown_connections 2024-04-25T11:25:22.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 1 -- 172.21.15.80:0/1766561299 wait complete. 2024-04-25T11:25:22.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.876+0000 7ffbaba25740 20 client.15789 trim_cache size 0 max 16384 2024-04-25T11:25:22.874 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb880b0180 msgr2=0x7ffb880b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb880b0180 0x7ffb880b2690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb900fc700 tx=0x7ffb900f5840 comp rx=0 tx=0).stop 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 msgr2=0x7ffba019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba019a750 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffb90005940 tx=0x7ffb90004270 comp rx=0 tx=0).stop 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 shutdown_connections 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb880b0180 0x7ffb880b2690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffba010e050 0x7ffba019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffba010b6f0 0x7ffba019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 --2- 172.21.15.80:0/1882761397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffba0104c90 0x7ffba019a750 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 >> 172.21.15.80:0/1882761397 conn(0x7ffba0078100 msgr2=0x7ffba0101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 shutdown_connections 2024-04-25T11:25:22.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:22.877+0000 7ffba4b72640 1 -- 172.21.15.80:0/1882761397 wait complete. 2024-04-25T11:25:22.885 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:25:22.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:22 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3711993250' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:25:22.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 -- 172.21.15.80:0/3805092830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c7410d380 msgr2=0x7f7c7410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/3805092830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c7410d380 0x7f7c7410f7a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009ca0 tx=0x7f7c6c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 -- 172.21.15.80:0/3805092830 shutdown_connections 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/3805092830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c7410d380 0x7f7c7410f7a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/3805092830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c74102af0 0x7f7c74102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/3805092830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c74108a20 0x7f7c741025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 -- 172.21.15.80:0/3805092830 >> 172.21.15.80:0/3805092830 conn(0x7f7c74078100 msgr2=0x7f7c74078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 -- 172.21.15.80:0/3805092830 shutdown_connections 2024-04-25T11:25:22.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.003+0000 7f7c7c58f640 1 -- 172.21.15.80:0/3805092830 wait complete. 2024-04-25T11:25:22.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 Processor -- start 2024-04-25T11:25:22.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 -- start start 2024-04-25T11:25:22.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c74102af0 0x7f7c741a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c74108a20 0x7f7c741a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7410d380 0x7f7c7419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74112c50 con 0x7f7c74108a20 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74112ad0 con 0x7f7c74102af0 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7c58f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74112dd0 con 0x7f7c7410d380 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c79b2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c74108a20 0x7f7c741a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c79b2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c74108a20 0x7f7c741a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47442/0 (socket says 172.21.15.80:47442) 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c79b2a640 1 -- 172.21.15.80:0/310191771 learned_addr learned my addr 172.21.15.80:0/310191771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.004+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c74102af0 0x7f7c741a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7410d380 0x7f7c7419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c79b2a640 1 -- 172.21.15.80:0/310191771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7410d380 msgr2=0x7f7c7419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7410d380 0x7f7c7419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c79b2a640 1 -- 172.21.15.80:0/310191771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c74102af0 msgr2=0x7f7c741a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c74102af0 0x7f7c741a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c79b2a640 1 -- 172.21.15.80:0/310191771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7419ce40 con 0x7f7c74108a20 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c74102af0 0x7f7c741a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7410d380 0x7f7c7419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c74108a20 0x7f7c741a2ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400e9f0 tx=0x7f7c6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c6b7fe640 1 -- 172.21.15.80:0/310191771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6400ccc0 con 0x7f7c74108a20 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c6b7fe640 1 -- 172.21.15.80:0/310191771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c640035f0 con 0x7f7c74108a20 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c6b7fe640 1 -- 172.21.15.80:0/310191771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6400ce60 con 0x7f7c74108a20 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7419d0d0 con 0x7f7c74108a20 2024-04-25T11:25:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.005+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741a9330 con 0x7f7c74108a20 2024-04-25T11:25:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 Processor -- start 2024-04-25T11:25:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 -- start start 2024-04-25T11:25:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8da6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5643ed832d80 con 0x5643ed50b6b0 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5643ed7eca20 con 0x5643ed52c390 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c83442740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5643ed82ed40 con 0x5643ed5034d0 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c7ab2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c7ab2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:46072/0 (socket says 172.21.15.80:46072) 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/2813271153 learned_addr learned my addr 172.21.15.80:0/2813271153 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.009+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/2813271153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 msgr2=0x5643ed8cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/2813271153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 msgr2=0x5643ed8da6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8da6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/2813271153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643ed7f7c30 con 0x5643ed52c390 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8cd810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02f410 tx=0x7f7c6c02f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ed7f8820eb2308 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c6b7fe640 1 -- 172.21.15.80:0/310191771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7f7c64003aa0 con 0x7f7c74108a20 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c68bfe640 1 -- 172.21.15.80:0/2813271153 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c031cf0 con 0x5643ed52c390 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.010+0000 7f7c68bfe640 1 -- 172.21.15.80:0/2813271153 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c6c036040 con 0x5643ed52c390 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.011+0000 7f7c6b7fe640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7c600afd80 0x7f7c600b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.011+0000 7f7c68bfe640 1 -- 172.21.15.80:0/2813271153 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c004240 con 0x5643ed52c390 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.011+0000 7f7c6b7fe640 1 -- 172.21.15.80:0/310191771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7c640df6c0 con 0x7f7c74108a20 2024-04-25T11:25:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.011+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7c600afd80 0x7f7c600b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.011+0000 7f7c83442740 1 -- 172.21.15.80:0/2813271153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 msgr2=0x5643ed8cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.011+0000 7f7c83442740 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8cd810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02f410 tx=0x7f7c6c02f440 comp rx=0 tx=0).stop 2024-04-25T11:25:23.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.011+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7c600afd80 0x7f7c600b2290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009fd0 tx=0x7f7c70005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 -- 172.21.15.80:0/2813271153 shutdown_connections 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8da6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 --2- 172.21.15.80:0/2813271153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8cd810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 -- 172.21.15.80:0/2813271153 >> 172.21.15.80:0/2813271153 conn(0x5643ed5204e0 msgr2=0x5643ed8c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 -- 172.21.15.80:0/2813271153 shutdown_connections 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 -- 172.21.15.80:0/2813271153 wait complete. 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 -- start start 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.012+0000 7f7c83442740 1 Processor -- start 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c83442740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8d7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c83442740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8d8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c83442740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8e4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c83442740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5643ed8dad80 con 0x5643ed52c390 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c83442740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5643ed7b9dc0 con 0x5643ed5034d0 2024-04-25T11:25:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c83442740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5643ed8daf00 con 0x5643ed50b6b0 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8e4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47450/0 (socket says 172.21.15.80:47450) 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/1493189117 learned_addr learned my addr 172.21.15.80:0/1493189117 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8d7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c83442740 10 client.0 _ll_register_callbacks cb 0x5643ed7d5600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 msgr2=0x5643ed8d8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8d8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/1493189117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 msgr2=0x5643ed8d7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8d7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7ab2c640 1 -- 172.21.15.80:0/1493189117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643ed5443f0 con 0x5643ed52c390 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.013+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8d7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8e4300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02a900 tx=0x7f7c6c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10fd54d68bd65c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c5dffb640 1 -- 172.21.15.80:0/1493189117 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c052020 con 0x5643ed52c390 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c5dffb640 1 -- 172.21.15.80:0/1493189117 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7c6c031cf0 con 0x5643ed52c390 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c6c036040 con 0x5643ed52c390 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c5dffb640 1 -- 172.21.15.80:0/1493189117 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7c6c05d050 con 0x5643ed52c390 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c83442740 10 client.15798 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5643ed60e7d0 con 0x5643ed52c390 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c5dffb640 1 -- 172.21.15.80:0/1493189117 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c6c036040 con 0x5643ed52c390 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.014+0000 7f7c5dffb640 1 -- 172.21.15.80:0/1493189117 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7c6c04d030 con 0x5643ed52c390 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.015+0000 7f7c83442740 10 client.15798 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.015+0000 7f7c83442740 10 client.15798 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.015+0000 7f7c83442740 20 client.15798 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.015+0000 7f7c83442740 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4eaf60 0x5643ed8ea490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.015+0000 7f7c83442740 4 client.15798 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.015+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643ed840990 con 0x5643ed4eaf60 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.015+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4eaf60 0x5643ed8ea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.016+0000 7f7c5dffb640 10 client.15798 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.016+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4eaf60 0x5643ed8ea490 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6758c4bccc57063d server_cookie=38f63037f1d755ea in_seq=0 out_seq=0 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.016+0000 7f7c5dffb640 1 -- 172.21.15.80:0/1493189117 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5643ed840990 con 0x5643ed4eaf60 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.016+0000 7f7c5dffb640 10 client.15798 handle_command_reply: tid=0 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.016+0000 7f7c83442740 1 client.15798 shutdown 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 msgr2=0x5643ed8e4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8e4300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02a900 tx=0x7f7c6c005c80 comp rx=0 tx=0).stop 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 shutdown_connections 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8e4300 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4eaf60 0x5643ed8ea490 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8d8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 --2- 172.21.15.80:0/1493189117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8d7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c5dffb640 0 client.15798 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 >> 172.21.15.80:0/1493189117 conn(0x5643ed5204e0 msgr2=0x5643ed8cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 shutdown_connections 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 1 -- 172.21.15.80:0/1493189117 wait complete. 2024-04-25T11:25:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.017+0000 7f7c83442740 20 client.15798 trim_cache size 0 max 16384 2024-04-25T11:25:23.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.043+0000 7f7c83442740 1 Processor -- start 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c83442740 1 -- start start 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c83442740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8e4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c83442740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c83442740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8d9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c79b2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c79b2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47466/0 (socket says 172.21.15.80:47466) 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c79b2a640 1 -- 172.21.15.80:0/2251538407 learned_addr learned my addr 172.21.15.80:0/2251538407 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741b4350 con 0x5643ed50b6b0 2024-04-25T11:25:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741b1c20 con 0x5643ed52c390 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741afa70 con 0x5643ed5034d0 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.044+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c79b2a640 1 -- 172.21.15.80:0/2251538407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 msgr2=0x5643ed8e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8e4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c79b2a640 1 -- 172.21.15.80:0/2251538407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 msgr2=0x5643ed8d9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8d9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8d9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c79b2a640 1 -- 172.21.15.80:0/2251538407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643ed8cf010 con 0x5643ed50b6b0 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8d9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8ca0b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7c640dd420 tx=0x7f7c64003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192064c1d6ecc181 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c5ffff640 1 -- 172.21.15.80:0/2251538407 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c640a7d20 con 0x5643ed50b6b0 2024-04-25T11:25:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c5ffff640 1 -- 172.21.15.80:0/2251538407 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c640a7620 con 0x5643ed50b6b0 2024-04-25T11:25:23.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.045+0000 7f7c5ffff640 1 -- 172.21.15.80:0/2251538407 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c640a3a40 con 0x5643ed50b6b0 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.046+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 msgr2=0x5643ed8ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.046+0000 7f7c83442740 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8ca0b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7c640dd420 tx=0x7f7c64003db0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.046+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 shutdown_connections 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.046+0000 7f7c83442740 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed50b6b0 0x5643ed8ca0b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.046+0000 7f7c83442740 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed52c390 0x5643ed8d9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.046+0000 7f7c83442740 1 --2- 172.21.15.80:0/2251538407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed5034d0 0x5643ed8e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.047+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 >> 172.21.15.80:0/2251538407 conn(0x5643ed5204e0 msgr2=0x5643ed8d9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.047+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 shutdown_connections 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.047+0000 7f7c83442740 1 -- 172.21.15.80:0/2251538407 wait complete. 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.047+0000 7f7c83442740 1 -- start start 2024-04-25T11:25:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.047+0000 7f7c83442740 1 Processor -- start 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.047+0000 7f7c83442740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8ed420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c83442740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8ed960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c83442740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8ea820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c83442740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741b00e0 con 0x5643ed52c390 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c83442740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741b1550 con 0x5643ed5034d0 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c83442740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741b07b0 con 0x5643ed50b6b0 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c83442740 10 client.0 _ll_register_callbacks cb 0x7f7c70009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8ed420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:46108/0 (socket says 172.21.15.80:46108) 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 -- 172.21.15.80:0/2218947039 learned_addr learned my addr 172.21.15.80:0/2218947039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 -- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 msgr2=0x5643ed8ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 -- 172.21.15.80:0/2218947039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 msgr2=0x5643ed8ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8ea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 -- 172.21.15.80:0/2218947039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643ed8eaf10 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7ab2c640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.048+0000 7f7c7a32b640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8ed420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x5643ed8cefe0 tx=0x7f7c700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49db8bd9b2080bba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c5dffb640 1 -- 172.21.15.80:0/2218947039 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7002b500 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c5dffb640 1 -- 172.21.15.80:0/2218947039 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7c7002b6a0 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c640a7620 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c5dffb640 1 -- 172.21.15.80:0/2218947039 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7c7002b8a0 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c83442740 10 client.25370 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5643ed951e70 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c5dffb640 1 -- 172.21.15.80:0/2218947039 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c7002ba40 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.049+0000 7f7c5dffb640 1 -- 172.21.15.80:0/2218947039 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7c700055d0 con 0x5643ed5034d0 2024-04-25T11:25:23.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c83442740 10 client.25370 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c83442740 10 client.25370 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c83442740 20 client.25370 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c83442740 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4c03a0 0x5643ed9545e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c83442740 4 client.25370 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7c640a7620 con 0x5643ed4c03a0 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4c03a0 0x5643ed9545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c79b2a640 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4c03a0 0x5643ed9545e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a2df0aa1370f8d5 server_cookie=74de8d5d2aad3401 in_seq=0 out_seq=0 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.050+0000 7f7c5dffb640 10 client.25370 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c5dffb640 1 -- 172.21.15.80:0/2218947039 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7c640a7620 con 0x5643ed4c03a0 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c5dffb640 10 client.25370 handle_command_reply: tid=0 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 client.25370 shutdown 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 msgr2=0x5643ed8ed420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8ed420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x5643ed8cefe0 tx=0x7f7c700046c0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 shutdown_connections 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5643ed52c390 0x5643ed8ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5643ed4c03a0 0x5643ed9545e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5643ed50b6b0 0x5643ed8ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 --2- 172.21.15.80:0/2218947039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5643ed5034d0 0x5643ed8ed420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 >> 172.21.15.80:0/2218947039 conn(0x5643ed5204e0 msgr2=0x5643ed8d77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c5dffb640 0 client.25370 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 shutdown_connections 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 1 -- 172.21.15.80:0/2218947039 wait complete. 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.051+0000 7f7c83442740 20 client.25370 trim_cache size 0 max 16384 2024-04-25T11:25:23.050 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:25:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7c600afd80 msgr2=0x7f7c600b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7c600afd80 0x7f7c600b2290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009fd0 tx=0x7f7c70005f90 comp rx=0 tx=0).stop 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c74108a20 msgr2=0x7f7c741a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c74108a20 0x7f7c741a2ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400e9f0 tx=0x7f7c6400eeb0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 shutdown_connections 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7c600afd80 0x7f7c600b2290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c74108a20 0x7f7c741a2ad0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7410d380 0x7f7c7419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 --2- 172.21.15.80:0/310191771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c74102af0 0x7f7c741a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 >> 172.21.15.80:0/310191771 conn(0x7f7c74078100 msgr2=0x7f7c74069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 shutdown_connections 2024-04-25T11:25:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.052+0000 7f7c7c58f640 1 -- 172.21.15.80:0/310191771 wait complete. 2024-04-25T11:25:23.059 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:22 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3711993250' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:25:23.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:25:23.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.185+0000 7ff12733f640 1 -- 172.21.15.80:0/4125915249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 msgr2=0x7ff120102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.185+0000 7ff12733f640 1 --2- 172.21.15.80:0/4125915249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff120102f00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009900 tx=0x7ff11c02a410 comp rx=0 tx=0).stop 2024-04-25T11:25:23.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.185+0000 7ff12733f640 1 -- 172.21.15.80:0/4125915249 shutdown_connections 2024-04-25T11:25:23.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.185+0000 7ff12733f640 1 --2- 172.21.15.80:0/4125915249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff120102f00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.185+0000 7ff12733f640 1 --2- 172.21.15.80:0/4125915249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12010d380 0x7ff12010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.185+0000 7ff12733f640 1 --2- 172.21.15.80:0/4125915249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120108a20 0x7ff1201025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.185+0000 7ff12733f640 1 -- 172.21.15.80:0/4125915249 >> 172.21.15.80:0/4125915249 conn(0x7ff120078100 msgr2=0x7ff120078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.186+0000 7ff12733f640 1 -- 172.21.15.80:0/4125915249 shutdown_connections 2024-04-25T11:25:23.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.186+0000 7ff12733f640 1 -- 172.21.15.80:0/4125915249 wait complete. 2024-04-25T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.186+0000 7ff12733f640 1 Processor -- start 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.186+0000 7ff12733f640 1 -- start start 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.186+0000 7ff12733f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff12019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.186+0000 7ff12733f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120108a20 0x7ff12019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.186+0000 7ff12733f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12010d380 0x7ff12019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff12733f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff120113cf0 con 0x7ff120102af0 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff12733f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff120113b70 con 0x7ff12010d380 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff12733f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff120113e70 con 0x7ff120108a20 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff12019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff12019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47480/0 (socket says 172.21.15.80:47480) 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 -- 172.21.15.80:0/102272741 learned_addr learned my addr 172.21.15.80:0/102272741 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1248da640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120108a20 0x7ff12019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 -- 172.21.15.80:0/102272741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120108a20 msgr2=0x7ff12019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120108a20 0x7ff12019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1258dc640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12010d380 0x7ff12019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 -- 172.21.15.80:0/102272741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12010d380 msgr2=0x7ff12019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12010d380 0x7ff12019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 -- 172.21.15.80:0/102272741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12019f5b0 con 0x7ff120102af0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1258dc640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12010d380 0x7ff12019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1250db640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff12019a750 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff11800ebc0 tx=0x7ff11800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff1127fc640 1 -- 172.21.15.80:0/102272741 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118004d20 con 0x7ff120102af0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.187+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12019f8a0 con 0x7ff120102af0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.188+0000 7ff1127fc640 1 -- 172.21.15.80:0/102272741 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1180054d0 con 0x7ff120102af0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.188+0000 7ff1127fc640 1 -- 172.21.15.80:0/102272741 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118010720 con 0x7ff120102af0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.188+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1201a7220 con 0x7ff120102af0 2024-04-25T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 Processor -- start 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 -- start start 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc131f390 0x557fc16c0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557fc1625d80 con 0x557fc12fe6b0 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557fc15dfa20 con 0x557fc12f64d0 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557fc1621d40 con 0x557fc131f390 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.191+0000 7ff1127fc640 1 -- 172.21.15.80:0/102272741 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7ff118005020 con 0x7ff120102af0 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47482/0 (socket says 172.21.15.80:47482) 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 -- 172.21.15.80:0/2709854898 learned_addr learned my addr 172.21.15.80:0/2709854898 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1258dc640 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc131f390 0x557fc16c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1250db640 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 -- 172.21.15.80:0/2709854898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc131f390 msgr2=0x557fc16c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc131f390 0x557fc16c0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 -- 172.21.15.80:0/2709854898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 msgr2=0x557fc16c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1248da640 1 -- 172.21.15.80:0/2709854898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc15eac30 con 0x557fc12fe6b0 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1250db640 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1258dc640 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc131f390 0x557fc16c0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.192+0000 7ff1127fc640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff10c0afd80 0x7ff10c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.193+0000 7ff1248da640 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cd6a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff11c000c00 tx=0x7ff11c005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed52722aca44855a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.193+0000 7ff1127fc640 1 -- 172.21.15.80:0/102272741 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff1180dfd50 con 0x7ff120102af0 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.193+0000 7ff10b7fe640 1 -- 172.21.15.80:0/2709854898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c03f070 con 0x557fc12fe6b0 2024-04-25T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.193+0000 7ff1258dc640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff10c0afd80 0x7ff10c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.193+0000 7ff10b7fe640 1 -- 172.21.15.80:0/2709854898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff11c032e20 con 0x557fc12fe6b0 2024-04-25T11:25:23.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.193+0000 7ff10b7fe640 1 -- 172.21.15.80:0/2709854898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c035070 con 0x557fc12fe6b0 2024-04-25T11:25:23.191 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:22 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3711993250' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2709854898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 msgr2=0x557fc16cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff1258dc640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff10c0afd80 0x7ff10c0b2290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557fc16bd980 tx=0x7ff114009400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cd6a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff11c000c00 tx=0x7ff11c005e60 comp rx=0 tx=0).stop 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2709854898 shutdown_connections 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cd6a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2709854898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc131f390 0x557fc16c0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2709854898 >> 172.21.15.80:0/2709854898 conn(0x557fc13134e0 msgr2=0x557fc16bcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2709854898 shutdown_connections 2024-04-25T11:25:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.194+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2709854898 wait complete. 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.195+0000 7ff12e1f3740 1 -- start start 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.195+0000 7ff12e1f3740 1 Processor -- start 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12f64d0 0x557fc16cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc131f390 0x557fc16d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12f64d0 0x557fc16cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1248da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12f64d0 0x557fc16cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:37454/0 (socket says 172.21.15.80:37454) 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1248da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47484/0 (socket says 172.21.15.80:47484) 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557fc16cdd30 con 0x557fc12fe6b0 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557fc15acdc0 con 0x557fc131f390 2024-04-25T11:25:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557fc16cdeb0 con 0x557fc12f64d0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 -- 172.21.15.80:0/3756004057 learned_addr learned my addr 172.21.15.80:0/3756004057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff12e1f3740 10 client.0 _ll_register_callbacks cb 0x557fc15c8600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 -- 172.21.15.80:0/3756004057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc131f390 msgr2=0x557fc16d71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc131f390 0x557fc16d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 -- 172.21.15.80:0/3756004057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 msgr2=0x557fc16cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1250db640 1 -- 172.21.15.80:0/3756004057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc13373f0 con 0x557fc12f64d0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.196+0000 7ff1248da640 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff1250db640 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12f64d0 0x557fc16cb2e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff11800cba0 tx=0x7ff1180a74e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e40dc2f0f6c6554 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff108ff9640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff108ff9640 1 -- 172.21.15.80:0/3756004057 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1180a77c0 con 0x557fc12f64d0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff108ff9640 1 -- 172.21.15.80:0/3756004057 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff1180b0680 con 0x557fc12f64d0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff11c032e20 con 0x557fc12f64d0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff108ff9640 1 -- 172.21.15.80:0/3756004057 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff1180c2380 con 0x557fc12f64d0 2024-04-25T11:25:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff12e1f3740 10 client.25393 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.197+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557fc14017d0 con 0x557fc12f64d0 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff108ff9640 1 -- 172.21.15.80:0/3756004057 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff11c032e20 con 0x557fc12f64d0 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff108ff9640 1 -- 172.21.15.80:0/3756004057 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff1180dd610 con 0x557fc12f64d0 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff12e1f3740 10 client.25393 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff12e1f3740 10 client.25393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff12e1f3740 20 client.25393 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12ddf60 0x557fc16dd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff12e1f3740 4 client.25393 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.198+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fc1633990 con 0x557fc12ddf60 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.199+0000 7ff1248da640 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12ddf60 0x557fc16dd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.200+0000 7ff108ff9640 10 client.25393 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.200+0000 7ff1248da640 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12ddf60 0x557fc16dd620 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ebcd3f7c30ef7ef server_cookie=dd37f0cf12693de3 in_seq=0 out_seq=0 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff108ff9640 1 -- 172.21.15.80:0/3756004057 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fc1633990 con 0x557fc12ddf60 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff108ff9640 10 client.25393 handle_command_reply: tid=0 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 client.25393 shutdown 2024-04-25T11:25:23.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12f64d0 msgr2=0x557fc16cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12f64d0 0x557fc16cb2e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff11800cba0 tx=0x7ff1180a74e0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 shutdown_connections 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12ddf60 0x557fc16dd620 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc12fe6b0 0x557fc16cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff108ff9640 0 client.25393 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc131f390 0x557fc16d71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/3756004057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12f64d0 0x557fc16cb2e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 >> 172.21.15.80:0/3756004057 conn(0x557fc13134e0 msgr2=0x557fc16c2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 shutdown_connections 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 1 -- 172.21.15.80:0/3756004057 wait complete. 2024-04-25T11:25:23.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.201+0000 7ff12e1f3740 20 client.25393 trim_cache size 0 max 16384 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 Processor -- start 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 -- start start 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16d6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201afe40 con 0x557fc131f390 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201ad710 con 0x557fc12f64d0 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201ab560 con 0x557fc12fe6b0 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff1248da640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16d6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff1250db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff1248da640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16d6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:37458/0 (socket says 172.21.15.80:37458) 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff1248da640 1 -- 172.21.15.80:0/738043751 learned_addr learned my addr 172.21.15.80:0/738043751 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.223+0000 7ff1258dc640 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff1248da640 1 -- 172.21.15.80:0/738043751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 msgr2=0x557fc16bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff1248da640 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff1248da640 1 -- 172.21.15.80:0/738043751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 msgr2=0x557fc16c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff1248da640 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff1248da640 1 -- 172.21.15.80:0/738043751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc16bdbb0 con 0x557fc12fe6b0 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff1258dc640 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff1248da640 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16d6e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009900 tx=0x7ff11c005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68b9f9dd70a0464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff10affd640 1 -- 172.21.15.80:0/738043751 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c03f040 con 0x557fc12fe6b0 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.224+0000 7ff10affd640 1 -- 172.21.15.80:0/738043751 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff11c052070 con 0x557fc12fe6b0 2024-04-25T11:25:23.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.225+0000 7ff10affd640 1 -- 172.21.15.80:0/738043751 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c035040 con 0x557fc12fe6b0 2024-04-25T11:25:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 -- 172.21.15.80:0/738043751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 msgr2=0x557fc16d6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16d6e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009900 tx=0x7ff11c005a20 comp rx=0 tx=0).stop 2024-04-25T11:25:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 -- 172.21.15.80:0/738043751 shutdown_connections 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16d6e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/738043751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 -- 172.21.15.80:0/738043751 >> 172.21.15.80:0/738043751 conn(0x557fc13134e0 msgr2=0x557fc16bc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 -- 172.21.15.80:0/738043751 shutdown_connections 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 -- 172.21.15.80:0/738043751 wait complete. 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.226+0000 7ff12e1f3740 1 -- start start 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 1 Processor -- start 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201abbd0 con 0x557fc131f390 2024-04-25T11:25:23.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201ad040 con 0x557fc12f64d0 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201ac2a0 con 0x557fc12fe6b0 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff12e1f3740 10 client.0 _ll_register_callbacks cb 0x7ff1180a7620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff1258dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff1250db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff1258dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47494/0 (socket says 172.21.15.80:47494) 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff1258dc640 1 -- 172.21.15.80:0/2671577968 learned_addr learned my addr 172.21.15.80:0/2671577968 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.227+0000 7ff1248da640 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff1250db640 1 -- 172.21.15.80:0/2671577968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 msgr2=0x557fc16ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff1250db640 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff1250db640 1 -- 172.21.15.80:0/2671577968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 msgr2=0x557fc16ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff1250db640 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff1250db640 1 -- 172.21.15.80:0/2671577968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc16cef10 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff1250db640 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16d38a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1180dd440 tx=0x7ff1180a76d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8461e4b25c5584c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff108ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff108ff9640 1 -- 172.21.15.80:0/2671577968 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1180a7a80 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff108ff9640 1 -- 172.21.15.80:0/2671577968 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff11806e460 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff11c052070 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff108ff9640 1 -- 172.21.15.80:0/2671577968 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff1180dd270 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff12e1f3740 10 client.25382 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557fc17449c0 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.228+0000 7ff108ff9640 1 -- 172.21.15.80:0/2671577968 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff11c052070 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff108ff9640 1 -- 172.21.15.80:0/2671577968 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff118085050 con 0x557fc12f64d0 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff12e1f3740 10 client.25382 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff12e1f3740 10 client.25382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff12e1f3740 20 client.25382 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:23.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12b33a0 0x557fc1746ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff12e1f3740 4 client.25382 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557fc162d800 con 0x557fc12b33a0 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff1248da640 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12b33a0 0x557fc1746ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.229+0000 7ff108ff9640 10 client.25382 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff1248da640 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12b33a0 0x557fc1746ff0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca24240f6ce9bad1 server_cookie=9948cf7111353270 in_seq=0 out_seq=0 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff108ff9640 1 -- 172.21.15.80:0/2671577968 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557fc162d800 con 0x557fc12b33a0 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff108ff9640 10 client.25382 handle_command_reply: tid=0 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 client.25382 shutdown 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 msgr2=0x557fc16d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16d38a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1180dd440 tx=0x7ff1180a76d0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 shutdown_connections 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557fc12b33a0 0x557fc1746ff0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557fc131f390 0x557fc16ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff108ff9640 0 client.25382 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557fc12fe6b0 0x557fc16ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 --2- 172.21.15.80:0/2671577968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fc12f64d0 0x557fc16d38a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 >> 172.21.15.80:0/2671577968 conn(0x557fc13134e0 msgr2=0x557fc16cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 shutdown_connections 2024-04-25T11:25:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 1 -- 172.21.15.80:0/2671577968 wait complete. 2024-04-25T11:25:23.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.230+0000 7ff12e1f3740 20 client.25382 trim_cache size 0 max 16384 2024-04-25T11:25:23.229 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:25:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff10c0afd80 msgr2=0x7ff10c0b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff10c0afd80 0x7ff10c0b2290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557fc16bd980 tx=0x7ff114009400 comp rx=0 tx=0).stop 2024-04-25T11:25:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 msgr2=0x7ff12019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff12019a750 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff11800ebc0 tx=0x7ff11800c6a0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 shutdown_connections 2024-04-25T11:25:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff10c0afd80 0x7ff10c0b2290 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12010d380 0x7ff12019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120108a20 0x7ff12019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 --2- 172.21.15.80:0/102272741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff120102af0 0x7ff12019a750 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 >> 172.21.15.80:0/102272741 conn(0x7ff120078100 msgr2=0x7ff1201040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 shutdown_connections 2024-04-25T11:25:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:23.231+0000 7ff12733f640 1 -- 172.21.15.80:0/102272741 wait complete. 2024-04-25T11:25:23.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:23 smithi082 ceph-mon[32440]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-25T11:25:24.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:23 smithi080 ceph-mon[29126]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-25T11:25:24.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:23 smithi196 ceph-mon[32659]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-25T11:25:24.239 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:25:24.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:25:24.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 -- 172.21.15.80:0/2947196582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c108a20 msgr2=0x7f715c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 --2- 172.21.15.80:0/2947196582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c108a20 0x7f715c1025b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f714c009900 tx=0x7f714c02a410 comp rx=0 tx=0).stop 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 -- 172.21.15.80:0/2947196582 shutdown_connections 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 --2- 172.21.15.80:0/2947196582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c10d380 0x7f715c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 --2- 172.21.15.80:0/2947196582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f715c102af0 0x7f715c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 --2- 172.21.15.80:0/2947196582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c108a20 0x7f715c1025b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 -- 172.21.15.80:0/2947196582 >> 172.21.15.80:0/2947196582 conn(0x7f715c078100 msgr2=0x7f715c078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 -- 172.21.15.80:0/2947196582 shutdown_connections 2024-04-25T11:25:24.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.423+0000 7f716163c640 1 -- 172.21.15.80:0/2947196582 wait complete. 2024-04-25T11:25:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.424+0000 7f716163c640 1 Processor -- start 2024-04-25T11:25:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.424+0000 7f716163c640 1 -- start start 2024-04-25T11:25:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.424+0000 7f716163c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c102af0 0x7f715c19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.424+0000 7f716163c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f715c108a20 0x7f715c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.424+0000 7f716163c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c10d380 0x7f715c19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f716163c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f715c112c30 con 0x7f715c102af0 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f716163c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f715c112ab0 con 0x7f715c10d380 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f716163c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f715c112db0 con 0x7f715c108a20 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f715affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c102af0 0x7f715c19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f715affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c102af0 0x7f715c19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47504/0 (socket says 172.21.15.80:47504) 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f715affd640 1 -- 172.21.15.80:0/1770655054 learned_addr learned my addr 172.21.15.80:0/1770655054 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f7153fff640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f715c108a20 0x7f715c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f715b7fe640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c10d380 0x7f715c19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f7153fff640 1 -- 172.21.15.80:0/1770655054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c10d380 msgr2=0x7f715c19bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f7153fff640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c10d380 0x7f715c19bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f7153fff640 1 -- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c102af0 msgr2=0x7f715c19b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f7153fff640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c102af0 0x7f715c19b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f7153fff640 1 -- 172.21.15.80:0/1770655054 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c1a6890 con 0x7f715c108a20 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f715affd640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c102af0 0x7f715c19b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.425+0000 7f7153fff640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f715c108a20 0x7f715c19ba90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f715c06c4d0 tx=0x7f714400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.426+0000 7f7158ff9640 1 -- 172.21.15.80:0/1770655054 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714400cc40 con 0x7f715c108a20 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.426+0000 7f7158ff9640 1 -- 172.21.15.80:0/1770655054 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f714400cde0 con 0x7f715c108a20 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.426+0000 7f7158ff9640 1 -- 172.21.15.80:0/1770655054 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144010430 con 0x7f715c108a20 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.426+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c1993a0 con 0x7f715c108a20 2024-04-25T11:25:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.426+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c199840 con 0x7f715c108a20 2024-04-25T11:25:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.429+0000 7f71685c5740 1 Processor -- start 2024-04-25T11:25:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.429+0000 7f71685c5740 1 -- start start 2024-04-25T11:25:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.429+0000 7f7158ff9640 1 -- 172.21.15.80:0/1770655054 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7f7144003680 con 0x7f715c108a20 2024-04-25T11:25:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f71685c5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a62ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f71685c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a62f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f71685c5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a62f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f71685c5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aa7a58cb00 con 0x55aa7a265730 2024-04-25T11:25:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f71685c5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa7a528920 con 0x55aa7a25d550 2024-04-25T11:25:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f71685c5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa7a588ac0 con 0x55aa7a286410 2024-04-25T11:25:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f7153fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a62f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f715affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a62f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f715b7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a62ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f7153fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a62f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47516/0 (socket says 172.21.15.80:47516) 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.430+0000 7f7153fff640 1 -- 172.21.15.80:0/2160328057 learned_addr learned my addr 172.21.15.80:0/2160328057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f715b7fe640 1 -- 172.21.15.80:0/2160328057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 msgr2=0x55aa7a62f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f715b7fe640 1 --2- 172.21.15.80:0/2160328057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a62f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f715b7fe640 1 -- 172.21.15.80:0/2160328057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 msgr2=0x55aa7a62f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f715b7fe640 1 --2- 172.21.15.80:0/2160328057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a62f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f715b7fe640 1 -- 172.21.15.80:0/2160328057 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7a3667e0 con 0x55aa7a286410 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f715b7fe640 1 --2- 172.21.15.80:0/2160328057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a62ee30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f715c19c530 tx=0x7f71540107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cbb5a1fed4b07a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f7158ff9640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71480afe00 0x7f71480b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f71517fa640 1 -- 172.21.15.80:0/2160328057 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154003b70 con 0x55aa7a286410 2024-04-25T11:25:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f71517fa640 1 -- 172.21.15.80:0/2160328057 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7154003d10 con 0x55aa7a286410 2024-04-25T11:25:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f71517fa640 1 -- 172.21.15.80:0/2160328057 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154011860 con 0x55aa7a286410 2024-04-25T11:25:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.431+0000 7f715affd640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71480afe00 0x7f71480b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.432+0000 7f7158ff9640 1 -- 172.21.15.80:0/1770655054 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f71440df670 con 0x7f715c108a20 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.432+0000 7f71685c5740 1 -- 172.21.15.80:0/2160328057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 msgr2=0x55aa7a62ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.432+0000 7f715affd640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71480afe00 0x7f71480b2310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f714c000c00 tx=0x7f714c005a20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.432+0000 7f71685c5740 1 --2- 172.21.15.80:0/2160328057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a62ee30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f715c19c530 tx=0x7f71540107a0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 -- 172.21.15.80:0/2160328057 shutdown_connections 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 --2- 172.21.15.80:0/2160328057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a62f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 --2- 172.21.15.80:0/2160328057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a62f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 --2- 172.21.15.80:0/2160328057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a62ee30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 -- 172.21.15.80:0/2160328057 >> 172.21.15.80:0/2160328057 conn(0x55aa7a27a560 msgr2=0x55aa7a62b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 -- 172.21.15.80:0/2160328057 shutdown_connections 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 -- 172.21.15.80:0/2160328057 wait complete. 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 -- start start 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.433+0000 7f71685c5740 1 Processor -- start 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f71685c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a6394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f71685c5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a6399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f7153fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a6399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f7153fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a6399f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47526/0 (socket says 172.21.15.80:47526) 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f7153fff640 1 -- 172.21.15.80:0/2244645401 learned_addr learned my addr 172.21.15.80:0/2244645401 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f71685c5740 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a63f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aa7a63c180 con 0x55aa7a265730 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa7a5265d0 con 0x55aa7a25d550 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aa7a63c300 con 0x55aa7a286410 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f715affd640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a6394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f715b7fe640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a63f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.434+0000 7f71685c5740 10 client.0 _ll_register_callbacks cb 0x55aa7a514080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f715affd640 1 -- 172.21.15.80:0/2244645401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 msgr2=0x55aa7a63f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f715affd640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a63f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f715affd640 1 -- 172.21.15.80:0/2244645401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 msgr2=0x55aa7a6399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f715affd640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a6399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f715affd640 1 -- 172.21.15.80:0/2244645401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa7a3c6f70 con 0x55aa7a25d550 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f7153fff640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a6399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7154003d10 con 0x55aa7a25d550 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f715affd640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a6394b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f714c004770 tx=0x7f714c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a4b1420c5027a3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f71427fc640 10 client.25394 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:25:24.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f71427fc640 1 -- 172.21.15.80:0/2244645401 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c035040 con 0x55aa7a25d550 2024-04-25T11:25:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f71427fc640 1 -- 172.21.15.80:0/2244645401 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f714c0318b0 con 0x55aa7a25d550 2024-04-25T11:25:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f71427fc640 1 -- 172.21.15.80:0/2244645401 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f714c031ab0 con 0x55aa7a25d550 2024-04-25T11:25:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f71685c5740 10 client.25394 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.435+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55aa7a25e170 con 0x55aa7a25d550 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f71427fc640 1 -- 172.21.15.80:0/2244645401 <== mon.2 v2:172.21.15.82:3300/0 4 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f714c044030 con 0x55aa7a25d550 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f71685c5740 10 client.25394 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f71685c5740 10 client.25394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f71685c5740 20 client.25394 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f71685c5740 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a2451f0 0x55aa7a64b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f71685c5740 4 client.25394 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa7a59a710 con 0x55aa7a2451f0 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.436+0000 7f7153fff640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a2451f0 0x55aa7a64b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.437+0000 7f71427fc640 10 client.25394 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.437+0000 7f7153fff640 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a2451f0 0x55aa7a64b490 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d251c5f0a70bea server_cookie=4a34306ca7ded793 in_seq=0 out_seq=0 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.437+0000 7f71427fc640 1 -- 172.21.15.80:0/2244645401 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa7a59a710 con 0x55aa7a2451f0 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.437+0000 7f71427fc640 10 client.25394 handle_command_reply: tid=0 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.437+0000 7f71685c5740 1 client.25394 shutdown 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 msgr2=0x55aa7a6394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a6394b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f714c004770 tx=0x7f714c009260 comp rx=0 tx=0).stop 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 shutdown_connections 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a2451f0 0x55aa7a64b490 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a6399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71427fc640 0 client.25394 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a286410 0x55aa7a63f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 --2- 172.21.15.80:0/2244645401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a25d550 0x55aa7a6394b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 >> 172.21.15.80:0/2244645401 conn(0x55aa7a27a560 msgr2=0x55aa7a6214c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 shutdown_connections 2024-04-25T11:25:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 1 -- 172.21.15.80:0/2244645401 wait complete. 2024-04-25T11:25:24.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.438+0000 7f71685c5740 20 client.25394 trim_cache size 0 max 16384 2024-04-25T11:25:24.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.474+0000 7f71685c5740 1 Processor -- start 2024-04-25T11:25:24.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.474+0000 7f71685c5740 1 -- start start 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.474+0000 7f71685c5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a2451f0 0x55aa7a6385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.474+0000 7f71685c5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a62f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.474+0000 7f71685c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a265730 0x55aa7a632bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.474+0000 7f71685c5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1b0040 con 0x55aa7a2451f0 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.474+0000 7f71685c5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1ad910 con 0x55aa7a265730 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f71685c5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1ab760 con 0x55aa7a25d550 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a2451f0 0x55aa7a6385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a2451f0 0x55aa7a6385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47542/0 (socket says 172.21.15.80:47542) 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 -- 172.21.15.80:0/2414944179 learned_addr learned my addr 172.21.15.80:0/2414944179 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f7153fff640 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a62f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715b7fe640 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a265730 0x55aa7a632bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 -- 172.21.15.80:0/2414944179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 msgr2=0x55aa7a62f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a62f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 -- 172.21.15.80:0/2414944179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a265730 msgr2=0x55aa7a632bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a265730 0x55aa7a632bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 -- 172.21.15.80:0/2414944179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7a6303d0 con 0x55aa7a2451f0 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f715affd640 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a2451f0 0x55aa7a6385a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f714c031c70 tx=0x7f714c04a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f69efac6a4647e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.475+0000 7f7150ff9640 1 -- 172.21.15.80:0/2414944179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c0318b0 con 0x55aa7a2451f0 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.476+0000 7f7150ff9640 1 -- 172.21.15.80:0/2414944179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7154003d10 con 0x55aa7a2451f0 2024-04-25T11:25:24.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.476+0000 7f7150ff9640 1 -- 172.21.15.80:0/2414944179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c03d450 con 0x55aa7a2451f0 2024-04-25T11:25:24.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 -- 172.21.15.80:0/2414944179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a2451f0 msgr2=0x55aa7a6385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a2451f0 0x55aa7a6385a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f714c031c70 tx=0x7f714c04a070 comp rx=0 tx=0).stop 2024-04-25T11:25:24.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 -- 172.21.15.80:0/2414944179 shutdown_connections 2024-04-25T11:25:24.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a265730 0x55aa7a632bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a62f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 --2- 172.21.15.80:0/2414944179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a2451f0 0x55aa7a6385a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 -- 172.21.15.80:0/2414944179 >> 172.21.15.80:0/2414944179 conn(0x55aa7a27a560 msgr2=0x55aa7a62edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 -- 172.21.15.80:0/2414944179 shutdown_connections 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.477+0000 7f71685c5740 1 -- 172.21.15.80:0/2414944179 wait complete. 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.478+0000 7f71685c5740 1 -- start start 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.478+0000 7f71685c5740 1 Processor -- start 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.478+0000 7f71685c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a2451f0 0x55aa7a645f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.478+0000 7f71685c5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a63f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.478+0000 7f71685c5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a63f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.478+0000 7f71685c5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1abdd0 con 0x55aa7a265730 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.478+0000 7f71685c5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1ad240 con 0x55aa7a2451f0 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a63f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a63f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:37496/0 (socket says 172.21.15.80:37496) 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 -- 172.21.15.80:0/4164676119 learned_addr learned my addr 172.21.15.80:0/4164676119 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1ac4a0 con 0x55aa7a25d550 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f715affd640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a2451f0 0x55aa7a645f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f715b7fe640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a63f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f71685c5740 10 client.0 _ll_register_callbacks cb 0x7f714c0038b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 -- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a2451f0 msgr2=0x55aa7a645f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a2451f0 0x55aa7a645f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 -- 172.21.15.80:0/4164676119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 msgr2=0x55aa7a63f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a63f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 -- 172.21.15.80:0/4164676119 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa7a63fdc0 con 0x55aa7a25d550 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f715b7fe640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a63f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f715affd640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a2451f0 0x55aa7a645f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f7153fff640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a63f2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71440a3b10 tx=0x7f71440a7a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895dc7eeb26d2ee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f71427fc640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-25T11:25:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.479+0000 7f71427fc640 1 -- 172.21.15.80:0/4164676119 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440dcb30 con 0x55aa7a25d550 2024-04-25T11:25:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.480+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7154003d10 con 0x55aa7a25d550 2024-04-25T11:25:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.480+0000 7f71427fc640 1 -- 172.21.15.80:0/4164676119 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f71440b0150 con 0x55aa7a25d550 2024-04-25T11:25:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.480+0000 7f71427fc640 1 -- 172.21.15.80:0/4164676119 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f71440c1e60 con 0x55aa7a25d550 2024-04-25T11:25:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.480+0000 7f71685c5740 10 client.25417 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.480+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aa7a644830 con 0x55aa7a25d550 2024-04-25T11:25:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.480+0000 7f71427fc640 1 -- 172.21.15.80:0/4164676119 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7154003d10 con 0x55aa7a25d550 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f71427fc640 1 -- 172.21.15.80:0/4164676119 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f71440a67d0 con 0x55aa7a25d550 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f71685c5740 10 client.25417 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f71685c5740 10 client.25417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f71685c5740 20 client.25417 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f71685c5740 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a286410 0x55aa7a6b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f71685c5740 4 client.25417 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aa7a594580 con 0x55aa7a286410 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.481+0000 7f715affd640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a286410 0x55aa7a6b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.482+0000 7f71427fc640 10 client.25417 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.482+0000 7f715affd640 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a286410 0x55aa7a6b5cb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b67fe362336a9e server_cookie=bdd66ac918a2caaa in_seq=0 out_seq=0 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.483+0000 7f71427fc640 1 -- 172.21.15.80:0/4164676119 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aa7a594580 con 0x55aa7a286410 2024-04-25T11:25:24.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71427fc640 10 client.25417 handle_command_reply: tid=0 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 client.25417 shutdown 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 msgr2=0x55aa7a63f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a63f2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71440a3b10 tx=0x7f71440a7a50 comp rx=0 tx=0).stop 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 shutdown_connections 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aa7a286410 0x55aa7a6b5cb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aa7a265730 0x55aa7a63f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aa7a25d550 0x55aa7a63f2c0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71440a3b10 tx=0x7f71440a7a50 comp rx=0 tx=0).stop 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 --2- 172.21.15.80:0/4164676119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa7a2451f0 0x55aa7a645f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 >> 172.21.15.80:0/4164676119 conn(0x55aa7a27a560 msgr2=0x55aa7a638300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71427fc640 0 client.25417 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 shutdown_connections 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 1 -- 172.21.15.80:0/4164676119 wait complete. 2024-04-25T11:25:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.484+0000 7f71685c5740 20 client.25417 trim_cache size 0 max 16384 2024-04-25T11:25:24.480 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:25:24.480 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:25:24.480 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "e7534118-9479-46c6-8db3-a8a2a028d909", 2024-04-25T11:25:24.480 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:25:24.480 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71480afe00 msgr2=0x7f71480b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71480afe00 0x7f71480b2310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f714c000c00 tx=0x7f714c005a20 comp rx=0 tx=0).stop 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f715c108a20 msgr2=0x7f715c19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f715c108a20 0x7f715c19ba90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f715c06c4d0 tx=0x7f714400ee50 comp rx=0 tx=0).stop 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 shutdown_connections 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71480afe00 0x7f71480b2310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c10d380 0x7f715c19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f715c108a20 0x7f715c19ba90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 --2- 172.21.15.80:0/1770655054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f715c102af0 0x7f715c19b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 >> 172.21.15.80:0/1770655054 conn(0x7f715c078100 msgr2=0x7f715c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 shutdown_connections 2024-04-25T11:25:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.485+0000 7f716163c640 1 -- 172.21.15.80:0/1770655054 wait complete. 2024-04-25T11:25:24.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:25:24.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 -- 172.21.15.80:0/1940991657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e8410d380 msgr2=0x7f5e8410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/1940991657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e8410d380 0x7f5e8410f7a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009ca0 tx=0x7f5e7c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 -- 172.21.15.80:0/1940991657 shutdown_connections 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/1940991657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e8410d380 0x7f5e8410f7a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/1940991657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84102af0 0x7f5e84102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/1940991657 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e84108a20 0x7f5e841025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 -- 172.21.15.80:0/1940991657 >> 172.21.15.80:0/1940991657 conn(0x7f5e84078100 msgr2=0x7f5e84078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 -- 172.21.15.80:0/1940991657 shutdown_connections 2024-04-25T11:25:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.670+0000 7f5e8bce7640 1 -- 172.21.15.80:0/1940991657 wait complete. 2024-04-25T11:25:24.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.671+0000 7f5e8bce7640 1 Processor -- start 2024-04-25T11:25:24.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.671+0000 7f5e8bce7640 1 -- start start 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.671+0000 7f5e8bce7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84102af0 0x7f5e841992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e8bce7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e84108a20 0x7f5e84199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e8bce7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e8410d380 0x7f5e84199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e8bce7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84112c30 con 0x7f5e84108a20 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e8bce7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84112ab0 con 0x7f5e84102af0 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e8bce7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84112db0 con 0x7f5e8410d380 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e84108a20 0x7f5e84199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e84108a20 0x7f5e84199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47576/0 (socket says 172.21.15.80:47576) 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 -- 172.21.15.80:0/3456914176 learned_addr learned my addr 172.21.15.80:0/3456914176 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89a83640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84102af0 0x7f5e841992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e8a284640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e8410d380 0x7f5e84199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 -- 172.21.15.80:0/3456914176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e8410d380 msgr2=0x7f5e84199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e8410d380 0x7f5e84199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 -- 172.21.15.80:0/3456914176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84102af0 msgr2=0x7f5e841992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84102af0 0x7f5e841992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 -- 172.21.15.80:0/3456914176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8419e5d0 con 0x7f5e84108a20 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.672+0000 7f5e89282640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e84108a20 0x7f5e84199800 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d740 tx=0x7f5e7400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.673+0000 7f5e7affd640 1 -- 172.21.15.80:0/3456914176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74017070 con 0x7f5e84108a20 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.673+0000 7f5e7affd640 1 -- 172.21.15.80:0/3456914176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e7400de50 con 0x7f5e84108a20 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.673+0000 7f5e7affd640 1 -- 172.21.15.80:0/3456914176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74003c20 con 0x7f5e84108a20 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.673+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8419e8c0 con 0x7f5e84108a20 2024-04-25T11:25:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.673+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e8419ed90 con 0x7f5e84108a20 2024-04-25T11:25:24.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.677+0000 7f5e7affd640 1 -- 172.21.15.80:0/3456914176 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7f5e74003dc0 con 0x7f5e84108a20 2024-04-25T11:25:24.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.677+0000 7f5e92b97740 1 Processor -- start 2024-04-25T11:25:24.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.677+0000 7f5e92b97740 1 -- start start 2024-04-25T11:25:24.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2d5390 0x55c02c675a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2ac4d0 0x55c02c675fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c6828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e92b97740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c02c5dbd80 con 0x55c02c2ac4d0 2024-04-25T11:25:24.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e92b97740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c02c5958b0 con 0x55c02c2b46b0 2024-04-25T11:25:24.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e92b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c02c5d7d40 con 0x55c02c2d5390 2024-04-25T11:25:24.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e89a83640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2ac4d0 0x55c02c675fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e7affd640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5e700afe00 0x7f5e700b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e89a83640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2ac4d0 0x55c02c675fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47584/0 (socket says 172.21.15.80:47584) 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e89a83640 1 -- 172.21.15.80:0/641106635 learned_addr learned my addr 172.21.15.80:0/641106635 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e89282640 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c6828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e8a284640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5e700afe00 0x7f5e700b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e89a83640 1 -- 172.21.15.80:0/641106635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2d5390 msgr2=0x55c02c675a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.678+0000 7f5e89a83640 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2d5390 0x55c02c675a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e89a83640 1 -- 172.21.15.80:0/641106635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 msgr2=0x55c02c6828f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e89a83640 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c6828f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e89a83640 1 -- 172.21.15.80:0/641106635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02c566a40 con 0x55c02c2ac4d0 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e89282640 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c6828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e7affd640 1 -- 172.21.15.80:0/3456914176 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f5e740debf0 con 0x7f5e84108a20 2024-04-25T11:25:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e89a83640 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2ac4d0 0x55c02c675fa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000bc30 tx=0x7f5e800107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b541a8b2fe5cefb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e8a284640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5e700afe00 0x7f5e700b2310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e8419a2a0 tx=0x7f5e7c005fd0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e6ffff640 1 -- 172.21.15.80:0/641106635 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8001c480 con 0x55c02c2ac4d0 2024-04-25T11:25:24.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e6ffff640 1 -- 172.21.15.80:0/641106635 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e8001cad0 con 0x55c02c2ac4d0 2024-04-25T11:25:24.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.679+0000 7f5e6ffff640 1 -- 172.21.15.80:0/641106635 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80011a70 con 0x55c02c2ac4d0 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.680+0000 7f5e92b97740 1 -- 172.21.15.80:0/641106635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2ac4d0 msgr2=0x55c02c675fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.680+0000 7f5e92b97740 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2ac4d0 0x55c02c675fa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000bc30 tx=0x7f5e800107a0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.680+0000 7f5e92b97740 1 -- 172.21.15.80:0/641106635 shutdown_connections 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.680+0000 7f5e92b97740 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2ac4d0 0x55c02c675fa0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.681+0000 7f5e92b97740 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c6828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.681+0000 7f5e92b97740 1 --2- 172.21.15.80:0/641106635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2d5390 0x55c02c675a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.681+0000 7f5e92b97740 1 -- 172.21.15.80:0/641106635 >> 172.21.15.80:0/641106635 conn(0x55c02c2c94e0 msgr2=0x55c02c672210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.682+0000 7f5e92b97740 1 -- 172.21.15.80:0/641106635 shutdown_connections 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.682+0000 7f5e92b97740 1 -- 172.21.15.80:0/641106635 wait complete. 2024-04-25T11:25:24.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.682+0000 7f5e92b97740 1 -- start start 2024-04-25T11:25:24.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.682+0000 7f5e92b97740 1 Processor -- start 2024-04-25T11:25:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.682+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2ac4d0 0x55c02c680670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.682+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2b46b0 0x55c02c680bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6864a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e92b97740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c02c682fe0 con 0x55c02c2d5390 2024-04-25T11:25:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e92b97740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c02c562d10 con 0x55c02c2ac4d0 2024-04-25T11:25:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e92b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c02c683160 con 0x55c02c2b46b0 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6864a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e92b97740 10 client.0 _ll_register_callbacks cb 0x55c02c58f210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6864a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47586/0 (socket says 172.21.15.80:47586) 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 -- 172.21.15.80:0/466562751 learned_addr learned my addr 172.21.15.80:0/466562751 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e89a83640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2ac4d0 0x55c02c680670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e89282640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2b46b0 0x55c02c680bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 -- 172.21.15.80:0/466562751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2b46b0 msgr2=0x55c02c680bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2b46b0 0x55c02c680bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 -- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2ac4d0 msgr2=0x55c02c680670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2ac4d0 0x55c02c680670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 -- 172.21.15.80:0/466562751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02c3b77d0 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e89282640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2b46b0 0x55c02c680bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e8a284640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6864a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009ca0 tx=0x7f5e7c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6028d29eb023ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.683+0000 7f5e6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/466562751 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c055060 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/466562751 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f5e7c004040 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e8001cad0 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/466562751 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e7c004240 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 10 client.15852 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c02c2ed3f0 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/466562751 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e8001cad0 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/466562751 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5e7c04f030 con 0x55c02c2d5390 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 10 client.15852 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 20 client.15852 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:24.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c293f60 0x55c02c692b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 4 client.15852 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:24.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.684+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c02c5e9990 con 0x55c02c293f60 2024-04-25T11:25:24.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.685+0000 7f5e89a83640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c293f60 0x55c02c692b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.685+0000 7f5e6d7fa640 10 client.15852 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.685+0000 7f5e89a83640 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c293f60 0x55c02c692b40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=298f5eb860edce4 server_cookie=32da5331ebaf59ea in_seq=0 out_seq=0 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/466562751 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c02c5e9990 con 0x55c02c293f60 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e6d7fa640 10 client.15852 handle_command_reply: tid=0 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 client.15852 shutdown 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 msgr2=0x55c02c6864a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6864a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009ca0 tx=0x7f5e7c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 shutdown_connections 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c293f60 0x55c02c692b40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6864a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2b46b0 0x55c02c680bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e6d7fa640 0 client.15852 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 --2- 172.21.15.80:0/466562751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2ac4d0 0x55c02c680670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 >> 172.21.15.80:0/466562751 conn(0x55c02c2c94e0 msgr2=0x55c02c677780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 shutdown_connections 2024-04-25T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 1 -- 172.21.15.80:0/466562751 wait complete. 2024-04-25T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.686+0000 7f5e92b97740 20 client.15852 trim_cache size 0 max 16384 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.704+0000 7f5e92b97740 1 Processor -- start 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.704+0000 7f5e92b97740 1 -- start start 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c675f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c698340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c698880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e92b97740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841b89a0 con 0x55c02c2d5390 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e92b97740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841b6270 con 0x55c02c2b46b0 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e92b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841b40c0 con 0x55c02c2ac4d0 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c698880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c698880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47596/0 (socket says 172.21.15.80:47596) 2024-04-25T11:25:24.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 -- 172.21.15.80:0/461884122 learned_addr learned my addr 172.21.15.80:0/461884122 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e89282640 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c698340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e89a83640 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c675f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 -- 172.21.15.80:0/461884122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 msgr2=0x55c02c675f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c675f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 -- 172.21.15.80:0/461884122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 msgr2=0x55c02c698340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c698340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 -- 172.21.15.80:0/461884122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02c2ad0f0 con 0x55c02c2d5390 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e89a83640 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c675f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e8a284640 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c698880 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c005e30 tx=0x7f5e7c031950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d7806fd907e98c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.705+0000 7f5e6f7fe640 1 -- 172.21.15.80:0/461884122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c055040 con 0x55c02c2d5390 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e6f7fe640 1 -- 172.21.15.80:0/461884122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e7c032e90 con 0x55c02c2d5390 2024-04-25T11:25:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e6f7fe640 1 -- 172.21.15.80:0/461884122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c004640 con 0x55c02c2d5390 2024-04-25T11:25:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 -- 172.21.15.80:0/461884122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 msgr2=0x55c02c698880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c698880 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c005e30 tx=0x7f5e7c031950 comp rx=0 tx=0).stop 2024-04-25T11:25:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 -- 172.21.15.80:0/461884122 shutdown_connections 2024-04-25T11:25:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c698880 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c698340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 --2- 172.21.15.80:0/461884122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c675f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 -- 172.21.15.80:0/461884122 >> 172.21.15.80:0/461884122 conn(0x55c02c2c94e0 msgr2=0x55c02c6757f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.706+0000 7f5e92b97740 1 -- 172.21.15.80:0/461884122 shutdown_connections 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.707+0000 7f5e92b97740 1 -- 172.21.15.80:0/461884122 wait complete. 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.707+0000 7f5e92b97740 1 -- start start 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.707+0000 7f5e92b97740 1 Processor -- start 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c687840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c687d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e92b97740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6882c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e92b97740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841b4730 con 0x55c02c2d5390 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e92b97740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841b5ba0 con 0x55c02c2b46b0 2024-04-25T11:25:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e92b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841b4e00 con 0x55c02c2ac4d0 2024-04-25T11:25:24.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e92b97740 10 client.0 _ll_register_callbacks cb 0x7f5e7c009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:24.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6882c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47608/0 (socket says 172.21.15.80:47608) 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e89282640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c687d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 -- 172.21.15.80:0/568067007 learned_addr learned my addr 172.21.15.80:0/568067007 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e89a83640 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c687840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 -- 172.21.15.80:0/568067007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 msgr2=0x55c02c687840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c687840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 -- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 msgr2=0x55c02c687d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c687d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 -- 172.21.15.80:0/568067007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02c59c4b0 con 0x55c02c2d5390 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e89282640 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c687d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e8a284640 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6882c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009ca0 tx=0x7f5e7c02fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc294750036f5b52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.708+0000 7f5e6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/568067007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c055070 con 0x55c02c2d5390 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/568067007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f5e7c031d00 con 0x55c02c2d5390 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e7c032e90 con 0x55c02c2d5390 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/568067007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e7c072050 con 0x55c02c2d5390 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e92b97740 10 client.15858 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c02c6fa0a0 con 0x55c02c2d5390 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/568067007 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e7c032e90 con 0x55c02c2d5390 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.709+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/568067007 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5e7c04f040 con 0x55c02c2d5390 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e92b97740 10 client.15858 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e92b97740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e92b97740 20 client.15858 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e92b97740 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c2693a0 0x55c02c6fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e92b97740 4 client.15858 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c02c5e3800 con 0x55c02c2693a0 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e89a83640 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c2693a0 0x55c02c6fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e6d7fa640 10 client.15858 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e89a83640 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c2693a0 0x55c02c6fc6f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd04b1c0ca5497fd server_cookie=8ad8816b6cd1c58a in_seq=0 out_seq=0 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e6d7fa640 1 -- 172.21.15.80:0/568067007 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c02c5e3800 con 0x55c02c2693a0 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.710+0000 7f5e6d7fa640 10 client.15858 handle_command_reply: tid=0 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 client.15858 shutdown 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 msgr2=0x55c02c6882c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6882c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009ca0 tx=0x7f5e7c02fab0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 shutdown_connections 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c02c2693a0 0x55c02c6fc6f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c02c2d5390 0x55c02c6882c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e6d7fa640 0 client.15858 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c02c2b46b0 0x55c02c687d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 --2- 172.21.15.80:0/568067007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c02c2ac4d0 0x55c02c687840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 >> 172.21.15.80:0/568067007 conn(0x55c02c2c94e0 msgr2=0x55c02c677660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 shutdown_connections 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 1 -- 172.21.15.80:0/568067007 wait complete. 2024-04-25T11:25:24.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.711+0000 7f5e92b97740 20 client.15858 trim_cache size 0 max 16384 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout: "e7534118-9479-46c6-8db3-a8a2a028d909": { 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "e7534118-9479-46c6-8db3-a8a2a028d909", 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:25:24.714 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:25:24.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:25:24.715 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:25:24.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5e700afe00 msgr2=0x7f5e700b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5e700afe00 0x7f5e700b2310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e8419a2a0 tx=0x7f5e7c005fd0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e84108a20 msgr2=0x7f5e84199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e84108a20 0x7f5e84199800 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d740 tx=0x7f5e7400dc00 comp rx=0 tx=0).stop 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 shutdown_connections 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5e700afe00 0x7f5e700b2310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e84108a20 0x7f5e84199800 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e8410d380 0x7f5e84199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 --2- 172.21.15.80:0/3456914176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e84102af0 0x7f5e841992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 >> 172.21.15.80:0/3456914176 conn(0x7f5e84078100 msgr2=0x7f5e841040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 shutdown_connections 2024-04-25T11:25:24.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:24.712+0000 7f5e8bce7640 1 -- 172.21.15.80:0/3456914176 wait complete. 2024-04-25T11:25:24.719 INFO:tasks.cephfs.filesystem:scrub status for tag:e7534118-9479-46c6-8db3-a8a2a028d909 - {'path': '/', 'tag': 'e7534118-9479-46c6-8db3-a8a2a028d909', 'options': 'recursive,force'} 2024-04-25T11:25:26.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:25 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:25:26.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:25 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:26.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:25 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:25:26.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:25 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:26.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:25 smithi080 ceph-mon[29126]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-25T11:25:26.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:25 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:25:26.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:25 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:26.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:25 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:25:26.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:25 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:26.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:25 smithi196 ceph-mon[32659]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-25T11:25:26.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:25 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:25:26.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:25 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:26.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:25 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:25:26.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:25 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:26.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:25 smithi082 ceph-mon[32440]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 6 op/s 2024-04-25T11:25:28.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:27 smithi080 ceph-mon[29126]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 289 B/s wr, 8 op/s 2024-04-25T11:25:28.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:27 smithi196 ceph-mon[32659]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 289 B/s wr, 8 op/s 2024-04-25T11:25:28.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:27 smithi082 ceph-mon[32440]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 289 B/s wr, 8 op/s 2024-04-25T11:25:29.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:28 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 -- 172.21.15.80:0/2229565013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b8109bb0 msgr2=0x7f60b8103750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 --2- 172.21.15.80:0/2229565013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b8109bb0 0x7f60b8103750 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009900 tx=0x7f60a802a410 comp rx=0 tx=0).stop 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 -- 172.21.15.80:0/2229565013 shutdown_connections 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 --2- 172.21.15.80:0/2229565013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b8104300 0x7f60b81106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 --2- 172.21.15.80:0/2229565013 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60b810a050 0x7f60b8103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 --2- 172.21.15.80:0/2229565013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b8109bb0 0x7f60b8103750 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 -- 172.21.15.80:0/2229565013 >> 172.21.15.80:0/2229565013 conn(0x7f60b8079320 msgr2=0x7f60b8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 -- 172.21.15.80:0/2229565013 shutdown_connections 2024-04-25T11:25:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.160+0000 7f60bc940640 1 -- 172.21.15.80:0/2229565013 wait complete. 2024-04-25T11:25:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 Processor -- start 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 -- start start 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b8104300 0x7f60b819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60b8109bb0 0x7f60b819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b810a050 0x7f60b819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8113df0 con 0x7f60b810a050 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8113c70 con 0x7f60b8104300 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.161+0000 7f60bc940640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8113f70 con 0x7f60b8109bb0 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b810a050 0x7f60b819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b810a050 0x7f60b819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37254/0 (socket says 172.21.15.80:37254) 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 -- 172.21.15.80:0/18329729 learned_addr learned my addr 172.21.15.80:0/18329729 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60b8109bb0 0x7f60b819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b659c640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b8104300 0x7f60b819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 -- 172.21.15.80:0/18329729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60b8109bb0 msgr2=0x7f60b819ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60b8109bb0 0x7f60b819ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 -- 172.21.15.80:0/18329729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b8104300 msgr2=0x7f60b819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b8104300 0x7f60b819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 -- 172.21.15.80:0/18329729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b819f650 con 0x7f60b810a050 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60b6d9d640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b810a050 0x7f60b819f010 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f60b000eaa0 tx=0x7f60b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.162+0000 7f60a77fe640 1 -- 172.21.15.80:0/18329729 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b000cdb0 con 0x7f60b810a050 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.163+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b819f940 con 0x7f60b810a050 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.163+0000 7f60a77fe640 1 -- 172.21.15.80:0/18329729 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60b0005020 con 0x7f60b810a050 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.163+0000 7f60a77fe640 1 -- 172.21.15.80:0/18329729 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b00116d0 con 0x7f60b810a050 2024-04-25T11:25:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.163+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b8074dd0 con 0x7f60b810a050 2024-04-25T11:25:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.166+0000 7f60c37f0740 1 Processor -- start 2024-04-25T11:25:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.166+0000 7f60a77fe640 1 -- 172.21.15.80:0/18329729 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7f60b00051d0 con 0x7f60b810a050 2024-04-25T11:25:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60c37f0740 1 -- start start 2024-04-25T11:25:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f694c1b0 0x5565f6cebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6cec030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cec570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60c37f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5565f6c52460 con 0x5565f69232f0 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60c37f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565f6c0c590 con 0x5565f694c1b0 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60c37f0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5565f6c4e420 con 0x5565f692b4d0 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60a77fe640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f60a00afd70 0x7f60a00b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60b659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6cec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60b5d9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60b659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6cec030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37262/0 (socket says 172.21.15.80:37262) 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60b659c640 1 -- 172.21.15.80:0/3814486330 learned_addr learned my addr 172.21.15.80:0/3814486330 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cec570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:46268/0 (socket says 172.21.15.80:46268) 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.167+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f694c1b0 0x5565f6cebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60a77fe640 1 -- 172.21.15.80:0/18329729 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f60b00df430 con 0x7f60b810a050 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b6d9d640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f60a00afd70 0x7f60a00b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b5d9b640 1 -- 172.21.15.80:0/3814486330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 msgr2=0x5565f6cec570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cec570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b5d9b640 1 -- 172.21.15.80:0/3814486330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 msgr2=0x5565f6cec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6cec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b5d9b640 1 -- 172.21.15.80:0/3814486330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565f6c190d0 con 0x5565f694c1b0 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b659c640 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6cec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f694c1b0 0x5565f6cebaf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60b810f9c0 tx=0x7f60ac005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=581ee2b9c6f418c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60a4ff9640 1 -- 172.21.15.80:0/3814486330 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac004030 con 0x5565f694c1b0 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60a4ff9640 1 -- 172.21.15.80:0/3814486330 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60ac0035f0 con 0x5565f694c1b0 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.168+0000 7f60a4ff9640 1 -- 172.21.15.80:0/3814486330 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00f6e0 con 0x5565f694c1b0 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.169+0000 7f60c37f0740 1 -- 172.21.15.80:0/3814486330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f694c1b0 msgr2=0x5565f6cebaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.169+0000 7f60b6d9d640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f60a00afd70 0x7f60a00b2280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60b00dca70 tx=0x7f60b000cf50 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.169+0000 7f60c37f0740 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f694c1b0 0x5565f6cebaf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60b810f9c0 tx=0x7f60ac005f90 comp rx=0 tx=0).stop 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.169+0000 7f60c37f0740 1 -- 172.21.15.80:0/3814486330 shutdown_connections 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.169+0000 7f60c37f0740 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6cec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.169+0000 7f60c37f0740 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cec570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.170+0000 7f60c37f0740 1 --2- 172.21.15.80:0/3814486330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f694c1b0 0x5565f6cebaf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.170+0000 7f60c37f0740 1 -- 172.21.15.80:0/3814486330 >> 172.21.15.80:0/3814486330 conn(0x5565f6940300 msgr2=0x5565f6ce82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.170+0000 7f60c37f0740 1 -- 172.21.15.80:0/3814486330 shutdown_connections 2024-04-25T11:25:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.170+0000 7f60c37f0740 1 -- 172.21.15.80:0/3814486330 wait complete. 2024-04-25T11:25:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.170+0000 7f60c37f0740 1 -- start start 2024-04-25T11:25:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.170+0000 7f60c37f0740 1 Processor -- start 2024-04-25T11:25:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cf7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cf8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cf6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60c37f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5565f6cf8c20 con 0x5565f694c1b0 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60c37f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565f6bd9b60 con 0x5565f69232f0 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60c37f0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5565f6cf8da0 con 0x5565f692b4d0 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60c37f0740 10 client.0 _ll_register_callbacks cb 0x5565f6bfe2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cf6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cf6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37266/0 (socket says 172.21.15.80:37266) 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 -- 172.21.15.80:0/785503464 learned_addr learned my addr 172.21.15.80:0/785503464 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b659c640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cf8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cf7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 -- 172.21.15.80:0/785503464 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 msgr2=0x5565f6cf8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cf8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 -- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 msgr2=0x5565f6cf7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cf7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 -- 172.21.15.80:0/785503464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565f6964210 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b659c640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cf8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cf6050 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0045d0 tx=0x7f60ac003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f6426165286726 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.171+0000 7f609dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.172+0000 7f609dffb640 1 -- 172.21.15.80:0/785503464 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac003860 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.172+0000 7f609dffb640 1 -- 172.21.15.80:0/785503464 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f60ac003a00 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.172+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60ac0035f0 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.172+0000 7f609dffb640 1 -- 172.21.15.80:0/785503464 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f60ac034050 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.172+0000 7f60c37f0740 10 client.15870 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.172+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5565f6a30620 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.172+0000 7f609dffb640 1 -- 172.21.15.80:0/785503464 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60ac0035f0 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f609dffb640 1 -- 172.21.15.80:0/785503464 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f60ac01d020 con 0x5565f694c1b0 2024-04-25T11:25:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f60c37f0740 10 client.15870 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f60c37f0740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f60c37f0740 20 client.15870 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f60c37f0740 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f690ad80 0x5565f6d08600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f60c37f0740 4 client.15870 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565f6c60070 con 0x5565f690ad80 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.173+0000 7f60b659c640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f690ad80 0x5565f6d08600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f609dffb640 10 client.15870 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60b659c640 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f690ad80 0x5565f6d08600 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dea84b307b451db server_cookie=52b0060ef9fcc8c0 in_seq=0 out_seq=0 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f609dffb640 1 -- 172.21.15.80:0/785503464 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5565f6c60070 con 0x5565f690ad80 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f609dffb640 10 client.15870 handle_command_reply: tid=0 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60c37f0740 1 client.15870 shutdown 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 msgr2=0x5565f6cf6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60c37f0740 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cf6050 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0045d0 tx=0x7f60ac003f60 comp rx=0 tx=0).stop 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 shutdown_connections 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60c37f0740 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f690ad80 0x5565f6d08600 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60c37f0740 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cf6050 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f60c37f0740 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cf8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.175+0000 7f60c37f0740 1 --2- 172.21.15.80:0/785503464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cf7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.174+0000 7f609dffb640 0 client.15870 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.175+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 >> 172.21.15.80:0/785503464 conn(0x5565f6940300 msgr2=0x5565f6ceb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.175+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 shutdown_connections 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.175+0000 7f60c37f0740 1 -- 172.21.15.80:0/785503464 wait complete. 2024-04-25T11:25:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.175+0000 7f60c37f0740 20 client.15870 trim_cache size 0 max 16384 2024-04-25T11:25:29.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:28 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 Processor -- start 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 -- start start 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cefec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cfe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cfe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81b4600 con 0x5565f694c1b0 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81b1ed0 con 0x5565f69232f0 2024-04-25T11:25:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60c37f0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81afd20 con 0x5565f692b4d0 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60b5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cfe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60b659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cfe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60b5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cfe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37278/0 (socket says 172.21.15.80:37278) 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.204+0000 7f60b5d9b640 1 -- 172.21.15.80:0/2578240487 learned_addr learned my addr 172.21.15.80:0/2578240487 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cefec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b659c640 1 -- 172.21.15.80:0/2578240487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 msgr2=0x5565f6cefec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b659c640 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cefec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b659c640 1 -- 172.21.15.80:0/2578240487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 msgr2=0x5565f6cfe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b659c640 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cfe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b659c640 1 -- 172.21.15.80:0/2578240487 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565f6cfeab0 con 0x5565f692b4d0 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cfe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f60b659c640 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cfe030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5565f6ce95e0 tx=0x7f60a8005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8594fe275b21c0d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f609ffff640 1 -- 172.21.15.80:0/2578240487 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8048020 con 0x5565f692b4d0 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f609ffff640 1 -- 172.21.15.80:0/2578240487 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60a80054f0 con 0x5565f692b4d0 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.205+0000 7f609ffff640 1 -- 172.21.15.80:0/2578240487 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8035040 con 0x5565f692b4d0 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 -- 172.21.15.80:0/2578240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 msgr2=0x5565f6cfe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cfe030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5565f6ce95e0 tx=0x7f60a8005a20 comp rx=0 tx=0).stop 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 -- 172.21.15.80:0/2578240487 shutdown_connections 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f694c1b0 0x5565f6cfe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f692b4d0 0x5565f6cfe030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 --2- 172.21.15.80:0/2578240487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f69232f0 0x5565f6cefec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 -- 172.21.15.80:0/2578240487 >> 172.21.15.80:0/2578240487 conn(0x5565f6940300 msgr2=0x5565f6cef7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 -- 172.21.15.80:0/2578240487 shutdown_connections 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 -- 172.21.15.80:0/2578240487 wait complete. 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 -- start start 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.207+0000 7f60c37f0740 1 Processor -- start 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6d67ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f692b4d0 0x5565f6d67ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60c37f0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f694c1b0 0x5565f6cfd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60c37f0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81b0390 con 0x5565f69232f0 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60c37f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81b1800 con 0x5565f692b4d0 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60c37f0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81b0a60 con 0x5565f694c1b0 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6d67ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6d67ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37284/0 (socket says 172.21.15.80:37284) 2024-04-25T11:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 -- 172.21.15.80:0/783195304 learned_addr learned my addr 172.21.15.80:0/783195304 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60c37f0740 10 client.0 _ll_register_callbacks cb 0x7f60a8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b659c640 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f692b4d0 0x5565f6d67ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 -- 172.21.15.80:0/783195304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f694c1b0 msgr2=0x5565f6cfd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f694c1b0 0x5565f6cfd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 -- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f692b4d0 msgr2=0x5565f6d67ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f692b4d0 0x5565f6d67ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 -- 172.21.15.80:0/783195304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565f6cfd8b0 con 0x5565f69232f0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b659c640 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f692b4d0 0x5565f6d67ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f60b5d9b640 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6d67ab0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f60ac003f30 tx=0x7f60ac011610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75541df375a6037b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f609dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f609dffb640 1 -- 172.21.15.80:0/783195304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac03c020 con 0x5565f69232f0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.208+0000 7f609dffb640 1 -- 172.21.15.80:0/783195304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f60ac009b10 con 0x5565f69232f0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60a80054f0 con 0x5565f69232f0 2024-04-25T11:25:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f609dffb640 1 -- 172.21.15.80:0/783195304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f60ac0035f0 con 0x5565f69232f0 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f60c37f0740 10 client.15876 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5565f6d70220 con 0x5565f69232f0 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f609dffb640 1 -- 172.21.15.80:0/783195304 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60a80054f0 con 0x5565f69232f0 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f609dffb640 1 -- 172.21.15.80:0/783195304 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f60ac02a070 con 0x5565f69232f0 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f60c37f0740 10 client.15876 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f60c37f0740 10 client.15876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f60c37f0740 20 client.15876 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.209+0000 7f60c37f0740 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f68e01c0 0x5565f6d72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.210+0000 7f60c37f0740 4 client.15876 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.210+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5565f6c59ee0 con 0x5565f68e01c0 2024-04-25T11:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.210+0000 7f60b659c640 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f68e01c0 0x5565f6d72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.210+0000 7f609dffb640 10 client.15876 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.210+0000 7f60b659c640 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f68e01c0 0x5565f6d72a10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34bdb79053c6baab server_cookie=8fea3c42f68e1388 in_seq=0 out_seq=0 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f609dffb640 1 -- 172.21.15.80:0/783195304 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5565f6c59ee0 con 0x5565f68e01c0 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f609dffb640 10 client.15876 handle_command_reply: tid=0 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 client.15876 shutdown 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 msgr2=0x5565f6d67ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6d67ab0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f60ac003f30 tx=0x7f60ac011610 comp rx=0 tx=0).stop 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 shutdown_connections 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5565f68e01c0 0x5565f6d72a10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5565f694c1b0 0x5565f6cfd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f609dffb640 0 client.15876 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f692b4d0 0x5565f6d67ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 --2- 172.21.15.80:0/783195304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5565f69232f0 0x5565f6d67ab0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.214+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 >> 172.21.15.80:0/783195304 conn(0x5565f6940300 msgr2=0x5565f6ceb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 shutdown_connections 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60c37f0740 1 -- 172.21.15.80:0/783195304 wait complete. 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60c37f0740 20 client.15876 trim_cache size 0 max 16384 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:25:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:25:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:25:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f60a00afd70 msgr2=0x7f60a00b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f60a00afd70 0x7f60a00b2280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60b00dca70 tx=0x7f60b000cf50 comp rx=0 tx=0).stop 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b810a050 msgr2=0x7f60b819f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b810a050 0x7f60b819f010 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f60b000eaa0 tx=0x7f60b000ef60 comp rx=0 tx=0).stop 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 shutdown_connections 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f60a00afd70 0x7f60a00b2280 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60b810a050 0x7f60b819f010 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60b8109bb0 0x7f60b819ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.215+0000 7f60bc940640 1 --2- 172.21.15.80:0/18329729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b8104300 0x7f60b819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.216+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 >> 172.21.15.80:0/18329729 conn(0x7f60b8079320 msgr2=0x7f60b8105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.216+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 shutdown_connections 2024-04-25T11:25:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:29.216+0000 7f60bc940640 1 -- 172.21.15.80:0/18329729 wait complete. 2024-04-25T11:25:29.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:28 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:25:30.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:29 smithi080 ceph-mon[29126]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:30.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:29 smithi196 ceph-mon[32659]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:30.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:29 smithi082 ceph-mon[32440]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:32.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:31 smithi080 ceph-mon[29126]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-04-25T11:25:32.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:31 smithi196 ceph-mon[32659]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-04-25T11:25:32.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:31 smithi082 ceph-mon[32440]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-04-25T11:25:34.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:33 smithi080 ceph-mon[29126]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:34.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:33 smithi196 ceph-mon[32659]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:34.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:33 smithi082 ceph-mon[32440]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:36.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:35 smithi080 ceph-mon[29126]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T11:25:36.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:35 smithi196 ceph-mon[32659]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T11:25:36.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:35 smithi082 ceph-mon[32440]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T11:25:38.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:37 smithi080 ceph-mon[29126]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T11:25:38.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:37 smithi196 ceph-mon[32659]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T11:25:38.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:37 smithi082 ceph-mon[32440]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T11:25:40.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:39 smithi080 ceph-mon[29126]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T11:25:40.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:39 smithi196 ceph-mon[32659]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T11:25:40.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:39 smithi082 ceph-mon[32440]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T11:25:42.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:41 smithi080 ceph-mon[29126]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:42.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:41 smithi196 ceph-mon[32659]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:42.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:41 smithi082 ceph-mon[32440]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.363+0000 7f08138af640 1 -- 172.21.15.80:0/3416452701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108f00 msgr2=0x7f080c102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.363+0000 7f08138af640 1 --2- 172.21.15.80:0/3416452701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108f00 0x7f080c102b50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009900 tx=0x7f07fc02a410 comp rx=0 tx=0).stop 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.363+0000 7f08138af640 1 -- 172.21.15.80:0/3416452701 shutdown_connections 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.363+0000 7f08138af640 1 --2- 172.21.15.80:0/3416452701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108f00 0x7f080c102b50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.363+0000 7f08138af640 1 --2- 172.21.15.80:0/3416452701 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f080c1031c0 0x7f080c10f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.363+0000 7f08138af640 1 --2- 172.21.15.80:0/3416452701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c108a60 0x7f080c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.363+0000 7f08138af640 1 -- 172.21.15.80:0/3416452701 >> 172.21.15.80:0/3416452701 conn(0x7f080c0781b0 msgr2=0x7f080c0785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.364+0000 7f08138af640 1 -- 172.21.15.80:0/3416452701 shutdown_connections 2024-04-25T11:25:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.364+0000 7f08138af640 1 -- 172.21.15.80:0/3416452701 wait complete. 2024-04-25T11:25:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.365+0000 7f08138af640 1 Processor -- start 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.365+0000 7f08138af640 1 -- start start 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.365+0000 7f08138af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c1031c0 0x7f080c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.365+0000 7f08138af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108a60 0x7f080c199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f08138af640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f080c108f00 0x7f080c19deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f08138af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f080c112cd0 con 0x7f080c108a60 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c1031c0 0x7f080c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f0810e4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108a60 0x7f080c199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c1031c0 0x7f080c199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34460/0 (socket says 172.21.15.80:34460) 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 -- 172.21.15.80:0/3514100484 learned_addr learned my addr 172.21.15.80:0/3514100484 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f080c112b50 con 0x7f080c1031c0 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f080c112e50 con 0x7f080c108f00 2024-04-25T11:25:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f0811e4c640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f080c108f00 0x7f080c19deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 -- 172.21.15.80:0/3514100484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f080c108f00 msgr2=0x7f080c19deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f080c108f00 0x7f080c19deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 -- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108a60 msgr2=0x7f080c199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108a60 0x7f080c199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f081164b640 1 -- 172.21.15.80:0/3514100484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c19e4f0 con 0x7f080c1031c0 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f0811e4c640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f080c108f00 0x7f080c19deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.366+0000 7f0810e4a640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108a60 0x7f080c199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.367+0000 7f081164b640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c1031c0 0x7f080c199690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f080800d950 tx=0x7f080800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.367+0000 7f08027fc640 1 -- 172.21.15.80:0/3514100484 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808017070 con 0x7f080c1031c0 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.367+0000 7f08027fc640 1 -- 172.21.15.80:0/3514100484 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0808009c30 con 0x7f080c1031c0 2024-04-25T11:25:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.367+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c19e7e0 con 0x7f080c1031c0 2024-04-25T11:25:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.368+0000 7f08027fc640 1 -- 172.21.15.80:0/3514100484 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080047a0 con 0x7f080c1031c0 2024-04-25T11:25:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.368+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c06a3c0 con 0x7f080c1031c0 2024-04-25T11:25:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.371+0000 7f08027fc640 1 -- 172.21.15.80:0/3514100484 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 147753+0+0 (secure 0 0 0) 0x7f0808004020 con 0x7f080c1031c0 2024-04-25T11:25:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.371+0000 7f081a763740 1 Processor -- start 2024-04-25T11:25:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.371+0000 7f081a763740 1 -- start start 2024-04-25T11:25:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f081a763740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e6baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f081a763740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e6c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f081a763740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e6c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f081a763740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559d42dd2460 con 0x559d42acc1b0 2024-04-25T11:25:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f081a763740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559d42d8c590 con 0x559d42aa32f0 2024-04-25T11:25:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f081a763740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559d42dce420 con 0x559d42aab4d0 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f0811e4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e6baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f0811e4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e6baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44172/0 (socket says 172.21.15.80:44172) 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f0811e4c640 1 -- 172.21.15.80:0/1192709577 learned_addr learned my addr 172.21.15.80:0/1192709577 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f0810e4a640 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e6c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f081164b640 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e6c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f08027fc640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07f80afdf0 0x7f07f80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.372+0000 7f0810e4a640 1 -- 172.21.15.80:0/1192709577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 msgr2=0x559d42e6c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f0810e4a640 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e6c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f0810e4a640 1 -- 172.21.15.80:0/1192709577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 msgr2=0x559d42e6baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f0810e4a640 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e6baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f0810e4a640 1 -- 172.21.15.80:0/1192709577 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d42d990d0 con 0x559d42aab4d0 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f081164b640 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e6c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f0811e4c640 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e6baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f0811e4c640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07f80afdf0 0x7f07f80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f0810e4a640 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e6c570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009230 tx=0x7f07fc004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49a8297957d63a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f08027fc640 1 -- 172.21.15.80:0/3514100484 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f08080defd0 con 0x7f080c1031c0 2024-04-25T11:25:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f07f77fe640 1 -- 172.21.15.80:0/1192709577 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc035070 con 0x559d42aab4d0 2024-04-25T11:25:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f07f77fe640 1 -- 172.21.15.80:0/1192709577 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07fc005630 con 0x559d42aab4d0 2024-04-25T11:25:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.373+0000 7f07f77fe640 1 -- 172.21.15.80:0/1192709577 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc003850 con 0x559d42aab4d0 2024-04-25T11:25:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 -- 172.21.15.80:0/1192709577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 msgr2=0x559d42e6c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f0811e4c640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07f80afdf0 0x7f07f80b2300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x559d42e68c60 tx=0x7f0804004ab0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e6c570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009230 tx=0x7f07fc004500 comp rx=0 tx=0).stop 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 -- 172.21.15.80:0/1192709577 shutdown_connections 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e6c570 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e6c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 --2- 172.21.15.80:0/1192709577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e6baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 -- 172.21.15.80:0/1192709577 >> 172.21.15.80:0/1192709577 conn(0x559d42ac0300 msgr2=0x559d42e682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 -- 172.21.15.80:0/1192709577 shutdown_connections 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.374+0000 7f081a763740 1 -- 172.21.15.80:0/1192709577 wait complete. 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.375+0000 7f081a763740 1 -- start start 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.375+0000 7f081a763740 1 Processor -- start 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081a763740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e76110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081a763740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e76650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081a763740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e82070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081a763740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559d42e78bc0 con 0x559d42acc1b0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081a763740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559d42d59b60 con 0x559d42aa32f0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081a763740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559d42e78d40 con 0x559d42aab4d0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081a763740 10 client.0 _ll_register_callbacks cb 0x559d42d7e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f0811e4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e82070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081164b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e76110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f0811e4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e82070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44188/0 (socket says 172.21.15.80:44188) 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f0811e4c640 1 -- 172.21.15.80:0/1461480432 learned_addr learned my addr 172.21.15.80:0/1461480432 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f0810e4a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e76650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081164b640 1 -- 172.21.15.80:0/1461480432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 msgr2=0x559d42e76650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081164b640 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e76650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081164b640 1 -- 172.21.15.80:0/1461480432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 msgr2=0x559d42e82070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.376+0000 7f081164b640 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e82070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f081164b640 1 -- 172.21.15.80:0/1461480432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d42ae4210 con 0x559d42aa32f0 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f0811e4c640 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e82070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f081164b640 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e76110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08080dc550 tx=0x7f08080045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f24c6f50a7122971 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f07f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f07f4ff9640 1 -- 172.21.15.80:0/1461480432 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080a6640 con 0x559d42aa32f0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d42de0070 con 0x559d42aa32f0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f07f4ff9640 1 -- 172.21.15.80:0/1461480432 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f08080a2840 con 0x559d42aa32f0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f07f4ff9640 1 -- 172.21.15.80:0/1461480432 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f08080a69e0 con 0x559d42aa32f0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f081a763740 10 client.25448 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559d42bb0620 con 0x559d42aa32f0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.377+0000 7f07f4ff9640 1 -- 172.21.15.80:0/1461480432 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559d42de0070 con 0x559d42aa32f0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f07f4ff9640 1 -- 172.21.15.80:0/1461480432 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f08080dc830 con 0x559d42aa32f0 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f081a763740 10 client.25448 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f081a763740 10 client.25448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f081a763740 20 client.25448 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f081a763740 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42a8ad80 0x559d42e88ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f081a763740 4 client.25448 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d42dd9ee0 con 0x559d42a8ad80 2024-04-25T11:25:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.378+0000 7f0810e4a640 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42a8ad80 0x559d42e88ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.379+0000 7f0810e4a640 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42a8ad80 0x559d42e88ae0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb5e0ecd4af193e server_cookie=d130262a9b762ed9 in_seq=0 out_seq=0 2024-04-25T11:25:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.379+0000 7f07f4ff9640 10 client.25448 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.379+0000 7f07f4ff9640 1 -- 172.21.15.80:0/1461480432 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559d42dd9ee0 con 0x559d42a8ad80 2024-04-25T11:25:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.379+0000 7f07f4ff9640 10 client.25448 handle_command_reply: tid=0 2024-04-25T11:25:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.379+0000 7f081a763740 1 client.25448 shutdown 2024-04-25T11:25:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 msgr2=0x559d42e76110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e76110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08080dc550 tx=0x7f08080045d0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 shutdown_connections 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42a8ad80 0x559d42e88ae0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42acc1b0 0x559d42e82070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f07f4ff9640 0 client.25448 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aab4d0 0x559d42e76650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 --2- 172.21.15.80:0/1461480432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aa32f0 0x559d42e76110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 >> 172.21.15.80:0/1461480432 conn(0x559d42ac0300 msgr2=0x559d42e6d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 shutdown_connections 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 1 -- 172.21.15.80:0/1461480432 wait complete. 2024-04-25T11:25:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.380+0000 7f081a763740 20 client.25448 trim_cache size 0 max 16384 2024-04-25T11:25:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.410+0000 7f081a763740 1 Processor -- start 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.410+0000 7f081a763740 1 -- start start 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.410+0000 7f081a763740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42a8ad80 0x559d42e6fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.410+0000 7f081a763740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e7e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.410+0000 7f081a763740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aab4d0 0x559d42e81c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f081164b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42a8ad80 0x559d42e6fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f081164b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42a8ad80 0x559d42e6fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44190/0 (socket says 172.21.15.80:44190) 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0811e4c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aab4d0 0x559d42e81c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f081164b640 1 -- 172.21.15.80:0/2559555067 learned_addr learned my addr 172.21.15.80:0/2559555067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0810e4a640 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e7e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1b00b0 con 0x559d42a8ad80 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1ad980 con 0x559d42aab4d0 2024-04-25T11:25:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1ab7d0 con 0x559d42aa32f0 2024-04-25T11:25:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0811e4c640 1 -- 172.21.15.80:0/2559555067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 msgr2=0x559d42e7e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0811e4c640 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e7e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0811e4c640 1 -- 172.21.15.80:0/2559555067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42a8ad80 msgr2=0x559d42e6fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0811e4c640 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42a8ad80 0x559d42e6fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0811e4c640 1 -- 172.21.15.80:0/2559555067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d42e6b880 con 0x559d42aab4d0 2024-04-25T11:25:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f081164b640 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42a8ad80 0x559d42e6fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.411+0000 7f0811e4c640 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aab4d0 0x559d42e81c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0804005fd0 tx=0x7f0804009dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f1222826335ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.412+0000 7f07f6ffd640 1 -- 172.21.15.80:0/2559555067 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080401a040 con 0x559d42aab4d0 2024-04-25T11:25:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.412+0000 7f07f6ffd640 1 -- 172.21.15.80:0/2559555067 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0804027030 con 0x559d42aab4d0 2024-04-25T11:25:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.412+0000 7f07f6ffd640 1 -- 172.21.15.80:0/2559555067 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804023cc0 con 0x559d42aab4d0 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aab4d0 msgr2=0x559d42e81c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aab4d0 0x559d42e81c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0804005fd0 tx=0x7f0804009dc0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 shutdown_connections 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42aab4d0 0x559d42e81c50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e7e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 --2- 172.21.15.80:0/2559555067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42a8ad80 0x559d42e6fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 >> 172.21.15.80:0/2559555067 conn(0x559d42ac0300 msgr2=0x559d42e77620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 shutdown_connections 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.413+0000 7f081a763740 1 -- 172.21.15.80:0/2559555067 wait complete. 2024-04-25T11:25:42.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.414+0000 7f081a763740 1 -- start start 2024-04-25T11:25:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.414+0000 7f081a763740 1 Processor -- start 2024-04-25T11:25:42.408 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.416+0000 7f081a763740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42a8ad80 0x559d42e66de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.416+0000 7f081164b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42a8ad80 0x559d42e66de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.409 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.416+0000 7f081164b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42a8ad80 0x559d42e66de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34486/0 (socket says 172.21.15.80:34486) 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.416+0000 7f081a763740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e67320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.416+0000 7f081164b640 1 -- 172.21.15.80:0/3173005895 learned_addr learned my addr 172.21.15.80:0/3173005895 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.417+0000 7f0810e4a640 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e67320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.417+0000 7f081a763740 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42aab4d0 0x559d42ef7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.417+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1abe40 con 0x559d42aab4d0 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.417+0000 7f0811e4c640 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42aab4d0 0x559d42ef7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.417+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1ad2b0 con 0x559d42a8ad80 2024-04-25T11:25:42.410 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.417+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f080c1ac510 con 0x559d42aa32f0 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f0810e4a640 1 -- 172.21.15.80:0/3173005895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42a8ad80 msgr2=0x559d42e66de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f0810e4a640 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42a8ad80 0x559d42e66de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f0810e4a640 1 -- 172.21.15.80:0/3173005895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42aab4d0 msgr2=0x559d42ef7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f0810e4a640 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42aab4d0 0x559d42ef7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f0810e4a640 1 -- 172.21.15.80:0/3173005895 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d42e78d30 con 0x559d42aa32f0 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f0810e4a640 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e67320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009900 tx=0x7f07fc005410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f2bf1ca3f704eba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f07f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.418+0000 7f07f4ff9640 1 -- 172.21.15.80:0/3173005895 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc054020 con 0x559d42aa32f0 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.419+0000 7f07f4ff9640 1 -- 172.21.15.80:0/3173005895 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f07fc004770 con 0x559d42aa32f0 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.419+0000 7f07f4ff9640 10 client.0 inactive, discarding osd_map(81..81 src has 1..81) 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.419+0000 7f081a763740 10 client.0 _ll_register_callbacks cb 0x7f08080dc5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.419+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0804027030 con 0x559d42aa32f0 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.419+0000 7f07f4ff9640 1 -- 172.21.15.80:0/3173005895 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f07fc035070 con 0x559d42aa32f0 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.419+0000 7f081a763740 10 client.25459 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.419+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({fsmap=24}) -- 0x559d42ef8850 con 0x559d42aa32f0 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f07f4ff9640 1 -- 172.21.15.80:0/3173005895 <== mon.1 v2:172.21.15.196:3300/0 4 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f07fc004970 con 0x559d42aa32f0 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f081a763740 10 client.25459 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f081a763740 10 client.25459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f081a763740 20 client.25459 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f081a763740 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42acc1b0 0x559d42efab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f081a763740 4 client.25459 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:25:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0804027030 con 0x559d42acc1b0 2024-04-25T11:25:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.420+0000 7f081164b640 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42acc1b0 0x559d42efab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.421+0000 7f081164b640 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42acc1b0 0x559d42efab00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d33559eb5cd2ef server_cookie=657d1237567b193e in_seq=0 out_seq=0 2024-04-25T11:25:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.421+0000 7f07f4ff9640 10 client.25459 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.424+0000 7f07f4ff9640 1 -- 172.21.15.80:0/3173005895 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0804027030 con 0x559d42acc1b0 2024-04-25T11:25:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.424+0000 7f07f4ff9640 10 client.25459 handle_command_reply: tid=0 2024-04-25T11:25:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 client.25459 shutdown 2024-04-25T11:25:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 msgr2=0x559d42e67320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e67320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009900 tx=0x7f07fc005410 comp rx=0 tx=0).stop 2024-04-25T11:25:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 shutdown_connections 2024-04-25T11:25:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559d42acc1b0 0x559d42efab00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559d42aab4d0 0x559d42ef7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f07f4ff9640 0 client.25459 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559d42aa32f0 0x559d42e67320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 --2- 172.21.15.80:0/3173005895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d42a8ad80 0x559d42e66de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.425+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 >> 172.21.15.80:0/3173005895 conn(0x559d42ac0300 msgr2=0x559d42e77fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.426+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 shutdown_connections 2024-04-25T11:25:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.426+0000 7f081a763740 1 -- 172.21.15.80:0/3173005895 wait complete. 2024-04-25T11:25:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.426+0000 7f081a763740 20 client.25459 trim_cache size 0 max 16384 2024-04-25T11:25:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:25:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:25:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:25:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:25:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07f80afdf0 msgr2=0x7f07f80b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07f80afdf0 0x7f07f80b2300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x559d42e68c60 tx=0x7f0804004ab0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c1031c0 msgr2=0x7f080c199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c1031c0 0x7f080c199690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f080800d950 tx=0x7f080800de10 comp rx=0 tx=0).stop 2024-04-25T11:25:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 shutdown_connections 2024-04-25T11:25:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07f80afdf0 0x7f07f80b2300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f080c108a60 0x7f080c199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f080c108f00 0x7f080c19deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 --2- 172.21.15.80:0/3514100484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f080c1031c0 0x7f080c199690 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 >> 172.21.15.80:0/3514100484 conn(0x7f080c0781b0 msgr2=0x7f080c104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 shutdown_connections 2024-04-25T11:25:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:42.427+0000 7f08138af640 1 -- 172.21.15.80:0/3514100484 wait complete. 2024-04-25T11:25:44.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:43 smithi080 ceph-mon[29126]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T11:25:44.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:43 smithi196 ceph-mon[32659]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T11:25:44.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:43 smithi082 ceph-mon[32440]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T11:25:46.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:45 smithi080 ceph-mon[29126]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:25:46.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:45 smithi196 ceph-mon[32659]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:25:46.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:45 smithi082 ceph-mon[32440]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T11:25:46.319 INFO:tasks.workunit.client.0.smithi080.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr: git switch -c 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr:Or undo this operation with: 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr: git switch - 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:46.320 INFO:tasks.workunit.client.0.smithi080.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T11:25:46.327 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T11:25:46.393 INFO:tasks.workunit.client.0.smithi080.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T11:25:46.395 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T11:25:46.395 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T11:25:46.975 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T11:25:47.045 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T11:25:47.083 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T11:25:47.085 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T11:25:47.085 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T11:25:47.123 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T11:25:47.126 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:25:47.127 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T11:25:47.183 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-04-25T11:25:47.184 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-04-25T11:25:47.184 DEBUG:teuthology.orchestra.run.smithi080:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-04-25T11:25:47.243 INFO:tasks.workunit.client.0.smithi080.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-04-25T11:25:47.269 INFO:tasks.workunit.client.0.smithi080.stderr:--2024-04-25 11:25:47-- http://download.ceph.com/qa/fsync-tester.c 2024-04-25T11:25:47.270 INFO:tasks.workunit.client.0.smithi080.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-25T11:25:47.324 INFO:tasks.workunit.client.0.smithi080.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-25T11:25:47.371 INFO:tasks.workunit.client.0.smithi080.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-25T11:25:47.371 INFO:tasks.workunit.client.0.smithi080.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-04-25T11:25:47.373 INFO:tasks.workunit.client.0.smithi080.stderr:Saving to: ‘fsync-tester.c’ 2024-04-25T11:25:47.376 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:47.376 INFO:tasks.workunit.client.0.smithi080.stderr: 0K .. 100% 560M=0s 2024-04-25T11:25:47.376 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:47.376 INFO:tasks.workunit.client.0.smithi080.stderr:2024-04-25 11:25:47 (560 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-04-25T11:25:47.376 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-25T11:25:47.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-04-25T11:25:47.442 INFO:tasks.workunit.client.0.smithi080.stderr:+ ./fsync-tester 2024-04-25T11:25:48.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:47 smithi196 ceph-mon[32659]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-04-25T11:25:48.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:47 smithi196 ceph-mon[32659]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-25T11:25:48.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:47 smithi082 ceph-mon[32440]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-04-25T11:25:48.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:47 smithi082 ceph-mon[32440]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-25T11:25:48.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:47 smithi080 ceph-mon[29126]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 8 op/s 2024-04-25T11:25:48.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:47 smithi080 ceph-mon[29126]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-25T11:25:50.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:49 smithi196 ceph-mon[32659]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-25T11:25:50.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:49 smithi082 ceph-mon[32440]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-25T11:25:50.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:49 smithi080 ceph-mon[29126]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-25T11:25:52.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:51 smithi196 ceph-mon[32659]: pgmap v52: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 349 KiB/s wr, 11 op/s 2024-04-25T11:25:52.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:51 smithi082 ceph-mon[32440]: pgmap v52: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 349 KiB/s wr, 11 op/s 2024-04-25T11:25:52.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:51 smithi080 ceph-mon[29126]: pgmap v52: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 349 KiB/s wr, 11 op/s 2024-04-25T11:25:54.179 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:53 smithi080 ceph-mon[29126]: pgmap v53: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 349 KiB/s wr, 9 op/s 2024-04-25T11:25:54.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:53 smithi196 ceph-mon[32659]: pgmap v53: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 349 KiB/s wr, 9 op/s 2024-04-25T11:25:54.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:53 smithi082 ceph-mon[32440]: pgmap v53: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 349 KiB/s wr, 9 op/s 2024-04-25T11:25:54.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:25:54.720 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:25:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.845+0000 7f57fc8e0640 1 -- 172.21.15.80:0/1513276327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f810d380 msgr2=0x7f57f810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.845+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/1513276327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f810d380 0x7f57f810f7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009ca0 tx=0x7f57f002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.845+0000 7f57fc8e0640 1 -- 172.21.15.80:0/1513276327 shutdown_connections 2024-04-25T11:25:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.845+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/1513276327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f810d380 0x7f57f810f7a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.845+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/1513276327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f8102af0 0x7f57f8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.845+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/1513276327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f8108a20 0x7f57f81025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.845+0000 7f57fc8e0640 1 -- 172.21.15.80:0/1513276327 >> 172.21.15.80:0/1513276327 conn(0x7f57f8078100 msgr2=0x7f57f8078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.846+0000 7f57fc8e0640 1 -- 172.21.15.80:0/1513276327 shutdown_connections 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.846+0000 7f57fc8e0640 1 -- 172.21.15.80:0/1513276327 wait complete. 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.846+0000 7f57fc8e0640 1 Processor -- start 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.846+0000 7f57fc8e0640 1 -- start start 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57fc8e0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f8102af0 0x7f57f81995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57fc8e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f8108a20 0x7f57f8199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57fc8e0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f810d380 0x7f57f819de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57fc8e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8112c00 con 0x7f57f8108a20 2024-04-25T11:25:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57fc8e0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8112a80 con 0x7f57f8102af0 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57fc8e0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8112d80 con 0x7f57f810d380 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f8108a20 0x7f57f8199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f8108a20 0x7f57f8199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60922/0 (socket says 172.21.15.80:60922) 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 -- 172.21.15.80:0/261436413 learned_addr learned my addr 172.21.15.80:0/261436413 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f659c640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f8102af0 0x7f57f81995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f810d380 0x7f57f819de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 -- 172.21.15.80:0/261436413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f810d380 msgr2=0x7f57f819de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f810d380 0x7f57f819de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 -- 172.21.15.80:0/261436413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f8102af0 msgr2=0x7f57f81995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f8102af0 0x7f57f81995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 -- 172.21.15.80:0/261436413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f819e440 con 0x7f57f8108a20 2024-04-25T11:25:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f8108a20 0x7f57f8199b40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009830 tx=0x7f57ec009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.847+0000 7f57e77fe640 1 -- 172.21.15.80:0/261436413 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec004020 con 0x7f57f8108a20 2024-04-25T11:25:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.848+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f819e730 con 0x7f57f8108a20 2024-04-25T11:25:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.848+0000 7f57e77fe640 1 -- 172.21.15.80:0/261436413 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57ec007c50 con 0x7f57f8108a20 2024-04-25T11:25:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.848+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f8069e90 con 0x7f57f8108a20 2024-04-25T11:25:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.848+0000 7f57e77fe640 1 -- 172.21.15.80:0/261436413 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec003a10 con 0x7f57f8108a20 2024-04-25T11:25:54.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.850+0000 7f57e77fe640 1 -- 172.21.15.80:0/261436413 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f57ec003bb0 con 0x7f57f8108a20 2024-04-25T11:25:54.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.850+0000 7f580378a740 1 Processor -- start 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f580378a740 1 -- start start 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f580378a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790d6390 0x560179476a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f580378a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x560179476fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f580378a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x5601794838f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f580378a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5601793dcd80 con 0x5601790d6390 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f580378a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5601793968b0 con 0x5601790ad4d0 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f580378a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5601793d8d40 con 0x5601790b56b0 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790d6390 0x560179476a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790d6390 0x560179476a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60930/0 (socket says 172.21.15.80:60930) 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 -- 172.21.15.80:0/2348829295 learned_addr learned my addr 172.21.15.80:0/2348829295 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x5601794838f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57e77fe640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e00afc60 0x7f57e00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f659c640 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x560179476fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 -- 172.21.15.80:0/2348829295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 msgr2=0x5601794838f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x5601794838f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 -- 172.21.15.80:0/2348829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 msgr2=0x560179476fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x560179476fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f6d9d640 1 -- 172.21.15.80:0/2348829295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560179367a40 con 0x5601790d6390 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x5601794838f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.851+0000 7f57e77fe640 1 -- 172.21.15.80:0/261436413 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f57ec0e0500 con 0x7f57f8108a20 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.852+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e00afc60 0x7f57e00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.852+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790d6390 0x560179476a60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f57f0005cc0 tx=0x7f57f00094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb82edb0d383d10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.852+0000 7f57e4ff9640 1 -- 172.21.15.80:0/2348829295 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0031e30 con 0x5601790d6390 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.852+0000 7f57e4ff9640 1 -- 172.21.15.80:0/2348829295 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f0036040 con 0x5601790d6390 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.852+0000 7f57e4ff9640 1 -- 172.21.15.80:0/2348829295 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0004680 con 0x5601790d6390 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 -- 172.21.15.80:0/2348829295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790d6390 msgr2=0x560179476a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e00afc60 0x7f57e00b2170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57f004c000 tx=0x7f57f0049000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790d6390 0x560179476a60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f57f0005cc0 tx=0x7f57f00094a0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 -- 172.21.15.80:0/2348829295 shutdown_connections 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x5601794838f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x560179476fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 --2- 172.21.15.80:0/2348829295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790d6390 0x560179476a60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 -- 172.21.15.80:0/2348829295 >> 172.21.15.80:0/2348829295 conn(0x5601790ca4e0 msgr2=0x560179473210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 -- 172.21.15.80:0/2348829295 shutdown_connections 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 -- 172.21.15.80:0/2348829295 wait complete. 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 -- start start 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.853+0000 7f580378a740 1 Processor -- start 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f580378a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790ad4d0 0x560179481640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f580378a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x560179481b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f580378a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x5601794874a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f580378a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560179483fe0 con 0x5601790b56b0 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f580378a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560179363d10 con 0x5601790d6390 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f580378a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560179484160 con 0x5601790ad4d0 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f580378a740 10 client.0 _ll_register_callbacks cb 0x560179390210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x560179481b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x560179481b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60936/0 (socket says 172.21.15.80:60936) 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1971280917 learned_addr learned my addr 172.21.15.80:0/1971280917 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x5601794874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f659c640 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790ad4d0 0x560179481640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1971280917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790ad4d0 msgr2=0x560179481640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790ad4d0 0x560179481640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 msgr2=0x5601794874a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x5601794874a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1971280917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601791b87d0 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x560179481b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0a4730 tx=0x7f57ec0e3f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d553c41187b5c5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.854+0000 7f57ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f57ddffb640 1 -- 172.21.15.80:0/1971280917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0a7e20 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f57ddffb640 1 -- 172.21.15.80:0/1971280917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f57ec0a7910 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f0036040 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f57ddffb640 1 -- 172.21.15.80:0/1971280917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f57ec007e00 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 10 client.15906 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5601790ee3f0 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f57ddffb640 1 -- 172.21.15.80:0/1971280917 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f0036040 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f57ddffb640 1 -- 172.21.15.80:0/1971280917 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f57ec0bdb00 con 0x5601790b56b0 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 10 client.15906 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 20 client.15906 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560179094f60 0x560179493760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 4 client.15906 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601793ea990 con 0x560179094f60 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.855+0000 7f57f659c640 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560179094f60 0x560179493760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.856+0000 7f57ddffb640 10 client.15906 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.856+0000 7f57f659c640 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560179094f60 0x560179493760 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79083f4334c39868 server_cookie=330d0443eaf2bf52 in_seq=0 out_seq=0 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f57ddffb640 1 -- 172.21.15.80:0/1971280917 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5601793ea990 con 0x560179094f60 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f57ddffb640 10 client.15906 handle_command_reply: tid=0 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 client.15906 shutdown 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 msgr2=0x560179481b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x560179481b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0a4730 tx=0x7f57ec0e3f50 comp rx=0 tx=0).stop 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 shutdown_connections 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560179094f60 0x560179493760 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x560179481b80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x5601794874a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f57ddffb640 0 client.15906 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 --2- 172.21.15.80:0/1971280917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790ad4d0 0x560179481640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 >> 172.21.15.80:0/1971280917 conn(0x5601790ca4e0 msgr2=0x560179478780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 shutdown_connections 2024-04-25T11:25:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 1 -- 172.21.15.80:0/1971280917 wait complete. 2024-04-25T11:25:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.857+0000 7f580378a740 20 client.15906 trim_cache size 0 max 16384 2024-04-25T11:25:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.875+0000 7f580378a740 1 Processor -- start 2024-04-25T11:25:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.875+0000 7f580378a740 1 -- start start 2024-04-25T11:25:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.875+0000 7f580378a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790ad4d0 0x560179487420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.875+0000 7f580378a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x560179473240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.875+0000 7f580378a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x560179480410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f580378a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81afec0 con 0x5601790ad4d0 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f580378a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81ad790 con 0x5601790d6390 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f580378a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81ab5e0 con 0x5601790b56b0 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790ad4d0 0x560179487420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790ad4d0 0x560179487420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60940/0 (socket says 172.21.15.80:60940) 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 -- 172.21.15.80:0/3969045946 learned_addr learned my addr 172.21.15.80:0/3969045946 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x560179480410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x560179473240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 -- 172.21.15.80:0/3969045946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 msgr2=0x560179473240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x560179473240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 -- 172.21.15.80:0/3969045946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 msgr2=0x560179480410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x560179480410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 -- 172.21.15.80:0/3969045946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601790ae0f0 con 0x5601790ad4d0 2024-04-25T11:25:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57f659c640 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790ad4d0 0x560179487420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5601794741a0 tx=0x7f57e800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527753c6e65e67b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57dffff640 1 -- 172.21.15.80:0/3969045946 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8005020 con 0x5601790ad4d0 2024-04-25T11:25:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57dffff640 1 -- 172.21.15.80:0/3969045946 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e8023030 con 0x5601790ad4d0 2024-04-25T11:25:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.876+0000 7f57dffff640 1 -- 172.21.15.80:0/3969045946 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e801f0f0 con 0x5601790ad4d0 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 -- 172.21.15.80:0/3969045946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790ad4d0 msgr2=0x560179487420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790ad4d0 0x560179487420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5601794741a0 tx=0x7f57e800b390 comp rx=0 tx=0).stop 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 -- 172.21.15.80:0/3969045946 shutdown_connections 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790d6390 0x560179480410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790b56b0 0x560179473240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 --2- 172.21.15.80:0/3969045946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790ad4d0 0x560179487420 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 -- 172.21.15.80:0/3969045946 >> 172.21.15.80:0/3969045946 conn(0x5601790ca4e0 msgr2=0x56017947fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 -- 172.21.15.80:0/3969045946 shutdown_connections 2024-04-25T11:25:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.877+0000 7f580378a740 1 -- 172.21.15.80:0/3969045946 wait complete. 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 -- start start 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 Processor -- start 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x56017948d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x5601794886c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790d6390 0x560179488c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81abc50 con 0x5601790b56b0 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81ad0c0 con 0x5601790ad4d0 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81ac320 con 0x5601790d6390 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f580378a740 10 client.0 _ll_register_callbacks cb 0x7f57ec003f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x5601794886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x5601794886c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60942/0 (socket says 172.21.15.80:60942) 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1170342513 learned_addr learned my addr 172.21.15.80:0/1170342513 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f57f659c640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x56017948d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.878+0000 7f57f6d9d640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790d6390 0x560179488c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1170342513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790d6390 msgr2=0x560179488c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790d6390 0x560179488c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 msgr2=0x56017948d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x56017948d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57f5d9b640 1 -- 172.21.15.80:0/1170342513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017939d4b0 con 0x5601790b56b0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57f659c640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x56017948d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57f5d9b640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x5601794886c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0a3fb0 tx=0x7f57ec0a7c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3804b6529d2c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57ddffb640 1 -- 172.21.15.80:0/1170342513 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0a8480 con 0x5601790b56b0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57ddffb640 1 -- 172.21.15.80:0/1170342513 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f57ec08fd10 con 0x5601790b56b0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57e8023030 con 0x5601790b56b0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57ddffb640 1 -- 172.21.15.80:0/1170342513 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f57ec0041c0 con 0x5601790b56b0 2024-04-25T11:25:54.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f580378a740 10 client.15912 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5601794fb440 con 0x5601790b56b0 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.879+0000 7f57ddffb640 1 -- 172.21.15.80:0/1170342513 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e8023030 con 0x5601790b56b0 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f57ddffb640 1 -- 172.21.15.80:0/1170342513 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f57ec0a7380 con 0x5601790b56b0 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f580378a740 10 client.15912 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f580378a740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f580378a740 20 client.15912 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f580378a740 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56017906a3a0 0x5601794fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f580378a740 4 client.15912 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5601793e4800 con 0x56017906a3a0 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f57f659c640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56017906a3a0 0x5601794fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f57ddffb640 10 client.15912 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f57f659c640 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56017906a3a0 0x5601794fdb40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5723e7869028ce server_cookie=d8ccff3691de1820 in_seq=0 out_seq=0 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f57ddffb640 1 -- 172.21.15.80:0/1170342513 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5601793e4800 con 0x56017906a3a0 2024-04-25T11:25:54.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.880+0000 7f57ddffb640 10 client.15912 handle_command_reply: tid=0 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 client.15912 shutdown 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 msgr2=0x5601794886c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x5601794886c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0a3fb0 tx=0x7f57ec0a7c40 comp rx=0 tx=0).stop 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 shutdown_connections 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56017906a3a0 0x5601794fdb40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5601790b56b0 0x5601794886c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5601790d6390 0x560179488c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57ddffb640 0 client.15912 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 --2- 172.21.15.80:0/1170342513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5601790ad4d0 0x56017948d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 >> 172.21.15.80:0/1170342513 conn(0x5601790ca4e0 msgr2=0x5601794719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 shutdown_connections 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 1 -- 172.21.15.80:0/1170342513 wait complete. 2024-04-25T11:25:54.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f580378a740 20 client.15912 trim_cache size 0 max 16384 2024-04-25T11:25:54.881 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:25:54.881 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:25:54.881 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:25:54.881 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e00afc60 msgr2=0x7f57e00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e00afc60 0x7f57e00b2170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57f004c000 tx=0x7f57f0049000 comp rx=0 tx=0).stop 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f8108a20 msgr2=0x7f57f8199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f8108a20 0x7f57f8199b40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009830 tx=0x7f57ec009cf0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 shutdown_connections 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f57e00afc60 0x7f57e00b2170 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57f8108a20 0x7f57f8199b40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57f810d380 0x7f57f819de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 --2- 172.21.15.80:0/261436413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f8102af0 0x7f57f81995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:54.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.881+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 >> 172.21.15.80:0/261436413 conn(0x7f57f8078100 msgr2=0x7f57f81040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:54.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.882+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 shutdown_connections 2024-04-25T11:25:54.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:54.882+0000 7f57fc8e0640 1 -- 172.21.15.80:0/261436413 wait complete. 2024-04-25T11:25:54.886 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:25:54.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:25:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 -- 172.21.15.80:0/3810726117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 msgr2=0x7f720010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 --2- 172.21.15.80:0/3810726117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720010f7a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009ca0 tx=0x7f71f802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 -- 172.21.15.80:0/3810726117 shutdown_connections 2024-04-25T11:25:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 --2- 172.21.15.80:0/3810726117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720010f7a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 --2- 172.21.15.80:0/3810726117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7200102af0 0x7f7200102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 --2- 172.21.15.80:0/3810726117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200108a20 0x7f72001025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 -- 172.21.15.80:0/3810726117 >> 172.21.15.80:0/3810726117 conn(0x7f72000780a0 msgr2=0x7f7200078520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 -- 172.21.15.80:0/3810726117 shutdown_connections 2024-04-25T11:25:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.008+0000 7f7205f96640 1 -- 172.21.15.80:0/3810726117 wait complete. 2024-04-25T11:25:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.009+0000 7f7205f96640 1 Processor -- start 2024-04-25T11:25:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.009+0000 7f7205f96640 1 -- start start 2024-04-25T11:25:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f7205f96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7200102af0 0x7f720019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f7205f96640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200108a20 0x7f720019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f7205f96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720019bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f7205f96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7200112c00 con 0x7f720010d380 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f7205f96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7200112a80 con 0x7f7200102af0 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f7205f96640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7200112d80 con 0x7f7200108a20 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720019bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720019bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60950/0 (socket says 172.21.15.80:60950) 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 -- 172.21.15.80:0/4011327732 learned_addr learned my addr 172.21.15.80:0/4011327732 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71feffd640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200108a20 0x7f720019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71ff7fe640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7200102af0 0x7f720019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 -- 172.21.15.80:0/4011327732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200108a20 msgr2=0x7f720019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200108a20 0x7f720019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 -- 172.21.15.80:0/4011327732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7200102af0 msgr2=0x7f720019b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7200102af0 0x7f720019b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 -- 172.21.15.80:0/4011327732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72001a6820 con 0x7f720010d380 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71ff7fe640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7200102af0 0x7f720019b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fffff640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720019bf80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f71f80098d0 tx=0x7f71f80317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f71fcff9640 1 -- 172.21.15.80:0/4011327732 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f8003b70 con 0x7f720010d380 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.010+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72001a6ab0 con 0x7f720010d380 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.011+0000 7f71fcff9640 1 -- 172.21.15.80:0/4011327732 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71f8003d10 con 0x7f720010d380 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.011+0000 7f71fcff9640 1 -- 172.21.15.80:0/4011327732 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f802fa20 con 0x7f720010d380 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.011+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72001a7050 con 0x7f720010d380 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.012+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7200069310 con 0x7f720010d380 2024-04-25T11:25:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.014+0000 7f71fcff9640 1 -- 172.21.15.80:0/4011327732 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f71f802fc40 con 0x7f720010d380 2024-04-25T11:25:55.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.015+0000 7f71fcff9640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71e80afc60 0x7f71e80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.015+0000 7f71ff7fe640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71e80afc60 0x7f71e80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.015+0000 7f71fcff9640 1 -- 172.21.15.80:0/4011327732 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f71f81004b0 con 0x7f720010d380 2024-04-25T11:25:55.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.015+0000 7f71ff7fe640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71e80afc60 0x7f71e80b2170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005fd0 tx=0x7f71f400b5d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.020+0000 7f71fcff9640 1 -- 172.21.15.80:0/4011327732 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f71f80c8e70 con 0x7f720010d380 2024-04-25T11:25:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.245+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f720006b8e0 con 0x7f720010d380 2024-04-25T11:25:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.246+0000 7f71fcff9640 1 -- 172.21.15.80:0/4011327732 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f71f80c8770 con 0x7f720010d380 2024-04-25T11:25:55.239 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:25:55.239 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:25:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:25:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.248+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71e80afc60 msgr2=0x7f71e80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.248+0000 7f7205f96640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71e80afc60 0x7f71e80b2170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005fd0 tx=0x7f71f400b5d0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.248+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 msgr2=0x7f720019bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.248+0000 7f7205f96640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720019bf80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f71f80098d0 tx=0x7f71f80317b0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 shutdown_connections 2024-04-25T11:25:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f71e80afc60 0x7f71e80b2170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720010d380 0x7f720019bf80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200108a20 0x7f720019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 --2- 172.21.15.80:0/4011327732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7200102af0 0x7f720019b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 >> 172.21.15.80:0/4011327732 conn(0x7f72000780a0 msgr2=0x7f72001040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 shutdown_connections 2024-04-25T11:25:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.249+0000 7f7205f96640 1 -- 172.21.15.80:0/4011327732 wait complete. 2024-04-25T11:25:55.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:25:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 -- 172.21.15.80:0/2087432439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0108a20 msgr2=0x7f8fe01025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/2087432439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0108a20 0x7f8fe01025d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009900 tx=0x7f8fdc02a410 comp rx=0 tx=0).stop 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 -- 172.21.15.80:0/2087432439 shutdown_connections 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/2087432439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe0103180 0x7f8fe010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/2087432439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fe0108ec0 0x7f8fe0102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/2087432439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0108a20 0x7f8fe01025d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 -- 172.21.15.80:0/2087432439 >> 172.21.15.80:0/2087432439 conn(0x7f8fe0078110 msgr2=0x7f8fe0078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 -- 172.21.15.80:0/2087432439 shutdown_connections 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 -- 172.21.15.80:0/2087432439 wait complete. 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 Processor -- start 2024-04-25T11:25:55.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.377+0000 7f8fe76f2640 1 -- start start 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe76f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0103180 0x7f8fe0199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe76f2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fe0108a20 0x7f8fe0199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe76f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe0108ec0 0x7f8fe019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe76f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0112c20 con 0x7f8fe0103180 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe76f2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0112aa0 con 0x7f8fe0108ec0 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe76f2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0112da0 con 0x7f8fe0108a20 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0103180 0x7f8fe0199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0103180 0x7f8fe0199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60972/0 (socket says 172.21.15.80:60972) 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 -- 172.21.15.80:0/112709686 learned_addr learned my addr 172.21.15.80:0/112709686 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fe0108a20 0x7f8fe0199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe0108ec0 0x7f8fe019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 -- 172.21.15.80:0/112709686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fe0108a20 msgr2=0x7f8fe0199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fe0108a20 0x7f8fe0199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 -- 172.21.15.80:0/112709686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe0108ec0 msgr2=0x7f8fe019dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe0108ec0 0x7f8fe019dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 -- 172.21.15.80:0/112709686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe019e4e0 con 0x7f8fe0103180 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fe0108a20 0x7f8fe0199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fe548e640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0103180 0x7f8fe0199680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc02a930 tx=0x7f8fdc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.378+0000 7f8fd67fc640 1 -- 172.21.15.80:0/112709686 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc03f030 con 0x7f8fe0103180 2024-04-25T11:25:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.379+0000 7f8fd67fc640 1 -- 172.21.15.80:0/112709686 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc003aa0 con 0x7f8fe0103180 2024-04-25T11:25:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.379+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe019e770 con 0x7f8fe0103180 2024-04-25T11:25:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.379+0000 7f8fd67fc640 1 -- 172.21.15.80:0/112709686 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc035070 con 0x7f8fe0103180 2024-04-25T11:25:55.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.379+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe019ec60 con 0x7f8fe0103180 2024-04-25T11:25:55.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.381+0000 7f8fee5a1740 1 Processor -- start 2024-04-25T11:25:55.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.381+0000 7f8fd67fc640 1 -- 172.21.15.80:0/112709686 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f8fdc042030 con 0x7f8fe0103180 2024-04-25T11:25:55.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.381+0000 7f8fee5a1740 1 -- start start 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a06462b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06462bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a0646386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a064590d80 con 0x55a06428a390 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a06454aa20 con 0x55a0642614d0 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a06458cd40 con 0x55a0642696b0 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a06462b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a06462b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60978/0 (socket says 172.21.15.80:60978) 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/2561336429 learned_addr learned my addr 172.21.15.80:0/2561336429 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe548e640 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06462bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a0646386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fd67fc640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8fcc0afc60 0x7f8fcc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/2561336429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 msgr2=0x55a0646386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a0646386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/2561336429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 msgr2=0x55a06462bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06462bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/2561336429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a064555c30 con 0x55a06428a390 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a0646386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.382+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8fcc0afc60 0x7f8fcc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.383+0000 7f8fd67fc640 1 -- 172.21.15.80:0/112709686 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f8fdc0ff470 con 0x7f8fe0103180 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.383+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a06462b810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800f500 tx=0x7f8fd800f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a576379554fbb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.383+0000 7f8fcb7fe640 1 -- 172.21.15.80:0/2561336429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd801c400 con 0x55a06428a390 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.383+0000 7f8fcb7fe640 1 -- 172.21.15.80:0/2561336429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd80124b0 con 0x55a06428a390 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.383+0000 7f8fcb7fe640 1 -- 172.21.15.80:0/2561336429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80106c0 con 0x55a06428a390 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 -- 172.21.15.80:0/2561336429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 msgr2=0x55a06462b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8fcc0afc60 0x7f8fcc0b2170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8020000 tx=0x7f8fd801d000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a06462b810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800f500 tx=0x7f8fd800f9c0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 -- 172.21.15.80:0/2561336429 shutdown_connections 2024-04-25T11:25:55.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a0646386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06462bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/2561336429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a06462b810 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 -- 172.21.15.80:0/2561336429 >> 172.21.15.80:0/2561336429 conn(0x55a06427e4e0 msgr2=0x55a064627fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 -- 172.21.15.80:0/2561336429 shutdown_connections 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 -- 172.21.15.80:0/2561336429 wait complete. 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 -- start start 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.384+0000 7f8fee5a1740 1 Processor -- start 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a064636210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a064636750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a064642210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a064638d90 con 0x55a06428a390 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a064517dc0 con 0x55a0642614d0 2024-04-25T11:25:55.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a064638f10 con 0x55a0642696b0 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fee5a1740 10 client.0 _ll_register_callbacks cb 0x55a064533600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a064642210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a064642210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60990/0 (socket says 172.21.15.80:60990) 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3044283315 learned_addr learned my addr 172.21.15.80:0/3044283315 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a064636750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe548e640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a064636210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3044283315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 msgr2=0x55a064636750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a064636750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 msgr2=0x55a064636210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a064636210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3044283315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0642a23f0 con 0x55a06428a390 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.385+0000 7f8fe548e640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a064636210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a064642210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009520 tx=0x7f8fd8010670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80687afa1523c986 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/3044283315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8010c70 con 0x55a06428a390 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/3044283315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f8fd80049e0 con 0x55a06428a390 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fd80124b0 con 0x55a06428a390 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/3044283315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fd8010e10 con 0x55a06428a390 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 10 client.15930 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a06436c7d0 con 0x55a06428a390 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/3044283315 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd80124b0 con 0x55a06428a390 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/3044283315 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8fd801cb50 con 0x55a06428a390 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 10 client.15930 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 10 client.15930 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 20 client.15930 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a064248f60 0x55a0646484f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 4 client.15930 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.386+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a06459e990 con 0x55a064248f60 2024-04-25T11:25:55.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.387+0000 7f8fe548e640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a064248f60 0x55a0646484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.387+0000 7f8fc8ff9640 10 client.15930 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.387+0000 7f8fe548e640 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a064248f60 0x55a0646484f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=27d9d3147bfb2d9a server_cookie=9c95830fc54b7ec9 in_seq=0 out_seq=0 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/3044283315 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a06459e990 con 0x55a064248f60 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fc8ff9640 10 client.15930 handle_command_reply: tid=0 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 client.15930 shutdown 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 msgr2=0x55a064642210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a064642210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009520 tx=0x7f8fd8010670 comp rx=0 tx=0).stop 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 shutdown_connections 2024-04-25T11:25:55.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a064248f60 0x55a0646484f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a06428a390 0x55a064642210 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642696b0 0x55a064636750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fc8ff9640 0 client.15930 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3044283315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a064636210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 >> 172.21.15.80:0/3044283315 conn(0x55a06427e4e0 msgr2=0x55a06462d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 shutdown_connections 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3044283315 wait complete. 2024-04-25T11:25:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.388+0000 7f8fee5a1740 20 client.15930 trim_cache size 0 max 16384 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 Processor -- start 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 -- start start 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a064248f60 0x55a06462bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642614d0 0x55a064641e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a06463e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01b11b0 con 0x55a0642696b0 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01aea80 con 0x55a064248f60 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.402+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01ac8d0 con 0x55a0642614d0 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a06463e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a06463e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60992/0 (socket says 172.21.15.80:60992) 2024-04-25T11:25:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3756934598 learned_addr learned my addr 172.21.15.80:0/3756934598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe548e640 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a064248f60 0x55a06462bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642614d0 0x55a064641e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3756934598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642614d0 msgr2=0x55a064641e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642614d0 0x55a064641e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3756934598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a064248f60 msgr2=0x55a06462bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a064248f60 0x55a06462bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/3756934598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0646374c0 con 0x55a0642696b0 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a06463e3e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80265d0 tx=0x7f8fd8009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ab053cb11f6c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fcaffd640 1 -- 172.21.15.80:0/3756934598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8010c70 con 0x55a0642696b0 2024-04-25T11:25:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fcaffd640 1 -- 172.21.15.80:0/3756934598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd802a040 con 0x55a0642696b0 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.403+0000 7f8fcaffd640 1 -- 172.21.15.80:0/3756934598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80269e0 con 0x55a0642696b0 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3756934598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 msgr2=0x55a06463e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a06463e3e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80265d0 tx=0x7f8fd8009a60 comp rx=0 tx=0).stop 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3756934598 shutdown_connections 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a06463e3e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0642614d0 0x55a064641e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/3756934598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a064248f60 0x55a06462bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3756934598 >> 172.21.15.80:0/3756934598 conn(0x55a06427e4e0 msgr2=0x55a06462b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3756934598 shutdown_connections 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.404+0000 7f8fee5a1740 1 -- 172.21.15.80:0/3756934598 wait complete. 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 -- start start 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 Processor -- start 2024-04-25T11:25:55.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a064248f60 0x55a06463b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06463bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a0646b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01acf40 con 0x55a0642696b0 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01ae3b0 con 0x55a0642614d0 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01ad610 con 0x55a064248f60 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fee5a1740 10 client.0 _ll_register_callbacks cb 0x7f8fd801f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a0646b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fe4c8d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06463bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fe5c8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a0646b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60994/0 (socket says 172.21.15.80:60994) 2024-04-25T11:25:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fe548e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a064248f60 0x55a06463b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.405+0000 7f8fe5c8f640 1 -- 172.21.15.80:0/687610885 learned_addr learned my addr 172.21.15.80:0/687610885 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fe4c8d640 1 -- 172.21.15.80:0/687610885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a064248f60 msgr2=0x55a06463b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a064248f60 0x55a06463b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fe4c8d640 1 -- 172.21.15.80:0/687610885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 msgr2=0x55a0646b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a0646b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fe4c8d640 1 -- 172.21.15.80:0/687610885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0646b0d10 con 0x55a0642614d0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fe5c8f640 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a0646b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fe4c8d640 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06463bb10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00058c0 tx=0x7f8fd0012950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472e57a54a40144e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/687610885 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0021060 con 0x55a0642614d0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/687610885 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f8fd0004440 con 0x55a0642614d0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fd802a040 con 0x55a0642614d0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/687610885 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fd00035f0 con 0x55a0642614d0 2024-04-25T11:25:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fee5a1740 10 client.25496 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a0646b1fc0 con 0x55a0642614d0 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.406+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/687610885 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd802a040 con 0x55a0642614d0 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/687610885 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8fd001b030 con 0x55a0642614d0 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fee5a1740 10 client.25496 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fee5a1740 10 client.25496 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fee5a1740 20 client.25496 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a06428a390 0x55a0646b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fee5a1740 4 client.25496 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a064598800 con 0x55a06428a390 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fe548e640 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a06428a390 0x55a0646b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fc8ff9640 10 client.25496 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.407+0000 7f8fe548e640 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a06428a390 0x55a0646b4750 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d3dc12d8db5c78a server_cookie=e80e8903845425ae in_seq=0 out_seq=0 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fc8ff9640 1 -- 172.21.15.80:0/687610885 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a064598800 con 0x55a06428a390 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fc8ff9640 10 client.25496 handle_command_reply: tid=0 2024-04-25T11:25:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 client.25496 shutdown 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 msgr2=0x55a06463bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06463bb10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00058c0 tx=0x7f8fd0012950 comp rx=0 tx=0).stop 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 shutdown_connections 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55a06428a390 0x55a0646b4750 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0642696b0 0x55a0646b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fc8ff9640 0 client.25496 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0642614d0 0x55a06463bb10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 --2- 172.21.15.80:0/687610885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a064248f60 0x55a06463b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 >> 172.21.15.80:0/687610885 conn(0x55a06427e4e0 msgr2=0x55a064627760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 shutdown_connections 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 1 -- 172.21.15.80:0/687610885 wait complete. 2024-04-25T11:25:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fee5a1740 20 client.25496 trim_cache size 0 max 16384 2024-04-25T11:25:55.410 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8fcc0afc60 msgr2=0x7f8fcc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8fcc0afc60 0x7f8fcc0b2170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8020000 tx=0x7f8fd801d000 comp rx=0 tx=0).stop 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0103180 msgr2=0x7f8fe0199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.408+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0103180 0x7f8fe0199680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc02a930 tx=0x7f8fdc004270 comp rx=0 tx=0).stop 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 shutdown_connections 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8fcc0afc60 0x7f8fcc0b2170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe0108ec0 0x7f8fe019dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fe0108a20 0x7f8fe0199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 --2- 172.21.15.80:0/112709686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fe0103180 0x7f8fe0199680 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 >> 172.21.15.80:0/112709686 conn(0x7f8fe0078110 msgr2=0x7f8fe0104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 shutdown_connections 2024-04-25T11:25:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.409+0000 7f8fe76f2640 1 -- 172.21.15.80:0/112709686 wait complete. 2024-04-25T11:25:55.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:25:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 -- 172.21.15.80:0/250753747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b4108ef0 msgr2=0x7f05b4102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 --2- 172.21.15.80:0/250753747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b4108ef0 0x7f05b4102b40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009900 tx=0x7f05a402a410 comp rx=0 tx=0).stop 2024-04-25T11:25:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 -- 172.21.15.80:0/250753747 shutdown_connections 2024-04-25T11:25:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 --2- 172.21.15.80:0/250753747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b4108ef0 0x7f05b4102b40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 --2- 172.21.15.80:0/250753747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b41031b0 0x7f05b410f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 --2- 172.21.15.80:0/250753747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b4108a50 0x7f05b4102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 -- 172.21.15.80:0/250753747 >> 172.21.15.80:0/250753747 conn(0x7f05b40fe260 msgr2=0x7f05b4100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 -- 172.21.15.80:0/250753747 shutdown_connections 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.533+0000 7f05bb892640 1 -- 172.21.15.80:0/250753747 wait complete. 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 Processor -- start 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 -- start start 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b41031b0 0x7f05b419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b4108a50 0x7f05b419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b4108ef0 0x7f05b419c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05b4112c50 con 0x7f05b41031b0 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05b4112ad0 con 0x7f05b4108ef0 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05bb892640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05b4112dd0 con 0x7f05b4108a50 2024-04-25T11:25:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05b962e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b41031b0 0x7f05b419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05b962e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b41031b0 0x7f05b419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32784/0 (socket says 172.21.15.80:32784) 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05b962e640 1 -- 172.21.15.80:0/3438548017 learned_addr learned my addr 172.21.15.80:0/3438548017 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b4108ef0 0x7f05b419c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.534+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b4108a50 0x7f05b419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05b962e640 1 -- 172.21.15.80:0/3438548017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b4108a50 msgr2=0x7f05b419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05b962e640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b4108a50 0x7f05b419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05b962e640 1 -- 172.21.15.80:0/3438548017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b4108ef0 msgr2=0x7f05b419c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05b962e640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b4108ef0 0x7f05b419c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05b962e640 1 -- 172.21.15.80:0/3438548017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b41a69d0 con 0x7f05b41031b0 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b4108ef0 0x7f05b419c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05b962e640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b41031b0 0x7f05b419b690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e9f0 tx=0x7f05b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05aa7fc640 1 -- 172.21.15.80:0/3438548017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b000ccc0 con 0x7f05b41031b0 2024-04-25T11:25:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b41a6cc0 con 0x7f05b41031b0 2024-04-25T11:25:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05aa7fc640 1 -- 172.21.15.80:0/3438548017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b00108e0 con 0x7f05b41031b0 2024-04-25T11:25:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05aa7fc640 1 -- 172.21.15.80:0/3438548017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0018860 con 0x7f05b41031b0 2024-04-25T11:25:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.535+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b41a71d0 con 0x7f05b41031b0 2024-04-25T11:25:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 -- 172.21.15.80:0/2151756167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0103180 msgr2=0x7f09b010f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 --2- 172.21.15.80:0/2151756167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0103180 0x7f09b010f4b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009900 tx=0x7f09a802e820 comp rx=0 tx=0).stop 2024-04-25T11:25:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 -- 172.21.15.80:0/2151756167 shutdown_connections 2024-04-25T11:25:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 --2- 172.21.15.80:0/2151756167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0103180 0x7f09b010f4b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 --2- 172.21.15.80:0/2151756167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b0108ec0 0x7f09b0102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 --2- 172.21.15.80:0/2151756167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0108a20 0x7f09b01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 -- 172.21.15.80:0/2151756167 >> 172.21.15.80:0/2151756167 conn(0x7f09b0078110 msgr2=0x7f09b0078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 -- 172.21.15.80:0/2151756167 shutdown_connections 2024-04-25T11:25:55.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.538+0000 7f09b80af640 1 -- 172.21.15.80:0/2151756167 wait complete. 2024-04-25T11:25:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 Processor -- start 2024-04-25T11:25:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 -- start start 2024-04-25T11:25:55.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f09b80af640 1 Processor -- start 2024-04-25T11:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05aa7fc640 1 -- 172.21.15.80:0/3438548017 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f05b0018a00 con 0x7f05b41031b0 2024-04-25T11:25:55.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f09b80af640 1 -- start start 2024-04-25T11:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb7daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb7e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5653ebae4460 con 0x5653eb7bd4d0 2024-04-25T11:25:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5653eba9e590 con 0x5653eb7de1b0 2024-04-25T11:25:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05c2811740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5653ebae0420 con 0x5653eb7b52f0 2024-04-25T11:25:55.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f09b80af640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0103180 0x7f09b0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05b9e2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb7daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05b962e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05b8e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb7e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05b9e2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb7daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34952/0 (socket says 172.21.15.80:34952) 2024-04-25T11:25:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f05b9e2f640 1 -- 172.21.15.80:0/2784624370 learned_addr learned my addr 172.21.15.80:0/2784624370 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.539+0000 7f09b80af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0108a20 0x7f09b0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b80af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b0108ec0 0x7f09b019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b80af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0111ba0 con 0x7f09b0108a20 2024-04-25T11:25:55.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b80af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0111a20 con 0x7f09b0108ec0 2024-04-25T11:25:55.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b80af640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0111d20 con 0x7f09b0103180 2024-04-25T11:25:55.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0103180 0x7f09b0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0103180 0x7f09b0198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:57154/0 (socket says 172.21.15.80:57154) 2024-04-25T11:25:55.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b564a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0108a20 0x7f09b0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 -- 172.21.15.80:0/2781273735 learned_addr learned my addr 172.21.15.80:0/2781273735 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b664c640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b0108ec0 0x7f09b019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05b962e640 1 -- 172.21.15.80:0/2784624370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 msgr2=0x5653ebb7daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05b962e640 1 --2- 172.21.15.80:0/2784624370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb7daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05b962e640 1 -- 172.21.15.80:0/2784624370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 msgr2=0x5653ebb7e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05b962e640 1 --2- 172.21.15.80:0/2784624370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb7e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05b962e640 1 -- 172.21.15.80:0/2784624370 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ebaab0d0 con 0x5653eb7b52f0 2024-04-25T11:25:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05aa7fc640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05a00afc50 0x7f05a00b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05a00afc50 0x7f05a00b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 -- 172.21.15.80:0/2781273735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b0108ec0 msgr2=0x7f09b019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b0108ec0 0x7f09b019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 -- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0108a20 msgr2=0x7f09b0198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0108a20 0x7f09b0198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 -- 172.21.15.80:0/2781273735 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b019d360 con 0x7f09b0103180 2024-04-25T11:25:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05b962e640 1 --2- 172.21.15.80:0/2784624370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05b00dca10 tx=0x7f05b00e79b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9021d6947a9863d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f05aa7fc640 1 -- 172.21.15.80:0/3438548017 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f05b00df2b0 con 0x7f05b41031b0 2024-04-25T11:25:55.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.540+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0103180 0x7f09b0198500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00dab0 tx=0x7f09ac00df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f059f7fe640 1 -- 172.21.15.80:0/2784624370 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0026030 con 0x5653eb7b52f0 2024-04-25T11:25:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05a00afc50 0x7f05a00b2160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5653ebb7ac60 tx=0x7f05ac009600 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f09a6ffd640 1 -- 172.21.15.80:0/2781273735 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac01b020 con 0x7f09b0103180 2024-04-25T11:25:55.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f09a6ffd640 1 -- 172.21.15.80:0/2781273735 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ac00bc30 con 0x7f09b0103180 2024-04-25T11:25:55.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f09a6ffd640 1 -- 172.21.15.80:0/2781273735 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac005950 con 0x7f09b0103180 2024-04-25T11:25:55.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b019d650 con 0x7f09b0103180 2024-04-25T11:25:55.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b019db50 con 0x7f09b0103180 2024-04-25T11:25:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f059f7fe640 1 -- 172.21.15.80:0/2784624370 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b00a7020 con 0x5653eb7b52f0 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.541+0000 7f059f7fe640 1 -- 172.21.15.80:0/2784624370 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b00a6c80 con 0x5653eb7b52f0 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 -- 172.21.15.80:0/2784624370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 msgr2=0x5653ebb7e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 --2- 172.21.15.80:0/2784624370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05b00dca10 tx=0x7f05b00e79b0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 -- 172.21.15.80:0/2784624370 shutdown_connections 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 --2- 172.21.15.80:0/2784624370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb7e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 --2- 172.21.15.80:0/2784624370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e030 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 --2- 172.21.15.80:0/2784624370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb7daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 -- 172.21.15.80:0/2784624370 >> 172.21.15.80:0/2784624370 conn(0x5653eb7d2300 msgr2=0x5653ebb7a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 -- 172.21.15.80:0/2784624370 shutdown_connections 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 -- 172.21.15.80:0/2784624370 wait complete. 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 -- start start 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.542+0000 7f05c2811740 1 Processor -- start 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05c2811740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7b52f0 0x5653ebb880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05c2811740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb88610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05c2811740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7de1b0 0x5653ebb940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05c2811740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5653ebb8ac20 con 0x5653eb7b52f0 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05c2811740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5653eba6bb60 con 0x5653eb7bd4d0 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05c2811740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5653ebb8ada0 con 0x5653eb7de1b0 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05c2811740 10 client.0 _ll_register_callbacks cb 0x5653eba902b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05b962e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7b52f0 0x5653ebb880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05b962e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7b52f0 0x5653ebb880d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32808/0 (socket says 172.21.15.80:32808) 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05b962e640 1 -- 172.21.15.80:0/4191698220 learned_addr learned my addr 172.21.15.80:0/4191698220 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.543+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb88610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b8e2d640 1 -- 172.21.15.80:0/4191698220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7de1b0 msgr2=0x5653ebb940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7de1b0 0x5653ebb940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 Processor -- start 2024-04-25T11:25:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7de1b0 0x5653ebb940d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b8e2d640 1 -- 172.21.15.80:0/4191698220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7b52f0 msgr2=0x5653ebb880d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7b52f0 0x5653ebb880d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b8e2d640 1 -- 172.21.15.80:0/4191698220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653eb7f6210 con 0x5653eb7bd4d0 2024-04-25T11:25:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7de1b0 0x5653ebb940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b962e640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7b52f0 0x5653ebb880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:55.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 -- start start 2024-04-25T11:25:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb88610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05a402a930 tx=0x7f05a4032f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58855a9153e603f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f059cff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:25:55.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09a6ffd640 1 -- 172.21.15.80:0/2781273735 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f09ac004a40 con 0x7f09b0103180 2024-04-25T11:25:55.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1ac6390 0x555ba1e67810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e67d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e746a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555ba1dccd80 con 0x555ba1a9d4d0 2024-04-25T11:25:55.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ba1d86a20 con 0x555ba1aa56b0 2024-04-25T11:25:55.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09bef64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555ba1dc8d40 con 0x555ba1ac6390 2024-04-25T11:25:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f059cff9640 1 -- 172.21.15.80:0/4191698220 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4035040 con 0x5653eb7bd4d0 2024-04-25T11:25:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05b00a7020 con 0x5653eb7bd4d0 2024-04-25T11:25:55.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f09b5e4b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e67d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e67d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32820/0 (socket says 172.21.15.80:32820) 2024-04-25T11:25:55.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 -- 172.21.15.80:0/3008273421 learned_addr learned my addr 172.21.15.80:0/3008273421 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.544+0000 7f059cff9640 1 -- 172.21.15.80:0/4191698220 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f05a4004050 con 0x5653eb7bd4d0 2024-04-25T11:25:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f059cff9640 1 -- 172.21.15.80:0/4191698220 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f05a4004270 con 0x5653eb7bd4d0 2024-04-25T11:25:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 10 client.25514 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5653eb8c2620 con 0x5653eb7bd4d0 2024-04-25T11:25:55.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b564a640 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b664c640 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1ac6390 0x555ba1e67810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 -- 172.21.15.80:0/3008273421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1ac6390 msgr2=0x555ba1e67810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f059cff9640 1 -- 172.21.15.80:0/4191698220 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b00a7020 con 0x5653eb7bd4d0 2024-04-25T11:25:55.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1ac6390 0x555ba1e67810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 -- 172.21.15.80:0/3008273421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 msgr2=0x555ba1e746a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e746a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 -- 172.21.15.80:0/3008273421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba1d91c30 con 0x555ba1a9d4d0 2024-04-25T11:25:55.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b564a640 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:55.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b664c640 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1ac6390 0x555ba1e67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:25:55.552 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f059cff9640 1 -- 172.21.15.80:0/4191698220 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f05a40049f0 con 0x5653eb7bd4d0 2024-04-25T11:25:55.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09a6ffd640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f099c0afce0 0x7f099c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 10 client.25514 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 10 client.25514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 20 client.25514 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb79cd80 0x5653ebb9a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 4 client.25514 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653ebaf2070 con 0x5653eb79cd80 2024-04-25T11:25:55.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e67d50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0dc460 tx=0x7f09ac0e74b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108f346191335b52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09b664c640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f099c0afce0 0x7f099c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.554 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f05b962e640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb79cd80 0x5653ebb9a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.545+0000 7f09a6ffd640 1 -- 172.21.15.80:0/2781273735 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f09ac0ded90 con 0x7f09b0103180 2024-04-25T11:25:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.546+0000 7f059cff9640 10 client.25514 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.546+0000 7f099bfff640 1 -- 172.21.15.80:0/3008273421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0a2e90 con 0x555ba1a9d4d0 2024-04-25T11:25:55.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.546+0000 7f099bfff640 1 -- 172.21.15.80:0/3008273421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ac0a6ae0 con 0x555ba1a9d4d0 2024-04-25T11:25:55.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.546+0000 7f099bfff640 1 -- 172.21.15.80:0/3008273421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0a6740 con 0x555ba1a9d4d0 2024-04-25T11:25:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.546+0000 7f05b962e640 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb79cd80 0x5653ebb9a610 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b24c359d09799a76 server_cookie=3e71c198c2f40494 in_seq=0 out_seq=0 2024-04-25T11:25:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f059cff9640 1 -- 172.21.15.80:0/4191698220 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5653ebaf2070 con 0x5653eb79cd80 2024-04-25T11:25:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f059cff9640 10 client.25514 handle_command_reply: tid=0 2024-04-25T11:25:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 client.25514 shutdown 2024-04-25T11:25:55.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 -- 172.21.15.80:0/3008273421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 msgr2=0x555ba1e67d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09b664c640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f099c0afce0 0x7f099c0b21f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09a8005ab0 tx=0x7f09a8005a40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e67d50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0dc460 tx=0x7f09ac0e74b0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 msgr2=0x5653ebb88610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb88610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05a402a930 tx=0x7f05a4032f60 comp rx=0 tx=0).stop 2024-04-25T11:25:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 shutdown_connections 2024-04-25T11:25:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb79cd80 0x5653ebb9a610 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 -- 172.21.15.80:0/3008273421 shutdown_connections 2024-04-25T11:25:55.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e67d50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 --2- 172.21.15.80:0/3008273421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1ac6390 0x555ba1e67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 -- 172.21.15.80:0/3008273421 >> 172.21.15.80:0/3008273421 conn(0x555ba1aba4e0 msgr2=0x555ba1e63fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7de1b0 0x5653ebb940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb88610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 --2- 172.21.15.80:0/4191698220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7b52f0 0x5653ebb880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 >> 172.21.15.80:0/4191698220 conn(0x5653eb7d2300 msgr2=0x5653ebb7f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f059cff9640 0 client.25514 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 shutdown_connections 2024-04-25T11:25:55.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 -- 172.21.15.80:0/3008273421 shutdown_connections 2024-04-25T11:25:55.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f09bef64740 1 -- 172.21.15.80:0/3008273421 wait complete. 2024-04-25T11:25:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 1 -- 172.21.15.80:0/4191698220 wait complete. 2024-04-25T11:25:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.547+0000 7f05c2811740 20 client.25514 trim_cache size 0 max 16384 2024-04-25T11:25:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 -- start start 2024-04-25T11:25:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 Processor -- start 2024-04-25T11:25:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a9d4d0 0x555ba1e72330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e72870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1ac6390 0x555ba1e7e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555ba1e74d90 con 0x555ba1ac6390 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ba1d53dc0 con 0x555ba1aa56b0 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555ba1e74f10 con 0x555ba1a9d4d0 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09bef64740 10 client.0 _ll_register_callbacks cb 0x555ba1d6f600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09b664c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1ac6390 0x555ba1e7e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09b664c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1ac6390 0x555ba1e7e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32834/0 (socket says 172.21.15.80:32834) 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09b664c640 1 -- 172.21.15.80:0/459134779 learned_addr learned my addr 172.21.15.80:0/459134779 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09b564a640 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e72870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.548+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a9d4d0 0x555ba1e72330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09b664c640 1 -- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a9d4d0 msgr2=0x555ba1e72330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09b664c640 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a9d4d0 0x555ba1e72330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09b664c640 1 -- 172.21.15.80:0/459134779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 msgr2=0x555ba1e72870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09b664c640 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e72870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09b664c640 1 -- 172.21.15.80:0/459134779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba1ade3f0 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09b664c640 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1ac6390 0x555ba1e7e210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f09a8004650 tx=0x7f09a802e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc2b9154affef41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09997fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09997fa640 1 -- 172.21.15.80:0/459134779 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8050070 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09997fa640 1 -- 172.21.15.80:0/459134779 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f09a8033040 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09ac0a6ae0 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09997fa640 1 -- 172.21.15.80:0/459134779 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f09a80368a0 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09bef64740 10 client.15960 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.549+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ba1ba87d0 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09997fa640 1 -- 172.21.15.80:0/459134779 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ac0a6ae0 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09997fa640 1 -- 172.21.15.80:0/459134779 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f09a8055460 con 0x555ba1ac6390 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09bef64740 10 client.15960 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09bef64740 10 client.15960 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09bef64740 20 client.15960 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09bef64740 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1a84f60 0x555ba1e84680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09bef64740 4 client.15960 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ba1dda990 con 0x555ba1a84f60 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.550+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1a84f60 0x555ba1e84680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.551+0000 7f09997fa640 10 client.15960 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.551+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1a84f60 0x555ba1e84680 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6426a433b933805c server_cookie=cf351df493b22b35 in_seq=0 out_seq=0 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.551+0000 7f09997fa640 1 -- 172.21.15.80:0/459134779 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555ba1dda990 con 0x555ba1a84f60 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.551+0000 7f09997fa640 10 client.15960 handle_command_reply: tid=0 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.551+0000 7f09bef64740 1 client.15960 shutdown 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.551+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1ac6390 msgr2=0x555ba1e7e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1ac6390 0x555ba1e7e210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f09a8004650 tx=0x7f09a802e820 comp rx=0 tx=0).stop 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 shutdown_connections 2024-04-25T11:25:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1ac6390 0x555ba1e7e210 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1a84f60 0x555ba1e84680 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e72870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 --2- 172.21.15.80:0/459134779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a9d4d0 0x555ba1e72330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09997fa640 0 client.15960 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 >> 172.21.15.80:0/459134779 conn(0x555ba1aba4e0 msgr2=0x555ba1e69530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 shutdown_connections 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 1 -- 172.21.15.80:0/459134779 wait complete. 2024-04-25T11:25:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.552+0000 7f09bef64740 20 client.15960 trim_cache size 0 max 16384 2024-04-25T11:25:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 Processor -- start 2024-04-25T11:25:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 -- start start 2024-04-25T11:25:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb93cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7de1b0 0x5653ebb89d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05b41b01e0 con 0x5653eb7de1b0 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05b41adab0 con 0x5653eb7bd4d0 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05c2811740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05b41ab920 con 0x5653eb7b52f0 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05b9e2f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7de1b0 0x5653ebb89d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05b9e2f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7de1b0 0x5653ebb89d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32846/0 (socket says 172.21.15.80:32846) 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05b9e2f640 1 -- 172.21.15.80:0/2881279421 learned_addr learned my addr 172.21.15.80:0/2881279421 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05b962e640 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.564+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb93cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f05b9e2f640 1 -- 172.21.15.80:0/2881279421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 msgr2=0x5653ebb7e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f05b9e2f640 1 -- 172.21.15.80:0/2881279421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 msgr2=0x5653ebb93cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb93cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f05b9e2f640 1 -- 172.21.15.80:0/2881279421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653eb79cfb0 con 0x5653eb7de1b0 2024-04-25T11:25:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7de1b0 0x5653ebb89d10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f05ac013e00 tx=0x7f05ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd9a7ac01ba2ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f059effd640 1 -- 172.21.15.80:0/2881279421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac02b070 con 0x5653eb7de1b0 2024-04-25T11:25:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f059effd640 1 -- 172.21.15.80:0/2881279421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ac01dd80 con 0x5653eb7de1b0 2024-04-25T11:25:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.565+0000 7f059effd640 1 -- 172.21.15.80:0/2881279421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac01b630 con 0x5653eb7de1b0 2024-04-25T11:25:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 Processor -- start 2024-04-25T11:25:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 -- start start 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 -- 172.21.15.80:0/2881279421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7de1b0 msgr2=0x5653ebb89d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7de1b0 0x5653ebb89d10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f05ac013e00 tx=0x7f05ac016000 comp rx=0 tx=0).stop 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 -- 172.21.15.80:0/2881279421 shutdown_connections 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7de1b0 0x5653ebb89d10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7bd4d0 0x5653ebb93cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 --2- 172.21.15.80:0/2881279421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb7e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 -- 172.21.15.80:0/2881279421 >> 172.21.15.80:0/2881279421 conn(0x5653eb7d2300 msgr2=0x5653ebb89600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 -- 172.21.15.80:0/2881279421 shutdown_connections 2024-04-25T11:25:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 -- 172.21.15.80:0/2881279421 wait complete. 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e71440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e7de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e73f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b00b0 con 0x555ba1a9d4d0 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01ad980 con 0x555ba1aa56b0 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09bef64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01ab7d0 con 0x555ba1a84f60 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09b564a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e7de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09b564a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e7de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32854/0 (socket says 172.21.15.80:32854) 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09b564a640 1 -- 172.21.15.80:0/2375180776 learned_addr learned my addr 172.21.15.80:0/2375180776 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09b5e4b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e71440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f09b664c640 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e73f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.566+0000 7f05c2811740 1 -- start start 2024-04-25T11:25:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 1 Processor -- start 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f09b564a640 1 -- 172.21.15.80:0/2375180776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 msgr2=0x555ba1e71440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f09b564a640 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e71440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f09b564a640 1 -- 172.21.15.80:0/2375180776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 msgr2=0x555ba1e73f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f09b564a640 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e73f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f09b564a640 1 -- 172.21.15.80:0/2375180776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba1e84b70 con 0x555ba1a9d4d0 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f09b564a640 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e7de70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009e60 tx=0x7f09a0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe77eb4eee983 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f099b7fe640 1 -- 172.21.15.80:0/2375180776 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a00120d0 con 0x555ba1a9d4d0 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f099b7fe640 1 -- 172.21.15.80:0/2375180776 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a0012270 con 0x555ba1a9d4d0 2024-04-25T11:25:55.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f099b7fe640 1 -- 172.21.15.80:0/2375180776 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0010430 con 0x555ba1a9d4d0 2024-04-25T11:25:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb80790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb80cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb81210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05b41abf70 con 0x5653eb7bd4d0 2024-04-25T11:25:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05b41ad3e0 con 0x5653eb7de1b0 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05b41ac640 con 0x5653eb7b52f0 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05c2811740 10 client.0 _ll_register_callbacks cb 0x7f05a4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05b8e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb80cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05b8e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb80cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32858/0 (socket says 172.21.15.80:32858) 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05b8e2d640 1 -- 172.21.15.80:0/367992635 learned_addr learned my addr 172.21.15.80:0/367992635 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05b962e640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb80790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.567+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb81210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05b8e2d640 1 -- 172.21.15.80:0/367992635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 msgr2=0x5653ebb80790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb80790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05b8e2d640 1 -- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 msgr2=0x5653ebb81210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb81210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05b8e2d640 1 -- 172.21.15.80:0/367992635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ebb8f0e0 con 0x5653eb7bd4d0 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05b9e2f640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb81210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05b8e2d640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb80cd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x5653ebb74600 tx=0x7f05a40329f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31508aee7888269 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f059cff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f059cff9640 1 -- 172.21.15.80:0/367992635 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a405b060 con 0x5653eb7bd4d0 2024-04-25T11:25:55.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 -- 172.21.15.80:0/2375180776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 msgr2=0x555ba1e7de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e7de70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009e60 tx=0x7f09a0005f90 comp rx=0 tx=0).stop 2024-04-25T11:25:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f059cff9640 1 -- 172.21.15.80:0/367992635 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f05a4004ad0 con 0x5653eb7bd4d0 2024-04-25T11:25:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05ac01dd80 con 0x5653eb7bd4d0 2024-04-25T11:25:55.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 -- 172.21.15.80:0/2375180776 shutdown_connections 2024-04-25T11:25:55.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1a9d4d0 0x555ba1e7de70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1aa56b0 0x555ba1e73f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 --2- 172.21.15.80:0/2375180776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e71440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 -- 172.21.15.80:0/2375180776 >> 172.21.15.80:0/2375180776 conn(0x555ba1aba4e0 msgr2=0x555ba1e73860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 -- 172.21.15.80:0/2375180776 shutdown_connections 2024-04-25T11:25:55.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f09bef64740 1 -- 172.21.15.80:0/2375180776 wait complete. 2024-04-25T11:25:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f059cff9640 1 -- 172.21.15.80:0/367992635 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f05a4035050 con 0x5653eb7bd4d0 2024-04-25T11:25:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05c2811740 10 client.15969 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5653ebb90370 con 0x5653eb7bd4d0 2024-04-25T11:25:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.568+0000 7f059cff9640 1 -- 172.21.15.80:0/367992635 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ac01dd80 con 0x5653eb7bd4d0 2024-04-25T11:25:55.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 -- start start 2024-04-25T11:25:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f059cff9640 1 -- 172.21.15.80:0/367992635 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f05a4003a70 con 0x5653eb7bd4d0 2024-04-25T11:25:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f05c2811740 10 client.15969 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f05c2811740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f05c2811740 20 client.15969 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 Processor -- start 2024-04-25T11:25:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f05c2811740 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb7721c0 0x5653ebc049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f05c2811740 4 client.15969 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:25:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5653ebaebee0 con 0x5653eb7721c0 2024-04-25T11:25:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f05b962e640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb7721c0 0x5653ebc049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e7a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1a9d4d0 0x555ba1e75850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1aa56b0 0x555ba1e75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01abe40 con 0x555ba1aa56b0 2024-04-25T11:25:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01ad2b0 con 0x555ba1a9d4d0 2024-04-25T11:25:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01ac510 con 0x555ba1a84f60 2024-04-25T11:25:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f09bef64740 10 client.0 _ll_register_callbacks cb 0x7f09a8044050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.569+0000 7f059cff9640 10 client.15969 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1aa56b0 0x555ba1e75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1aa56b0 0x555ba1e75d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32860/0 (socket says 172.21.15.80:32860) 2024-04-25T11:25:55.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b5e4b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e7a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 -- 172.21.15.80:0/401255640 learned_addr learned my addr 172.21.15.80:0/401255640 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b564a640 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1a9d4d0 0x555ba1e75850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f05b962e640 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb7721c0 0x5653ebc049d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ebb8aaa5a2dc326 server_cookie=70c57fb0296fb4cb in_seq=0 out_seq=0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 -- 172.21.15.80:0/401255640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 msgr2=0x555ba1e7a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e7a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 -- 172.21.15.80:0/401255640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1a9d4d0 msgr2=0x555ba1e75850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1a9d4d0 0x555ba1e75850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 -- 172.21.15.80:0/401255640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba1e762d0 con 0x555ba1aa56b0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09b664c640 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1aa56b0 0x555ba1e75d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f09a8036a40 tx=0x7f09a8036cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658d72edbcb47190 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09997fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09997fa640 1 -- 172.21.15.80:0/401255640 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8050040 con 0x555ba1aa56b0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09997fa640 1 -- 172.21.15.80:0/401255640 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f09a8068480 con 0x555ba1aa56b0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09a0012270 con 0x555ba1aa56b0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09997fa640 1 -- 172.21.15.80:0/401255640 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f09a8068680 con 0x555ba1aa56b0 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09bef64740 10 client.15972 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.570+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ba1eec610 con 0x555ba1aa56b0 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09997fa640 1 -- 172.21.15.80:0/401255640 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a0012270 con 0x555ba1aa56b0 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09997fa640 1 -- 172.21.15.80:0/401255640 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f09a804c420 con 0x555ba1aa56b0 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09bef64740 10 client.15972 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09bef64740 10 client.15972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09bef64740 20 client.15972 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09bef64740 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1ac6390 0x555ba1eeed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09bef64740 4 client.15972 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ba1dd4800 con 0x555ba1ac6390 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.571+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1ac6390 0x555ba1eeed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09997fa640 10 client.15972 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09b5e4b640 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1ac6390 0x555ba1eeed40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=817e08f1ed047aad server_cookie=ae15b6b3eec7abca in_seq=0 out_seq=0 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09997fa640 1 -- 172.21.15.80:0/401255640 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ba1dd4800 con 0x555ba1ac6390 2024-04-25T11:25:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09997fa640 10 client.15972 handle_command_reply: tid=0 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 client.15972 shutdown 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1aa56b0 msgr2=0x555ba1e75d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1aa56b0 0x555ba1e75d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f09a8036a40 tx=0x7f09a8036cf0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 shutdown_connections 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ba1aa56b0 0x555ba1e75d90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x555ba1ac6390 0x555ba1eeed40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ba1a9d4d0 0x555ba1e75850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 --2- 172.21.15.80:0/401255640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ba1a84f60 0x555ba1e7a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09997fa640 0 client.15972 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 >> 172.21.15.80:0/401255640 conn(0x555ba1aba4e0 msgr2=0x555ba1e711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 shutdown_connections 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 1 -- 172.21.15.80:0/401255640 wait complete. 2024-04-25T11:25:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.572+0000 7f09bef64740 20 client.15972 trim_cache size 0 max 16384 2024-04-25T11:25:55.594 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:25:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f099c0afce0 msgr2=0x7f099c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f099c0afce0 0x7f099c0b21f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09a8005ab0 tx=0x7f09a8005a40 comp rx=0 tx=0).stop 2024-04-25T11:25:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0103180 msgr2=0x7f09b0198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0103180 0x7f09b0198500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00dab0 tx=0x7f09ac00df70 comp rx=0 tx=0).stop 2024-04-25T11:25:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 shutdown_connections 2024-04-25T11:25:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f099c0afce0 0x7f099c0b21f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b0108a20 0x7f09b0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b0108ec0 0x7f09b019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 --2- 172.21.15.80:0/2781273735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09b0103180 0x7f09b0198500 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 >> 172.21.15.80:0/2781273735 conn(0x7f09b0078110 msgr2=0x7f09b0100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 shutdown_connections 2024-04-25T11:25:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.573+0000 7f09b80af640 1 -- 172.21.15.80:0/2781273735 wait complete. 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f059cff9640 1 -- 172.21.15.80:0/367992635 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5653ebaebee0 con 0x5653eb7721c0 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f059cff9640 10 client.15969 handle_command_reply: tid=0 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 client.15969 shutdown 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 msgr2=0x5653ebb80cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb80cd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x5653ebb74600 tx=0x7f05a40329f0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 shutdown_connections 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5653eb7721c0 0x5653ebc049d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5653eb7bd4d0 0x5653ebb80cd0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653eb7de1b0 0x5653ebb81210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f059cff9640 0 client.15969 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 --2- 172.21.15.80:0/367992635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5653eb7b52f0 0x5653ebb80790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 >> 172.21.15.80:0/367992635 conn(0x5653eb7d2300 msgr2=0x5653ebb89fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 shutdown_connections 2024-04-25T11:25:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 1 -- 172.21.15.80:0/367992635 wait complete. 2024-04-25T11:25:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.581+0000 7f05c2811740 20 client.15969 trim_cache size 0 max 16384 2024-04-25T11:25:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:25:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:25:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:25:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:25:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05a00afc50 msgr2=0x7f05a00b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05a00afc50 0x7f05a00b2160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5653ebb7ac60 tx=0x7f05ac009600 comp rx=0 tx=0).stop 2024-04-25T11:25:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b41031b0 msgr2=0x7f05b419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b41031b0 0x7f05b419b690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e9f0 tx=0x7f05b000eeb0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 shutdown_connections 2024-04-25T11:25:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05a00afc50 0x7f05a00b2160 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b4108ef0 0x7f05b419c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05b4108a50 0x7f05b419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 --2- 172.21.15.80:0/3438548017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05b41031b0 0x7f05b419b690 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 >> 172.21.15.80:0/3438548017 conn(0x7f05b40fe260 msgr2=0x7f05b40fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 shutdown_connections 2024-04-25T11:25:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:25:55.582+0000 7f05bb892640 1 -- 172.21.15.80:0/3438548017 wait complete. 2024-04-25T11:25:55.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 -- 172.21.15.80:0/3919735926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab0109b20 msgr2=0x7ffab0101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 --2- 172.21.15.80:0/3919735926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab0109b20 0x7ffab0101c10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009900 tx=0x7ffaa002a410 comp rx=0 tx=0).stop 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 -- 172.21.15.80:0/3919735926 shutdown_connections 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 --2- 172.21.15.80:0/3919735926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab01027c0 0x7ffab0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 --2- 172.21.15.80:0/3919735926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffab0109fc0 0x7ffab0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 --2- 172.21.15.80:0/3919735926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab0109b20 0x7ffab0101c10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 -- 172.21.15.80:0/3919735926 >> 172.21.15.80:0/3919735926 conn(0x7ffab0077880 msgr2=0x7ffab0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 -- 172.21.15.80:0/3919735926 shutdown_connections 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.725+0000 7ffab74af640 1 -- 172.21.15.80:0/3919735926 wait complete. 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 Processor -- start 2024-04-25T11:25:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 -- start start 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab01027c0 0x7ffab0102df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffab0109b20 0x7ffab0103330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab0109fc0 0x7ffab0103870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0113d10 con 0x7ffab01027c0 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0113b90 con 0x7ffab0109fc0 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab74af640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0113e90 con 0x7ffab0109b20 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab524b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab01027c0 0x7ffab0102df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.726+0000 7ffab524b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab01027c0 0x7ffab0102df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32880/0 (socket says 172.21.15.80:32880) 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab524b640 1 -- 172.21.15.80:0/4237024708 learned_addr learned my addr 172.21.15.80:0/4237024708 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab4a4a640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffab0109b20 0x7ffab0103330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab0109fc0 0x7ffab0103870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab524b640 1 -- 172.21.15.80:0/4237024708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffab0109b20 msgr2=0x7ffab0103330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab524b640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffab0109b20 0x7ffab0103330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab524b640 1 -- 172.21.15.80:0/4237024708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab0109fc0 msgr2=0x7ffab0103870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab524b640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab0109fc0 0x7ffab0103870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab524b640 1 -- 172.21.15.80:0/4237024708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab01a8ad0 con 0x7ffab01027c0 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab524b640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab01027c0 0x7ffab0102df0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0005940 tx=0x7ffaa0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffaa67fc640 1 -- 172.21.15.80:0/4237024708 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa003f030 con 0x7ffab01027c0 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab01a8d60 con 0x7ffab01027c0 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffaa67fc640 1 -- 172.21.15.80:0/4237024708 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa0003aa0 con 0x7ffab01027c0 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffaa67fc640 1 -- 172.21.15.80:0/4237024708 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0035070 con 0x7ffab01027c0 2024-04-25T11:25:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.727+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab01a91e0 con 0x7ffab01027c0 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 Processor -- start 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffaa67fc640 1 -- 172.21.15.80:0/4237024708 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ffaa0042030 con 0x7ffab01027c0 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 -- start start 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb942390 0x55ddfbce3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9194d0 0x55ddfbce3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbc48d80 con 0x55ddfb9194d0 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbc02a20 con 0x55ddfb942390 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffabe363740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbc44d40 con 0x55ddfb9216b0 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.730+0000 7ffab524b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9194d0 0x55ddfbce3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab524b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9194d0 0x55ddfbce3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32890/0 (socket says 172.21.15.80:32890) 2024-04-25T11:25:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab524b640 1 -- 172.21.15.80:0/988042660 learned_addr learned my addr 172.21.15.80:0/988042660 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb942390 0x55ddfbce3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab4a4a640 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 -- 172.21.15.80:0/988042660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9216b0 msgr2=0x55ddfbcf06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 -- 172.21.15.80:0/988042660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9194d0 msgr2=0x55ddfbce3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffaa67fc640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa9c0afc60 0x7ffa9c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9194d0 0x55ddfbce3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 -- 172.21.15.80:0/988042660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfbc0dc30 con 0x55ddfb942390 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab524b640 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9194d0 0x55ddfbce3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa9c0afc60 0x7ffa9c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffaa67fc640 1 -- 172.21.15.80:0/4237024708 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffaa00ff6c0 con 0x7ffab01027c0 2024-04-25T11:25:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb942390 0x55ddfbce3810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009f00 tx=0x7ffaa8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60d5cbff655d76e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.731+0000 7ffa9b7fe640 1 -- 172.21.15.80:0/988042660 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80045c0 con 0x55ddfb942390 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffa9b7fe640 1 -- 172.21.15.80:0/988042660 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa8004760 con 0x55ddfb942390 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa9c0afc60 0x7ffa9c0b2170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8020000 tx=0x7ffaa8021000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffa9b7fe640 1 -- 172.21.15.80:0/988042660 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa801c400 con 0x55ddfb942390 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffabe363740 1 -- 172.21.15.80:0/988042660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb942390 msgr2=0x55ddfbce3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffabe363740 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb942390 0x55ddfbce3810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009f00 tx=0x7ffaa8011810 comp rx=0 tx=0).stop 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffabe363740 1 -- 172.21.15.80:0/988042660 shutdown_connections 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffabe363740 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9194d0 0x55ddfbce3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffabe363740 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffabe363740 1 --2- 172.21.15.80:0/988042660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb942390 0x55ddfbce3810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.732+0000 7ffabe363740 1 -- 172.21.15.80:0/988042660 >> 172.21.15.80:0/988042660 conn(0x55ddfb9364e0 msgr2=0x55ddfbcdffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.733+0000 7ffabe363740 1 -- 172.21.15.80:0/988042660 shutdown_connections 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.733+0000 7ffabe363740 1 -- 172.21.15.80:0/988042660 wait complete. 2024-04-25T11:25:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.733+0000 7ffabe363740 1 -- start start 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.733+0000 7ffabe363740 1 Processor -- start 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.733+0000 7ffabe363740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.733+0000 7ffabe363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9216b0 0x55ddfbcee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.733+0000 7ffabe363740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb942390 0x55ddfbcfa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffabe363740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbcf0d90 con 0x55ddfb942390 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffabe363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbbcfdc0 con 0x55ddfb9216b0 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffabe363740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbcf0f10 con 0x55ddfb9194d0 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffabe363740 10 client.0 _ll_register_callbacks cb 0x55ddfbbeb600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb942390 0x55ddfbcfa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab4a4a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9216b0 0x55ddfbcee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb942390 0x55ddfbcfa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32906/0 (socket says 172.21.15.80:32906) 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 -- 172.21.15.80:0/397116332 learned_addr learned my addr 172.21.15.80:0/397116332 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab524b640 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 -- 172.21.15.80:0/397116332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 msgr2=0x55ddfbcee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 -- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9216b0 msgr2=0x55ddfbcee7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9216b0 0x55ddfbcee7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 -- 172.21.15.80:0/397116332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfb95a3f0 con 0x55ddfb942390 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab4a4a640 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9216b0 0x55ddfbcee7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb942390 0x55ddfbcfa210 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800fb60 tx=0x7ffaa8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe40d2feaaed605 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffa98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffa98ff9640 1 -- 172.21.15.80:0/397116332 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80045c0 con 0x55ddfb942390 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffa98ff9640 1 -- 172.21.15.80:0/397116332 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffaa800f690 con 0x55ddfb942390 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.734+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa8004760 con 0x55ddfb942390 2024-04-25T11:25:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffa98ff9640 1 -- 172.21.15.80:0/397116332 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffaa801c400 con 0x55ddfb942390 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 10 client.15984 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ddfba247d0 con 0x55ddfb942390 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffa98ff9640 1 -- 172.21.15.80:0/397116332 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa8004760 con 0x55ddfb942390 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffa98ff9640 1 -- 172.21.15.80:0/397116332 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffaa8030070 con 0x55ddfb942390 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 10 client.15984 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 20 client.15984 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb900f60 0x55ddfbd004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 4 client.15984 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddfbc56990 con 0x55ddfb900f60 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.735+0000 7ffab524b640 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb900f60 0x55ddfbd004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.736+0000 7ffa98ff9640 10 client.15984 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.736+0000 7ffab524b640 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb900f60 0x55ddfbd004f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f86a724a475b8b1 server_cookie=97049eb5848f276a in_seq=0 out_seq=0 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffa98ff9640 1 -- 172.21.15.80:0/397116332 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ddfbc56990 con 0x55ddfb900f60 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffa98ff9640 10 client.15984 handle_command_reply: tid=0 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 client.15984 shutdown 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb942390 msgr2=0x55ddfbcfa210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb942390 0x55ddfbcfa210 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800fb60 tx=0x7ffaa8005bd0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 shutdown_connections 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb900f60 0x55ddfbd004f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb942390 0x55ddfbcfa210 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffa98ff9640 0 client.15984 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9216b0 0x55ddfbcee7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 --2- 172.21.15.80:0/397116332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 >> 172.21.15.80:0/397116332 conn(0x55ddfb9364e0 msgr2=0x55ddfbce5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 shutdown_connections 2024-04-25T11:25:55.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 1 -- 172.21.15.80:0/397116332 wait complete. 2024-04-25T11:25:55.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.737+0000 7ffabe363740 20 client.15984 trim_cache size 0 max 16384 2024-04-25T11:25:55.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 Processor -- start 2024-04-25T11:25:55.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 -- start start 2024-04-25T11:25:55.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb900f60 0x55ddfbce3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbd05c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01b4510 con 0x55ddfb9216b0 2024-04-25T11:25:55.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01b1de0 con 0x55ddfb900f60 2024-04-25T11:25:55.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffabe363740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01afc30 con 0x55ddfb9194d0 2024-04-25T11:25:55.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffab5a4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbd05c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffab5a4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbd05c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32922/0 (socket says 172.21.15.80:32922) 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffab5a4c640 1 -- 172.21.15.80:0/2650348010 learned_addr learned my addr 172.21.15.80:0/2650348010 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffab4a4a640 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.762+0000 7ffab524b640 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb900f60 0x55ddfbce3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffab5a4c640 1 -- 172.21.15.80:0/2650348010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 msgr2=0x55ddfbcf9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffab5a4c640 1 -- 172.21.15.80:0/2650348010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb900f60 msgr2=0x55ddfbce3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb900f60 0x55ddfbce3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffab5a4c640 1 -- 172.21.15.80:0/2650348010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfbce9c10 con 0x55ddfb9216b0 2024-04-25T11:25:55.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbd05c10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8006010 tx=0x7ffaa800ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ad53a9bdea998b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffa9affd640 1 -- 172.21.15.80:0/2650348010 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800fb90 con 0x55ddfb9216b0 2024-04-25T11:25:55.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffa9affd640 1 -- 172.21.15.80:0/2650348010 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa8009b30 con 0x55ddfb9216b0 2024-04-25T11:25:55.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.763+0000 7ffa9affd640 1 -- 172.21.15.80:0/2650348010 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8005880 con 0x55ddfb9216b0 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 -- 172.21.15.80:0/2650348010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 msgr2=0x55ddfbd05c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbd05c10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8006010 tx=0x7ffaa800ffa0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 -- 172.21.15.80:0/2650348010 shutdown_connections 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbd05c10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 --2- 172.21.15.80:0/2650348010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb900f60 0x55ddfbce3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 -- 172.21.15.80:0/2650348010 >> 172.21.15.80:0/2650348010 conn(0x55ddfb9364e0 msgr2=0x55ddfbce35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 -- 172.21.15.80:0/2650348010 shutdown_connections 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 -- 172.21.15.80:0/2650348010 wait complete. 2024-04-25T11:25:55.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 -- start start 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.764+0000 7ffabe363740 1 Processor -- start 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffabe363740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb900f60 0x55ddfbcf67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffabe363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffabe363740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffabe363740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01b02a0 con 0x55ddfb9216b0 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffabe363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01b1710 con 0x55ddfb9194d0 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffabe363740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01b0970 con 0x55ddfb900f60 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffabe363740 10 client.0 _ll_register_callbacks cb 0x7ffaa801f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32936/0 (socket says 172.21.15.80:32936) 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 -- 172.21.15.80:0/3679405287 learned_addr learned my addr 172.21.15.80:0/3679405287 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab524b640 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb900f60 0x55ddfbcf67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab4a4a640 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 -- 172.21.15.80:0/3679405287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb900f60 msgr2=0x55ddfbcf67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb900f60 0x55ddfbcf67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 -- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9194d0 msgr2=0x55ddfbcf11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.765+0000 7ffab5a4c640 1 -- 172.21.15.80:0/3679405287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfbcf1e60 con 0x55ddfb9216b0 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffab5a4c640 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf16f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005c10 tx=0x7ffaa8004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb98932deda86b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffa98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffa98ff9640 1 -- 172.21.15.80:0/3679405287 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80047d0 con 0x55ddfb9216b0 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffa98ff9640 1 -- 172.21.15.80:0/3679405287 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffaa80055b0 con 0x55ddfb9216b0 2024-04-25T11:25:55.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa8009b30 con 0x55ddfb9216b0 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffa98ff9640 1 -- 172.21.15.80:0/3679405287 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffaa804f050 con 0x55ddfb9216b0 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 10 client.15990 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ddfbd676d0 con 0x55ddfb9216b0 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffa98ff9640 1 -- 172.21.15.80:0/3679405287 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa8009b30 con 0x55ddfb9216b0 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffa98ff9640 1 -- 172.21.15.80:0/3679405287 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffaa804a030 con 0x55ddfb9216b0 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 10 client.15990 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 20 client.15990 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb942390 0x55ddfbd69d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 4 client.15990 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.766+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddfbc50800 con 0x55ddfb942390 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffab524b640 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb942390 0x55ddfbd69d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffa98ff9640 10 client.15990 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffab524b640 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb942390 0x55ddfbd69d70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b451200ba63ef2 server_cookie=25ea0264b4dec8bd in_seq=0 out_seq=0 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffa98ff9640 1 -- 172.21.15.80:0/3679405287 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddfbc50800 con 0x55ddfb942390 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffa98ff9640 10 client.15990 handle_command_reply: tid=0 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 client.15990 shutdown 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 msgr2=0x55ddfbcf16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf16f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005c10 tx=0x7ffaa8004490 comp rx=0 tx=0).stop 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 shutdown_connections 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ddfb942390 0x55ddfbd69d70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddfb9216b0 0x55ddfbcf16f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffa98ff9640 0 client.15990 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddfb9194d0 0x55ddfbcf11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 --2- 172.21.15.80:0/3679405287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddfb900f60 0x55ddfbcf67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.767+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 >> 172.21.15.80:0/3679405287 conn(0x55ddfb9364e0 msgr2=0x55ddfbcec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 shutdown_connections 2024-04-25T11:25:55.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffabe363740 1 -- 172.21.15.80:0/3679405287 wait complete. 2024-04-25T11:25:55.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffabe363740 20 client.15990 trim_cache size 0 max 16384 2024-04-25T11:25:55.769 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:25:55.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa9c0afc60 msgr2=0x7ffa9c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa9c0afc60 0x7ffa9c0b2170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8020000 tx=0x7ffaa8021000 comp rx=0 tx=0).stop 2024-04-25T11:25:55.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab01027c0 msgr2=0x7ffab0102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:55.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab01027c0 0x7ffab0102df0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0005940 tx=0x7ffaa0004270 comp rx=0 tx=0).stop 2024-04-25T11:25:55.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 shutdown_connections 2024-04-25T11:25:55.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa9c0afc60 0x7ffa9c0b2170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffab0109fc0 0x7ffab0103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffab0109b20 0x7ffab0103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 --2- 172.21.15.80:0/4237024708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffab01027c0 0x7ffab0102df0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:55.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 >> 172.21.15.80:0/4237024708 conn(0x7ffab0077880 msgr2=0x7ffab0105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:55.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 shutdown_connections 2024-04-25T11:25:55.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:55.768+0000 7ffab74af640 1 -- 172.21.15.80:0/4237024708 wait complete. 2024-04-25T11:25:56.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:55 smithi196 ceph-mon[32659]: pgmap v54: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 349 KiB/s wr, 8 op/s 2024-04-25T11:25:56.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:55 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4011327732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:25:56.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:55 smithi082 ceph-mon[32440]: pgmap v54: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 349 KiB/s wr, 8 op/s 2024-04-25T11:25:56.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:55 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4011327732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:25:56.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:55 smithi080 ceph-mon[29126]: pgmap v54: 97 pgs: 97 active+clean; 2.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 349 KiB/s wr, 8 op/s 2024-04-25T11:25:56.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:55 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4011327732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:25:56.774 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:25:56.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:25:56.774 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 -- 172.21.15.80:0/4119730390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c107450 msgr2=0x7ffa8c10ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/4119730390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c107450 0x7ffa8c10ebf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009ca0 tx=0x7ffa8402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 -- 172.21.15.80:0/4119730390 shutdown_connections 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/4119730390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c107450 0x7ffa8c10ebf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/4119730390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa8c106990 0x7ffa8c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/4119730390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa8c102400 0x7ffa8c102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 -- 172.21.15.80:0/4119730390 >> 172.21.15.80:0/4119730390 conn(0x7ffa8c077880 msgr2=0x7ffa8c077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 -- 172.21.15.80:0/4119730390 shutdown_connections 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 -- 172.21.15.80:0/4119730390 wait complete. 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 Processor -- start 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.900+0000 7ffa93e9a640 1 -- start start 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa93e9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c102400 0x7ffa8c19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa93e9a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa8c106990 0x7ffa8c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa93e9a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa8c107450 0x7ffa8c19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa93e9a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c112be0 con 0x7ffa8c102400 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa93e9a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c112a60 con 0x7ffa8c106990 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa93e9a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c112d60 con 0x7ffa8c107450 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c102400 0x7ffa8c19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c102400 0x7ffa8c19b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55410/0 (socket says 172.21.15.80:55410) 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 -- 172.21.15.80:0/769958918 learned_addr learned my addr 172.21.15.80:0/769958918 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91435640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa8c106990 0x7ffa8c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa92437640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa8c107450 0x7ffa8c19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 -- 172.21.15.80:0/769958918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa8c107450 msgr2=0x7ffa8c19c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa8c107450 0x7ffa8c19c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 -- 172.21.15.80:0/769958918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa8c106990 msgr2=0x7ffa8c19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa8c106990 0x7ffa8c19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 -- 172.21.15.80:0/769958918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c1a6920 con 0x7ffa8c102400 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa92437640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa8c107450 0x7ffa8c19c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.901+0000 7ffa91c36640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c102400 0x7ffa8c19b5e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00e9f0 tx=0x7ffa7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.902+0000 7ffa82ffd640 1 -- 172.21.15.80:0/769958918 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00cd80 con 0x7ffa8c102400 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.902+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c1a6c10 con 0x7ffa8c102400 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.902+0000 7ffa82ffd640 1 -- 172.21.15.80:0/769958918 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa7c0108e0 con 0x7ffa8c102400 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.902+0000 7ffa82ffd640 1 -- 172.21.15.80:0/769958918 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c018980 con 0x7ffa8c102400 2024-04-25T11:25:56.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.902+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c1a7160 con 0x7ffa8c102400 2024-04-25T11:25:56.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 Processor -- start 2024-04-25T11:25:56.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 -- start start 2024-04-25T11:25:56.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe27620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3dfd8db00 con 0x55c3dfa66730 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3dfd29920 con 0x55c3dfa5e550 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.905+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c3dfd89ac0 con 0x55c3dfa87410 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa82ffd640 1 -- 172.21.15.80:0/769958918 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ffa7c010430 con 0x7ffa8c102400 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe280a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55418/0 (socket says 172.21.15.80:55418) 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa92437640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe27620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 -- 172.21.15.80:0/3690690725 learned_addr learned my addr 172.21.15.80:0/3690690725 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91c36640 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 -- 172.21.15.80:0/3690690725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 msgr2=0x55c3dfe27620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe27620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 -- 172.21.15.80:0/3690690725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 msgr2=0x55c3dfe27b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe27b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 -- 172.21.15.80:0/3690690725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3dfb677e0 con 0x55c3dfa66730 2024-04-25T11:25:56.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa91435640 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe280a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009c00 tx=0x7ffa88011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94b601101f532c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:56.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.906+0000 7ffa82ffd640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa780afc60 0x7ffa780b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.907+0000 7ffa92437640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa780afc60 0x7ffa780b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.907+0000 7ffa82ffd640 1 -- 172.21.15.80:0/769958918 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffa7c0df3e0 con 0x7ffa8c102400 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.907+0000 7ffa92437640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa780afc60 0x7ffa780b2170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa84005cc0 tx=0x7ffa84005c30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.908+0000 7ffa77fff640 1 -- 172.21.15.80:0/3690690725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88004230 con 0x55c3dfa66730 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.908+0000 7ffa77fff640 1 -- 172.21.15.80:0/3690690725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa880043d0 con 0x55c3dfa66730 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.908+0000 7ffa77fff640 1 -- 172.21.15.80:0/3690690725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88019640 con 0x55c3dfa66730 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 -- 172.21.15.80:0/3690690725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 msgr2=0x55c3dfe280a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe280a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009c00 tx=0x7ffa88011810 comp rx=0 tx=0).stop 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 -- 172.21.15.80:0/3690690725 shutdown_connections 2024-04-25T11:25:56.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe280a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/3690690725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe27620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 -- 172.21.15.80:0/3690690725 >> 172.21.15.80:0/3690690725 conn(0x55c3dfa7b560 msgr2=0x55c3dfe23dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:56.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 -- 172.21.15.80:0/3690690725 shutdown_connections 2024-04-25T11:25:56.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 -- 172.21.15.80:0/3690690725 wait complete. 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 -- start start 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.909+0000 7ffa9ae20740 1 Processor -- start 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa66730 0x55c3dfe32060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe3de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3dfe34970 con 0x55c3dfa5e550 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3dfd275d0 con 0x55c3dfa66730 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c3dfe34af0 con 0x55c3dfa87410 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa9ae20740 10 client.0 _ll_register_callbacks cb 0x55c3dfd15080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55420/0 (socket says 172.21.15.80:55420) 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 -- 172.21.15.80:0/2306799514 learned_addr learned my addr 172.21.15.80:0/2306799514 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa92437640 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe3de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91435640 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa66730 0x55c3dfe32060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 -- 172.21.15.80:0/2306799514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 msgr2=0x55c3dfe3de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe3de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 -- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa66730 msgr2=0x55c3dfe32060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa66730 0x55c3dfe32060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 -- 172.21.15.80:0/2306799514 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3dfbc7f70 con 0x55c3dfa5e550 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa91c36640 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31b20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c6a0 tx=0x7ffa7c0a3510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e283ba9ae3e52e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.910+0000 7ffa757fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa757fa640 1 -- 172.21.15.80:0/2306799514 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0a6d00 con 0x55c3dfa5e550 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa757fa640 1 -- 172.21.15.80:0/2306799514 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffa7c0e2c20 con 0x55c3dfa5e550 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa880043d0 con 0x55c3dfa5e550 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa757fa640 1 -- 172.21.15.80:0/2306799514 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa7c010720 con 0x55c3dfa5e550 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 10 client.16002 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c3dfa5f170 con 0x55c3dfa5e550 2024-04-25T11:25:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa757fa640 1 -- 172.21.15.80:0/2306799514 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa880043d0 con 0x55c3dfa5e550 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa757fa640 1 -- 172.21.15.80:0/2306799514 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffa7c018b20 con 0x55c3dfa5e550 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 10 client.16002 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 20 client.16002 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa461f0 0x55c3dfe43ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 4 client.16002 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3dfd9b710 con 0x55c3dfa461f0 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.911+0000 7ffa91435640 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa461f0 0x55c3dfe43ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.912+0000 7ffa91435640 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa461f0 0x55c3dfe43ef0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e444804b097732f6 server_cookie=402ca395e49e1223 in_seq=0 out_seq=0 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.912+0000 7ffa757fa640 10 client.16002 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa757fa640 1 -- 172.21.15.80:0/2306799514 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c3dfd9b710 con 0x55c3dfa461f0 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa757fa640 10 client.16002 handle_command_reply: tid=0 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 client.16002 shutdown 2024-04-25T11:25:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa5e550 msgr2=0x55c3dfe31b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31b20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c6a0 tx=0x7ffa7c0a3510 comp rx=0 tx=0).stop 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 shutdown_connections 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa461f0 0x55c3dfe43ef0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa87410 0x55c3dfe3de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa66730 0x55c3dfe32060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2306799514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31b20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa757fa640 0 client.16002 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 >> 172.21.15.80:0/2306799514 conn(0x55c3dfa7b560 msgr2=0x55c3dfe29340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 shutdown_connections 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2306799514 wait complete. 2024-04-25T11:25:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.913+0000 7ffa9ae20740 20 client.16002 trim_cache size 0 max 16384 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.931+0000 7ffa9ae20740 1 Processor -- start 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa9ae20740 1 -- start start 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa66730 0x55c3dfe496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa87410 0x55c3dfe49bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1b0100 con 0x55c3dfa87410 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1ad9d0 con 0x55c3dfa5e550 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1ab820 con 0x55c3dfa66730 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa87410 0x55c3dfe49bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa87410 0x55c3dfe49bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55432/0 (socket says 172.21.15.80:55432) 2024-04-25T11:25:56.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 -- 172.21.15.80:0/1559242376 learned_addr learned my addr 172.21.15.80:0/1559242376 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa91435640 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa66730 0x55c3dfe496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa91c36640 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 -- 172.21.15.80:0/1559242376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa66730 msgr2=0x55c3dfe496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa66730 0x55c3dfe496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 -- 172.21.15.80:0/1559242376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 msgr2=0x55c3dfe31bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.932+0000 7ffa92437640 1 -- 172.21.15.80:0/1559242376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3dfe273b0 con 0x55c3dfa87410 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.933+0000 7ffa92437640 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa87410 0x55c3dfe49bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009ca0 tx=0x7ffa84047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2eb5a4aa77c896 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.933+0000 7ffa777fe640 1 -- 172.21.15.80:0/1559242376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa840318e0 con 0x55c3dfa87410 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.933+0000 7ffa777fe640 1 -- 172.21.15.80:0/1559242376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa84036040 con 0x55c3dfa87410 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.933+0000 7ffa777fe640 1 -- 172.21.15.80:0/1559242376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa840044d0 con 0x55c3dfa87410 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 -- 172.21.15.80:0/1559242376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa87410 msgr2=0x55c3dfe49bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa87410 0x55c3dfe49bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009ca0 tx=0x7ffa84047000 comp rx=0 tx=0).stop 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 -- 172.21.15.80:0/1559242376 shutdown_connections 2024-04-25T11:25:56.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa87410 0x55c3dfe49bf0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa66730 0x55c3dfe496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/1559242376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa5e550 0x55c3dfe31bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 -- 172.21.15.80:0/1559242376 >> 172.21.15.80:0/1559242376 conn(0x55c3dfa7b560 msgr2=0x55c3dfe27c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:56.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 -- 172.21.15.80:0/1559242376 shutdown_connections 2024-04-25T11:25:56.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 -- 172.21.15.80:0/1559242376 wait complete. 2024-04-25T11:25:56.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 -- start start 2024-04-25T11:25:56.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.934+0000 7ffa9ae20740 1 Processor -- start 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa5e550 0x55c3dfe3a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe36d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa87410 0x55c3dfe37290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1abe90 con 0x55c3dfa66730 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1ad300 con 0x55c3dfa87410 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1ac560 con 0x55c3dfa5e550 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 10 client.0 _ll_register_callbacks cb 0x7ffa7c0a2d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe36d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe36d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55440/0 (socket says 172.21.15.80:55440) 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 -- 172.21.15.80:0/2177733448 learned_addr learned my addr 172.21.15.80:0/2177733448 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91c36640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa5e550 0x55c3dfe3a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa92437640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa87410 0x55c3dfe37290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 -- 172.21.15.80:0/2177733448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa5e550 msgr2=0x55c3dfe3a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa5e550 0x55c3dfe3a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 -- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa87410 msgr2=0x55c3dfe37290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa87410 0x55c3dfe37290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 -- 172.21.15.80:0/2177733448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3dfe377d0 con 0x55c3dfa66730 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa92437640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa87410 0x55c3dfe37290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa91435640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe36d50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ffa88003e40 tx=0x7ffa88003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f5911ace3dcd77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa757fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa757fa640 1 -- 172.21.15.80:0/2177733448 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88035060 con 0x55c3dfa66730 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa757fa640 1 -- 172.21.15.80:0/2177733448 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffa880041d0 con 0x55c3dfa66730 2024-04-25T11:25:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.935+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa84036040 con 0x55c3dfa66730 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa757fa640 1 -- 172.21.15.80:0/2177733448 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa8801f040 con 0x55c3dfa66730 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 10 client.16008 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c3dfeacf80 con 0x55c3dfa66730 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa757fa640 1 -- 172.21.15.80:0/2177733448 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa84036040 con 0x55c3dfa66730 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa757fa640 1 -- 172.21.15.80:0/2177733448 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffa88018070 con 0x55c3dfa66730 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 10 client.16008 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 20 client.16008 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa1b630 0x55c3dfeaf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 4 client.16008 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c3dfd95580 con 0x55c3dfa1b630 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.936+0000 7ffa91c36640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa1b630 0x55c3dfeaf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.937+0000 7ffa757fa640 10 client.16008 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.937+0000 7ffa91c36640 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa1b630 0x55c3dfeaf630 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d06bf9f58026208 server_cookie=158a86979ceac60a in_seq=0 out_seq=0 2024-04-25T11:25:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa757fa640 1 -- 172.21.15.80:0/2177733448 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c3dfd95580 con 0x55c3dfa1b630 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa757fa640 10 client.16008 handle_command_reply: tid=0 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 client.16008 shutdown 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 msgr2=0x55c3dfe36d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe36d50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ffa88003e40 tx=0x7ffa88003e70 comp rx=0 tx=0).stop 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 shutdown_connections 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3dfa1b630 0x55c3dfeaf630 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3dfa66730 0x55c3dfe36d50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3dfa87410 0x55c3dfe37290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 --2- 172.21.15.80:0/2177733448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3dfa5e550 0x55c3dfe3a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 >> 172.21.15.80:0/2177733448 conn(0x55c3dfa7b560 msgr2=0x55c3dfe27c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa757fa640 0 client.16008 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 shutdown_connections 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.938+0000 7ffa9ae20740 1 -- 172.21.15.80:0/2177733448 wait complete. 2024-04-25T11:25:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa9ae20740 20 client.16008 trim_cache size 0 max 16384 2024-04-25T11:25:56.937 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:25:56.937 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:25:56.937 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "8634c6e0-5d20-4a6f-8d57-9f5960bd8650", 2024-04-25T11:25:56.937 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:25:56.937 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa780afc60 msgr2=0x7ffa780b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa780afc60 0x7ffa780b2170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffa84005cc0 tx=0x7ffa84005c30 comp rx=0 tx=0).stop 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c102400 msgr2=0x7ffa8c19b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c102400 0x7ffa8c19b5e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00e9f0 tx=0x7ffa7c00eeb0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 shutdown_connections 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa780afc60 0x7ffa780b2170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa8c107450 0x7ffa8c19c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa8c106990 0x7ffa8c19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 --2- 172.21.15.80:0/769958918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa8c102400 0x7ffa8c19b5e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:56.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 >> 172.21.15.80:0/769958918 conn(0x7ffa8c077880 msgr2=0x7ffa8c0ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:56.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 shutdown_connections 2024-04-25T11:25:56.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:56.939+0000 7ffa93e9a640 1 -- 172.21.15.80:0/769958918 wait complete. 2024-04-25T11:25:56.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:25:56.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 -- 172.21.15.80:0/1046904207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc40108a40 msgr2=0x7efc401025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 --2- 172.21.15.80:0/1046904207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc40108a40 0x7efc401025d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efc34009900 tx=0x7efc3402c620 comp rx=0 tx=0).stop 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 -- 172.21.15.80:0/1046904207 shutdown_connections 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 --2- 172.21.15.80:0/1046904207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4010d3a0 0x7efc4010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 --2- 172.21.15.80:0/1046904207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc40102b10 0x7efc40102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 --2- 172.21.15.80:0/1046904207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc40108a40 0x7efc401025d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 -- 172.21.15.80:0/1046904207 >> 172.21.15.80:0/1046904207 conn(0x7efc40078180 msgr2=0x7efc400785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 -- 172.21.15.80:0/1046904207 shutdown_connections 2024-04-25T11:25:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 -- 172.21.15.80:0/1046904207 wait complete. 2024-04-25T11:25:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 Processor -- start 2024-04-25T11:25:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.071+0000 7efc46e49640 1 -- start start 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc46e49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40102b10 0x7efc40198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc46e49640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc40108a40 0x7efc40198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc46e49640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc4010d3a0 0x7efc4019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc46e49640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc40111b00 con 0x7efc4010d3a0 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc46e49640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc40111980 con 0x7efc40102b10 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc46e49640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efc40111c80 con 0x7efc40108a40 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc4010d3a0 0x7efc4019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc4010d3a0 0x7efc4019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55454/0 (socket says 172.21.15.80:55454) 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 -- 172.21.15.80:0/3897041960 learned_addr learned my addr 172.21.15.80:0/3897041960 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc3ffff640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc40108a40 0x7efc40198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc44be5640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40102b10 0x7efc40198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 -- 172.21.15.80:0/3897041960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc40108a40 msgr2=0x7efc40198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc40108a40 0x7efc40198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 -- 172.21.15.80:0/3897041960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40102b10 msgr2=0x7efc40198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40102b10 0x7efc40198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 -- 172.21.15.80:0/3897041960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4019d380 con 0x7efc4010d3a0 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.072+0000 7efc453e6640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc4010d3a0 0x7efc4019cd40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efc3800eb10 tx=0x7efc3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.073+0000 7efc3dffb640 1 -- 172.21.15.80:0/3897041960 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38004b20 con 0x7efc4010d3a0 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.073+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4019d670 con 0x7efc4010d3a0 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.073+0000 7efc3dffb640 1 -- 172.21.15.80:0/3897041960 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc38004cc0 con 0x7efc4010d3a0 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.073+0000 7efc3dffb640 1 -- 172.21.15.80:0/3897041960 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38010670 con 0x7efc4010d3a0 2024-04-25T11:25:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.073+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4019db70 con 0x7efc4010d3a0 2024-04-25T11:25:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.075+0000 7efc3dffb640 1 -- 172.21.15.80:0/3897041960 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7efc38010830 con 0x7efc4010d3a0 2024-04-25T11:25:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.075+0000 7efc4ddd5740 1 Processor -- start 2024-04-25T11:25:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc4ddd5740 1 -- start start 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccb06390 0x556bccea6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bccea6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccae56b0 0x556bcceb38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556bcce0cd80 con 0x556bccadd4d0 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556bccdc68b0 con 0x556bccae56b0 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556bcce08d40 con 0x556bccb06390 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bccea6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bccea6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55466/0 (socket says 172.21.15.80:55466) 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 -- 172.21.15.80:0/2569565147 learned_addr learned my addr 172.21.15.80:0/2569565147 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc3dffb640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc300afc60 0x7efc300b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc3ffff640 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccb06390 0x556bccea6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc453e6640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc300afc60 0x7efc300b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc3ffff640 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccae56b0 0x556bcceb38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 -- 172.21.15.80:0/2569565147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccb06390 msgr2=0x556bccea6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccb06390 0x556bccea6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 -- 172.21.15.80:0/2569565147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccae56b0 msgr2=0x556bcceb38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccae56b0 0x556bcceb38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc44be5640 1 -- 172.21.15.80:0/2569565147 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bccd97a40 con 0x556bccadd4d0 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc3ffff640 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccb06390 0x556bccea6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.076+0000 7efc3dffb640 1 -- 172.21.15.80:0/3897041960 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7efc380df670 con 0x7efc4010d3a0 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.077+0000 7efc44be5640 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bccea6fa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efc34009900 tx=0x7efc34005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb3780bb64f389d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.077+0000 7efc453e6640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc300afc60 0x7efc300b2170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc380a7520 tx=0x7efc38075080 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.077+0000 7efc2affd640 1 -- 172.21.15.80:0/2569565147 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34041070 con 0x556bccadd4d0 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.077+0000 7efc2affd640 1 -- 172.21.15.80:0/2569565147 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc34034e20 con 0x556bccadd4d0 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.077+0000 7efc2affd640 1 -- 172.21.15.80:0/2569565147 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34037070 con 0x556bccadd4d0 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 -- 172.21.15.80:0/2569565147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 msgr2=0x556bccea6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bccea6fa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efc34009900 tx=0x7efc34005e60 comp rx=0 tx=0).stop 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 -- 172.21.15.80:0/2569565147 shutdown_connections 2024-04-25T11:25:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bccea6fa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccae56b0 0x556bcceb38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/2569565147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccb06390 0x556bccea6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 -- 172.21.15.80:0/2569565147 >> 172.21.15.80:0/2569565147 conn(0x556bccafa4e0 msgr2=0x556bccea3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 -- 172.21.15.80:0/2569565147 shutdown_connections 2024-04-25T11:25:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.078+0000 7efc4ddd5740 1 -- 172.21.15.80:0/2569565147 wait complete. 2024-04-25T11:25:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 -- start start 2024-04-25T11:25:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 Processor -- start 2024-04-25T11:25:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bcceb3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccb06390 0x556bcceb14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556bcceb3f80 con 0x556bccadd4d0 2024-04-25T11:25:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556bccd93d10 con 0x556bccb06390 2024-04-25T11:25:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556bcceb4100 con 0x556bccae56b0 2024-04-25T11:25:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc4ddd5740 10 client.0 _ll_register_callbacks cb 0x556bccdc0210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bcceb3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bcceb3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55472/0 (socket says 172.21.15.80:55472) 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc3ffff640 1 -- 172.21.15.80:0/1048840409 learned_addr learned my addr 172.21.15.80:0/1048840409 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.079+0000 7efc44be5640 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc3ffff640 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccb06390 0x556bcceb14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc3ffff640 1 -- 172.21.15.80:0/1048840409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 msgr2=0x556bcceb3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc3ffff640 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc3ffff640 1 -- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccb06390 msgr2=0x556bcceb14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc3ffff640 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccb06390 0x556bcceb14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc3ffff640 1 -- 172.21.15.80:0/1048840409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bccbe87d0 con 0x556bccadd4d0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc3ffff640 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bcceb3040 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efc40075fd0 tx=0x7efc2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bcb79832813460 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc1ffff640 1 -- 172.21.15.80:0/1048840409 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c01b040 con 0x556bccadd4d0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc1ffff640 1 -- 172.21.15.80:0/1048840409 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7efc2c010cf0 con 0x556bccadd4d0 2024-04-25T11:25:57.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc34034e20 con 0x556bccadd4d0 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc1ffff640 1 -- 172.21.15.80:0/1048840409 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc2c028050 con 0x556bccadd4d0 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc4ddd5740 10 client.16020 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556bccb1e3f0 con 0x556bccadd4d0 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.080+0000 7efc1ffff640 1 -- 172.21.15.80:0/1048840409 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc34034e20 con 0x556bccadd4d0 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc1ffff640 1 -- 172.21.15.80:0/1048840409 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7efc2c0048c0 con 0x556bccadd4d0 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc4ddd5740 10 client.16020 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc4ddd5740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc4ddd5740 20 client.16020 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccac4f60 0x556bccec3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc4ddd5740 4 client.16020 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bcce1a990 con 0x556bccac4f60 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc44be5640 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccac4f60 0x556bccec3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc1ffff640 10 client.16020 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:57.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.081+0000 7efc44be5640 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccac4f60 0x556bccec3670 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30ba2060545f72ad server_cookie=dbc904e665a0d010 in_seq=0 out_seq=0 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc1ffff640 1 -- 172.21.15.80:0/1048840409 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556bcce1a990 con 0x556bccac4f60 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc1ffff640 10 client.16020 handle_command_reply: tid=0 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 client.16020 shutdown 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 msgr2=0x556bcceb3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bcceb3040 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efc40075fd0 tx=0x7efc2c0046c0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 shutdown_connections 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccac4f60 0x556bccec3670 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccb06390 0x556bcceb14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc1ffff640 0 client.16020 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/1048840409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccadd4d0 0x556bcceb3040 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.082+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 >> 172.21.15.80:0/1048840409 conn(0x556bccafa4e0 msgr2=0x556bccea8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.083+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 shutdown_connections 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.083+0000 7efc4ddd5740 1 -- 172.21.15.80:0/1048840409 wait complete. 2024-04-25T11:25:57.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.083+0000 7efc4ddd5740 20 client.16020 trim_cache size 0 max 16384 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 Processor -- start 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 -- start start 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceafdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bccec8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc401afe70 con 0x556bccac4f60 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc401ad740 con 0x556bccadd4d0 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efc401ab590 con 0x556bccae56b0 2024-04-25T11:25:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceafdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceafdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55480/0 (socket says 172.21.15.80:55480) 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 -- 172.21.15.80:0/849520516 learned_addr learned my addr 172.21.15.80:0/849520516 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc44be5640 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bccec8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 -- 172.21.15.80:0/849520516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 msgr2=0x556bccec8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bccec8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 -- 172.21.15.80:0/849520516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 msgr2=0x556bcceb02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.113+0000 7efc3ffff640 1 -- 172.21.15.80:0/849520516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bccade0f0 con 0x556bccac4f60 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.114+0000 7efc3ffff640 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceafdb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00bd00 tx=0x7efc2c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874a3d0318b0822f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.114+0000 7efc2a7fc640 1 -- 172.21.15.80:0/849520516 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c005850 con 0x556bccac4f60 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.114+0000 7efc2a7fc640 1 -- 172.21.15.80:0/849520516 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc2c012660 con 0x556bccac4f60 2024-04-25T11:25:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.114+0000 7efc2a7fc640 1 -- 172.21.15.80:0/849520516 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c005060 con 0x556bccac4f60 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 -- 172.21.15.80:0/849520516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 msgr2=0x556bcceafdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceafdb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00bd00 tx=0x7efc2c00b4a0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 -- 172.21.15.80:0/849520516 shutdown_connections 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bccec8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/849520516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceafdb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 -- 172.21.15.80:0/849520516 >> 172.21.15.80:0/849520516 conn(0x556bccafa4e0 msgr2=0x556bcceac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 -- 172.21.15.80:0/849520516 shutdown_connections 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 -- 172.21.15.80:0/849520516 wait complete. 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 -- start start 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.115+0000 7efc4ddd5740 1 Processor -- start 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceb9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc4ddd5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc401abc00 con 0x556bccac4f60 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc401ad070 con 0x556bccadd4d0 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc4ddd5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efc401ac2d0 con 0x556bccae56b0 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc4ddd5740 10 client.0 _ll_register_callbacks cb 0x7efc2c00baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceb9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceb9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55488/0 (socket says 172.21.15.80:55488) 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 -- 172.21.15.80:0/961783963 learned_addr learned my addr 172.21.15.80:0/961783963 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:25:57.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc44be5640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 -- 172.21.15.80:0/961783963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 msgr2=0x556bcceb6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 -- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 msgr2=0x556bcceb9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 -- 172.21.15.80:0/961783963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bccdcd4b0 con 0x556bccac4f60 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc44be5640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc3ffff640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceb9350 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efc2c006010 tx=0x7efc2c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9763d4d1d9032ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.116+0000 7efc1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc1ffff640 1 -- 172.21.15.80:0/961783963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c03c060 con 0x556bccac4f60 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc1ffff640 1 -- 172.21.15.80:0/961783963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7efc2c0048c0 con 0x556bccac4f60 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc2c012660 con 0x556bccac4f60 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc1ffff640 1 -- 172.21.15.80:0/961783963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc2c025070 con 0x556bccac4f60 2024-04-25T11:25:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 10 client.16026 fetch_fsmap learned FSMap version 24 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556bccf2b1a0 con 0x556bccac4f60 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc1ffff640 1 -- 172.21.15.80:0/961783963 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc2c012660 con 0x556bccac4f60 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc1ffff640 1 -- 172.21.15.80:0/961783963 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7efc2c036070 con 0x556bccac4f60 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 10 client.16026 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 20 client.16026 populate_metadata read hostname 'smithi080' 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccb06390 0x556bccf2d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 4 client.16026 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556bcce14800 con 0x556bccb06390 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.117+0000 7efc44be5640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccb06390 0x556bccf2d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc1ffff640 10 client.16026 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc44be5640 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccb06390 0x556bccf2d810 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1b4cc8a22fcf15 server_cookie=971e0b7c8e926e0a in_seq=0 out_seq=0 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc1ffff640 1 -- 172.21.15.80:0/961783963 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556bcce14800 con 0x556bccb06390 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc1ffff640 10 client.16026 handle_command_reply: tid=0 2024-04-25T11:25:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 client.16026 shutdown 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 msgr2=0x556bcceb9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceb9350 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efc2c006010 tx=0x7efc2c005bb0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 shutdown_connections 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556bccb06390 0x556bccf2d810 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556bccae56b0 0x556bcceb6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc1ffff640 0 client.16026 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556bccadd4d0 0x556bcceb9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 --2- 172.21.15.80:0/961783963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556bccac4f60 0x556bcceb9350 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 >> 172.21.15.80:0/961783963 conn(0x556bccafa4e0 msgr2=0x556bccea8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.118+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 shutdown_connections 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc4ddd5740 1 -- 172.21.15.80:0/961783963 wait complete. 2024-04-25T11:25:57.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc4ddd5740 20 client.16026 trim_cache size 0 max 16384 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: "8634c6e0-5d20-4a6f-8d57-9f5960bd8650": { 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "8634c6e0-5d20-4a6f-8d57-9f5960bd8650", 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:25:57.118 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:25:57.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc300afc60 msgr2=0x7efc300b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc300afc60 0x7efc300b2170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc380a7520 tx=0x7efc38075080 comp rx=0 tx=0).stop 2024-04-25T11:25:57.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc4010d3a0 msgr2=0x7efc4019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:25:57.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc4010d3a0 0x7efc4019cd40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efc3800eb10 tx=0x7efc3800c2d0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 shutdown_connections 2024-04-25T11:25:57.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc300afc60 0x7efc300b2170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc4010d3a0 0x7efc4019cd40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc40108a40 0x7efc40198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 --2- 172.21.15.80:0/3897041960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc40102b10 0x7efc40198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:25:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 >> 172.21.15.80:0/3897041960 conn(0x7efc40078180 msgr2=0x7efc401040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:25:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 shutdown_connections 2024-04-25T11:25:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:25:57.119+0000 7efc46e49640 1 -- 172.21.15.80:0/3897041960 wait complete. 2024-04-25T11:25:57.124 INFO:tasks.cephfs.filesystem:scrub status for tag:8634c6e0-5d20-4a6f-8d57-9f5960bd8650 - {'path': '/', 'tag': '8634c6e0-5d20-4a6f-8d57-9f5960bd8650', 'options': 'recursive,force'} 2024-04-25T11:25:58.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:57 smithi196 ceph-mon[32659]: pgmap v55: 97 pgs: 97 active+clean; 2.5 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 782 KiB/s wr, 15 op/s 2024-04-25T11:25:58.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:57 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:25:58.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:57 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:58.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:57 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:25:58.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:57 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:58.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:57 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:25:58.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:57 smithi082 ceph-mon[32440]: pgmap v55: 97 pgs: 97 active+clean; 2.5 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 782 KiB/s wr, 15 op/s 2024-04-25T11:25:58.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:57 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:25:58.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:57 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:58.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:57 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:25:58.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:57 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:58.243 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:57 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:25:58.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:57 smithi080 ceph-mon[29126]: pgmap v55: 97 pgs: 97 active+clean; 2.5 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 782 KiB/s wr, 15 op/s 2024-04-25T11:25:58.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:57 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:25:58.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:57 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:58.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:57 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:25:58.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:57 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:25:58.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:57 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:26:00.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:25:59 smithi196 ceph-mon[32659]: pgmap v56: 97 pgs: 97 active+clean; 2.5 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 781 KiB/s wr, 11 op/s 2024-04-25T11:26:00.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:25:59 smithi082 ceph-mon[32440]: pgmap v56: 97 pgs: 97 active+clean; 2.5 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 781 KiB/s wr, 11 op/s 2024-04-25T11:26:00.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:25:59 smithi080 ceph-mon[29126]: pgmap v56: 97 pgs: 97 active+clean; 2.5 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 781 KiB/s wr, 11 op/s 2024-04-25T11:26:02.877 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:02 smithi080 ceph-mon[29126]: pgmap v57: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 30 op/s 2024-04-25T11:26:02.938 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:02 smithi196 ceph-mon[32659]: pgmap v57: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 30 op/s 2024-04-25T11:26:02.992 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:02 smithi082 ceph-mon[32440]: pgmap v57: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 30 op/s 2024-04-25T11:26:04.877 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:04 smithi080 ceph-mon[29126]: pgmap v58: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 919 KiB/s wr, 25 op/s 2024-04-25T11:26:04.938 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:04 smithi196 ceph-mon[32659]: pgmap v58: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 919 KiB/s wr, 25 op/s 2024-04-25T11:26:04.992 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:04 smithi082 ceph-mon[32440]: pgmap v58: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 919 KiB/s wr, 25 op/s 2024-04-25T11:26:06.877 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:06 smithi080 ceph-mon[29126]: pgmap v59: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 919 KiB/s wr, 25 op/s 2024-04-25T11:26:06.938 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:06 smithi196 ceph-mon[32659]: pgmap v59: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 919 KiB/s wr, 25 op/s 2024-04-25T11:26:06.992 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:06 smithi082 ceph-mon[32440]: pgmap v59: 97 pgs: 97 active+clean; 117 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 919 KiB/s wr, 25 op/s 2024-04-25T11:26:07.876 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:07 smithi080 ceph-mon[29126]: pgmap v60: 97 pgs: 97 active+clean; 255 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.6 MiB/s wr, 362 op/s 2024-04-25T11:26:07.938 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:07 smithi196 ceph-mon[32659]: pgmap v60: 97 pgs: 97 active+clean; 255 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.6 MiB/s wr, 362 op/s 2024-04-25T11:26:07.992 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:07 smithi082 ceph-mon[32440]: pgmap v60: 97 pgs: 97 active+clean; 255 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.6 MiB/s wr, 362 op/s 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 -- 172.21.15.80:0/1878309770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f541031e0 msgr2=0x7f1f5410f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/1878309770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f541031e0 0x7f1f5410f5b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009ca0 tx=0x7f1f4c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 -- 172.21.15.80:0/1878309770 shutdown_connections 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/1878309770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f541031e0 0x7f1f5410f5b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/1878309770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f54108f30 0x7f1f54102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/1878309770 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f54108a90 0x7f1f54102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 -- 172.21.15.80:0/1878309770 >> 172.21.15.80:0/1878309770 conn(0x7f1f54078080 msgr2=0x7f1f540784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 -- 172.21.15.80:0/1878309770 shutdown_connections 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.689+0000 7f1f5bed1640 1 -- 172.21.15.80:0/1878309770 wait complete. 2024-04-25T11:26:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 Processor -- start 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 -- start start 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f541031e0 0x7f1f5419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f54108a90 0x7f1f5419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f54108f30 0x7f1f5419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54113da0 con 0x7f1f54108f30 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54113c20 con 0x7f1f541031e0 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5bed1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54113f20 con 0x7f1f54108a90 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f59c6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f541031e0 0x7f1f5419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f59c6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f541031e0 0x7f1f5419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:45200/0 (socket says 172.21.15.80:45200) 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f59c6d640 1 -- 172.21.15.80:0/4250518708 learned_addr learned my addr 172.21.15.80:0/4250518708 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f54108f30 0x7f1f5419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.690+0000 7f1f5946c640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f54108a90 0x7f1f5419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f59c6d640 1 -- 172.21.15.80:0/4250518708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f54108a90 msgr2=0x7f1f5419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f59c6d640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f54108a90 0x7f1f5419ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f59c6d640 1 -- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f54108f30 msgr2=0x7f1f5419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f59c6d640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f54108f30 0x7f1f5419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f59c6d640 1 -- 172.21.15.80:0/4250518708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5419f5e0 con 0x7f1f541031e0 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f5946c640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f54108a90 0x7f1f5419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f59c6d640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f541031e0 0x7f1f5419a780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000e9f0 tx=0x7f1f5000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f4affd640 1 -- 172.21.15.80:0/4250518708 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000ccc0 con 0x7f1f541031e0 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5419f8d0 con 0x7f1f541031e0 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f4affd640 1 -- 172.21.15.80:0/4250518708 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f500054d0 con 0x7f1f541031e0 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f4affd640 1 -- 172.21.15.80:0/4250518708 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50010430 con 0x7f1f541031e0 2024-04-25T11:26:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.691+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f541a7250 con 0x7f1f541031e0 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 Processor -- start 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 -- start start 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f4affd640 1 -- 172.21.15.80:0/4250518708 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1f500046c0 con 0x7f1f541031e0 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780ad8daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9c52f0 0x55780ad8e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9cd4d0 0x55780ad8e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55780acf4460 con 0x55780a9ee1b0 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55780acae590 con 0x55780a9c52f0 2024-04-25T11:26:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.694+0000 7f1f62d80740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55780acf0420 con 0x55780a9cd4d0 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780ad8daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f59c6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9c52f0 0x55780ad8e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780ad8daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44384/0 (socket says 172.21.15.80:44384) 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3823870601 learned_addr learned my addr 172.21.15.80:0/3823870601 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5946c640 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9cd4d0 0x55780ad8e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3823870601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9cd4d0 msgr2=0x55780ad8e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9cd4d0 0x55780ad8e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3823870601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9c52f0 msgr2=0x55780ad8e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9c52f0 0x55780ad8e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3823870601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780acbb0d0 con 0x55780a9ee1b0 2024-04-25T11:26:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5946c640 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9cd4d0 0x55780ad8e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780ad8daf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c02f410 tx=0x7f1f4c02f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73f349d90353b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f4affd640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1f400afc50 0x7f1f400b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.695+0000 7f1f3ffff640 1 -- 172.21.15.80:0/3823870601 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c031cf0 con 0x55780a9ee1b0 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.696+0000 7f1f3ffff640 1 -- 172.21.15.80:0/3823870601 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c036030 con 0x55780a9ee1b0 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.696+0000 7f1f3ffff640 1 -- 172.21.15.80:0/3823870601 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c004280 con 0x55780a9ee1b0 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.696+0000 7f1f59c6d640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1f400afc50 0x7f1f400b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.696+0000 7f1f4affd640 1 -- 172.21.15.80:0/4250518708 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1f500df390 con 0x7f1f541031e0 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 -- 172.21.15.80:0/3823870601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 msgr2=0x55780ad8daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780ad8daf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c02f410 tx=0x7f1f4c02f440 comp rx=0 tx=0).stop 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f59c6d640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1f400afc50 0x7f1f400b2160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f500dcba0 tx=0x7f1f500e18a0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 -- 172.21.15.80:0/3823870601 shutdown_connections 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9cd4d0 0x55780ad8e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9c52f0 0x55780ad8e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3823870601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780ad8daf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 -- 172.21.15.80:0/3823870601 >> 172.21.15.80:0/3823870601 conn(0x55780a9e2300 msgr2=0x55780ad8a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 -- 172.21.15.80:0/3823870601 shutdown_connections 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 -- 172.21.15.80:0/3823870601 wait complete. 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 -- start start 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.697+0000 7f1f62d80740 1 Processor -- start 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad981b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad98710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ad9df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f62d80740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55780ad9aa40 con 0x55780a9c52f0 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f62d80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55780ac7bb60 con 0x55780a9cd4d0 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f62d80740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55780ad9abc0 con 0x55780a9ee1b0 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f62d80740 10 client.0 _ll_register_callbacks cb 0x55780aca02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44392/0 (socket says 172.21.15.80:44392) 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5a46e640 1 -- 172.21.15.80:0/978990066 learned_addr learned my addr 172.21.15.80:0/978990066 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5946c640 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad98710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ad9df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5946c640 1 -- 172.21.15.80:0/978990066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 msgr2=0x55780ad9df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5946c640 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ad9df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5946c640 1 -- 172.21.15.80:0/978990066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 msgr2=0x55780ad981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5946c640 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.698+0000 7f1f5946c640 1 -- 172.21.15.80:0/978990066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55780aa06210 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.699+0000 7f1f5946c640 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad98710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f54109360 tx=0x7f1f4400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be3217f49cc01c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.699+0000 7f1f3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/978990066 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f440120d0 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/978990066 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1f44004030 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4c036030 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/978990066 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1f44012270 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 10 client.25598 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55780aad2620 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/978990066 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c036030 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/978990066 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1f4401c460 con 0x55780a9cd4d0 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 10 client.25598 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 10 client.25598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 20 client.25598 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9acd80 0x55780adaa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 4 client.25598 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55780ad02070 con 0x55780a9acd80 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.700+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9acd80 0x55780adaa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.701+0000 7f1f3d7fa640 10 client.25598 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.701+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9acd80 0x55780adaa630 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7caee1a18806b29 server_cookie=32e121246909f98a in_seq=0 out_seq=0 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.702+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/978990066 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55780ad02070 con 0x55780a9acd80 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.702+0000 7f1f3d7fa640 10 client.25598 handle_command_reply: tid=0 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.702+0000 7f1f62d80740 1 client.25598 shutdown 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 msgr2=0x55780ad98710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad98710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f54109360 tx=0x7f1f4400f790 comp rx=0 tx=0).stop 2024-04-25T11:26:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 shutdown_connections 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9acd80 0x55780adaa630 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ad9df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad98710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 --2- 172.21.15.80:0/978990066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f3d7fa640 0 client.25598 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 >> 172.21.15.80:0/978990066 conn(0x55780a9e2300 msgr2=0x55780ad8d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 shutdown_connections 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 1 -- 172.21.15.80:0/978990066 wait complete. 2024-04-25T11:26:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.703+0000 7f1f62d80740 20 client.25598 trim_cache size 0 max 16384 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 Processor -- start 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 -- start start 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9c52f0 0x55780ad98690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad9de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780adafe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b22b0 con 0x55780a9ee1b0 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541afb80 con 0x55780a9cd4d0 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f62d80740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541ad9d0 con 0x55780a9c52f0 2024-04-25T11:26:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9c52f0 0x55780ad98690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9c52f0 0x55780ad98690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:51436/0 (socket says 172.21.15.80:51436) 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3580268280 learned_addr learned my addr 172.21.15.80:0/3580268280 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780adafe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.720+0000 7f1f5946c640 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad9de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3580268280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 msgr2=0x55780ad9de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad9de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3580268280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 msgr2=0x55780adafe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780adafe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f5a46e640 1 -- 172.21.15.80:0/3580268280 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780ad8ebd0 con 0x55780a9c52f0 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9c52f0 0x55780ad98690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c005e30 tx=0x7f1f4c02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b45d4885df2090e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f3f7fe640 1 -- 172.21.15.80:0/3580268280 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c031bb0 con 0x55780a9c52f0 2024-04-25T11:26:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f3f7fe640 1 -- 172.21.15.80:0/3580268280 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c036050 con 0x55780a9c52f0 2024-04-25T11:26:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.721+0000 7f1f3f7fe640 1 -- 172.21.15.80:0/3580268280 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c02fbb0 con 0x55780a9c52f0 2024-04-25T11:26:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 -- 172.21.15.80:0/3580268280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9c52f0 msgr2=0x55780ad98690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9c52f0 0x55780ad98690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c005e30 tx=0x7f1f4c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 -- 172.21.15.80:0/3580268280 shutdown_connections 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9ee1b0 0x55780adafe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ad9de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 --2- 172.21.15.80:0/3580268280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9c52f0 0x55780ad98690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 -- 172.21.15.80:0/3580268280 >> 172.21.15.80:0/3580268280 conn(0x55780a9e2300 msgr2=0x55780ad97f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 -- 172.21.15.80:0/3580268280 shutdown_connections 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 -- 172.21.15.80:0/3580268280 wait complete. 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 -- start start 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.722+0000 7f1f62d80740 1 Processor -- start 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad9fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ada0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f62d80740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ada0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f62d80740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541ae040 con 0x55780a9c52f0 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f62d80740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541af4b0 con 0x55780a9cd4d0 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f62d80740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541ae710 con 0x55780a9ee1b0 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f62d80740 10 client.0 _ll_register_callbacks cb 0x7f1f44012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad9fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5946c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ada0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad9fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44410/0 (socket says 172.21.15.80:44410) 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 -- 172.21.15.80:0/449285499 learned_addr learned my addr 172.21.15.80:0/449285499 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ada0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 -- 172.21.15.80:0/449285499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 msgr2=0x55780ada0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ada0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 -- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 msgr2=0x55780ada0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ada0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 -- 172.21.15.80:0/449285499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55780ae11ae0 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5946c640 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ada0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f5a46e640 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad9fce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009620 tx=0x7f1f4c02f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57be957ce3978dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.723+0000 7f1f3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/449285499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c069060 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/449285499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1f4c031bb0 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4c036050 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/449285499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1f4c031db0 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 10 client.16044 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55780ae12d30 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/449285499 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c036050 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/449285499 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1f4c043070 con 0x55780a9c52f0 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 10 client.16044 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 10 client.16044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 20 client.16044 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9821c0 0x55780ae15100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 4 client.16044 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:26:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55780acfbee0 con 0x55780a9821c0 2024-04-25T11:26:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.724+0000 7f1f5946c640 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9821c0 0x55780ae15100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.725+0000 7f1f3d7fa640 10 client.16044 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.725+0000 7f1f5946c640 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9821c0 0x55780ae15100 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6210fe978b32cb21 server_cookie=ee4d80400b0b9913 in_seq=0 out_seq=0 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.734+0000 7f1f3d7fa640 1 -- 172.21.15.80:0/449285499 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55780acfbee0 con 0x55780a9821c0 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.734+0000 7f1f3d7fa640 10 client.16044 handle_command_reply: tid=0 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.734+0000 7f1f62d80740 1 client.16044 shutdown 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 msgr2=0x55780ad9fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad9fce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009620 tx=0x7f1f4c02f850 comp rx=0 tx=0).stop 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 shutdown_connections 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55780a9821c0 0x55780ae15100 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55780a9ee1b0 0x55780ada0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780a9cd4d0 0x55780ada0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f3d7fa640 0 client.16044 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 --2- 172.21.15.80:0/449285499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55780a9c52f0 0x55780ad9fce0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 >> 172.21.15.80:0/449285499 conn(0x55780a9e2300 msgr2=0x55780ad8d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 shutdown_connections 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 1 -- 172.21.15.80:0/449285499 wait complete. 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.735+0000 7f1f62d80740 20 client.16044 trim_cache size 0 max 16384 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:26:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:26:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1f400afc50 msgr2=0x7f1f400b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1f400afc50 0x7f1f400b2160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f500dcba0 tx=0x7f1f500e18a0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f541031e0 msgr2=0x7f1f5419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f541031e0 0x7f1f5419a780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000e9f0 tx=0x7f1f5000eeb0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 shutdown_connections 2024-04-25T11:26:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1f400afc50 0x7f1f400b2160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f54108f30 0x7f1f5419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f54108a90 0x7f1f5419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 --2- 172.21.15.80:0/4250518708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f541031e0 0x7f1f5419a780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 >> 172.21.15.80:0/4250518708 conn(0x7f1f54078080 msgr2=0x7f1f540ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 shutdown_connections 2024-04-25T11:26:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:08.736+0000 7f1f5bed1640 1 -- 172.21.15.80:0/4250518708 wait complete. 2024-04-25T11:26:10.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:09 smithi080 ceph-mon[29126]: pgmap v61: 97 pgs: 97 active+clean; 255 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.2 MiB/s wr, 355 op/s 2024-04-25T11:26:10.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:09 smithi196 ceph-mon[32659]: pgmap v61: 97 pgs: 97 active+clean; 255 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.2 MiB/s wr, 355 op/s 2024-04-25T11:26:10.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:09 smithi082 ceph-mon[32440]: pgmap v61: 97 pgs: 97 active+clean; 255 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.2 MiB/s wr, 355 op/s 2024-04-25T11:26:12.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:11 smithi080 ceph-mon[29126]: pgmap v62: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 682 op/s 2024-04-25T11:26:12.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:11 smithi196 ceph-mon[32659]: pgmap v62: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 682 op/s 2024-04-25T11:26:12.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:11 smithi082 ceph-mon[32440]: pgmap v62: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 682 op/s 2024-04-25T11:26:14.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:13 smithi080 ceph-mon[29126]: pgmap v63: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 664 op/s 2024-04-25T11:26:14.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:13 smithi196 ceph-mon[32659]: pgmap v63: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 664 op/s 2024-04-25T11:26:14.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:13 smithi082 ceph-mon[32440]: pgmap v63: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 664 op/s 2024-04-25T11:26:16.126 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:15 smithi080 ceph-mon[29126]: pgmap v64: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 664 op/s 2024-04-25T11:26:16.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:15 smithi196 ceph-mon[32659]: pgmap v64: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 664 op/s 2024-04-25T11:26:16.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:15 smithi082 ceph-mon[32440]: pgmap v64: 97 pgs: 97 active+clean; 258 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 664 op/s 2024-04-25T11:26:18.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:17 smithi080 ceph-mon[29126]: pgmap v65: 97 pgs: 97 active+clean; 259 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.8 MiB/s wr, 1.12k op/s 2024-04-25T11:26:18.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:17 smithi196 ceph-mon[32659]: pgmap v65: 97 pgs: 97 active+clean; 259 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.8 MiB/s wr, 1.12k op/s 2024-04-25T11:26:18.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:17 smithi082 ceph-mon[32440]: pgmap v65: 97 pgs: 97 active+clean; 259 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.8 MiB/s wr, 1.12k op/s 2024-04-25T11:26:20.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:19 smithi080 ceph-mon[29126]: pgmap v66: 97 pgs: 97 active+clean; 259 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 781 op/s 2024-04-25T11:26:20.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:19 smithi196 ceph-mon[32659]: pgmap v66: 97 pgs: 97 active+clean; 259 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 781 op/s 2024-04-25T11:26:20.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:19 smithi082 ceph-mon[32440]: pgmap v66: 97 pgs: 97 active+clean; 259 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 781 op/s 2024-04-25T11:26:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 -- 172.21.15.80:0/737863629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b8108a80 msgr2=0x7f96b8102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 --2- 172.21.15.80:0/737863629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b8108a80 0x7f96b8102620 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009900 tx=0x7f96a802a410 comp rx=0 tx=0).stop 2024-04-25T11:26:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 -- 172.21.15.80:0/737863629 shutdown_connections 2024-04-25T11:26:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 --2- 172.21.15.80:0/737863629 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b81031d0 0x7f96b810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 --2- 172.21.15.80:0/737863629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b8108f20 0x7f96b8102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 --2- 172.21.15.80:0/737863629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b8108a80 0x7f96b8102620 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 -- 172.21.15.80:0/737863629 >> 172.21.15.80:0/737863629 conn(0x7f96b8078150 msgr2=0x7f96b8078590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 -- 172.21.15.80:0/737863629 shutdown_connections 2024-04-25T11:26:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.844+0000 7f96bca42640 1 -- 172.21.15.80:0/737863629 wait complete. 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 Processor -- start 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 -- start start 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b81031d0 0x7f96b819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b8108a80 0x7f96b819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b8108f20 0x7f96b819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8112c70 con 0x7f96b81031d0 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8112af0 con 0x7f96b8108a80 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.845+0000 7f96bca42640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8112df0 con 0x7f96b8108f20 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b81031d0 0x7f96b819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b81031d0 0x7f96b819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54822/0 (socket says 172.21.15.80:54822) 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b8108a80 0x7f96b819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 -- 172.21.15.80:0/1273263532 learned_addr learned my addr 172.21.15.80:0/1273263532 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b8108f20 0x7f96b819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 -- 172.21.15.80:0/1273263532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b8108f20 msgr2=0x7f96b819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b8108f20 0x7f96b819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 -- 172.21.15.80:0/1273263532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b8108a80 msgr2=0x7f96b819ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b8108a80 0x7f96b819ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 -- 172.21.15.80:0/1273263532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b819f640 con 0x7f96b81031d0 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96b659c640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b81031d0 0x7f96b819a7e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f96a8032fd0 tx=0x7f96a8031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96a77fe640 1 -- 172.21.15.80:0/1273263532 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a803f030 con 0x7f96b81031d0 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96a77fe640 1 -- 172.21.15.80:0/1273263532 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96a8004490 con 0x7f96b81031d0 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b819f8d0 con 0x7f96b81031d0 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96a77fe640 1 -- 172.21.15.80:0/1273263532 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8035070 con 0x7f96b81031d0 2024-04-25T11:26:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.846+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b819fdc0 con 0x7f96b81031d0 2024-04-25T11:26:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 Processor -- start 2024-04-25T11:26:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 -- start start 2024-04-25T11:26:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d231b0 0x5616d80c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5616d8029460 con 0x5616d7d024d0 2024-04-25T11:26:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616d7fe3590 con 0x5616d7d231b0 2024-04-25T11:26:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.850+0000 7f96c39d0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5616d8025420 con 0x5616d7cfa2f0 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d231b0 0x5616d80c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96a77fe640 1 -- 172.21.15.80:0/1273263532 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f96a8042030 con 0x7f96b81031d0 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d231b0 0x5616d80c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:50940/0 (socket says 172.21.15.80:50940) 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b6d9d640 1 -- 172.21.15.80:0/1454435592 learned_addr learned my addr 172.21.15.80:0/1454435592 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b659c640 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b6d9d640 1 -- 172.21.15.80:0/1454435592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 msgr2=0x5616d80c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.851+0000 7f96b6d9d640 1 -- 172.21.15.80:0/1454435592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 msgr2=0x5616d80c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96b6d9d640 1 -- 172.21.15.80:0/1454435592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d7ff00d0 con 0x5616d7d231b0 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96a77fe640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f96a00afc50 0x7f96a00b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96b659c640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f96a00afc50 0x7f96a00b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d231b0 0x5616d80c3fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009fd0 tx=0x7f96b00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=196a6365c99e4935 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96a77fe640 1 -- 172.21.15.80:0/1273263532 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f96a80ff390 con 0x7f96b81031d0 2024-04-25T11:26:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96a4ff9640 1 -- 172.21.15.80:0/1454435592 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0004d20 con 0x5616d7d231b0 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96a4ff9640 1 -- 172.21.15.80:0/1454435592 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96b0004050 con 0x5616d7d231b0 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.852+0000 7f96a4ff9640 1 -- 172.21.15.80:0/1454435592 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0005260 con 0x5616d7d231b0 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 -- 172.21.15.80:0/1454435592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d231b0 msgr2=0x5616d80c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96b659c640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f96a00afc50 0x7f96a00b2160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5616d80c9a00 tx=0x7f96a803b560 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d231b0 0x5616d80c3fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009fd0 tx=0x7f96b00118d0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 -- 172.21.15.80:0/1454435592 shutdown_connections 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1454435592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d231b0 0x5616d80c3fc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 -- 172.21.15.80:0/1454435592 >> 172.21.15.80:0/1454435592 conn(0x5616d7d17300 msgr2=0x5616d80bf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 -- 172.21.15.80:0/1454435592 shutdown_connections 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.853+0000 7f96c39d0740 1 -- 172.21.15.80:0/1454435592 wait complete. 2024-04-25T11:26:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 -- start start 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 Processor -- start 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7cfa2f0 0x5616d80d5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d024d0 0x5616d80d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7d231b0 0x5616d80e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5616d80d8560 con 0x5616d7cfa2f0 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616d7fb0b60 con 0x5616d7d024d0 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5616d80d86e0 con 0x5616d7d231b0 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96c39d0740 10 client.0 _ll_register_callbacks cb 0x5616d7fd52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7cfa2f0 0x5616d80d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d024d0 0x5616d80d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7cfa2f0 0x5616d80d5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54836/0 (socket says 172.21.15.80:54836) 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b6d9d640 1 -- 172.21.15.80:0/1752017316 learned_addr learned my addr 172.21.15.80:0/1752017316 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7d231b0 0x5616d80e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b5d9b640 1 -- 172.21.15.80:0/1752017316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7d231b0 msgr2=0x5616d80e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7d231b0 0x5616d80e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b5d9b640 1 -- 172.21.15.80:0/1752017316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7cfa2f0 msgr2=0x5616d80d5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.854+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7cfa2f0 0x5616d80d5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f96b5d9b640 1 -- 172.21.15.80:0/1752017316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d7d3b210 con 0x5616d7d024d0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7cfa2f0 0x5616d80d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d024d0 0x5616d80d6200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96b810fa30 tx=0x7f96ac013b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738a4971298fcc6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f969dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f969dffb640 1 -- 172.21.15.80:0/1752017316 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac004030 con 0x5616d7d024d0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b0004050 con 0x5616d7d024d0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f969dffb640 1 -- 172.21.15.80:0/1752017316 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f96ac0041d0 con 0x5616d7d024d0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f969dffb640 1 -- 172.21.15.80:0/1752017316 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96ac0043d0 con 0x5616d7d024d0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f96c39d0740 10 client.25616 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616d7e07620 con 0x5616d7d024d0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.855+0000 7f969dffb640 1 -- 172.21.15.80:0/1752017316 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96b0004050 con 0x5616d7d024d0 2024-04-25T11:26:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f969dffb640 1 -- 172.21.15.80:0/1752017316 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f96ac01b5b0 con 0x5616d7d024d0 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f96c39d0740 10 client.25616 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f96c39d0740 10 client.25616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f96c39d0740 20 client.25616 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7ce1d80 0x5616d80e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f96c39d0740 4 client.25616 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616d8037070 con 0x5616d7ce1d80 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7ce1d80 0x5616d80e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.856+0000 7f969dffb640 10 client.25616 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.857+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7ce1d80 0x5616d80e7f60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba933f8d485455 server_cookie=479f01b611d7f0ac in_seq=0 out_seq=0 2024-04-25T11:26:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.857+0000 7f969dffb640 1 -- 172.21.15.80:0/1752017316 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5616d8037070 con 0x5616d7ce1d80 2024-04-25T11:26:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.857+0000 7f969dffb640 10 client.25616 handle_command_reply: tid=0 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.857+0000 7f96c39d0740 1 client.25616 shutdown 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d024d0 msgr2=0x5616d80d6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d024d0 0x5616d80d6200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96b810fa30 tx=0x7f96ac013b70 comp rx=0 tx=0).stop 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 shutdown_connections 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7ce1d80 0x5616d80e7f60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7d231b0 0x5616d80e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f969dffb640 0 client.25616 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7d024d0 0x5616d80d6200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 --2- 172.21.15.80:0/1752017316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7cfa2f0 0x5616d80d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 >> 172.21.15.80:0/1752017316 conn(0x5616d7d17300 msgr2=0x5616d80bd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 shutdown_connections 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 1 -- 172.21.15.80:0/1752017316 wait complete. 2024-04-25T11:26:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.858+0000 7f96c39d0740 20 client.25616 trim_cache size 0 max 16384 2024-04-25T11:26:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.889+0000 7f96c39d0740 1 Processor -- start 2024-04-25T11:26:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.889+0000 7f96c39d0740 1 -- start start 2024-04-25T11:26:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7ce1d80 0x5616d80e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96c39d0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81b0100 con 0x5616d7d024d0 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96c39d0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ad9d0 con 0x5616d7ce1d80 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96c39d0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ab840 con 0x5616d7cfa2f0 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7ce1d80 0x5616d80e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7ce1d80 0x5616d80e15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:50972/0 (socket says 172.21.15.80:50972) 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 -- 172.21.15.80:0/2702007067 learned_addr learned my addr 172.21.15.80:0/2702007067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 -- 172.21.15.80:0/2702007067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 msgr2=0x5616d80c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 -- 172.21.15.80:0/2702007067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 msgr2=0x5616d80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.890+0000 7f96b6d9d640 1 -- 172.21.15.80:0/2702007067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d80d6970 con 0x5616d7ce1d80 2024-04-25T11:26:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.891+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7ce1d80 0x5616d80e15b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96b0014040 tx=0x7f96b00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a72382dc7c3d61df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.891+0000 7f969ffff640 1 -- 172.21.15.80:0/2702007067 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b00044d0 con 0x5616d7ce1d80 2024-04-25T11:26:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.891+0000 7f969ffff640 1 -- 172.21.15.80:0/2702007067 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96b0004670 con 0x5616d7ce1d80 2024-04-25T11:26:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.891+0000 7f969ffff640 1 -- 172.21.15.80:0/2702007067 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b000f740 con 0x5616d7ce1d80 2024-04-25T11:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 -- 172.21.15.80:0/2702007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7ce1d80 msgr2=0x5616d80e15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7ce1d80 0x5616d80e15b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96b0014040 tx=0x7f96b00118d0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 -- 172.21.15.80:0/2702007067 shutdown_connections 2024-04-25T11:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7cfa2f0 0x5616d80c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 --2- 172.21.15.80:0/2702007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7ce1d80 0x5616d80e15b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 -- 172.21.15.80:0/2702007067 >> 172.21.15.80:0/2702007067 conn(0x5616d7d17300 msgr2=0x5616d80d5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 -- 172.21.15.80:0/2702007067 shutdown_connections 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.892+0000 7f96c39d0740 1 -- 172.21.15.80:0/2702007067 wait complete. 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 -- start start 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 Processor -- start 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7ce1d80 0x5616d80daf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7cfa2f0 0x5616d80db460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d814e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81abe90 con 0x5616d7d024d0 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ad300 con 0x5616d7cfa2f0 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ac560 con 0x5616d7ce1d80 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96c39d0740 10 client.0 _ll_register_callbacks cb 0x7f96ac0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.893+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7cfa2f0 0x5616d80db460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d814e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54850/0 (socket says 172.21.15.80:54850) 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b6d9d640 1 -- 172.21.15.80:0/907696410 learned_addr learned my addr 172.21.15.80:0/907696410 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7cfa2f0 0x5616d80db460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:50982/0 (socket says 172.21.15.80:50982) 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7ce1d80 0x5616d80daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 -- 172.21.15.80:0/907696410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7ce1d80 msgr2=0x5616d80daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7ce1d80 0x5616d80daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 -- 172.21.15.80:0/907696410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 msgr2=0x5616d814e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d814e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 -- 172.21.15.80:0/907696410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d80c9a30 con 0x5616d7cfa2f0 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d814e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96b5d9b640 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7cfa2f0 0x5616d80db460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96ac01ba50 tx=0x7f96ac01be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74cc5a41d5439d21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f969dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f969dffb640 1 -- 172.21.15.80:0/907696410 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac005040 con 0x5616d7cfa2f0 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b0004670 con 0x5616d7cfa2f0 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.894+0000 7f969dffb640 1 -- 172.21.15.80:0/907696410 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f96ac0051e0 con 0x5616d7cfa2f0 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f969dffb640 1 -- 172.21.15.80:0/907696410 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96ac0053e0 con 0x5616d7cfa2f0 2024-04-25T11:26:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 10 client.25622 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616d814f940 con 0x5616d7cfa2f0 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f969dffb640 1 -- 172.21.15.80:0/907696410 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96b0004670 con 0x5616d7cfa2f0 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f969dffb640 1 -- 172.21.15.80:0/907696410 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f96ac02f500 con 0x5616d7cfa2f0 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 10 client.25622 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 10 client.25622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 20 client.25622 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7d231b0 0x5616d81520b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 4 client.25622 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5616d8030ee0 con 0x5616d7d231b0 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.895+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7d231b0 0x5616d81520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.896+0000 7f969dffb640 10 client.25622 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.896+0000 7f96b6d9d640 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7d231b0 0x5616d81520b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af55f515ab49f5d server_cookie=fb961c4689e01414 in_seq=0 out_seq=0 2024-04-25T11:26:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f969dffb640 1 -- 172.21.15.80:0/907696410 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5616d8030ee0 con 0x5616d7d231b0 2024-04-25T11:26:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f969dffb640 10 client.25622 handle_command_reply: tid=0 2024-04-25T11:26:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 client.25622 shutdown 2024-04-25T11:26:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7cfa2f0 msgr2=0x5616d80db460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7cfa2f0 0x5616d80db460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96ac01ba50 tx=0x7f96ac01be70 comp rx=0 tx=0).stop 2024-04-25T11:26:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 shutdown_connections 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5616d7d231b0 0x5616d81520b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5616d7d024d0 0x5616d814e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616d7cfa2f0 0x5616d80db460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f969dffb640 0 client.25622 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 --2- 172.21.15.80:0/907696410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5616d7ce1d80 0x5616d80daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 >> 172.21.15.80:0/907696410 conn(0x5616d7d17300 msgr2=0x5616d80d5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 shutdown_connections 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.906+0000 7f96c39d0740 1 -- 172.21.15.80:0/907696410 wait complete. 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96c39d0740 20 client.25622 trim_cache size 0 max 16384 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:26:21.900 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:26:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:26:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f96a00afc50 msgr2=0x7f96a00b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f96a00afc50 0x7f96a00b2160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5616d80c9a00 tx=0x7f96a803b560 comp rx=0 tx=0).stop 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b81031d0 msgr2=0x7f96b819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b81031d0 0x7f96b819a7e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f96a8032fd0 tx=0x7f96a8031a20 comp rx=0 tx=0).stop 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 shutdown_connections 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f96a00afc50 0x7f96a00b2160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b8108f20 0x7f96b819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b8108a80 0x7f96b819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 --2- 172.21.15.80:0/1273263532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96b81031d0 0x7f96b819a7e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 >> 172.21.15.80:0/1273263532 conn(0x7f96b8078150 msgr2=0x7f96b806af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 shutdown_connections 2024-04-25T11:26:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:21.907+0000 7f96bca42640 1 -- 172.21.15.80:0/1273263532 wait complete. 2024-04-25T11:26:22.126 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:21 smithi080 ceph-mon[29126]: pgmap v67: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.0 MiB/s wr, 1.10k op/s 2024-04-25T11:26:22.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:21 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:26:22.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:21 smithi196 ceph-mon[32659]: pgmap v67: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.0 MiB/s wr, 1.10k op/s 2024-04-25T11:26:22.188 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:21 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:26:22.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:21 smithi082 ceph-mon[32440]: pgmap v67: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.0 MiB/s wr, 1.10k op/s 2024-04-25T11:26:22.242 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:21 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:26:23.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:23 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:23 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:23 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:26:23.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:23 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:26:23.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:23 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:23 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:23 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:23 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:26:23.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:23 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:26:23.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:23 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:23 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:23 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:23.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:23 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:26:23.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:23 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:26:23.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:23 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:26:24.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:24 smithi080 ceph-mon[29126]: pgmap v68: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 769 op/s 2024-04-25T11:26:24.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:24 smithi196 ceph-mon[32659]: pgmap v68: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 769 op/s 2024-04-25T11:26:24.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:24 smithi082 ceph-mon[32440]: pgmap v68: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 769 op/s 2024-04-25T11:26:26.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:26 smithi080 ceph-mon[29126]: pgmap v69: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 769 op/s 2024-04-25T11:26:26.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:26 smithi196 ceph-mon[32659]: pgmap v69: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 769 op/s 2024-04-25T11:26:26.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:26 smithi082 ceph-mon[32440]: pgmap v69: 97 pgs: 97 active+clean; 259 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 769 op/s 2024-04-25T11:26:27.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:26:27.125 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:26:27.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 -- 172.21.15.80:0/1573076792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be81038d0 msgr2=0x7f8be810f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1573076792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be81038d0 0x7f8be810f570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009be0 tx=0x7f8be002a750 comp rx=0 tx=0).stop 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 -- 172.21.15.80:0/1573076792 shutdown_connections 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1573076792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be81038d0 0x7f8be810f570 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1573076792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108e90 0x7f8be8103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1573076792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8108a80 0x7f8be8102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 -- 172.21.15.80:0/1573076792 >> 172.21.15.80:0/1573076792 conn(0x7f8be8077920 msgr2=0x7f8be8077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 -- 172.21.15.80:0/1573076792 shutdown_connections 2024-04-25T11:26:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.253+0000 7f8bf0506640 1 -- 172.21.15.80:0/1573076792 wait complete. 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 Processor -- start 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 -- start start 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108a80 0x7f8be819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8108e90 0x7f8be819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be819eb70 0x7f8be819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8be8112c60 con 0x7f8be8108e90 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8be8112ae0 con 0x7f8be819eb70 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bf0506640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8be8112de0 con 0x7f8be8108a80 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bedaa1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8108e90 0x7f8be819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bee2a2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108a80 0x7f8be819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8beeaa3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be819eb70 0x7f8be819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bee2a2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108a80 0x7f8be819a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:53236/0 (socket says 172.21.15.80:53236) 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1600903155 learned_addr learned my addr 172.21.15.80:0/1600903155 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.254+0000 7f8bedaa1640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8108e90 0x7f8be819a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38634/0 (socket says 172.21.15.80:38634) 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1600903155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be819eb70 msgr2=0x7f8be819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be819eb70 0x7f8be819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8108e90 msgr2=0x7f8be819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8108e90 0x7f8be819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1600903155 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be819f5c0 con 0x7f8be8108a80 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be819eb70 0x7f8be819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108a80 0x7f8be819a350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e9a0 tx=0x7f8be400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bdf7fe640 1 -- 172.21.15.80:0/1600903155 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400cd80 con 0x7f8be8108a80 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bdf7fe640 1 -- 172.21.15.80:0/1600903155 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be40035f0 con 0x7f8be8108a80 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be819f8b0 con 0x7f8be8108a80 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bdf7fe640 1 -- 172.21.15.80:0/1600903155 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4010690 con 0x7f8be8108a80 2024-04-25T11:26:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.255+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be81a7110 con 0x7f8be8108a80 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 Processor -- start 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 -- start start 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dc8da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bdf7fe640 1 -- 172.21.15.80:0/1600903155 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f8be4004000 con 0x7f8be8108a80 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc8dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc9a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557f0dbf3d80 con 0x557f0d8cc6b0 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557f0dbad8b0 con 0x557f0d8c44d0 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557f0dbefd40 con 0x557f0d8ed390 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bee2a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc8dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8beeaa3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dc8da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bedaa1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc9a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bee2a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc8dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:46132/0 (socket says 172.21.15.80:46132) 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.258+0000 7f8bee2a2640 1 -- 172.21.15.80:0/2191600742 learned_addr learned my addr 172.21.15.80:0/2191600742 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bee2a2640 1 -- 172.21.15.80:0/2191600742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 msgr2=0x557f0dc8da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/2191600742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dc8da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bee2a2640 1 -- 172.21.15.80:0/2191600742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 msgr2=0x557f0dc9a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/2191600742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc9a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bee2a2640 1 -- 172.21.15.80:0/2191600742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f0db7ea40 con 0x557f0d8c44d0 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/2191600742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc8dfa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8be40dc920 tx=0x7f8be40e77c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8972e43c86034785 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bdf7fe640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bd40afce0 0x7f8bd40b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bdcbfe640 1 -- 172.21.15.80:0/2191600742 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be40f2070 con 0x557f0d8c44d0 2024-04-25T11:26:27.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bd40afce0 0x7f8bd40b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bdcbfe640 1 -- 172.21.15.80:0/2191600742 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be4003b90 con 0x557f0d8c44d0 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bdcbfe640 1 -- 172.21.15.80:0/2191600742 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be40a6b70 con 0x557f0d8c44d0 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.259+0000 7f8bdf7fe640 1 -- 172.21.15.80:0/1600903155 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f8be40df250 con 0x7f8be8108a80 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2191600742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 msgr2=0x557f0dc8dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bd40afce0 0x7f8bd40b21f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8be0006010 tx=0x7f8be0004a40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2191600742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc8dfa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8be40dc920 tx=0x7f8be40e77c0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2191600742 shutdown_connections 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2191600742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc9a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2191600742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc8dfa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2191600742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dc8da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2191600742 >> 172.21.15.80:0/2191600742 conn(0x557f0d8e14e0 msgr2=0x557f0dc8a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2191600742 shutdown_connections 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.260+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2191600742 wait complete. 2024-04-25T11:26:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 -- start start 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 Processor -- start 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc98580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc98ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dca4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557f0dc9afe0 con 0x557f0d8cc6b0 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557f0db7ad10 con 0x557f0d8c44d0 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557f0dc9b160 con 0x557f0d8ed390 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bf73bc740 10 client.0 _ll_register_callbacks cb 0x557f0dba7210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bee2a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc98580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bee2a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc98580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:46140/0 (socket says 172.21.15.80:46140) 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1009586504 learned_addr learned my addr 172.21.15.80:0/1009586504 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8bedaa1640 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc98ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.261+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dca4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1009586504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 msgr2=0x557f0dca4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dca4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1009586504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 msgr2=0x557f0dc98ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc98ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bee2a2640 1 -- 172.21.15.80:0/1009586504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f0d9cf7d0 con 0x557f0d8c44d0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc98580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8be40a7390 tx=0x7f8be4003d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb950381fa1a038 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/1009586504 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400a900 con 0x557f0d8c44d0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/1009586504 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f8be40037a0 con 0x557f0d8c44d0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be4003b90 con 0x557f0d8c44d0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/1009586504 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8be400ab20 con 0x557f0d8c44d0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bf73bc740 10 client.25634 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f0d9053f0 con 0x557f0d8c44d0 2024-04-25T11:26:27.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/1009586504 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be4003b90 con 0x557f0d8c44d0 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.262+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/1009586504 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8be40dcc30 con 0x557f0d8c44d0 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bf73bc740 10 client.25634 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bf73bc740 10 client.25634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bf73bc740 20 client.25634 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8abf60 0x557f0dcaa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bf73bc740 4 client.25634 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f0dc01990 con 0x557f0d8abf60 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bedaa1640 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8abf60 0x557f0dcaa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bd1ffb640 10 client.25634 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.263+0000 7f8bedaa1640 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8abf60 0x557f0dcaa690 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd9c72ea5e20981 server_cookie=95aea5faa36d8efd in_seq=0 out_seq=0 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/1009586504 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557f0dc01990 con 0x557f0d8abf60 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bd1ffb640 10 client.25634 handle_command_reply: tid=0 2024-04-25T11:26:27.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 client.25634 shutdown 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 msgr2=0x557f0dc98580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc98580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8be40a7390 tx=0x7f8be4003d70 comp rx=0 tx=0).stop 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 shutdown_connections 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8abf60 0x557f0dcaa690 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8cc6b0 0x557f0dc98ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8ed390 0x557f0dca4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1009586504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8c44d0 0x557f0dc98580 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bd1ffb640 0 client.25634 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 >> 172.21.15.80:0/1009586504 conn(0x557f0d8e14e0 msgr2=0x557f0dc8f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 shutdown_connections 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1009586504 wait complete. 2024-04-25T11:26:27.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.264+0000 7f8bf73bc740 20 client.25634 trim_cache size 0 max 16384 2024-04-25T11:26:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 Processor -- start 2024-04-25T11:26:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 -- start start 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dc8de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dc93590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8be81b22c0 con 0x557f0d8ed390 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8be81afb90 con 0x557f0d8cc6b0 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8be81ad9e0 con 0x557f0d8c44d0 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8beeaa3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bedaa1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dc93590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8beeaa3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38664/0 (socket says 172.21.15.80:38664) 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8beeaa3640 1 -- 172.21.15.80:0/1586380202 learned_addr learned my addr 172.21.15.80:0/1586380202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.284+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dc8de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8beeaa3640 1 -- 172.21.15.80:0/1586380202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 msgr2=0x557f0dc8de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dc8de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8beeaa3640 1 -- 172.21.15.80:0/1586380202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 msgr2=0x557f0dc93590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dc93590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8beeaa3640 1 -- 172.21.15.80:0/1586380202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f0d8c50f0 con 0x557f0d8ed390 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8bedaa1640 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dc93590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9a1c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009be0 tx=0x7f8be0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307a9321bcb96135 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8bd3fff640 1 -- 172.21.15.80:0/1586380202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0036040 con 0x557f0d8ed390 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8bd3fff640 1 -- 172.21.15.80:0/1586380202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be0050070 con 0x557f0d8ed390 2024-04-25T11:26:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.285+0000 7f8bd3fff640 1 -- 172.21.15.80:0/1586380202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0031c00 con 0x557f0d8ed390 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1586380202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 msgr2=0x557f0dc9a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9a1c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009be0 tx=0x7f8be0040000 comp rx=0 tx=0).stop 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1586380202 shutdown_connections 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9a1c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dc93590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/1586380202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dc8de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1586380202 >> 172.21.15.80:0/1586380202 conn(0x557f0d8e14e0 msgr2=0x557f0dc99ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1586380202 shutdown_connections 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 -- 172.21.15.80:0/1586380202 wait complete. 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.286+0000 7f8bf73bc740 1 -- start start 2024-04-25T11:26:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 1 Processor -- start 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dd0ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dd0b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8be81ae050 con 0x557f0d8ed390 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8be81af4c0 con 0x557f0d8cc6b0 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8be81ae720 con 0x557f0d8c44d0 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bf73bc740 10 client.0 _ll_register_callbacks cb 0x7f8be40f0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bee2a2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dd0ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38678/0 (socket says 172.21.15.80:38678) 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bedaa1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dd0b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 -- 172.21.15.80:0/2935169143 learned_addr learned my addr 172.21.15.80:0/2935169143 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 -- 172.21.15.80:0/2935169143 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 msgr2=0x557f0dd0ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dd0ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 -- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 msgr2=0x557f0dd0b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dd0b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8beeaa3640 1 -- 172.21.15.80:0/2935169143 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f0dbb44b0 con 0x557f0d8ed390 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.287+0000 7f8bedaa1640 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dd0b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8beeaa3640 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9b810 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8be00099a0 tx=0x7f8be0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47abcb89a1050dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/2935169143 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be005c030 con 0x557f0d8ed390 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/2935169143 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f8be0031940 con 0x557f0d8ed390 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be0050070 con 0x557f0d8ed390 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/2935169143 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8be0036070 con 0x557f0d8ed390 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 10 client.16077 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:27.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f0dd11ff0 con 0x557f0d8ed390 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/2935169143 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be0050070 con 0x557f0d8ed390 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/2935169143 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8be00634c0 con 0x557f0d8ed390 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 10 client.16077 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 20 client.16077 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8813a0 0x557f0dd146a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 4 client.16077 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.288+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f0dbfb800 con 0x557f0d8813a0 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8813a0 0x557f0dd146a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bd1ffb640 10 client.16077 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bee2a2640 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8813a0 0x557f0dd146a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4646ad9e7b6e52f server_cookie=d23d22988e6371b9 in_seq=0 out_seq=0 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bd1ffb640 1 -- 172.21.15.80:0/2935169143 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557f0dbfb800 con 0x557f0d8813a0 2024-04-25T11:26:27.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bd1ffb640 10 client.16077 handle_command_reply: tid=0 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 client.16077 shutdown 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 msgr2=0x557f0dc9b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9b810 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8be00099a0 tx=0x7f8be0003c10 comp rx=0 tx=0).stop 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 shutdown_connections 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557f0d8813a0 0x557f0dd146a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557f0d8ed390 0x557f0dc9b810 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f0d8cc6b0 0x557f0dd0b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 --2- 172.21.15.80:0/2935169143 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f0d8c44d0 0x557f0dd0ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 >> 172.21.15.80:0/2935169143 conn(0x557f0d8e14e0 msgr2=0x557f0dc9a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bd1ffb640 0 client.16077 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 shutdown_connections 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.289+0000 7f8bf73bc740 1 -- 172.21.15.80:0/2935169143 wait complete. 2024-04-25T11:26:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf73bc740 20 client.16077 trim_cache size 0 max 16384 2024-04-25T11:26:27.289 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:26:27.289 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:26:27.289 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:26:27.289 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bd40afce0 msgr2=0x7f8bd40b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bd40afce0 0x7f8bd40b21f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8be0006010 tx=0x7f8be0004a40 comp rx=0 tx=0).stop 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108a80 msgr2=0x7f8be819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108a80 0x7f8be819a350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e9a0 tx=0x7f8be400ee60 comp rx=0 tx=0).stop 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 shutdown_connections 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bd40afce0 0x7f8bd40b21f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8be8108e90 0x7f8be819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be819eb70 0x7f8be819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 --2- 172.21.15.80:0/1600903155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8be8108a80 0x7f8be819a350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 >> 172.21.15.80:0/1600903155 conn(0x7f8be8077920 msgr2=0x7f8be8100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 shutdown_connections 2024-04-25T11:26:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.290+0000 7f8bf0506640 1 -- 172.21.15.80:0/1600903155 wait complete. 2024-04-25T11:26:27.294 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:26:27.295 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 -- 172.21.15.80:0/213244327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90109b10 msgr2=0x7f7b901036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 --2- 172.21.15.80:0/213244327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90109b10 0x7f7b901036b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009900 tx=0x7f7b8002a410 comp rx=0 tx=0).stop 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 -- 172.21.15.80:0/213244327 shutdown_connections 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 --2- 172.21.15.80:0/213244327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b90104260 0x7f7b90110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 --2- 172.21.15.80:0/213244327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b90109fb0 0x7f7b90103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 --2- 172.21.15.80:0/213244327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90109b10 0x7f7b901036b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 -- 172.21.15.80:0/213244327 >> 172.21.15.80:0/213244327 conn(0x7f7b90079100 msgr2=0x7f7b90079540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 -- 172.21.15.80:0/213244327 shutdown_connections 2024-04-25T11:26:27.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.421+0000 7f7b9488c640 1 -- 172.21.15.80:0/213244327 wait complete. 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 Processor -- start 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 -- start start 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90104260 0x7f7b9019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b90109b10 0x7f7b9019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b90109fb0 0x7f7b9019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90113d00 con 0x7f7b90104260 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90113b80 con 0x7f7b90109fb0 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b9488c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90113e80 con 0x7f7b90109b10 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b8e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90104260 0x7f7b9019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b8e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90104260 0x7f7b9019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38708/0 (socket says 172.21.15.80:38708) 2024-04-25T11:26:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b8e59c640 1 -- 172.21.15.80:0/1258916846 learned_addr learned my addr 172.21.15.80:0/1258916846 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.422+0000 7f7b87fff640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b90109b10 0x7f7b9019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8ed9d640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b90109fb0 0x7f7b9019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8e59c640 1 -- 172.21.15.80:0/1258916846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b90109b10 msgr2=0x7f7b9019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8e59c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b90109b10 0x7f7b9019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8e59c640 1 -- 172.21.15.80:0/1258916846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b90109fb0 msgr2=0x7f7b9019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8e59c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b90109fb0 0x7f7b9019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8e59c640 1 -- 172.21.15.80:0/1258916846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9019f580 con 0x7f7b90104260 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8ed9d640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b90109fb0 0x7f7b9019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b8e59c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90104260 0x7f7b9019a720 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7b80006010 tx=0x7f7b80004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b877fe640 1 -- 172.21.15.80:0/1258916846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8003f030 con 0x7f7b90104260 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b877fe640 1 -- 172.21.15.80:0/1258916846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b80003aa0 con 0x7f7b90104260 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9019f810 con 0x7f7b90104260 2024-04-25T11:26:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b877fe640 1 -- 172.21.15.80:0/1258916846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80035070 con 0x7f7b90104260 2024-04-25T11:26:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.423+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9019fd00 con 0x7f7b90104260 2024-04-25T11:26:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.424+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9006afa0 con 0x7f7b90104260 2024-04-25T11:26:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.425+0000 7f7b877fe640 1 -- 172.21.15.80:0/1258916846 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f7b80042030 con 0x7f7b90104260 2024-04-25T11:26:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.426+0000 7f7b877fe640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7b7c0afc60 0x7f7b7c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.426+0000 7f7b87fff640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7b7c0afc60 0x7f7b7c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.426+0000 7f7b877fe640 1 -- 172.21.15.80:0/1258916846 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7b800ff8c0 con 0x7f7b90104260 2024-04-25T11:26:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.427+0000 7f7b87fff640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7b7c0afc60 0x7f7b7c0b2170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b9010f8a0 tx=0x7f7b7800b390 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.430+0000 7f7b877fe640 1 -- 172.21.15.80:0/1258916846 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7b800c8170 con 0x7f7b90104260 2024-04-25T11:26:27.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.683+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b90107fe0 con 0x7f7b90104260 2024-04-25T11:26:27.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.684+0000 7f7b877fe640 1 -- 172.21.15.80:0/1258916846 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f7b800d01f0 con 0x7f7b90104260 2024-04-25T11:26:27.676 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:26:27.676 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:26:27.677 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:26:27.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7b7c0afc60 msgr2=0x7f7b7c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7b7c0afc60 0x7f7b7c0b2170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b9010f8a0 tx=0x7f7b7800b390 comp rx=0 tx=0).stop 2024-04-25T11:26:27.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90104260 msgr2=0x7f7b9019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90104260 0x7f7b9019a720 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7b80006010 tx=0x7f7b80004060 comp rx=0 tx=0).stop 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 shutdown_connections 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7b7c0afc60 0x7f7b7c0b2170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b90109fb0 0x7f7b9019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b90109b10 0x7f7b9019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 --2- 172.21.15.80:0/1258916846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b90104260 0x7f7b9019a720 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 >> 172.21.15.80:0/1258916846 conn(0x7f7b90079100 msgr2=0x7f7b901051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 shutdown_connections 2024-04-25T11:26:27.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.686+0000 7f7b9488c640 1 -- 172.21.15.80:0/1258916846 wait complete. 2024-04-25T11:26:27.690 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 -- 172.21.15.80:0/683600062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c109fc0 msgr2=0x7f283c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 --2- 172.21.15.80:0/683600062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c109fc0 0x7f283c102150 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f282c009900 tx=0x7f282c02a410 comp rx=0 tx=0).stop 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 -- 172.21.15.80:0/683600062 shutdown_connections 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 --2- 172.21.15.80:0/683600062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c109fc0 0x7f283c102150 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 --2- 172.21.15.80:0/683600062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283c1027c0 0x7f283c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 --2- 172.21.15.80:0/683600062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283c109b20 0x7f283c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 -- 172.21.15.80:0/683600062 >> 172.21.15.80:0/683600062 conn(0x7f283c077880 msgr2=0x7f283c077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 -- 172.21.15.80:0/683600062 shutdown_connections 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.817+0000 7f28435b4640 1 -- 172.21.15.80:0/683600062 wait complete. 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 Processor -- start 2024-04-25T11:26:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 -- start start 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c1027c0 0x7f283c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283c109b20 0x7f283c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283c109fc0 0x7f283c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f283c113d10 con 0x7f283c1027c0 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f283c113b90 con 0x7f283c109fc0 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f28435b4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f283c113e90 con 0x7f283c109b20 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c1027c0 0x7f283c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c1027c0 0x7f283c19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38724/0 (socket says 172.21.15.80:38724) 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 -- 172.21.15.80:0/643400686 learned_addr learned my addr 172.21.15.80:0/643400686 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2840b4f640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283c109b20 0x7f283c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841b51640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283c109fc0 0x7f283c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 -- 172.21.15.80:0/643400686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283c109b20 msgr2=0x7f283c19ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283c109b20 0x7f283c19ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 -- 172.21.15.80:0/643400686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283c109fc0 msgr2=0x7f283c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283c109fc0 0x7f283c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 -- 172.21.15.80:0/643400686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c19f590 con 0x7f283c1027c0 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.818+0000 7f2841350640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c1027c0 0x7f283c19a7b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f283800c950 tx=0x7f283800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.819+0000 7f28327fc640 1 -- 172.21.15.80:0/643400686 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838007bb0 con 0x7f283c1027c0 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.819+0000 7f28327fc640 1 -- 172.21.15.80:0/643400686 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2838007d50 con 0x7f283c1027c0 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.819+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283c19f880 con 0x7f283c1027c0 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.819+0000 7f28327fc640 1 -- 172.21.15.80:0/643400686 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838018780 con 0x7f283c1027c0 2024-04-25T11:26:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.819+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283c19fdf0 con 0x7f283c1027c0 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 Processor -- start 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f28327fc640 1 -- 172.21.15.80:0/643400686 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f2838018920 con 0x7f283c1027c0 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 -- start start 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2946810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2946d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d29536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5649d28abd80 con 0x5649d257c4d0 2024-04-25T11:26:27.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5649d2865a20 con 0x5649d25a5390 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f284a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5649d28a7d40 con 0x5649d25846b0 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d29536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d29536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:53322/0 (socket says 172.21.15.80:53322) 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 -- 172.21.15.80:0/1876975261 learned_addr learned my addr 172.21.15.80:0/1876975261 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2841b51640 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2946810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2841350640 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2946d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 -- 172.21.15.80:0/1876975261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 msgr2=0x5649d2946810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2946810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 -- 172.21.15.80:0/1876975261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 msgr2=0x5649d2946d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2946d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.822+0000 7f2840b4f640 1 -- 172.21.15.80:0/1876975261 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d2870c30 con 0x5649d25846b0 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f2841b51640 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2946810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:27.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f28327fc640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28280afce0 0x7f28280b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f2840b4f640 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d29536a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f283c0754b0 tx=0x7f282c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3152fa6ab821982d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f2841b51640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28280afce0 0x7f28280b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f28327fc640 1 -- 172.21.15.80:0/643400686 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f28380df060 con 0x7f283c1027c0 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f28277fe640 1 -- 172.21.15.80:0/1876975261 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c040070 con 0x5649d25846b0 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f28277fe640 1 -- 172.21.15.80:0/1876975261 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f282c004030 con 0x5649d25846b0 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.823+0000 7f28277fe640 1 -- 172.21.15.80:0/1876975261 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c035040 con 0x5649d25846b0 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 -- 172.21.15.80:0/1876975261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 msgr2=0x5649d29536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f2841b51640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28280afce0 0x7f28280b21f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5649d2943980 tx=0x7f2834009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d29536a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f283c0754b0 tx=0x7f282c000bc0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 -- 172.21.15.80:0/1876975261 shutdown_connections 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2946d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d29536a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 --2- 172.21.15.80:0/1876975261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2946810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 -- 172.21.15.80:0/1876975261 >> 172.21.15.80:0/1876975261 conn(0x5649d25994e0 msgr2=0x5649d2942fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 -- 172.21.15.80:0/1876975261 shutdown_connections 2024-04-25T11:26:27.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.824+0000 7f284a461740 1 -- 172.21.15.80:0/1876975261 wait complete. 2024-04-25T11:26:27.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 -- start start 2024-04-25T11:26:27.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 Processor -- start 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2951280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25846b0 0x5649d29517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25a5390 0x5649d2961680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5649d2958140 con 0x5649d257c4d0 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5649d2832dc0 con 0x5649d25846b0 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f284a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5649d29582c0 con 0x5649d25a5390 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f2841350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2951280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.825+0000 7f2840b4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25846b0 0x5649d29517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25846b0 0x5649d29517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:46220/0 (socket says 172.21.15.80:46220) 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2841350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2951280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38742/0 (socket says 172.21.15.80:38742) 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 -- 172.21.15.80:0/2757279599 learned_addr learned my addr 172.21.15.80:0/2757279599 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f284a461740 10 client.0 _ll_register_callbacks cb 0x5649d284e600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2841b51640 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25a5390 0x5649d2961680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 -- 172.21.15.80:0/2757279599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25a5390 msgr2=0x5649d2961680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25a5390 0x5649d2961680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 -- 172.21.15.80:0/2757279599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 msgr2=0x5649d2951280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2951280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 -- 172.21.15.80:0/2757279599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649d25bd3f0 con 0x5649d25846b0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2840b4f640 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25846b0 0x5649d29517c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f282c005eb0 tx=0x7f282c0050e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc7c0b43f5b766b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2824ff9640 1 -- 172.21.15.80:0/2757279599 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c035070 con 0x5649d25846b0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f282c004030 con 0x5649d25846b0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2824ff9640 1 -- 172.21.15.80:0/2757279599 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f282c005500 con 0x5649d25846b0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f2824ff9640 1 -- 172.21.15.80:0/2757279599 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f282c040040 con 0x5649d25846b0 2024-04-25T11:26:27.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f284a461740 10 client.25658 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.826+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5649d26877d0 con 0x5649d25846b0 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f2824ff9640 1 -- 172.21.15.80:0/2757279599 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f282c004030 con 0x5649d25846b0 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f2824ff9640 1 -- 172.21.15.80:0/2757279599 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f282c004d10 con 0x5649d25846b0 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f284a461740 10 client.25658 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f284a461740 10 client.25658 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f284a461740 20 client.25658 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f284a461740 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d2563f60 0x5649d2956eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f284a461740 4 client.25658 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649d28b9990 con 0x5649d2563f60 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f2841350640 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d2563f60 0x5649d2956eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.827+0000 7f2824ff9640 10 client.25658 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f2841350640 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d2563f60 0x5649d2956eb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ab43b723285861d server_cookie=55b1e09dcb5d262c in_seq=0 out_seq=0 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f2824ff9640 1 -- 172.21.15.80:0/2757279599 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5649d28b9990 con 0x5649d2563f60 2024-04-25T11:26:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f2824ff9640 10 client.25658 handle_command_reply: tid=0 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f284a461740 1 client.25658 shutdown 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25846b0 msgr2=0x5649d29517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f284a461740 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25846b0 0x5649d29517c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f282c005eb0 tx=0x7f282c0050e0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 shutdown_connections 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f284a461740 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d2563f60 0x5649d2956eb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.828+0000 7f284a461740 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25a5390 0x5649d2961680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.829+0000 7f284a461740 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25846b0 0x5649d29517c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.829+0000 7f284a461740 1 --2- 172.21.15.80:0/2757279599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2951280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.829+0000 7f2824ff9640 0 client.25658 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.829+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 >> 172.21.15.80:0/2757279599 conn(0x5649d25994e0 msgr2=0x5649d2948530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.829+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 shutdown_connections 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.829+0000 7f284a461740 1 -- 172.21.15.80:0/2757279599 wait complete. 2024-04-25T11:26:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.829+0000 7f284a461740 20 client.25658 trim_cache size 0 max 16384 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 Processor -- start 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 -- start start 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2942f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d2961260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d29696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1affc0 con 0x5649d257c4d0 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1ad890 con 0x5649d25a5390 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f284a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1ab6e0 con 0x5649d25846b0 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f2841350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2942f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f2841350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2942f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38754/0 (socket says 172.21.15.80:38754) 2024-04-25T11:26:27.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f2841350640 1 -- 172.21.15.80:0/2875388056 learned_addr learned my addr 172.21.15.80:0/2875388056 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f2841b51640 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d29696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.844+0000 7f2840b4f640 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d2961260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2841350640 1 -- 172.21.15.80:0/2875388056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 msgr2=0x5649d2961260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2841350640 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d2961260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2841350640 1 -- 172.21.15.80:0/2875388056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 msgr2=0x5649d29696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2841350640 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d29696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2841350640 1 -- 172.21.15.80:0/2875388056 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d2951090 con 0x5649d257c4d0 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2841350640 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2942f70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f283800ffd0 tx=0x7f28380e2b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afe5f039827f781 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2826ffd640 1 -- 172.21.15.80:0/2875388056 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28380a6920 con 0x5649d257c4d0 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2826ffd640 1 -- 172.21.15.80:0/2875388056 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28380a6cc0 con 0x5649d257c4d0 2024-04-25T11:26:27.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.845+0000 7f2826ffd640 1 -- 172.21.15.80:0/2875388056 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28380e2c80 con 0x5649d257c4d0 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 -- 172.21.15.80:0/2875388056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 msgr2=0x5649d2942f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2942f70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f283800ffd0 tx=0x7f28380e2b10 comp rx=0 tx=0).stop 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 -- 172.21.15.80:0/2875388056 shutdown_connections 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d29696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d25846b0 0x5649d2961260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 --2- 172.21.15.80:0/2875388056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d257c4d0 0x5649d2942f70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 -- 172.21.15.80:0/2875388056 >> 172.21.15.80:0/2875388056 conn(0x5649d25994e0 msgr2=0x5649d2942860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 -- 172.21.15.80:0/2875388056 shutdown_connections 2024-04-25T11:26:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.846+0000 7f284a461740 1 -- 172.21.15.80:0/2875388056 wait complete. 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 -- start start 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 Processor -- start 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d257c4d0 0x5649d295dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d25846b0 0x5649d29585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2958ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1abd50 con 0x5649d25846b0 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1ad1c0 con 0x5649d25a5390 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1ac420 con 0x5649d257c4d0 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f284a461740 10 client.0 _ll_register_callbacks cb 0x7f28380e29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f2840b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d25846b0 0x5649d29585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f2840b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d25846b0 0x5649d29585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38768/0 (socket says 172.21.15.80:38768) 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f2840b4f640 1 -- 172.21.15.80:0/3986949641 learned_addr learned my addr 172.21.15.80:0/3986949641 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f2841b51640 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2958ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.847+0000 7f2841350640 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d257c4d0 0x5649d295dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2840b4f640 1 -- 172.21.15.80:0/3986949641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d257c4d0 msgr2=0x5649d295dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2840b4f640 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d257c4d0 0x5649d295dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2840b4f640 1 -- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 msgr2=0x5649d2958ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2840b4f640 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2958ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2840b4f640 1 -- 172.21.15.80:0/3986949641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649d29591d0 con 0x5649d25846b0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2840b4f640 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d25846b0 0x5649d29585a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x5649d293e940 tx=0x7f282c031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6873dbd57dddfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2824ff9640 1 -- 172.21.15.80:0/3986949641 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c035070 con 0x5649d25846b0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2824ff9640 1 -- 172.21.15.80:0/3986949641 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f282c005560 con 0x5649d25846b0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28380a6cc0 con 0x5649d25846b0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2824ff9640 1 -- 172.21.15.80:0/3986949641 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f282c0318c0 con 0x5649d25846b0 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f284a461740 10 client.16101 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5649d29cb0f0 con 0x5649d25846b0 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2824ff9640 1 -- 172.21.15.80:0/3986949641 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28380a6cc0 con 0x5649d25846b0 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.848+0000 7f2824ff9640 1 -- 172.21.15.80:0/3986949641 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f282c003760 con 0x5649d25846b0 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f284a461740 10 client.16101 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f284a461740 10 client.16101 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f284a461740 20 client.16101 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f284a461740 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d25393a0 0x5649d29cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f284a461740 4 client.16101 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649d28b3800 con 0x5649d25393a0 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f2841350640 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d25393a0 0x5649d29cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f2824ff9640 10 client.16101 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f2841350640 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d25393a0 0x5649d29cd6c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f35f6d6c2e9d13a server_cookie=39d3481e54fb32ee in_seq=0 out_seq=0 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f2824ff9640 1 -- 172.21.15.80:0/3986949641 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649d28b3800 con 0x5649d25393a0 2024-04-25T11:26:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f2824ff9640 10 client.16101 handle_command_reply: tid=0 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.849+0000 7f284a461740 1 client.16101 shutdown 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d25846b0 msgr2=0x5649d29585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d25846b0 0x5649d29585a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x5649d293e940 tx=0x7f282c031750 comp rx=0 tx=0).stop 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 shutdown_connections 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5649d25393a0 0x5649d29cd6c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5649d25846b0 0x5649d29585a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f2824ff9640 0 client.16101 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649d25a5390 0x5649d2958ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 --2- 172.21.15.80:0/3986949641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5649d257c4d0 0x5649d295dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 >> 172.21.15.80:0/3986949641 conn(0x5649d25994e0 msgr2=0x5649d2956eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 shutdown_connections 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 1 -- 172.21.15.80:0/3986949641 wait complete. 2024-04-25T11:26:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.850+0000 7f284a461740 20 client.16101 trim_cache size 0 max 16384 2024-04-25T11:26:27.849 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28280afce0 msgr2=0x7f28280b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28280afce0 0x7f28280b21f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5649d2943980 tx=0x7f2834009500 comp rx=0 tx=0).stop 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c1027c0 msgr2=0x7f283c19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c1027c0 0x7f283c19a7b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f283800c950 tx=0x7f283800cd50 comp rx=0 tx=0).stop 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 shutdown_connections 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f28280afce0 0x7f28280b21f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283c109fc0 0x7f283c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283c109b20 0x7f283c19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 --2- 172.21.15.80:0/643400686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c1027c0 0x7f283c19a7b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 >> 172.21.15.80:0/643400686 conn(0x7f283c077880 msgr2=0x7f283c105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 shutdown_connections 2024-04-25T11:26:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:27.851+0000 7f28435b4640 1 -- 172.21.15.80:0/643400686 wait complete. 2024-04-25T11:26:27.857 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:26:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.068+0000 7f33d9d0d640 1 -- 172.21.15.80:0/3221963797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4069e90 msgr2=0x7f33d406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.068+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/3221963797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4069e90 0x7f33d406a2a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009be0 tx=0x7f33cc02a6f0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.068+0000 7f33d9d0d640 1 -- 172.21.15.80:0/3221963797 shutdown_connections 2024-04-25T11:26:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.068+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/3221963797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4069e90 0x7f33d406a2a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.068+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/3221963797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d4102af0 0x7f33d4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.068+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/3221963797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d4108a20 0x7f33d41025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.068+0000 7f33d9d0d640 1 -- 172.21.15.80:0/3221963797 >> 172.21.15.80:0/3221963797 conn(0x7f33d4078100 msgr2=0x7f33d4078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.069+0000 7f33d9d0d640 1 -- 172.21.15.80:0/3221963797 shutdown_connections 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.069+0000 7f33d9d0d640 1 -- 172.21.15.80:0/3221963797 wait complete. 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 Processor -- start 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 -- start start 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d4069e90 0x7f33d4112960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d4102af0 0x7f33d4074380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4108a20 0x7f33d4112ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f33d406cb70 con 0x7f33d4069e90 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33d406c9f0 con 0x7f33d4102af0 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.070+0000 7f33d9d0d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f33d406ccf0 con 0x7f33d4108a20 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.071+0000 7f33d3fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4108a20 0x7f33d4112ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.071+0000 7f33d3fff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4108a20 0x7f33d4112ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:53366/0 (socket says 172.21.15.80:53366) 2024-04-25T11:26:28.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.071+0000 7f33d3fff640 1 -- 172.21.15.80:0/857459510 learned_addr learned my addr 172.21.15.80:0/857459510 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d37fe640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d4069e90 0x7f33d4112960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d4102af0 0x7f33d4074380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d3fff640 1 -- 172.21.15.80:0/857459510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d4102af0 msgr2=0x7f33d4074380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d3fff640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d4102af0 0x7f33d4074380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d3fff640 1 -- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d4069e90 msgr2=0x7f33d4112960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d3fff640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d4069e90 0x7f33d4112960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d3fff640 1 -- 172.21.15.80:0/857459510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d4074b00 con 0x7f33d4108a20 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d3fff640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4108a20 0x7f33d4112ea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33cc003f10 tx=0x7f33cc003f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d0ff9640 1 -- 172.21.15.80:0/857459510 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc040020 con 0x7f33d4108a20 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d0ff9640 1 -- 172.21.15.80:0/857459510 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33cc030970 con 0x7f33d4108a20 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.074+0000 7f33d0ff9640 1 -- 172.21.15.80:0/857459510 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc036040 con 0x7f33d4108a20 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.076+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d41133e0 con 0x7f33d4108a20 2024-04-25T11:26:28.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.076+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d41ad6e0 con 0x7f33d4108a20 2024-04-25T11:26:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.082+0000 7f33e0bbf740 1 Processor -- start 2024-04-25T11:26:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.084+0000 7f33e0bbf740 1 -- start start 2024-04-25T11:26:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.084+0000 7f33d0ff9640 1 -- 172.21.15.80:0/857459510 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f33cc043020 con 0x7f33d4108a20 2024-04-25T11:26:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.085+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e83d390 0x56074ebde810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.085+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e8144d0 0x56074ebded50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.085+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e81c6b0 0x56074ebeb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.085+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56074eb43d80 con 0x56074e83d390 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.085+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56074eafda20 con 0x56074e81c6b0 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.085+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56074eb3fd40 con 0x56074e8144d0 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.087+0000 7f33d0ff9640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33bc0afd90 0x7f33bc0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.087+0000 7f33d0ff9640 1 -- 172.21.15.80:0/857459510 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f33cc0fffc0 con 0x7f33d4108a20 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.088+0000 7f33d3fff640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33bc0afd90 0x7f33bc0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.088+0000 7f33d37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e8144d0 0x56074ebded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.088+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e83d390 0x56074ebde810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.088+0000 7f33d37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e8144d0 0x56074ebded50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:53382/0 (socket says 172.21.15.80:53382) 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.088+0000 7f33d37fe640 1 -- 172.21.15.80:0/2124183167 learned_addr learned my addr 172.21.15.80:0/2124183167 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.088+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e81c6b0 0x56074ebeb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.090+0000 7f33d37fe640 1 -- 172.21.15.80:0/2124183167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e81c6b0 msgr2=0x56074ebeb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.090+0000 7f33d37fe640 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e81c6b0 0x56074ebeb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.090+0000 7f33d37fe640 1 -- 172.21.15.80:0/2124183167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e83d390 msgr2=0x56074ebde810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.090+0000 7f33d37fe640 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e83d390 0x56074ebde810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.090+0000 7f33d37fe640 1 -- 172.21.15.80:0/2124183167 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56074eb08c30 con 0x56074e8144d0 2024-04-25T11:26:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.090+0000 7f33d37fe640 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e8144d0 0x56074ebded50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b740 tx=0x7f33c80045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ee98b7e91e4c17c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.090+0000 7f33d3fff640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33bc0afd90 0x7f33bc0b22a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009420 tx=0x7f33cc02a6f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.098+0000 7f33b9ffb640 1 -- 172.21.15.80:0/2124183167 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8003bd0 con 0x56074e8144d0 2024-04-25T11:26:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.098+0000 7f33b9ffb640 1 -- 172.21.15.80:0/2124183167 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33c8015070 con 0x56074e8144d0 2024-04-25T11:26:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.098+0000 7f33b9ffb640 1 -- 172.21.15.80:0/2124183167 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c80116a0 con 0x56074e8144d0 2024-04-25T11:26:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.100+0000 7f33e0bbf740 1 -- 172.21.15.80:0/2124183167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e8144d0 msgr2=0x56074ebded50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.100+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e8144d0 0x56074ebded50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b740 tx=0x7f33c80045f0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.106+0000 7f33e0bbf740 1 -- 172.21.15.80:0/2124183167 shutdown_connections 2024-04-25T11:26:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.106+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e81c6b0 0x56074ebeb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.106+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e8144d0 0x56074ebded50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.106+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/2124183167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e83d390 0x56074ebde810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.106+0000 7f33e0bbf740 1 -- 172.21.15.80:0/2124183167 >> 172.21.15.80:0/2124183167 conn(0x56074e8314e0 msgr2=0x56074ebdafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.109+0000 7f33e0bbf740 1 -- 172.21.15.80:0/2124183167 shutdown_connections 2024-04-25T11:26:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.109+0000 7f33e0bbf740 1 -- 172.21.15.80:0/2124183167 wait complete. 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.109+0000 7f33e0bbf740 1 -- start start 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 1 Processor -- start 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e8144d0 0x56074ebe9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebe9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56074ebebd90 con 0x56074e81c6b0 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56074eacadc0 con 0x56074e8144d0 2024-04-25T11:26:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56074ebebf10 con 0x56074e83d390 2024-04-25T11:26:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.110+0000 7f33e0bbf740 10 client.0 _ll_register_callbacks cb 0x56074eae6600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.111+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e8144d0 0x56074ebe9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.111+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.111+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e8144d0 0x56074ebe9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:46268/0 (socket says 172.21.15.80:46268) 2024-04-25T11:26:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.111+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1650704416 learned_addr learned my addr 172.21.15.80:0/1650704416 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.112+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1650704416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 msgr2=0x56074ebf5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.112+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.112+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1650704416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 msgr2=0x56074ebe9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.112+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebe9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.112+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1650704416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56074e8553f0 con 0x56074e8144d0 2024-04-25T11:26:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.114+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e8144d0 0x56074ebe9250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33d4075fd0 tx=0x7f33c4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cfc8e9eddfd58e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.115+0000 7f33b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-25T11:26:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.115+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1650704416 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c401c020 con 0x56074e8144d0 2024-04-25T11:26:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.115+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1650704416 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f33c4014c50 con 0x56074e8144d0 2024-04-25T11:26:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.116+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33c8015070 con 0x56074e8144d0 2024-04-25T11:26:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.116+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1650704416 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f33c400f040 con 0x56074e8144d0 2024-04-25T11:26:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.116+0000 7f33e0bbf740 10 client.25673 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.116+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56074e91f7d0 con 0x56074e8144d0 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.119+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1650704416 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33c8015070 con 0x56074e8144d0 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.119+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1650704416 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f33c40203a0 con 0x56074e8144d0 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.120+0000 7f33e0bbf740 10 client.25673 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.120+0000 7f33e0bbf740 10 client.25673 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.120+0000 7f33e0bbf740 20 client.25673 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.120+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074e7fbf60 0x56074ebfb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.120+0000 7f33e0bbf740 4 client.25673 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.120+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56074eb51990 con 0x56074e7fbf60 2024-04-25T11:26:28.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.120+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074e7fbf60 0x56074ebfb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.121+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074e7fbf60 0x56074ebfb6d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d947e2eb97e989f0 server_cookie=883d991de72af3f7 in_seq=0 out_seq=0 2024-04-25T11:26:28.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.121+0000 7f33b2ffd640 10 client.25673 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:26:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.125+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1650704416 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56074eb51990 con 0x56074e7fbf60 2024-04-25T11:26:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.125+0000 7f33b2ffd640 10 client.25673 handle_command_reply: tid=0 2024-04-25T11:26:28.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.126+0000 7f33e0bbf740 1 client.25673 shutdown 2024-04-25T11:26:28.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e8144d0 msgr2=0x56074ebe9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e8144d0 0x56074ebe9250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33d4075fd0 tx=0x7f33c4008040 comp rx=0 tx=0).stop 2024-04-25T11:26:28.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 shutdown_connections 2024-04-25T11:26:28.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebe9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074e7fbf60 0x56074ebfb6d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1650704416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e8144d0 0x56074ebe9250 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33d4075fd0 tx=0x7f33c4008040 comp rx=0 tx=0).stop 2024-04-25T11:26:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 >> 172.21.15.80:0/1650704416 conn(0x56074e8314e0 msgr2=0x56074ebe0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.127+0000 7f33b2ffd640 0 client.25673 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:26:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.132+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 shutdown_connections 2024-04-25T11:26:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.133+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1650704416 wait complete. 2024-04-25T11:26:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.134+0000 7f33e0bbf740 20 client.25673 trim_cache size 0 max 16384 2024-04-25T11:26:28.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.159+0000 7f33e0bbf740 1 Processor -- start 2024-04-25T11:26:28.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.159+0000 7f33e0bbf740 1 -- start start 2024-04-25T11:26:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.159+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebdaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.159+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e7d13a0 0x56074ebe3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f33d41b8a30 con 0x56074e81c6b0 2024-04-25T11:26:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33d41b6380 con 0x56074e7d13a0 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f33d406afa0 con 0x56074e83d390 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebdaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebdaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38816/0 (socket says 172.21.15.80:38816) 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1169070645 learned_addr learned my addr 172.21.15.80:0/1169070645 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e7d13a0 0x56074ebe3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1169070645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 msgr2=0x56074ebf4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1169070645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e7d13a0 msgr2=0x56074ebe3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e7d13a0 0x56074ebe3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.160+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1169070645 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56074ebdb410 con 0x56074e81c6b0 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.161+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.161+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebdaed0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f33c400b1a0 tx=0x7f33c4000e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23c7215f3dd0060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.161+0000 7f33b97fa640 1 -- 172.21.15.80:0/1169070645 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c401c040 con 0x56074e81c6b0 2024-04-25T11:26:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.162+0000 7f33b97fa640 1 -- 172.21.15.80:0/1169070645 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33c4010040 con 0x56074e81c6b0 2024-04-25T11:26:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.162+0000 7f33b97fa640 1 -- 172.21.15.80:0/1169070645 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c40044a0 con 0x56074e81c6b0 2024-04-25T11:26:28.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1169070645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 msgr2=0x56074ebdaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebdaed0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f33c400b1a0 tx=0x7f33c4000e40 comp rx=0 tx=0).stop 2024-04-25T11:26:28.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1169070645 shutdown_connections 2024-04-25T11:26:28.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e7d13a0 0x56074ebe3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e83d390 0x56074ebf4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1169070645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e81c6b0 0x56074ebdaed0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1169070645 >> 172.21.15.80:0/1169070645 conn(0x56074e8314e0 msgr2=0x56074ebda7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1169070645 shutdown_connections 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.163+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1169070645 wait complete. 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.164+0000 7f33e0bbf740 1 -- start start 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.164+0000 7f33e0bbf740 1 Processor -- start 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.164+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e7d13a0 0x56074ebec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.164+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e81c6b0 0x56074ebec6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.164+0000 7f33e0bbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e83d390 0x56074ec61a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f33d41b4840 con 0x56074e7d13a0 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33d41b5cb0 con 0x56074e83d390 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e7d13a0 0x56074ebec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33e0bbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f33d41b4f10 con 0x56074e81c6b0 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e7d13a0 0x56074ebec1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38822/0 (socket says 172.21.15.80:38822) 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1301275663 learned_addr learned my addr 172.21.15.80:0/1301275663 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33e0bbf740 10 client.0 _ll_register_callbacks cb 0x7f33c400ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e83d390 0x56074ec61a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e81c6b0 0x56074ebec6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e81c6b0 msgr2=0x56074ebec6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e81c6b0 0x56074ebec6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1301275663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e83d390 msgr2=0x56074ec61a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e83d390 0x56074ec61a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 -- 172.21.15.80:0/1301275663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56074ebecf70 con 0x56074e7d13a0 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e81c6b0 0x56074ebec6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33d2ffd640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e7d13a0 0x56074ebec1b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f33c4014810 tx=0x7f33c4006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64060cbd8246561f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.165+0000 7f33b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:28.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1301275663 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c401c070 con 0x56074e7d13a0 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1301275663 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f33c40042e0 con 0x56074e7d13a0 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33c4010040 con 0x56074e7d13a0 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1301275663 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f33c4020e50 con 0x56074e7d13a0 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 10 client.16116 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56074ec62f90 con 0x56074e7d13a0 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1301275663 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33c4010040 con 0x56074e7d13a0 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1301275663 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f33c4040050 con 0x56074e7d13a0 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 10 client.16116 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 10 client.16116 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 20 client.16116 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074ec635d0 0x56074ec659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 4 client.16116 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:26:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.166+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56074eb4b800 con 0x56074ec635d0 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.168+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074ec635d0 0x56074ec659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.168+0000 7f33b2ffd640 10 client.16116 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.168+0000 7f33d37fe640 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074ec635d0 0x56074ec659f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7bf1372842f57296 server_cookie=8cfd82457af394c1 in_seq=0 out_seq=0 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33b2ffd640 1 -- 172.21.15.80:0/1301275663 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56074eb4b800 con 0x56074ec635d0 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33b2ffd640 10 client.16116 handle_command_reply: tid=0 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 client.16116 shutdown 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e7d13a0 msgr2=0x56074ebec1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e7d13a0 0x56074ebec1b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f33c4014810 tx=0x7f33c4006f90 comp rx=0 tx=0).stop 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 shutdown_connections 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56074ec635d0 0x56074ec659f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33b2ffd640 0 client.16116 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56074e83d390 0x56074ec61a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56074e81c6b0 0x56074ebec6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 --2- 172.21.15.80:0/1301275663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56074e7d13a0 0x56074ebec1b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 >> 172.21.15.80:0/1301275663 conn(0x56074e8314e0 msgr2=0x56074ebd9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 shutdown_connections 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 1 -- 172.21.15.80:0/1301275663 wait complete. 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.169+0000 7f33e0bbf740 20 client.16116 trim_cache size 0 max 16384 2024-04-25T11:26:28.165 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:26:28.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.170+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33bc0afd90 msgr2=0x7f33bc0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.170+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33bc0afd90 0x7f33bc0b22a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009420 tx=0x7f33cc02a6f0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.170+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4108a20 msgr2=0x7f33d4112ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.170+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4108a20 0x7f33d4112ea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33cc003f10 tx=0x7f33cc003f40 comp rx=0 tx=0).stop 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 shutdown_connections 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33bc0afd90 0x7f33bc0b22a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33d4108a20 0x7f33d4112ea0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33d4102af0 0x7f33d4074380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 --2- 172.21.15.80:0/857459510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33d4069e90 0x7f33d4112960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 >> 172.21.15.80:0/857459510 conn(0x7f33d4078100 msgr2=0x7f33d40ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 shutdown_connections 2024-04-25T11:26:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.171+0000 7f33d9d0d640 1 -- 172.21.15.80:0/857459510 wait complete. 2024-04-25T11:26:28.179 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:26:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 -- 172.21.15.80:0/1990839526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 msgr2=0x7fcbe4103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/1990839526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4103be0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009900 tx=0x7fcbd402a410 comp rx=0 tx=0).stop 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 -- 172.21.15.80:0/1990839526 shutdown_connections 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/1990839526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4103be0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/1990839526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe4104250 0x7fcbe4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/1990839526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbe4109b00 0x7fcbe41036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 -- 172.21.15.80:0/1990839526 >> 172.21.15.80:0/1990839526 conn(0x7fcbe40ff1e0 msgr2=0x7fcbe4101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 -- 172.21.15.80:0/1990839526 shutdown_connections 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.317+0000 7fcbeb90d640 1 -- 172.21.15.80:0/1990839526 wait complete. 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 Processor -- start 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 -- start start 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe4104250 0x7fcbe4075fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbe4109b00 0x7fcbe40764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4076a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4113cf0 con 0x7fcbe4109fa0 2024-04-25T11:26:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4113b70 con 0x7fcbe4104250 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbeb90d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4113e70 con 0x7fcbe4109b00 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.318+0000 7fcbe9eaa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4076a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe8ea8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbe4109b00 0x7fcbe40764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4076a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38854/0 (socket says 172.21.15.80:38854) 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 -- 172.21.15.80:0/2084404725 learned_addr learned my addr 172.21.15.80:0/2084404725 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe4104250 0x7fcbe4075fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 -- 172.21.15.80:0/2084404725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbe4109b00 msgr2=0x7fcbe40764f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbe4109b00 0x7fcbe40764f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 -- 172.21.15.80:0/2084404725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe4104250 msgr2=0x7fcbe4075fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe4104250 0x7fcbe4075fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 -- 172.21.15.80:0/2084404725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe41a8b50 con 0x7fcbe4109fa0 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbe9eaa640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4076a30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00eb10 tx=0x7fcbdc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbda7fc640 1 -- 172.21.15.80:0/2084404725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc004b20 con 0x7fcbe4109fa0 2024-04-25T11:26:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbda7fc640 1 -- 172.21.15.80:0/2084404725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbdc004cc0 con 0x7fcbe4109fa0 2024-04-25T11:26:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe41a8e40 con 0x7fcbe4109fa0 2024-04-25T11:26:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbda7fc640 1 -- 172.21.15.80:0/2084404725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc010670 con 0x7fcbe4109fa0 2024-04-25T11:26:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.319+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe41a9280 con 0x7fcbe4109fa0 2024-04-25T11:26:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 Processor -- start 2024-04-25T11:26:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbda7fc640 1 -- 172.21.15.80:0/2084404725 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fcbdc005020 con 0x7fcbe4109fa0 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 -- start start 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afbb7390 0x5607aff58810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb8e4d0 0x5607aff58d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff656a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5607afebdd80 con 0x5607afbb7390 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607afe77a20 con 0x5607afb8e4d0 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5607afeb9d40 con 0x5607afb966b0 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbe8ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afbb7390 0x5607aff58810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbe8ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afbb7390 0x5607aff58810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38866/0 (socket says 172.21.15.80:38866) 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/1993068693 learned_addr learned my addr 172.21.15.80:0/1993068693 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb8e4d0 0x5607aff58d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.322+0000 7fcbda7fc640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcbd00afc60 0x7fcbd00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/1993068693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 msgr2=0x5607aff656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/1993068693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb8e4d0 msgr2=0x5607aff58d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb8e4d0 0x5607aff58d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/1993068693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607afe82c30 con 0x5607afbb7390 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbe9eaa640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcbd00afc60 0x7fcbd00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbda7fc640 1 -- 172.21.15.80:0/2084404725 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fcbdc0df610 con 0x7fcbe4109fa0 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afbb7390 0x5607aff58810 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcbe406b3a0 tx=0x7fcbd4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4f417fa76ee5b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbcf7fe640 1 -- 172.21.15.80:0/1993068693 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4044020 con 0x5607afbb7390 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbcf7fe640 1 -- 172.21.15.80:0/1993068693 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd40316a0 con 0x5607afbb7390 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.323+0000 7fcbcf7fe640 1 -- 172.21.15.80:0/1993068693 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4035040 con 0x5607afbb7390 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1993068693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afbb7390 msgr2=0x5607aff58810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbe9eaa640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcbd00afc60 0x7fcbd00b2170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0049d0 tx=0x7fcbdc00cf70 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afbb7390 0x5607aff58810 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcbe406b3a0 tx=0x7fcbd4000bc0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1993068693 shutdown_connections 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb8e4d0 0x5607aff58d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1993068693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afbb7390 0x5607aff58810 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1993068693 >> 172.21.15.80:0/1993068693 conn(0x5607afbab4e0 msgr2=0x5607aff54fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1993068693 shutdown_connections 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1993068693 wait complete. 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 -- start start 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.324+0000 7fcbf27c1740 1 Processor -- start 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff633a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afbb7390 0x5607aff69180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5607aff65d30 con 0x5607afb8e4d0 2024-04-25T11:26:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607afe44dc0 con 0x5607afbb7390 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5607aff65eb0 con 0x5607afb966b0 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbf27c1740 10 client.0 _ll_register_callbacks cb 0x5607afe60600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38872/0 (socket says 172.21.15.80:38872) 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/3477721400 learned_addr learned my addr 172.21.15.80:0/3477721400 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afbb7390 0x5607aff69180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/3477721400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 msgr2=0x5607aff638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afbb7390 msgr2=0x5607aff69180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afbb7390 0x5607aff69180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/3477721400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607afbcf3f0 con 0x5607afb8e4d0 2024-04-25T11:26:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff633a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4006010 tx=0x7fcbd4005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f6952e51a3a6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.325+0000 7fcbccff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbccff9640 1 -- 172.21.15.80:0/3477721400 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4051060 con 0x5607afb8e4d0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbccff9640 1 -- 172.21.15.80:0/3477721400 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fcbd4004240 con 0x5607afb8e4d0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbd40316a0 con 0x5607afb8e4d0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbccff9640 1 -- 172.21.15.80:0/3477721400 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbd4044050 con 0x5607afb8e4d0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 10 client.16128 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5607afc997d0 con 0x5607afb8e4d0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbccff9640 1 -- 172.21.15.80:0/3477721400 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd40316a0 con 0x5607afb8e4d0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbccff9640 1 -- 172.21.15.80:0/3477721400 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fcbd404c470 con 0x5607afb8e4d0 2024-04-25T11:26:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 10 client.16128 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 20 client.16128 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afb75f60 0x5607aff755c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 4 client.16128 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607afecb990 con 0x5607afb75f60 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.326+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afb75f60 0x5607aff755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.327+0000 7fcbccff9640 10 client.16128 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.327+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afb75f60 0x5607aff755c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363ddacc54d89f8d server_cookie=f68632bf6ec678dd in_seq=0 out_seq=0 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.327+0000 7fcbccff9640 1 -- 172.21.15.80:0/3477721400 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5607afecb990 con 0x5607afb75f60 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.327+0000 7fcbccff9640 10 client.16128 handle_command_reply: tid=0 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 client.16128 shutdown 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 msgr2=0x5607aff633a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff633a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4006010 tx=0x7fcbd4005f00 comp rx=0 tx=0).stop 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 shutdown_connections 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afb75f60 0x5607aff755c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afbb7390 0x5607aff69180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb966b0 0x5607aff638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbccff9640 0 client.16128 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/3477721400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff633a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 >> 172.21.15.80:0/3477721400 conn(0x5607afbab4e0 msgr2=0x5607aff5a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 shutdown_connections 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 1 -- 172.21.15.80:0/3477721400 wait complete. 2024-04-25T11:26:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.328+0000 7fcbf27c1740 20 client.16128 trim_cache size 0 max 16384 2024-04-25T11:26:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 Processor -- start 2024-04-25T11:26:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 -- start start 2024-04-25T11:26:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb75f60 0x5607aff69170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff53840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff5d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b4350 con 0x5607afb8e4d0 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b1c20 con 0x5607afb966b0 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41afa70 con 0x5607afb75f60 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff53840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff53840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38882/0 (socket says 172.21.15.80:38882) 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 -- 172.21.15.80:0/1947165198 learned_addr learned my addr 172.21.15.80:0/1947165198 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb75f60 0x5607aff69170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 -- 172.21.15.80:0/1947165198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb75f60 msgr2=0x5607aff69170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb75f60 0x5607aff69170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 -- 172.21.15.80:0/1947165198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 msgr2=0x5607aff5d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff5d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff5d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 -- 172.21.15.80:0/1947165198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607aff50710 con 0x5607afb8e4d0 2024-04-25T11:26:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.342+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff53840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x5607aff59fe0 tx=0x7fcbe0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73575f020ce13b22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbceffd640 1 -- 172.21.15.80:0/1947165198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0004250 con 0x5607afb8e4d0 2024-04-25T11:26:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbceffd640 1 -- 172.21.15.80:0/1947165198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbe00043f0 con 0x5607afb8e4d0 2024-04-25T11:26:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbceffd640 1 -- 172.21.15.80:0/1947165198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0020600 con 0x5607afb8e4d0 2024-04-25T11:26:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1947165198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 msgr2=0x5607aff53840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff53840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x5607aff59fe0 tx=0x7fcbe0005f90 comp rx=0 tx=0).stop 2024-04-25T11:26:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1947165198 shutdown_connections 2024-04-25T11:26:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb8e4d0 0x5607aff53840 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff5d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/1947165198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb75f60 0x5607aff69170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.343+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1947165198 >> 172.21.15.80:0/1947165198 conn(0x5607afbab4e0 msgr2=0x5607aff62110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1947165198 shutdown_connections 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 -- 172.21.15.80:0/1947165198 wait complete. 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 -- start start 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 Processor -- start 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb75f60 0x5607aff6f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb8e4d0 0x5607aff6fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff6cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b00e0 con 0x5607afb75f60 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b1550 con 0x5607afb966b0 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b07b0 con 0x5607afb8e4d0 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.344+0000 7fcbf27c1740 10 client.0 _ll_register_callbacks cb 0x7fcbe0009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:28.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb75f60 0x5607aff6f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb75f60 0x5607aff6f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38894/0 (socket says 172.21.15.80:38894) 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/2420162682 learned_addr learned my addr 172.21.15.80:0/2420162682 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb8e4d0 0x5607aff6fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff6cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/2420162682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb8e4d0 msgr2=0x5607aff6fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb8e4d0 0x5607aff6fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 msgr2=0x5607aff6cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff6cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 -- 172.21.15.80:0/2420162682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607aff62820 con 0x5607afb75f60 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbe8ea8640 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb75f60 0x5607aff6f6b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009900 tx=0x7fcbd4005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba17b725edb0da8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbccff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbccff9640 1 -- 172.21.15.80:0/2420162682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4051040 con 0x5607afb75f60 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbccff9640 1 -- 172.21.15.80:0/2420162682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fcbd404ca80 con 0x5607afb75f60 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbe00043f0 con 0x5607afb75f60 2024-04-25T11:26:28.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbccff9640 1 -- 172.21.15.80:0/2420162682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbd4035040 con 0x5607afb75f60 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbf27c1740 10 client.16134 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.345+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5607affdd010 con 0x5607afb75f60 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbccff9640 1 -- 172.21.15.80:0/2420162682 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbe00043f0 con 0x5607afb75f60 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbccff9640 1 -- 172.21.15.80:0/2420162682 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fcbd40035f0 con 0x5607afb75f60 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 10 client.16134 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 20 client.16134 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afbb7390 0x5607affdf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 4 client.16134 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607aff546f0 con 0x5607afbb7390 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afbb7390 0x5607affdf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbccff9640 10 client.16134 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbe96a9640 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afbb7390 0x5607affdf690 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4885a83b5bf20a7 server_cookie=86f6cbd0cda4f1c0 in_seq=0 out_seq=0 2024-04-25T11:26:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbccff9640 1 -- 172.21.15.80:0/2420162682 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607aff546f0 con 0x5607afbb7390 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbccff9640 10 client.16134 handle_command_reply: tid=0 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 client.16134 shutdown 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb75f60 msgr2=0x5607aff6f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb75f60 0x5607aff6f6b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009900 tx=0x7fcbd4005f00 comp rx=0 tx=0).stop 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 shutdown_connections 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5607afbb7390 0x5607affdf690 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607afb966b0 0x5607aff6cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbccff9640 0 client.16134 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5607afb8e4d0 0x5607aff6fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 --2- 172.21.15.80:0/2420162682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5607afb75f60 0x5607aff6f6b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 >> 172.21.15.80:0/2420162682 conn(0x5607afbab4e0 msgr2=0x5607aff65270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 shutdown_connections 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 1 -- 172.21.15.80:0/2420162682 wait complete. 2024-04-25T11:26:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.347+0000 7fcbf27c1740 20 client.16134 trim_cache size 0 max 16384 2024-04-25T11:26:28.346 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcbd00afc60 msgr2=0x7fcbd00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcbd00afc60 0x7fcbd00b2170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0049d0 tx=0x7fcbdc00cf70 comp rx=0 tx=0).stop 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 msgr2=0x7fcbe4076a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4076a30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00eb10 tx=0x7fcbdc00c2d0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 shutdown_connections 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcbd00afc60 0x7fcbd00b2170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbe4109fa0 0x7fcbe4076a30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbe4109b00 0x7fcbe40764f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 --2- 172.21.15.80:0/2084404725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe4104250 0x7fcbe4075fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 >> 172.21.15.80:0/2084404725 conn(0x7fcbe40ff1e0 msgr2=0x7fcbe410f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 shutdown_connections 2024-04-25T11:26:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:28.348+0000 7fcbeb90d640 1 -- 172.21.15.80:0/2084404725 wait complete. 2024-04-25T11:26:28.356 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:28 smithi080 ceph-mon[29126]: pgmap v70: 97 pgs: 97 active+clean; 260 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 1.05k op/s 2024-04-25T11:26:28.356 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:28 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1258916846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:26:28.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:28 smithi196 ceph-mon[32659]: pgmap v70: 97 pgs: 97 active+clean; 260 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 1.05k op/s 2024-04-25T11:26:28.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:28 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1258916846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:26:28.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:28 smithi082 ceph-mon[32440]: pgmap v70: 97 pgs: 97 active+clean; 260 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 1.05k op/s 2024-04-25T11:26:28.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:28 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1258916846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:26:29.356 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:26:29.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:26:29.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:26:29.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 -- 172.21.15.80:0/1871279080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710108a40 msgr2=0x7f17101025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 --2- 172.21.15.80:0/1871279080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710108a40 0x7f17101025d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1700009900 tx=0x7f170002a410 comp rx=0 tx=0).stop 2024-04-25T11:26:29.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 -- 172.21.15.80:0/1871279080 shutdown_connections 2024-04-25T11:26:29.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 --2- 172.21.15.80:0/1871279080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f171010d3a0 0x7f171010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 --2- 172.21.15.80:0/1871279080 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1710102b10 0x7f1710102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 --2- 172.21.15.80:0/1871279080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710108a40 0x7f17101025d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 -- 172.21.15.80:0/1871279080 >> 172.21.15.80:0/1871279080 conn(0x7f1710078180 msgr2=0x7f17100785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 -- 172.21.15.80:0/1871279080 shutdown_connections 2024-04-25T11:26:29.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.486+0000 7f1714d7a640 1 -- 172.21.15.80:0/1871279080 wait complete. 2024-04-25T11:26:29.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 Processor -- start 2024-04-25T11:26:29.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 -- start start 2024-04-25T11:26:29.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710102b10 0x7f171019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1710108a40 0x7f171019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f171010d3a0 0x7f171019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1710112c00 con 0x7f1710102b10 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1710112a80 con 0x7f171010d3a0 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f1714d7a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1710112d80 con 0x7f1710108a40 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f170e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710102b10 0x7f171019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f170e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710102b10 0x7f171019b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38918/0 (socket says 172.21.15.80:38918) 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f170e59c640 1 -- 172.21.15.80:0/868914916 learned_addr learned my addr 172.21.15.80:0/868914916 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f170ed9d640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f171010d3a0 0x7f171019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f170dd9b640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1710108a40 0x7f171019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f170e59c640 1 -- 172.21.15.80:0/868914916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1710108a40 msgr2=0x7f171019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.488+0000 7f170e59c640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1710108a40 0x7f171019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f170e59c640 1 -- 172.21.15.80:0/868914916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f171010d3a0 msgr2=0x7f171019c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f170e59c640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f171010d3a0 0x7f171019c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f170e59c640 1 -- 172.21.15.80:0/868914916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17101a68a0 con 0x7f1710102b10 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f170ed9d640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f171010d3a0 0x7f171019c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f170e59c640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710102b10 0x7f171019b560 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1700032fd0 tx=0x7f1700031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f16ff7fe640 1 -- 172.21.15.80:0/868914916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170003f030 con 0x7f1710102b10 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17101a6b30 con 0x7f1710102b10 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f16ff7fe640 1 -- 172.21.15.80:0/868914916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1700004490 con 0x7f1710102b10 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f16ff7fe640 1 -- 172.21.15.80:0/868914916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700035070 con 0x7f1710102b10 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.489+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17101a7070 con 0x7f1710102b10 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.492+0000 7f171bc22740 1 Processor -- start 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.492+0000 7f16ff7fe640 1 -- 172.21.15.80:0/868914916 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1700042030 con 0x7f1710102b10 2024-04-25T11:26:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.492+0000 7f171bc22740 1 -- start start 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.492+0000 7f171bc22740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625046b6410 0x562504a564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.492+0000 7f171bc22740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56250468d550 0x562504a569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.492+0000 7f171bc22740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a56f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f171bc22740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5625049bcb00 con 0x56250468d550 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f171bc22740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562504958920 con 0x5625046b6410 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f171bc22740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5625049b8ac0 con 0x562504695730 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56250468d550 0x562504a569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625046b6410 0x562504a564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625046b6410 0x562504a564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:46368/0 (socket says 172.21.15.80:46368) 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56250468d550 0x562504a569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38930/0 (socket says 172.21.15.80:38930) 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 -- 172.21.15.80:0/1986471973 learned_addr learned my addr 172.21.15.80:0/1986471973 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170dd9b640 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a56f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 -- 172.21.15.80:0/1986471973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 msgr2=0x562504a56f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a56f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 -- 172.21.15.80:0/1986471973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56250468d550 msgr2=0x562504a569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56250468d550 0x562504a569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 -- 172.21.15.80:0/1986471973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625047967e0 con 0x5625046b6410 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f16ff7fe640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f16f80afc60 0x7f16f80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170ed9d640 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625046b6410 0x562504a564b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1708011790 tx=0x7f1708011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd290eda707b8e01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f170e59c640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f16f80afc60 0x7f16f80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f16fcff9640 1 -- 172.21.15.80:0/1986471973 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708004d20 con 0x5625046b6410 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f16ff7fe640 1 -- 172.21.15.80:0/868914916 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f17000ff310 con 0x7f1710102b10 2024-04-25T11:26:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f16fcff9640 1 -- 172.21.15.80:0/1986471973 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170800fe90 con 0x5625046b6410 2024-04-25T11:26:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.493+0000 7f16fcff9640 1 -- 172.21.15.80:0/1986471973 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080044c0 con 0x5625046b6410 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f170e59c640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f16f80afc60 0x7f16f80b2170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17000fcb20 tx=0x7f1700104040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f171bc22740 1 -- 172.21.15.80:0/1986471973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625046b6410 msgr2=0x562504a564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f171bc22740 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625046b6410 0x562504a564b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1708011790 tx=0x7f1708011c50 comp rx=0 tx=0).stop 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f171bc22740 1 -- 172.21.15.80:0/1986471973 shutdown_connections 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f171bc22740 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56250468d550 0x562504a569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f171bc22740 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a56f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f171bc22740 1 --2- 172.21.15.80:0/1986471973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625046b6410 0x562504a564b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.494+0000 7f171bc22740 1 -- 172.21.15.80:0/1986471973 >> 172.21.15.80:0/1986471973 conn(0x5625046aa560 msgr2=0x562504a52dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 -- 172.21.15.80:0/1986471973 shutdown_connections 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 -- 172.21.15.80:0/1986471973 wait complete. 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 -- start start 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 Processor -- start 2024-04-25T11:26:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a65010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a65550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046b6410 0x562504a71230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562504a67d80 con 0x5625046b6410 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5625049565d0 con 0x56250468d550 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562504a67f00 con 0x562504695730 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.495+0000 7f171bc22740 10 client.0 _ll_register_callbacks cb 0x562504944080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046b6410 0x562504a71230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046b6410 0x562504a71230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38932/0 (socket says 172.21.15.80:38932) 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 -- 172.21.15.80:0/3551099349 learned_addr learned my addr 172.21.15.80:0/3551099349 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a65010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170dd9b640 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a65550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 -- 172.21.15.80:0/3551099349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 msgr2=0x562504a65550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a65550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 -- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 msgr2=0x562504a65010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a65010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 -- 172.21.15.80:0/3551099349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625047f6f70 con 0x5625046b6410 2024-04-25T11:26:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046b6410 0x562504a71230 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x562504a64660 tx=0x7f17080040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dc309574844bd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f16f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f16f5ffb640 1 -- 172.21.15.80:0/3551099349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170802c060 con 0x5625046b6410 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f16f5ffb640 1 -- 172.21.15.80:0/3551099349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1708004a40 con 0x5625046b6410 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170800fe90 con 0x5625046b6410 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f16f5ffb640 1 -- 172.21.15.80:0/3551099349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f170801d040 con 0x5625046b6410 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f171bc22740 10 client.16146 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.496+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56250468e170 con 0x5625046b6410 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f16f5ffb640 1 -- 172.21.15.80:0/3551099349 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170800fe90 con 0x5625046b6410 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f16f5ffb640 1 -- 172.21.15.80:0/3551099349 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1708023070 con 0x5625046b6410 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f171bc22740 10 client.16146 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f171bc22740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f171bc22740 20 client.16146 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f171bc22740 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046751f0 0x562504a77330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f171bc22740 4 client.16146 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625049ca710 con 0x5625046751f0 2024-04-25T11:26:29.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.497+0000 7f170dd9b640 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046751f0 0x562504a77330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.498+0000 7f16f5ffb640 10 client.16146 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.498+0000 7f170dd9b640 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046751f0 0x562504a77330 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48f93be5a1b3124a server_cookie=d2abfaa4e6fc4b48 in_seq=0 out_seq=0 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.498+0000 7f16f5ffb640 1 -- 172.21.15.80:0/3551099349 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5625049ca710 con 0x5625046751f0 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.498+0000 7f16f5ffb640 10 client.16146 handle_command_reply: tid=0 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.498+0000 7f171bc22740 1 client.16146 shutdown 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046b6410 msgr2=0x562504a71230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046b6410 0x562504a71230 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x562504a64660 tx=0x7f17080040c0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 shutdown_connections 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046751f0 0x562504a77330 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046b6410 0x562504a71230 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a65550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f16f5ffb640 0 client.16146 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 --2- 172.21.15.80:0/3551099349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a65010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 >> 172.21.15.80:0/3551099349 conn(0x5625046aa560 msgr2=0x562504a56e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 shutdown_connections 2024-04-25T11:26:29.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 1 -- 172.21.15.80:0/3551099349 wait complete. 2024-04-25T11:26:29.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.499+0000 7f171bc22740 20 client.16146 trim_cache size 0 max 16384 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 Processor -- start 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 -- start start 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a58800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a5e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a7c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f17101b00e0 con 0x5625046751f0 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17101ad9b0 con 0x56250468d550 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.517+0000 7f171bc22740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17101ab800 con 0x562504695730 2024-04-25T11:26:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a58800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a58800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38938/0 (socket says 172.21.15.80:38938) 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 -- 172.21.15.80:0/3180212366 learned_addr learned my addr 172.21.15.80:0/3180212366 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170dd9b640 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a5e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a7c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 -- 172.21.15.80:0/3180212366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 msgr2=0x562504a7c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a7c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 -- 172.21.15.80:0/3180212366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 msgr2=0x562504a5e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a5e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 -- 172.21.15.80:0/3180212366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562504a65d20 con 0x5625046751f0 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170dd9b640 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a5e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f170ed9d640 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a58800 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1708003f70 tx=0x7f1708009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8dd369e0321d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f16f7fff640 1 -- 172.21.15.80:0/3180212366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170802c070 con 0x5625046751f0 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f16f7fff640 1 -- 172.21.15.80:0/3180212366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1708024430 con 0x5625046751f0 2024-04-25T11:26:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.518+0000 7f16f7fff640 1 -- 172.21.15.80:0/3180212366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708004df0 con 0x5625046751f0 2024-04-25T11:26:29.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 -- 172.21.15.80:0/3180212366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 msgr2=0x562504a58800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a58800 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1708003f70 tx=0x7f1708009500 comp rx=0 tx=0).stop 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 -- 172.21.15.80:0/3180212366 shutdown_connections 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a7c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a5e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 --2- 172.21.15.80:0/3180212366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a58800 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 -- 172.21.15.80:0/3180212366 >> 172.21.15.80:0/3180212366 conn(0x5625046aa560 msgr2=0x562504a580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 -- 172.21.15.80:0/3180212366 shutdown_connections 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.519+0000 7f171bc22740 1 -- 172.21.15.80:0/3180212366 wait complete. 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 -- start start 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 Processor -- start 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a70210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a70750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a6c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f17101abe70 con 0x5625046751f0 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17101ad2e0 con 0x56250468d550 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17101ac540 con 0x562504695730 2024-04-25T11:26:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f171bc22740 10 client.0 _ll_register_callbacks cb 0x7f1708003d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a70210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a70210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38950/0 (socket says 172.21.15.80:38950) 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 -- 172.21.15.80:0/795371633 learned_addr learned my addr 172.21.15.80:0/795371633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170dd9b640 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a70750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a6c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 -- 172.21.15.80:0/795371633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 msgr2=0x562504a6c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a6c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 -- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 msgr2=0x562504a70750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a70750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.520+0000 7f170ed9d640 1 -- 172.21.15.80:0/795371633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562504a71020 con 0x5625046751f0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f170ed9d640 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a70210 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f17080115a0 tx=0x7f1708011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41b38917dd49b16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f16f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f16f5ffb640 1 -- 172.21.15.80:0/795371633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170802c070 con 0x5625046751f0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f16f5ffb640 1 -- 172.21.15.80:0/795371633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1708011030 con 0x5625046751f0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1708024430 con 0x5625046751f0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f16f5ffb640 1 -- 172.21.15.80:0/795371633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1708011230 con 0x5625046751f0 2024-04-25T11:26:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 10 client.16152 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562504a6d790 con 0x5625046751f0 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f16f5ffb640 1 -- 172.21.15.80:0/795371633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1708024430 con 0x5625046751f0 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f16f5ffb640 1 -- 172.21.15.80:0/795371633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1708023030 con 0x5625046751f0 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 10 client.16152 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 20 client.16152 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046b6410 0x562504ae1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 4 client.16152 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.521+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5625049c4580 con 0x5625046b6410 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.522+0000 7f170dd9b640 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046b6410 0x562504ae1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.522+0000 7f16f5ffb640 10 client.16152 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.522+0000 7f170dd9b640 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046b6410 0x562504ae1610 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ee5034f7efb858 server_cookie=6ee6fc7441f60f88 in_seq=0 out_seq=0 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f16f5ffb640 1 -- 172.21.15.80:0/795371633 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5625049c4580 con 0x5625046b6410 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f16f5ffb640 10 client.16152 handle_command_reply: tid=0 2024-04-25T11:26:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 client.16152 shutdown 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 msgr2=0x562504a70210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a70210 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f17080115a0 tx=0x7f1708011660 comp rx=0 tx=0).stop 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 shutdown_connections 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5625046b6410 0x562504ae1610 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562504695730 0x562504a6c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250468d550 0x562504a70750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 --2- 172.21.15.80:0/795371633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625046751f0 0x562504a70210 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 >> 172.21.15.80:0/795371633 conn(0x5625046aa560 msgr2=0x562504a563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f16f5ffb640 0 client.16152 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 shutdown_connections 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.523+0000 7f171bc22740 1 -- 172.21.15.80:0/795371633 wait complete. 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f171bc22740 20 client.16152 trim_cache size 0 max 16384 2024-04-25T11:26:29.519 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:26:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:26:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "c4c68b15-e402-4e45-bae2-830892ba9a4c", 2024-04-25T11:26:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:26:29.520 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:26:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f16f80afc60 msgr2=0x7f16f80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f16f80afc60 0x7f16f80b2170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17000fcb20 tx=0x7f1700104040 comp rx=0 tx=0).stop 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710102b10 msgr2=0x7f171019b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710102b10 0x7f171019b560 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1700032fd0 tx=0x7f1700031a20 comp rx=0 tx=0).stop 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 shutdown_connections 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f16f80afc60 0x7f16f80b2170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f171010d3a0 0x7f171019c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1710108a40 0x7f171019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 --2- 172.21.15.80:0/868914916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1710102b10 0x7f171019b560 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 >> 172.21.15.80:0/868914916 conn(0x7f1710078180 msgr2=0x7f17101040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 shutdown_connections 2024-04-25T11:26:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.524+0000 7f1714d7a640 1 -- 172.21.15.80:0/868914916 wait complete. 2024-04-25T11:26:29.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:26:29.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:26:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.654+0000 7fd21f99d640 1 -- 172.21.15.80:0/4136788364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21810e550 msgr2=0x7fd218110970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.654+0000 7fd21f99d640 1 --2- 172.21.15.80:0/4136788364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21810e550 0x7fd218110970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd210009ca0 tx=0x7fd21002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.654+0000 7fd21f99d640 1 -- 172.21.15.80:0/4136788364 shutdown_connections 2024-04-25T11:26:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.654+0000 7fd21f99d640 1 --2- 172.21.15.80:0/4136788364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21810e550 0x7fd218110970 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.654+0000 7fd21f99d640 1 --2- 172.21.15.80:0/4136788364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd218102050 0x7fd218102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.654+0000 7fd21f99d640 1 --2- 172.21.15.80:0/4136788364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd218109ba0 0x7fd218101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.654+0000 7fd21f99d640 1 -- 172.21.15.80:0/4136788364 >> 172.21.15.80:0/4136788364 conn(0x7fd218077880 msgr2=0x7fd218077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.655+0000 7fd21f99d640 1 -- 172.21.15.80:0/4136788364 shutdown_connections 2024-04-25T11:26:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.655+0000 7fd21f99d640 1 -- 172.21.15.80:0/4136788364 wait complete. 2024-04-25T11:26:29.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.655+0000 7fd21f99d640 1 Processor -- start 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21f99d640 1 -- start start 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21f99d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd218102050 0x7fd21819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21f99d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd218109ba0 0x7fd21819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21f99d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd21810e550 0x7fd21819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21f99d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd218113d10 con 0x7fd218102050 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21f99d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd218113b90 con 0x7fd218109ba0 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21f99d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd218113e90 con 0x7fd21810e550 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd218102050 0x7fd21819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd218102050 0x7fd21819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38980/0 (socket says 172.21.15.80:38980) 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 -- 172.21.15.80:0/2933609621 learned_addr learned my addr 172.21.15.80:0/2933609621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21df3a640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd21810e550 0x7fd21819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21cf38640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd218109ba0 0x7fd21819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 -- 172.21.15.80:0/2933609621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd21810e550 msgr2=0x7fd21819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd21810e550 0x7fd21819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 -- 172.21.15.80:0/2933609621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd218109ba0 msgr2=0x7fd21819ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd218109ba0 0x7fd21819ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.656+0000 7fd21d739640 1 -- 172.21.15.80:0/2933609621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21819f570 con 0x7fd218102050 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.657+0000 7fd21d739640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd218102050 0x7fd21819a710 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd21400e9f0 tx=0x7fd21400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.657+0000 7fd20e7fc640 1 -- 172.21.15.80:0/2933609621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21400ccc0 con 0x7fd218102050 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.657+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21819f860 con 0x7fd218102050 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.657+0000 7fd20e7fc640 1 -- 172.21.15.80:0/2933609621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2140035f0 con 0x7fd218102050 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.657+0000 7fd20e7fc640 1 -- 172.21.15.80:0/2933609621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21400ce60 con 0x7fd218102050 2024-04-25T11:26:29.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.657+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2181a71e0 con 0x7fd218102050 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 Processor -- start 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd20e7fc640 1 -- 172.21.15.80:0/2933609621 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fd214010690 con 0x7fd218102050 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 -- start start 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac2ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac2bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56245ab91d80 con 0x56245a88b390 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56245ab4b8b0 con 0x56245a86a6b0 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd226850740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56245ab8dd40 con 0x56245a8624d0 2024-04-25T11:26:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac2ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd21d739640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac2bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac2ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38996/0 (socket says 172.21.15.80:38996) 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd21df3a640 1 -- 172.21.15.80:0/4006710881 learned_addr learned my addr 172.21.15.80:0/4006710881 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.660+0000 7fd21cf38640 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21d739640 1 -- 172.21.15.80:0/4006710881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 msgr2=0x56245ac388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd20e7fc640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2040afc60 0x7fd2040b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21d739640 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21d739640 1 -- 172.21.15.80:0/4006710881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 msgr2=0x56245ac2ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21d739640 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac2ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21d739640 1 -- 172.21.15.80:0/4006710881 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56245ab1ca40 con 0x56245a8624d0 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21df3a640 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac2ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21df3a640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2040afc60 0x7fd2040b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd20e7fc640 1 -- 172.21.15.80:0/2933609621 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd2140df480 con 0x7fd218102050 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd21d739640 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac2bfa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2140dcbe0 tx=0x7fd2140a3d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60648ca6d10b86bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd2037fe640 1 -- 172.21.15.80:0/4006710881 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140a7400 con 0x56245a8624d0 2024-04-25T11:26:29.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd2037fe640 1 -- 172.21.15.80:0/4006710881 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2140a7140 con 0x56245a8624d0 2024-04-25T11:26:29.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.661+0000 7fd2037fe640 1 -- 172.21.15.80:0/4006710881 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140a6da0 con 0x56245a8624d0 2024-04-25T11:26:29.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 -- 172.21.15.80:0/4006710881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 msgr2=0x56245ac2bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac2bfa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2140dcbe0 tx=0x7fd2140a3d40 comp rx=0 tx=0).stop 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd21df3a640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2040afc60 0x7fd2040b2170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x56245ac28bd0 tx=0x7fd2100095c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 -- 172.21.15.80:0/4006710881 shutdown_connections 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac2bfa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 --2- 172.21.15.80:0/4006710881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac2ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 -- 172.21.15.80:0/4006710881 >> 172.21.15.80:0/4006710881 conn(0x56245a87f4e0 msgr2=0x56245ac28210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 -- 172.21.15.80:0/4006710881 shutdown_connections 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.662+0000 7fd226850740 1 -- 172.21.15.80:0/4006710881 wait complete. 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 -- start start 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 Processor -- start 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac36b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56245ac38f20 con 0x56245a88b390 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56245ab18d10 con 0x56245a86a6b0 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56245ac390a0 con 0x56245a8624d0 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd226850740 10 client.0 _ll_register_callbacks cb 0x56245ab45210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.663+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39006/0 (socket says 172.21.15.80:39006) 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 -- 172.21.15.80:0/1817352290 learned_addr learned my addr 172.21.15.80:0/1817352290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21d739640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21cf38640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac36b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 -- 172.21.15.80:0/1817352290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 msgr2=0x56245ac365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 -- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 msgr2=0x56245ac36b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac36b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 -- 172.21.15.80:0/1817352290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56245a96d7d0 con 0x56245a88b390 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21cf38640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac36b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd21df3a640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c370 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd21002ade0 tx=0x7fd21002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8789f63b46e3b4a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd200ff9640 1 -- 172.21.15.80:0/1817352290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210004240 con 0x56245a88b390 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd200ff9640 1 -- 172.21.15.80:0/1817352290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd2100043e0 con 0x56245a88b390 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2140a7140 con 0x56245a88b390 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd200ff9640 1 -- 172.21.15.80:0/1817352290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd2100045e0 con 0x56245a88b390 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd226850740 10 client.16164 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.664+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56245a8a33f0 con 0x56245a88b390 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd200ff9640 1 -- 172.21.15.80:0/1817352290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2140a7140 con 0x56245a88b390 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd200ff9640 1 -- 172.21.15.80:0/1817352290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd2100305c0 con 0x56245a88b390 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd226850740 10 client.16164 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd226850740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd226850740 20 client.16164 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd226850740 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a849f60 0x56245ac48580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd226850740 4 client.16164 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56245ab9f990 con 0x56245a849f60 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.665+0000 7fd21d739640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a849f60 0x56245ac48580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd200ff9640 10 client.16164 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd21d739640 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a849f60 0x56245ac48580 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47528a97dac8e60c server_cookie=7789333442de6d89 in_seq=0 out_seq=0 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd200ff9640 1 -- 172.21.15.80:0/1817352290 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56245ab9f990 con 0x56245a849f60 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd200ff9640 10 client.16164 handle_command_reply: tid=0 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 client.16164 shutdown 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 msgr2=0x56245ac3c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c370 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd21002ade0 tx=0x7fd21002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 shutdown_connections 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a849f60 0x56245ac48580 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c370 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac36b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd200ff9640 0 client.16164 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 --2- 172.21.15.80:0/1817352290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.666+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 >> 172.21.15.80:0/1817352290 conn(0x56245a87f4e0 msgr2=0x56245ac2d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.667+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 shutdown_connections 2024-04-25T11:26:29.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.667+0000 7fd226850740 1 -- 172.21.15.80:0/1817352290 wait complete. 2024-04-25T11:26:29.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.667+0000 7fd226850740 20 client.16164 trim_cache size 0 max 16384 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 Processor -- start 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 -- start start 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac30710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac2dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181b01d0 con 0x56245a88b390 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181adaa0 con 0x56245a86a6b0 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd226850740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181ab8f0 con 0x56245a8624d0 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39014/0 (socket says 172.21.15.80:39014) 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd21df3a640 1 -- 172.21.15.80:0/1332099210 learned_addr learned my addr 172.21.15.80:0/1332099210 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd21cf38640 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac2dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.685+0000 7fd21d739640 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac30710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd21df3a640 1 -- 172.21.15.80:0/1332099210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 msgr2=0x56245ac30710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd21df3a640 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac30710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd21df3a640 1 -- 172.21.15.80:0/1332099210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 msgr2=0x56245ac2dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd21df3a640 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac2dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd21df3a640 1 -- 172.21.15.80:0/1332099210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56245a8630f0 con 0x56245a88b390 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd21cf38640 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac2dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd21df3a640 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c360 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd210030a60 tx=0x7fd210031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5763d5575944922 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd202ffd640 1 -- 172.21.15.80:0/1332099210 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210030e50 con 0x56245a88b390 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd202ffd640 1 -- 172.21.15.80:0/1332099210 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21004e030 con 0x56245a88b390 2024-04-25T11:26:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.686+0000 7fd202ffd640 1 -- 172.21.15.80:0/1332099210 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21002f660 con 0x56245a88b390 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 -- 172.21.15.80:0/1332099210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 msgr2=0x56245ac3c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c360 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd210030a60 tx=0x7fd210031000 comp rx=0 tx=0).stop 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 -- 172.21.15.80:0/1332099210 shutdown_connections 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245ac3c360 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac2dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 --2- 172.21.15.80:0/1332099210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac30710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 -- 172.21.15.80:0/1332099210 >> 172.21.15.80:0/1332099210 conn(0x56245a87f4e0 msgr2=0x56245ac2d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 -- 172.21.15.80:0/1332099210 shutdown_connections 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 -- 172.21.15.80:0/1332099210 wait complete. 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.687+0000 7fd226850740 1 -- start start 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 1 Processor -- start 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac3da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245acae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181abf60 con 0x56245a88b390 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181ad3d0 con 0x56245a86a6b0 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181ac630 con 0x56245a8624d0 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd226850740 10 client.0 _ll_register_callbacks cb 0x7fd210009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245acae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd21df3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245acae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39018/0 (socket says 172.21.15.80:39018) 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd21df3a640 1 -- 172.21.15.80:0/26186215 learned_addr learned my addr 172.21.15.80:0/26186215 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd21cf38640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd21d739640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac3da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd21df3a640 1 -- 172.21.15.80:0/26186215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 msgr2=0x56245ac3da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.688+0000 7fd21df3a640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac3da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd21df3a640 1 -- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 msgr2=0x56245ac3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd21df3a640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd21df3a640 1 -- 172.21.15.80:0/26186215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56245ab524b0 con 0x56245a88b390 2024-04-25T11:26:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd21d739640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac3da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd21cf38640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd21df3a640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245acae8e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd21003e040 tx=0x7fd210004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e82bd35189e2773 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd200ff9640 1 -- 172.21.15.80:0/26186215 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210030dd0 con 0x56245a88b390 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd200ff9640 1 -- 172.21.15.80:0/26186215 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd210004040 con 0x56245a88b390 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21004e030 con 0x56245a88b390 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd200ff9640 1 -- 172.21.15.80:0/26186215 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd210005c50 con 0x56245a88b390 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd226850740 10 client.16170 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56245acafdb0 con 0x56245a88b390 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.689+0000 7fd200ff9640 1 -- 172.21.15.80:0/26186215 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21004e030 con 0x56245a88b390 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd200ff9640 1 -- 172.21.15.80:0/26186215 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd2100704a0 con 0x56245a88b390 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd226850740 10 client.16170 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd226850740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd226850740 20 client.16170 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd226850740 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a81f3a0 0x56245acb2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd226850740 4 client.16170 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56245ab99800 con 0x56245a81f3a0 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd21d739640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a81f3a0 0x56245acb2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd200ff9640 10 client.16170 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd21d739640 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a81f3a0 0x56245acb2480 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbb9defd20d99fa7 server_cookie=d858cb9479db44d5 in_seq=0 out_seq=0 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd200ff9640 1 -- 172.21.15.80:0/26186215 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56245ab99800 con 0x56245a81f3a0 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.690+0000 7fd200ff9640 10 client.16170 handle_command_reply: tid=0 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 client.16170 shutdown 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 msgr2=0x56245acae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245acae8e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd21003e040 tx=0x7fd210004990 comp rx=0 tx=0).stop 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 shutdown_connections 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56245a81f3a0 0x56245acb2480 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56245a88b390 0x56245acae8e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd200ff9640 0 client.16170 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56245a86a6b0 0x56245ac3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 --2- 172.21.15.80:0/26186215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56245a8624d0 0x56245ac3da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 >> 172.21.15.80:0/26186215 conn(0x56245a87f4e0 msgr2=0x56245ac34b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 shutdown_connections 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 1 -- 172.21.15.80:0/26186215 wait complete. 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd226850740 20 client.16170 trim_cache size 0 max 16384 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stdout: "c4c68b15-e402-4e45-bae2-830892ba9a4c": { 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "c4c68b15-e402-4e45-bae2-830892ba9a4c", 2024-04-25T11:26:29.688 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:26:29.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:26:29.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:26:29.689 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:26:29.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2040afc60 msgr2=0x7fd2040b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd21f99d640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2040afc60 0x7fd2040b2170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x56245ac28bd0 tx=0x7fd2100095c0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd218102050 msgr2=0x7fd21819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.691+0000 7fd21f99d640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd218102050 0x7fd21819a710 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd21400e9f0 tx=0x7fd21400eeb0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 shutdown_connections 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2040afc60 0x7fd2040b2170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd21810e550 0x7fd21819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd218109ba0 0x7fd21819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 --2- 172.21.15.80:0/2933609621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd218102050 0x7fd21819a710 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 >> 172.21.15.80:0/2933609621 conn(0x7fd218077880 msgr2=0x7fd2181051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 shutdown_connections 2024-04-25T11:26:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:29.692+0000 7fd21f99d640 1 -- 172.21.15.80:0/2933609621 wait complete. 2024-04-25T11:26:29.695 INFO:tasks.cephfs.filesystem:scrub status for tag:c4c68b15-e402-4e45-bae2-830892ba9a4c - {'path': '/', 'tag': 'c4c68b15-e402-4e45-bae2-830892ba9a4c', 'options': 'recursive,force'} 2024-04-25T11:26:30.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:30 smithi080 ceph-mon[29126]: pgmap v71: 97 pgs: 97 active+clean; 260 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.4 MiB/s wr, 594 op/s 2024-04-25T11:26:30.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:30 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:26:30.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:30 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:26:30.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:30 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:26:30.377 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:30 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:26:30.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:30 smithi196 ceph-mon[32659]: pgmap v71: 97 pgs: 97 active+clean; 260 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.4 MiB/s wr, 594 op/s 2024-04-25T11:26:30.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:30 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:26:30.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:30 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:26:30.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:30 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:26:30.439 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:30 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:26:30.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:30 smithi082 ceph-mon[32440]: pgmap v71: 97 pgs: 97 active+clean; 260 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.4 MiB/s wr, 594 op/s 2024-04-25T11:26:30.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:30 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:26:30.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:30 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:26:30.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:30 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:26:30.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:30 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:26:32.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:32 smithi080 ceph-mon[29126]: pgmap v72: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 2.88k op/s 2024-04-25T11:26:32.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:32 smithi196 ceph-mon[32659]: pgmap v72: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 2.88k op/s 2024-04-25T11:26:32.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:32 smithi082 ceph-mon[32440]: pgmap v72: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 2.88k op/s 2024-04-25T11:26:33.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:33 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:26:33.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:33 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:26:33.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:33 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:26:34.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:34 smithi080 ceph-mon[29126]: pgmap v73: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 2.57k op/s 2024-04-25T11:26:34.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:34 smithi196 ceph-mon[32659]: pgmap v73: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 2.57k op/s 2024-04-25T11:26:34.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:34 smithi082 ceph-mon[32440]: pgmap v73: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 2.57k op/s 2024-04-25T11:26:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 -- 172.21.15.80:0/475869572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281072b0 msgr2=0x7f09281076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 --2- 172.21.15.80:0/475869572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281072b0 0x7f09281076c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0924009900 tx=0x7f092402a410 comp rx=0 tx=0).stop 2024-04-25T11:26:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 -- 172.21.15.80:0/475869572 shutdown_connections 2024-04-25T11:26:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 --2- 172.21.15.80:0/475869572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281072b0 0x7f09281076c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 --2- 172.21.15.80:0/475869572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0928107d30 0x7f092810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 --2- 172.21.15.80:0/475869572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09281033f0 0x7f0928103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 -- 172.21.15.80:0/475869572 >> 172.21.15.80:0/475869572 conn(0x7f09280778b0 msgr2=0x7f0928077cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 -- 172.21.15.80:0/475869572 shutdown_connections 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.014+0000 7f093076c640 1 -- 172.21.15.80:0/475869572 wait complete. 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 Processor -- start 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 -- start start 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281033f0 0x7f0928199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09281072b0 0x7f0928199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0928107d30 0x7f092819de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0928112c30 con 0x7f09281033f0 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0928112ab0 con 0x7f0928107d30 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f093076c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0928112db0 con 0x7f09281072b0 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281033f0 0x7f0928199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281033f0 0x7f0928199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39042/0 (socket says 172.21.15.80:39042) 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f092e508640 1 -- 172.21.15.80:0/1541505305 learned_addr learned my addr 172.21.15.80:0/1541505305 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f092ed09640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0928107d30 0x7f092819de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.015+0000 7f092dd07640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09281072b0 0x7f0928199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f092e508640 1 -- 172.21.15.80:0/1541505305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09281072b0 msgr2=0x7f0928199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f092e508640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09281072b0 0x7f0928199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f092e508640 1 -- 172.21.15.80:0/1541505305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0928107d30 msgr2=0x7f092819de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f092e508640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0928107d30 0x7f092819de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f092e508640 1 -- 172.21.15.80:0/1541505305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092819e4b0 con 0x7f09281033f0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f092dd07640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09281072b0 0x7f0928199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f092e508640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281033f0 0x7f0928199650 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0918005fd0 tx=0x7f091800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f091f7fe640 1 -- 172.21.15.80:0/1541505305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918017070 con 0x7f09281033f0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f091f7fe640 1 -- 172.21.15.80:0/1541505305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0918009c30 con 0x7f09281033f0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092819e7a0 con 0x7f09281033f0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f091f7fe640 1 -- 172.21.15.80:0/1541505305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918003d30 con 0x7f09281033f0 2024-04-25T11:26:35.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.016+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09281a6120 con 0x7f09281033f0 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f091f7fe640 1 -- 172.21.15.80:0/1541505305 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f0918010460 con 0x7f09281033f0 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 Processor -- start 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 -- start start 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec43940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec43e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56553ebaa460 con 0x56553e87b2f0 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56553eb64590 con 0x56553e8834d0 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f0937616740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56553eba6420 con 0x56553e8a41b0 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec43e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec43e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39056/0 (socket says 172.21.15.80:39056) 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.019+0000 7f092e508640 1 -- 172.21.15.80:0/3367982455 learned_addr learned my addr 172.21.15.80:0/3367982455 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092dd07640 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092ed09640 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec43940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f091f7fe640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f09140afc50 0x7f09140b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092ed09640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f09140afc50 0x7f09140b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092e508640 1 -- 172.21.15.80:0/3367982455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 msgr2=0x56553ec43940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092e508640 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec43940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092e508640 1 -- 172.21.15.80:0/3367982455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 msgr2=0x56553ec443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092e508640 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092e508640 1 -- 172.21.15.80:0/3367982455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553eb710d0 con 0x56553e87b2f0 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f091f7fe640 1 -- 172.21.15.80:0/1541505305 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f09180ded90 con 0x7f09281033f0 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092e508640 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec43e80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f09180dc460 tx=0x7f0918018460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760b44d5e37d2930 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f092ed09640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f09140afc50 0x7f09140b2160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56553ec41500 tx=0x7f0920004ab0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f091cff9640 1 -- 172.21.15.80:0/3367982455 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09180a6d10 con 0x56553e87b2f0 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f091cff9640 1 -- 172.21.15.80:0/3367982455 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09180a6a50 con 0x56553e87b2f0 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.020+0000 7f091cff9640 1 -- 172.21.15.80:0/3367982455 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09180a66b0 con 0x56553e87b2f0 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 -- 172.21.15.80:0/3367982455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 msgr2=0x56553ec43e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec43e80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f09180dc460 tx=0x7f0918018460 comp rx=0 tx=0).stop 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 -- 172.21.15.80:0/3367982455 shutdown_connections 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec43e80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 --2- 172.21.15.80:0/3367982455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec43940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 -- 172.21.15.80:0/3367982455 >> 172.21.15.80:0/3367982455 conn(0x56553e898300 msgr2=0x56553ec402a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 -- 172.21.15.80:0/3367982455 shutdown_connections 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.021+0000 7f0937616740 1 -- 172.21.15.80:0/3367982455 wait complete. 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 -- start start 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 Processor -- start 2024-04-25T11:26:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec50310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec50850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec5c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56553ec52dd0 con 0x56553e87b2f0 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56553eb31b60 con 0x56553e8834d0 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56553ec52f50 con 0x56553e8a41b0 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f0937616740 10 client.0 _ll_register_callbacks cb 0x56553eb562b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec50310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec50310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39066/0 (socket says 172.21.15.80:39066) 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f092e508640 1 -- 172.21.15.80:0/1028686520 learned_addr learned my addr 172.21.15.80:0/1028686520 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.022+0000 7f092ed09640 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec5c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f092dd07640 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec50850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f092e508640 1 -- 172.21.15.80:0/1028686520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 msgr2=0x56553ec5c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f092e508640 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec5c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f092e508640 1 -- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 msgr2=0x56553ec50850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f092e508640 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec50850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f092e508640 1 -- 172.21.15.80:0/1028686520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553e8bc210 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f092e508640 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec50310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f09180dc5a0 tx=0x7f09180df100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f659ef76bb8cec3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0911ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0911ffb640 1 -- 172.21.15.80:0/1028686520 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09180a6890 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0911ffb640 1 -- 172.21.15.80:0/1028686520 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f09180a28b0 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09180a6a50 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0911ffb640 1 -- 172.21.15.80:0/1028686520 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f09180a6d10 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0937616740 10 client.16182 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56553e988620 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.023+0000 7f0911ffb640 1 -- 172.21.15.80:0/1028686520 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09180a6a50 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f0911ffb640 1 -- 172.21.15.80:0/1028686520 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f09180af910 con 0x56553e87b2f0 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f0937616740 10 client.16182 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f0937616740 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f0937616740 20 client.16182 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:35.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f0937616740 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e862d80 0x56553ec62620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f0937616740 4 client.16182 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56553ebb8070 con 0x56553e862d80 2024-04-25T11:26:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.024+0000 7f092dd07640 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e862d80 0x56553ec62620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.025+0000 7f0911ffb640 10 client.16182 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.025+0000 7f092dd07640 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e862d80 0x56553ec62620 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181260b85cceb92d server_cookie=ca4342e462afa383 in_seq=0 out_seq=0 2024-04-25T11:26:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.025+0000 7f0911ffb640 1 -- 172.21.15.80:0/1028686520 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56553ebb8070 con 0x56553e862d80 2024-04-25T11:26:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.025+0000 7f0911ffb640 10 client.16182 handle_command_reply: tid=0 2024-04-25T11:26:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 client.16182 shutdown 2024-04-25T11:26:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 msgr2=0x56553ec50310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec50310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f09180dc5a0 tx=0x7f09180df100 comp rx=0 tx=0).stop 2024-04-25T11:26:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 shutdown_connections 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e862d80 0x56553ec62620 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8a41b0 0x56553ec5c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0911ffb640 0 client.16182 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec50850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 --2- 172.21.15.80:0/1028686520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec50310 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 >> 172.21.15.80:0/1028686520 conn(0x56553e898300 msgr2=0x56553ec442b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 shutdown_connections 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 1 -- 172.21.15.80:0/1028686520 wait complete. 2024-04-25T11:26:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.026+0000 7f0937616740 20 client.16182 trim_cache size 0 max 16384 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 Processor -- start 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 -- start start 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e862d80 0x56553ec5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e87b2f0 0x56553ec51f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec65640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09281b00f0 con 0x56553e862d80 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09281ad9c0 con 0x56553e8834d0 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.041+0000 7f0937616740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09281ab810 con 0x56553e87b2f0 2024-04-25T11:26:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e862d80 0x56553ec5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092e508640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e862d80 0x56553ec5c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39078/0 (socket says 172.21.15.80:39078) 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092e508640 1 -- 172.21.15.80:0/1822473945 learned_addr learned my addr 172.21.15.80:0/1822473945 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092dd07640 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e87b2f0 0x56553ec51f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092ed09640 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec65640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092dd07640 1 -- 172.21.15.80:0/1822473945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 msgr2=0x56553ec65640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092dd07640 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec65640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092dd07640 1 -- 172.21.15.80:0/1822473945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e862d80 msgr2=0x56553ec5c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092dd07640 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e862d80 0x56553ec5c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092dd07640 1 -- 172.21.15.80:0/1822473945 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553ec4f400 con 0x56553e87b2f0 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092e508640 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e862d80 0x56553ec5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f092dd07640 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e87b2f0 0x56553ec51f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f092402a930 tx=0x7f09240058b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5469ae8e7c9daa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.042+0000 7f0913fff640 1 -- 172.21.15.80:0/1822473945 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092404a070 con 0x56553e87b2f0 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0913fff640 1 -- 172.21.15.80:0/1822473945 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09240054f0 con 0x56553e87b2f0 2024-04-25T11:26:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0913fff640 1 -- 172.21.15.80:0/1822473945 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0924035040 con 0x56553e87b2f0 2024-04-25T11:26:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 -- 172.21.15.80:0/1822473945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e87b2f0 msgr2=0x56553ec51f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e87b2f0 0x56553ec51f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f092402a930 tx=0x7f09240058b0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 -- 172.21.15.80:0/1822473945 shutdown_connections 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e8834d0 0x56553ec65640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e87b2f0 0x56553ec51f30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 --2- 172.21.15.80:0/1822473945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e862d80 0x56553ec5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 -- 172.21.15.80:0/1822473945 >> 172.21.15.80:0/1822473945 conn(0x56553e898300 msgr2=0x56553ec51820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 -- 172.21.15.80:0/1822473945 shutdown_connections 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.043+0000 7f0937616740 1 -- 172.21.15.80:0/1822473945 wait complete. 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 -- start start 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 Processor -- start 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e862d80 0x56553ec48d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8834d0 0x56553ec64650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09281abe80 con 0x56553e87b2f0 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09281ad2f0 con 0x56553e862d80 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09281ac550 con 0x56553e8834d0 2024-04-25T11:26:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f0937616740 10 client.0 _ll_register_callbacks cb 0x7f0924009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f092dd07640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f092dd07640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39088/0 (socket says 172.21.15.80:39088) 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f092ed09640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8834d0 0x56553ec64650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f092dd07640 1 -- 172.21.15.80:0/2345309243 learned_addr learned my addr 172.21.15.80:0/2345309243 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.044+0000 7f092e508640 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e862d80 0x56553ec48d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f092dd07640 1 -- 172.21.15.80:0/2345309243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8834d0 msgr2=0x56553ec64650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f092dd07640 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8834d0 0x56553ec64650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f092dd07640 1 -- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e862d80 msgr2=0x56553ec48d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f092dd07640 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e862d80 0x56553ec48d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f092dd07640 1 -- 172.21.15.80:0/2345309243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553ec64b90 con 0x56553e87b2f0 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f092e508640 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e862d80 0x56553ec48d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f092dd07640 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec492b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0924000c00 tx=0x7f0924004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd8b2320fd3c8ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0911ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0911ffb640 1 -- 172.21.15.80:0/2345309243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092404a040 con 0x56553e87b2f0 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0911ffb640 1 -- 172.21.15.80:0/2345309243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f0924005240 con 0x56553e87b2f0 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09240054f0 con 0x56553e87b2f0 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0911ffb640 1 -- 172.21.15.80:0/2345309243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f092405b050 con 0x56553e87b2f0 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0937616740 10 client.16188 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56553ec65e00 con 0x56553e87b2f0 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.045+0000 7f0911ffb640 1 -- 172.21.15.80:0/2345309243 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09240054f0 con 0x56553e87b2f0 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f0911ffb640 1 -- 172.21.15.80:0/2345309243 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0924056030 con 0x56553e87b2f0 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f0937616740 10 client.16188 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f0937616740 10 client.16188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f0937616740 20 client.16188 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f0937616740 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e8a41b0 0x56553ecced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f0937616740 4 client.16188 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:26:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56553ebb1ee0 con 0x56553e8a41b0 2024-04-25T11:26:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.046+0000 7f092e508640 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e8a41b0 0x56553ecced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.047+0000 7f0911ffb640 10 client.16188 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.047+0000 7f092e508640 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e8a41b0 0x56553ecced90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a077fb0bc828675 server_cookie=21b7c967cb30d44d in_seq=0 out_seq=0 2024-04-25T11:26:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0911ffb640 1 -- 172.21.15.80:0/2345309243 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56553ebb1ee0 con 0x56553e8a41b0 2024-04-25T11:26:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0911ffb640 10 client.16188 handle_command_reply: tid=0 2024-04-25T11:26:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 client.16188 shutdown 2024-04-25T11:26:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 msgr2=0x56553ec492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec492b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0924000c00 tx=0x7f0924004400 comp rx=0 tx=0).stop 2024-04-25T11:26:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 shutdown_connections 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56553e8a41b0 0x56553ecced90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56553e87b2f0 0x56553ec492b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0911ffb640 0 client.16188 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56553e8834d0 0x56553ec64650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 --2- 172.21.15.80:0/2345309243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56553e862d80 0x56553ec48d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 >> 172.21.15.80:0/2345309243 conn(0x56553e898300 msgr2=0x56553ec516d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 shutdown_connections 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.058+0000 7f0937616740 1 -- 172.21.15.80:0/2345309243 wait complete. 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f0937616740 20 client.16188 trim_cache size 0 max 16384 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:26:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:26:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:26:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f09140afc50 msgr2=0x7f09140b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f09140afc50 0x7f09140b2160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56553ec41500 tx=0x7f0920004ab0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281033f0 msgr2=0x7f0928199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281033f0 0x7f0928199650 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0918005fd0 tx=0x7f091800dde0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 shutdown_connections 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f09140afc50 0x7f09140b2160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0928107d30 0x7f092819de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09281072b0 0x7f0928199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 --2- 172.21.15.80:0/1541505305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09281033f0 0x7f0928199650 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 >> 172.21.15.80:0/1541505305 conn(0x7f09280778b0 msgr2=0x7f09280ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 shutdown_connections 2024-04-25T11:26:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:35.059+0000 7f093076c640 1 -- 172.21.15.80:0/1541505305 wait complete. 2024-04-25T11:26:36.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:36 smithi080 ceph-mon[29126]: pgmap v74: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 2.57k op/s 2024-04-25T11:26:36.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:36 smithi196 ceph-mon[32659]: pgmap v74: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 2.57k op/s 2024-04-25T11:26:36.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:36 smithi082 ceph-mon[32440]: pgmap v74: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 2.57k op/s 2024-04-25T11:26:38.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:38 smithi080 ceph-mon[29126]: pgmap v75: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 MiB/s wr, 2.58k op/s 2024-04-25T11:26:38.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:38 smithi196 ceph-mon[32659]: pgmap v75: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 MiB/s wr, 2.58k op/s 2024-04-25T11:26:38.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:38 smithi082 ceph-mon[32440]: pgmap v75: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 MiB/s wr, 2.58k op/s 2024-04-25T11:26:40.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:40 smithi080 ceph-mon[29126]: pgmap v76: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 2.30k op/s 2024-04-25T11:26:40.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:40 smithi196 ceph-mon[32659]: pgmap v76: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 2.30k op/s 2024-04-25T11:26:40.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:40 smithi082 ceph-mon[32440]: pgmap v76: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 2.30k op/s 2024-04-25T11:26:42.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:42 smithi080 ceph-mon[29126]: pgmap v77: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 20 MiB/s wr, 2.30k op/s 2024-04-25T11:26:42.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:42 smithi196 ceph-mon[32659]: pgmap v77: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 20 MiB/s wr, 2.30k op/s 2024-04-25T11:26:42.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:42 smithi082 ceph-mon[32440]: pgmap v77: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 20 MiB/s wr, 2.30k op/s 2024-04-25T11:26:44.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:44 smithi080 ceph-mon[29126]: pgmap v78: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-04-25T11:26:44.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:44 smithi196 ceph-mon[32659]: pgmap v78: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-04-25T11:26:44.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:44 smithi082 ceph-mon[32440]: pgmap v78: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-04-25T11:26:46.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:46 smithi080 ceph-mon[29126]: pgmap v79: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-04-25T11:26:46.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:46 smithi196 ceph-mon[32659]: pgmap v79: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-04-25T11:26:46.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:46 smithi082 ceph-mon[32440]: pgmap v79: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-04-25T11:26:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 -- 172.21.15.80:0/2411481015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b01072b0 msgr2=0x7fe5b01076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/2411481015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b01072b0 0x7fe5b01076c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009900 tx=0x7fe5ac02a410 comp rx=0 tx=0).stop 2024-04-25T11:26:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 -- 172.21.15.80:0/2411481015 shutdown_connections 2024-04-25T11:26:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/2411481015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b01072b0 0x7fe5b01076c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/2411481015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b0107d30 0x7fe5b010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/2411481015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5b01033f0 0x7fe5b0103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 -- 172.21.15.80:0/2411481015 >> 172.21.15.80:0/2411481015 conn(0x7fe5b00778b0 msgr2=0x7fe5b0077cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 -- 172.21.15.80:0/2411481015 shutdown_connections 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.165+0000 7fe5b80f0640 1 -- 172.21.15.80:0/2411481015 wait complete. 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 Processor -- start 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 -- start start 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5b01033f0 0x7fe5b019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b01072b0 0x7fe5b019bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0107d30 0x7fe5b019c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0112c30 con 0x7fe5b0107d30 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0112ab0 con 0x7fe5b01072b0 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b80f0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0112db0 con 0x7fe5b01033f0 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b668d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0107d30 0x7fe5b019c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b668d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0107d30 0x7fe5b019c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33380/0 (socket says 172.21.15.80:33380) 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b668d640 1 -- 172.21.15.80:0/790079276 learned_addr learned my addr 172.21.15.80:0/790079276 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b568b640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b01072b0 0x7fe5b019bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.166+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5b01033f0 0x7fe5b019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b668d640 1 -- 172.21.15.80:0/790079276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5b01033f0 msgr2=0x7fe5b019b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b668d640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5b01033f0 0x7fe5b019b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b668d640 1 -- 172.21.15.80:0/790079276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b01072b0 msgr2=0x7fe5b019bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b668d640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b01072b0 0x7fe5b019bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b668d640 1 -- 172.21.15.80:0/790079276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b01a68e0 con 0x7fe5b0107d30 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5b01033f0 0x7fe5b019b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b668d640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0107d30 0x7fe5b019c050 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800eb10 tx=0x7fe5a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5a2ffd640 1 -- 172.21.15.80:0/790079276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8004b20 con 0x7fe5b0107d30 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5a2ffd640 1 -- 172.21.15.80:0/790079276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a8004cc0 con 0x7fe5b0107d30 2024-04-25T11:26:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b01a6bd0 con 0x7fe5b0107d30 2024-04-25T11:26:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5a2ffd640 1 -- 172.21.15.80:0/790079276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8010670 con 0x7fe5b0107d30 2024-04-25T11:26:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.167+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b01a70f0 con 0x7fe5b0107d30 2024-04-25T11:26:48.169 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.169+0000 7fe5bef9c740 1 Processor -- start 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5a2ffd640 1 -- 172.21.15.80:0/790079276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fe5a8005020 con 0x7fe5b0107d30 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5bef9c740 1 -- start start 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b65e1b0 0x55e90b9fdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b6352f0 0x55e90b9fe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90b9fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e90b964460 con 0x55e90b63d4d0 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e90b91e590 con 0x55e90b6352f0 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e90b960420 con 0x55e90b65e1b0 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5b568b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90b9fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5b568b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90b9fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33382/0 (socket says 172.21.15.80:33382) 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5b568b640 1 -- 172.21.15.80:0/2245040613 learned_addr learned my addr 172.21.15.80:0/2245040613 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.170+0000 7fe5b5e8c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b6352f0 0x55e90b9fe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b65e1b0 0x55e90b9fdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5a2ffd640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe59c0afc50 0x7fe59c0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b668d640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe59c0afc50 0x7fe59c0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b568b640 1 -- 172.21.15.80:0/2245040613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b65e1b0 msgr2=0x55e90b9fdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b65e1b0 0x55e90b9fdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b568b640 1 -- 172.21.15.80:0/2245040613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b6352f0 msgr2=0x55e90b9fe030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b6352f0 0x55e90b9fe030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b568b640 1 -- 172.21.15.80:0/2245040613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90b92b0d0 con 0x55e90b63d4d0 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5a2ffd640 1 -- 172.21.15.80:0/790079276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe5a80df5b0 con 0x7fe5b0107d30 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b6352f0 0x55e90b9fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90b9fe570 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55e90b9fac60 tx=0x7fe5ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ed2280e337bc53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe59bfff640 1 -- 172.21.15.80:0/2245040613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac035070 con 0x55e90b63d4d0 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe5b668d640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe59c0afc50 0x7fe59c0b2160 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80dd310 tx=0x7fe5a806e020 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe59bfff640 1 -- 172.21.15.80:0/2245040613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5ac005030 con 0x55e90b63d4d0 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.171+0000 7fe59bfff640 1 -- 172.21.15.80:0/2245040613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0044e0 con 0x55e90b63d4d0 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2245040613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 msgr2=0x55e90b9fe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90b9fe570 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55e90b9fac60 tx=0x7fe5ac000bc0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2245040613 shutdown_connections 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90b9fe570 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b6352f0 0x55e90b9fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2245040613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b65e1b0 0x55e90b9fdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2245040613 >> 172.21.15.80:0/2245040613 conn(0x55e90b652300 msgr2=0x55e90b9fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2245040613 shutdown_connections 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.172+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2245040613 wait complete. 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 -- start start 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 Processor -- start 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba09b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba0a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba08030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e90ba0abc0 con 0x55e90b65e1b0 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e90b8ebb60 con 0x55e90b63d4d0 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e90ba0ad40 con 0x55e90b6352f0 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5bef9c740 10 client.0 _ll_register_callbacks cb 0x55e90b9102b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.173+0000 7fe5b568b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba08030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba08030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33394/0 (socket says 172.21.15.80:33394) 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 -- 172.21.15.80:0/3300171828 learned_addr learned my addr 172.21.15.80:0/3300171828 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba0a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba09b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 -- 172.21.15.80:0/3300171828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 msgr2=0x55e90ba09b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba09b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 -- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 msgr2=0x55e90ba0a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba0a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 -- 172.21.15.80:0/3300171828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e90b676210 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba0a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5b568b640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba08030 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55e90ba07890 tx=0x7fe5ac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9e2fb4ac258582 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5997fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5997fa640 1 -- 172.21.15.80:0/3300171828 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac035040 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5997fa640 1 -- 172.21.15.80:0/3300171828 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe5ac0053e0 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5ac005030 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5997fa640 1 -- 172.21.15.80:0/3300171828 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe5ac0055e0 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5bef9c740 10 client.16200 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.174+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e90b742620 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5997fa640 1 -- 172.21.15.80:0/3300171828 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5ac005030 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5997fa640 1 -- 172.21.15.80:0/3300171828 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe5ac055020 con 0x55e90b65e1b0 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5bef9c740 10 client.16200 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5bef9c740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5bef9c740 20 client.16200 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b61cd80 0x55e90ba1a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5bef9c740 4 client.16200 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e90b972070 con 0x55e90b61cd80 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.175+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b61cd80 0x55e90ba1a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.176+0000 7fe5997fa640 10 client.16200 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.176+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b61cd80 0x55e90ba1a620 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0024fde4f8d57ac server_cookie=1349a8ec44bc2f4d in_seq=0 out_seq=0 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.176+0000 7fe5997fa640 1 -- 172.21.15.80:0/3300171828 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e90b972070 con 0x55e90b61cd80 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.176+0000 7fe5997fa640 10 client.16200 handle_command_reply: tid=0 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.176+0000 7fe5bef9c740 1 client.16200 shutdown 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.176+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 msgr2=0x55e90ba08030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.176+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba08030 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55e90ba07890 tx=0x7fe5ac02a410 comp rx=0 tx=0).stop 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 shutdown_connections 2024-04-25T11:26:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b61cd80 0x55e90ba1a620 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba08030 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba0a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/3300171828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba09b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5997fa640 0 client.16200 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 >> 172.21.15.80:0/3300171828 conn(0x55e90b652300 msgr2=0x55e90b9ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 shutdown_connections 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 1 -- 172.21.15.80:0/3300171828 wait complete. 2024-04-25T11:26:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.177+0000 7fe5bef9c740 20 client.16200 trim_cache size 0 max 16384 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 Processor -- start 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 -- start start 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90b9ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba1db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01b22f0 con 0x55e90b65e1b0 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01afbc0 con 0x55e90b63d4d0 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01ada10 con 0x55e90b6352f0 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5b568b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba1db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5b568b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba1db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33406/0 (socket says 172.21.15.80:33406) 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.192+0000 7fe5b568b640 1 -- 172.21.15.80:0/2899251533 learned_addr learned my addr 172.21.15.80:0/2899251533 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90b9ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b568b640 1 -- 172.21.15.80:0/2899251533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 msgr2=0x55e90b9ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90b9ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b568b640 1 -- 172.21.15.80:0/2899251533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 msgr2=0x55e90ba1d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b568b640 1 -- 172.21.15.80:0/2899251533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90ba00380 con 0x55e90b65e1b0 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe5b568b640 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba1db90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac02ac00 tx=0x7fe5ac004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab2822910380bab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe59b7fe640 1 -- 172.21.15.80:0/2899251533 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac004c10 con 0x55e90b65e1b0 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe59b7fe640 1 -- 172.21.15.80:0/2899251533 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5ac0054b0 con 0x55e90b65e1b0 2024-04-25T11:26:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.193+0000 7fe59b7fe640 1 -- 172.21.15.80:0/2899251533 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac031d20 con 0x55e90b65e1b0 2024-04-25T11:26:48.188 INFO:tasks.workunit.client.0.smithi080.stdout:setting up random write file 2024-04-25T11:26:48.188 INFO:tasks.workunit.client.0.smithi080.stdout:done setting up random write file 2024-04-25T11:26:48.188 INFO:tasks.workunit.client.0.smithi080.stdout:starting fsync run 2024-04-25T11:26:48.188 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0086s 2024-04-25T11:26:48.188 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0049s 2024-04-25T11:26:48.188 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0053s 2024-04-25T11:26:48.188 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0053s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0046s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0049s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0056s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0057s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0048s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0055s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0044s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0041s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0044s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0048s 2024-04-25T11:26:48.189 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0041s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0047s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0041s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0047s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0048s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0004s fsync time: 0.0046s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0048s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0004s fsync time: 0.0044s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0043s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0047s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0049s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0043s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0005s fsync time: 0.0045s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0042s 2024-04-25T11:26:48.190 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0044s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0049s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0048s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0046s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0044s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0002s fsync time: 0.0046s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0046s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0047s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0042s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.2963s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0057s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0049s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0050s 2024-04-25T11:26:48.191 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0050s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0053s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0057s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0056s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0051s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0054s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0051s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0051s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0049s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0048s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0053s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:write time: 0.0003s fsync time: 0.0052s 2024-04-25T11:26:48.192 INFO:tasks.workunit.client.0.smithi080.stdout:run done 61 fsyncs total, killing random writer 2024-04-25T11:26:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2899251533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 msgr2=0x55e90ba1db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba1db90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac02ac00 tx=0x7fe5ac004960 comp rx=0 tx=0).stop 2024-04-25T11:26:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2899251533 shutdown_connections 2024-04-25T11:26:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b65e1b0 0x55e90ba1db90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/2899251533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90b9ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2899251533 >> 172.21.15.80:0/2899251533 conn(0x55e90b652300 msgr2=0x55e90b9ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2899251533 shutdown_connections 2024-04-25T11:26:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 -- 172.21.15.80:0/2899251533 wait complete. 2024-04-25T11:26:48.194 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-04-25T11:26:48.194 INFO:tasks.workunit.client.0.smithi080.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-04-25T11:26:48.195 INFO:tasks.workunit.client.0.smithi080.stderr:+ whereis lsof 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.194+0000 7fe5bef9c740 1 -- start start 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 1 Processor -- start 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba1cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b65e1b0 0x55e90ba7a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01ae080 con 0x55e90b63d4d0 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01af4f0 con 0x55e90b65e1b0 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01ae750 con 0x55e90b6352f0 2024-04-25T11:26:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5bef9c740 10 client.0 _ll_register_callbacks cb 0x7fe5a400b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33420/0 (socket says 172.21.15.80:33420) 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 -- 172.21.15.80:0/966567462 learned_addr learned my addr 172.21.15.80:0/966567462 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b568b640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b65e1b0 0x55e90ba7a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b568b640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba1cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 -- 172.21.15.80:0/966567462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 msgr2=0x55e90ba1cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba1cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 -- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b65e1b0 msgr2=0x55e90ba7a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b65e1b0 0x55e90ba7a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b5e8c640 1 -- 172.21.15.80:0/966567462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e90ba7ad20 con 0x55e90b63d4d0 2024-04-25T11:26:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.195+0000 7fe5b568b640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba1cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5b5e8c640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55e90b9fb5e0 tx=0x7fe5a4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9c45a188d12580 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5997fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5997fa640 1 -- 172.21.15.80:0/966567462 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a401d970 con 0x55e90b63d4d0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5997fa640 1 -- 172.21.15.80:0/966567462 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe5a4005020 con 0x55e90b63d4d0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5ac0054b0 con 0x55e90b63d4d0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5997fa640 1 -- 172.21.15.80:0/966567462 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe5a4005220 con 0x55e90b63d4d0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 10 client.16206 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e90ba820e0 con 0x55e90b63d4d0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5997fa640 1 -- 172.21.15.80:0/966567462 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5ac0054b0 con 0x55e90b63d4d0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5997fa640 1 -- 172.21.15.80:0/966567462 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe5a402e470 con 0x55e90b63d4d0 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 10 client.16206 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 10 client.16206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 20 client.16206 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b5f21c0 0x55e90ba84880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 4 client.16206 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T11:26:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.196+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e90b96bee0 con 0x55e90b5f21c0 2024-04-25T11:26:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.197+0000 7fe5b568b640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b5f21c0 0x55e90ba84880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.197+0000 7fe5997fa640 10 client.16206 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.197+0000 7fe5b568b640 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b5f21c0 0x55e90ba84880 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e8f52620cba2dc server_cookie=86ed58ed751f9319 in_seq=0 out_seq=0 2024-04-25T11:26:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5997fa640 1 -- 172.21.15.80:0/966567462 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e90b96bee0 con 0x55e90b5f21c0 2024-04-25T11:26:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5997fa640 10 client.16206 handle_command_reply: tid=0 2024-04-25T11:26:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 client.16206 shutdown 2024-04-25T11:26:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 msgr2=0x55e90ba1d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55e90b9fb5e0 tx=0x7fe5a4011a30 comp rx=0 tx=0).stop 2024-04-25T11:26:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 shutdown_connections 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e90b5f21c0 0x55e90ba84880 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e90b63d4d0 0x55e90ba1d0c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5997fa640 0 client.16206 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90b65e1b0 0x55e90ba7a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 --2- 172.21.15.80:0/966567462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e90b6352f0 0x55e90ba1cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 >> 172.21.15.80:0/966567462 conn(0x55e90b652300 msgr2=0x55e90ba06900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 shutdown_connections 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 1 -- 172.21.15.80:0/966567462 wait complete. 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.209+0000 7fe5bef9c740 20 client.16206 trim_cache size 0 max 16384 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-25T11:26:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-25T11:26:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-25T11:26:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-25T11:26:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe59c0afc50 msgr2=0x7fe59c0b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe59c0afc50 0x7fe59c0b2160 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80dd310 tx=0x7fe5a806e020 comp rx=0 tx=0).stop 2024-04-25T11:26:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0107d30 msgr2=0x7fe5b019c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0107d30 0x7fe5b019c050 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800eb10 tx=0x7fe5a800c2d0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 shutdown_connections 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe59c0afc50 0x7fe59c0b2160 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0107d30 0x7fe5b019c050 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b01072b0 0x7fe5b019bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 --2- 172.21.15.80:0/790079276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5b01033f0 0x7fe5b019b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 >> 172.21.15.80:0/790079276 conn(0x7fe5b00778b0 msgr2=0x7fe5b00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 shutdown_connections 2024-04-25T11:26:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-25T11:26:48.210+0000 7fe5b80f0640 1 -- 172.21.15.80:0/790079276 wait complete. 2024-04-25T11:26:48.211 INFO:tasks.workunit.client.0.smithi080.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-04-25T11:26:48.211 INFO:tasks.workunit.client.0.smithi080.stderr:+ lsof 2024-04-25T11:26:48.233 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b1c7f8494b2f5e23b6fa519e084255c96633ac1fafa44fc79a9a952070b50d9f/merged 2024-04-25T11:26:48.233 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/2f026872e004f649bf2352e76070352997b4e21c1b641a08835dc669a8d1dddc/merged 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/218f7dde817c274b55e3d1b6d257c4fa46436d9c86860e562b23a850471481f7/merged 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/7f49f68c83df91fedf3aa45a24123df132c1f31cdb377690735dcc10f7078562/merged 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/57fc61be0e4930cd28166f428095d83f16b01d21c0936f8f0f0c6be09260acf1/merged 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/9dc08b82e84b0e499b516ce46417dd3d1ab038e303c1d32bd2a075541069f5df/merged 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/661f33c724c62fd0c614d928daa74cbdcb11a82434f5493b3339aa252bd87673/merged 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d60b8544453c916a2a4a8f227794600eaa6a35b4f290044d4f262bea74d62bbf/merged 2024-04-25T11:26:48.234 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.235 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/f8cc25c8e5922d84b14b03036e7ec9354ed867db9e03722dae0e2eb529f4e307/merged 2024-04-25T11:26:48.235 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.235 INFO:tasks.workunit.client.0.smithi080.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/e37723187c2332cb3b1012874fce4bbaa42130a8441e92b3e2002b0575b1820c/merged 2024-04-25T11:26:48.235 INFO:tasks.workunit.client.0.smithi080.stderr: Output information may be incomplete. 2024-04-25T11:26:48.287 INFO:tasks.workunit.client.0.smithi080.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-04-25T11:26:48.287 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-04-25T11:26:48.287 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_gp 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_gp 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_gp 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_gp 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_par_g 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_par_g 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_par_g 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-04-25T11:26:48.288 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_par_g 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:slub_flus 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:slub_flus 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:slub_flus 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:slub_flus 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:netns 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:netns 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:netns 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:netns 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 8 root cwd unknown /proc/8/cwd (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 8 root rtd unknown /proc/8/root (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 8 root txt unknown /proc/8/exe (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 8 root NOFD /proc/8/fd (opendir: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-04-25T11:26:48.289 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:mm_percpu 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:mm_percpu 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:mm_percpu 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:mm_percpu 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-04-25T11:26:48.290 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:pr/ttyS1 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:pr/ttyS1 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:pr/ttyS1 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:pr/ttyS1 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_preem 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-04-25T11:26:48.291 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_preem 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_preem 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:rcu_preem 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:migration 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:migration 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:migration 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:migration 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/0 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/0 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/0 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-04-25T11:26:48.292 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/0 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/1 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/1 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/1 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/1 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:migration 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:migration 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:migration 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:migration 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-04-25T11:26:48.293 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/2 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/2 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/2 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/2 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-04-25T11:26:48.294 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:migration 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:migration 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:migration 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:migration 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-04-25T11:26:48.295 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/3 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/3 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/3 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/3 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:migration 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:migration 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:migration 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:migration 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-04-25T11:26:48.296 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/4 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/4 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/4 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/4 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:migration 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-04-25T11:26:48.297 INFO:tasks.workunit.client.0.smithi080.stdout:migration 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:migration 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:migration 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 45 root cwd unknown /proc/45/cwd (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 45 root rtd unknown /proc/45/root (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 45 root txt unknown /proc/45/exe (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 45 root NOFD /proc/45/fd (opendir: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/5 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/5 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-04-25T11:26:48.298 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/5 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/5 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:migration 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:migration 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:migration 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:migration 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-04-25T11:26:48.299 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 51 root cwd unknown /proc/51/cwd (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 51 root rtd unknown /proc/51/root (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 51 root txt unknown /proc/51/exe (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 51 root NOFD /proc/51/fd (opendir: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/6 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/6 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/6 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/6 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:migration 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:migration 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:migration 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-04-25T11:26:48.300 INFO:tasks.workunit.client.0.smithi080.stdout:migration 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/7 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/7 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/7 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:cpuhp/7 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-04-25T11:26:48.301 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:idle_inje 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:migration 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:migration 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:migration 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:migration 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:ksoftirqd 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 63 root cwd unknown /proc/63/cwd (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 63 root rtd unknown /proc/63/root (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 63 root txt unknown /proc/63/exe (readlink: Permission denied) 2024-04-25T11:26:48.302 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 63 root NOFD /proc/63/fd (opendir: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kdevtmpfs 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kdevtmpfs 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2024-04-25T11:26:48.303 INFO:tasks.workunit.client.0.smithi080.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:kdevtmpfs 71 root NOFD /proc/71/fd (opendir: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:inet_frag 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:inet_frag 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:inet_frag 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:inet_frag 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:kauditd 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:kauditd 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:kauditd 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:kauditd 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:khungtask 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:khungtask 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:khungtask 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:khungtask 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-04-25T11:26:48.304 INFO:tasks.workunit.client.0.smithi080.stdout:oom_reape 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:oom_reape 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:oom_reape 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:oom_reape 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:writeback 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:writeback 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:writeback 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:writeback 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:kcompactd 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:kcompactd 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:kcompactd 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:kcompactd 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:ksmd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:ksmd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-04-25T11:26:48.305 INFO:tasks.workunit.client.0.smithi080.stdout:ksmd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:ksmd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:khugepage 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:khugepage 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:khugepage 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:khugepage 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:cryptd 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:cryptd 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:cryptd 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:cryptd 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:kintegrit 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:kintegrit 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:kintegrit 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:kintegrit 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:kblockd 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-04-25T11:26:48.306 INFO:tasks.workunit.client.0.smithi080.stdout:kblockd 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:kblockd 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:kblockd 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:blkcg_pun 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:blkcg_pun 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:blkcg_pun 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:blkcg_pun 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:tpm_dev_w 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:tpm_dev_w 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:tpm_dev_w 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:md 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:md 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:md 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-04-25T11:26:48.307 INFO:tasks.workunit.client.0.smithi080.stdout:md 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:md_bitmap 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:md_bitmap 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:md_bitmap 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:md_bitmap 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:edac-poll 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:edac-poll 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:edac-poll 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:edac-poll 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:watchdogd 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:watchdogd 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:watchdogd 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:watchdogd 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-04-25T11:26:48.308 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kswapd0 93 root cwd unknown /proc/93/cwd (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kswapd0 93 root rtd unknown /proc/93/root (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kswapd0 93 root txt unknown /proc/93/exe (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kswapd0 93 root NOFD /proc/93/fd (opendir: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kthrotld 99 root cwd unknown /proc/99/cwd (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kthrotld 99 root rtd unknown /proc/99/root (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kthrotld 99 root txt unknown /proc/99/exe (readlink: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:kthrotld 99 root NOFD /proc/99/fd (opendir: Permission denied) 2024-04-25T11:26:48.309 INFO:tasks.workunit.client.0.smithi080.stdout:acpi_ther 108 root cwd unknown /proc/108/cwd (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:acpi_ther 108 root rtd unknown /proc/108/root (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:acpi_ther 108 root txt unknown /proc/108/exe (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:acpi_ther 108 root NOFD /proc/108/fd (opendir: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kmpath_rd 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kmpath_rd 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kmpath_rd 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kmpath_rd 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kaluad 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kaluad 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kaluad 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:kaluad 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:mld 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:mld 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-04-25T11:26:48.310 INFO:tasks.workunit.client.0.smithi080.stdout:mld 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:mld 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:ipv6_addr 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:ipv6_addr 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:ipv6_addr 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:ipv6_addr 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:kstrp 122 root cwd unknown /proc/122/cwd (readlink: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:kstrp 122 root rtd unknown /proc/122/root (readlink: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:kstrp 122 root txt unknown /proc/122/exe (readlink: Permission denied) 2024-04-25T11:26:48.311 INFO:tasks.workunit.client.0.smithi080.stdout:kstrp 122 root NOFD /proc/122/fd (opendir: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:zswap-shr 130 root cwd unknown /proc/130/cwd (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:zswap-shr 130 root rtd unknown /proc/130/root (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:zswap-shr 130 root txt unknown /proc/130/exe (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:zswap-shr 130 root NOFD /proc/130/fd (opendir: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 131 root cwd unknown /proc/131/cwd (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 131 root rtd unknown /proc/131/root (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 131 root txt unknown /proc/131/exe (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 131 root NOFD /proc/131/fd (opendir: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 239 root cwd unknown /proc/239/cwd (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 239 root rtd unknown /proc/239/root (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 239 root txt unknown /proc/239/exe (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 239 root NOFD /proc/239/fd (opendir: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 278 root cwd unknown /proc/278/cwd (readlink: Permission denied) 2024-04-25T11:26:48.312 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 278 root rtd unknown /proc/278/root (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 278 root txt unknown /proc/278/exe (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 278 root NOFD /proc/278/fd (opendir: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 281 root cwd unknown /proc/281/cwd (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 281 root rtd unknown /proc/281/root (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 281 root txt unknown /proc/281/exe (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 281 root NOFD /proc/281/fd (opendir: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 282 root cwd unknown /proc/282/cwd (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 282 root rtd unknown /proc/282/root (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 282 root txt unknown /proc/282/exe (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 282 root NOFD /proc/282/fd (opendir: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 288 root cwd unknown /proc/288/cwd (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 288 root rtd unknown /proc/288/root (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 288 root txt unknown /proc/288/exe (readlink: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 288 root NOFD /proc/288/fd (opendir: Permission denied) 2024-04-25T11:26:48.313 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 295 root cwd unknown /proc/295/cwd (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 295 root rtd unknown /proc/295/root (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 295 root txt unknown /proc/295/exe (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 295 root NOFD /proc/295/fd (opendir: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 370 root cwd unknown /proc/370/cwd (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 370 root rtd unknown /proc/370/root (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 370 root txt unknown /proc/370/exe (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 370 root NOFD /proc/370/fd (opendir: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 388 root cwd unknown /proc/388/cwd (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 388 root rtd unknown /proc/388/root (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 388 root txt unknown /proc/388/exe (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 388 root NOFD /proc/388/fd (opendir: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-wq 427 root cwd unknown /proc/427/cwd (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-wq 427 root rtd unknown /proc/427/root (readlink: Permission denied) 2024-04-25T11:26:48.314 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-wq 427 root txt unknown /proc/427/exe (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-wq 427 root NOFD /proc/427/fd (opendir: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-rese 428 root cwd unknown /proc/428/cwd (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-rese 428 root rtd unknown /proc/428/root (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-rese 428 root txt unknown /proc/428/exe (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-rese 428 root NOFD /proc/428/fd (opendir: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-dele 429 root cwd unknown /proc/429/cwd (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-dele 429 root rtd unknown /proc/429/root (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-dele 429 root txt unknown /proc/429/exe (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-dele 429 root NOFD /proc/429/fd (opendir: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-auth 430 root cwd unknown /proc/430/cwd (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-auth 430 root rtd unknown /proc/430/root (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-auth 430 root txt unknown /proc/430/exe (readlink: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:nvme-auth 430 root NOFD /proc/430/fd (opendir: Permission denied) 2024-04-25T11:26:48.315 INFO:tasks.workunit.client.0.smithi080.stdout:ata_sff 431 root cwd unknown /proc/431/cwd (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:ata_sff 431 root rtd unknown /proc/431/root (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:ata_sff 431 root txt unknown /proc/431/exe (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:ata_sff 431 root NOFD /proc/431/fd (opendir: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:ixgbe 443 root cwd unknown /proc/443/cwd (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:ixgbe 443 root rtd unknown /proc/443/root (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:ixgbe 443 root txt unknown /proc/443/exe (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:ixgbe 443 root NOFD /proc/443/fd (opendir: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_0 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_0 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_0 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_0 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-04-25T11:26:48.316 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_1 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_1 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_1 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_1 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_2 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-04-25T11:26:48.317 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_2 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_2 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_2 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_3 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_3 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_3 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_3 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-04-25T11:26:48.318 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_4 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_4 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_4 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_4 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_5 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_5 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_5 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_5 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-04-25T11:26:48.319 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_6 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_6 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_6 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_6 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_7 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_7 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_7 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_7 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-04-25T11:26:48.320 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_8 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_8 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_8 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_8 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_9 469 root cwd unknown /proc/469/cwd (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_9 469 root rtd unknown /proc/469/root (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_9 469 root txt unknown /proc/469/exe (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_eh_9 469 root NOFD /proc/469/fd (opendir: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 470 root cwd unknown /proc/470/cwd (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 470 root rtd unknown /proc/470/root (readlink: Permission denied) 2024-04-25T11:26:48.321 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 470 root txt unknown /proc/470/exe (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:scsi_tmf_ 470 root NOFD /proc/470/fd (opendir: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 498 root cwd unknown /proc/498/cwd (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 498 root rtd unknown /proc/498/root (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 498 root txt unknown /proc/498/exe (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 498 root NOFD /proc/498/fd (opendir: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:jbd2/sda1 499 root cwd unknown /proc/499/cwd (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:jbd2/sda1 499 root rtd unknown /proc/499/root (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:jbd2/sda1 499 root txt unknown /proc/499/exe (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:jbd2/sda1 499 root NOFD /proc/499/fd (opendir: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:ext4-rsv- 500 root cwd unknown /proc/500/cwd (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:ext4-rsv- 500 root rtd unknown /proc/500/root (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:ext4-rsv- 500 root txt unknown /proc/500/exe (readlink: Permission denied) 2024-04-25T11:26:48.322 INFO:tasks.workunit.client.0.smithi080.stdout:ext4-rsv- 500 root NOFD /proc/500/fd (opendir: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-j 575 root cwd unknown /proc/575/cwd (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-j 575 root rtd unknown /proc/575/root (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-j 575 root txt unknown /proc/575/exe (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-j 575 root NOFD /proc/575/fd (opendir: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:ext4lazyi 581 root cwd unknown /proc/581/cwd (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:ext4lazyi 581 root rtd unknown /proc/581/root (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:ext4lazyi 581 root txt unknown /proc/581/exe (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:ext4lazyi 581 root NOFD /proc/581/fd (opendir: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-u 599 root cwd unknown /proc/599/cwd (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-u 599 root rtd unknown /proc/599/root (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-u 599 root txt unknown /proc/599/exe (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-u 599 root NOFD /proc/599/fd (opendir: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:ipmi-msgh 650 root cwd unknown /proc/650/cwd (readlink: Permission denied) 2024-04-25T11:26:48.323 INFO:tasks.workunit.client.0.smithi080.stdout:ipmi-msgh 650 root rtd unknown /proc/650/root (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:ipmi-msgh 650 root txt unknown /proc/650/exe (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:ipmi-msgh 650 root NOFD /proc/650/fd (opendir: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:kipmi0 668 root cwd unknown /proc/668/cwd (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:kipmi0 668 root rtd unknown /proc/668/root (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:kipmi0 668 root txt unknown /proc/668/exe (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:kipmi0 668 root NOFD /proc/668/fd (opendir: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpcbind 677 rpc cwd unknown /proc/677/cwd (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpcbind 677 rpc rtd unknown /proc/677/root (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpcbind 677 rpc txt unknown /proc/677/exe (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpcbind 677 rpc NOFD /proc/677/fd (opendir: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpciod 679 root cwd unknown /proc/679/cwd (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpciod 679 root rtd unknown /proc/679/root (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpciod 679 root txt unknown /proc/679/exe (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:rpciod 679 root NOFD /proc/679/fd (opendir: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:xprtiod 680 root cwd unknown /proc/680/cwd (readlink: Permission denied) 2024-04-25T11:26:48.324 INFO:tasks.workunit.client.0.smithi080.stdout:xprtiod 680 root rtd unknown /proc/680/root (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:xprtiod 680 root txt unknown /proc/680/exe (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:xprtiod 680 root NOFD /proc/680/fd (opendir: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 root cwd unknown /proc/681/cwd (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 root rtd unknown /proc/681/root (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 root txt unknown /proc/681/exe (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 root NOFD /proc/681/fd (opendir: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 682 auditd root cwd unknown /proc/681/task/682/cwd (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 682 auditd root rtd unknown /proc/681/task/682/root (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 682 auditd root txt unknown /proc/681/task/682/exe (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 682 auditd root NOFD /proc/681/task/682/fd (opendir: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 684 auditd root cwd unknown /proc/681/task/684/cwd (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 684 auditd root rtd unknown /proc/681/task/684/root (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 684 auditd root txt unknown /proc/681/task/684/exe (readlink: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:auditd 681 684 auditd root NOFD /proc/681/task/684/fd (opendir: Permission denied) 2024-04-25T11:26:48.325 INFO:tasks.workunit.client.0.smithi080.stdout:sedispatc 683 root cwd unknown /proc/683/cwd (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:sedispatc 683 root rtd unknown /proc/683/root (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:sedispatc 683 root txt unknown /proc/683/exe (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:sedispatc 683 root NOFD /proc/683/fd (opendir: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 721 dbus cwd unknown /proc/721/cwd (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 721 dbus rtd unknown /proc/721/root (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 721 dbus txt unknown /proc/721/exe (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 721 dbus NOFD /proc/721/fd (opendir: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 722 dbus cwd unknown /proc/722/cwd (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 722 dbus rtd unknown /proc/722/root (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 722 dbus txt unknown /proc/722/exe (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:dbus-brok 722 dbus NOFD /proc/722/fd (opendir: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 root cwd unknown /proc/723/cwd (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 root rtd unknown /proc/723/root (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 root txt unknown /proc/723/exe (readlink: Permission denied) 2024-04-25T11:26:48.326 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 root NOFD /proc/723/fd (opendir: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 764 gmain root cwd unknown /proc/723/task/764/cwd (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 764 gmain root rtd unknown /proc/723/task/764/root (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 764 gmain root txt unknown /proc/723/task/764/exe (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 764 gmain root NOFD /proc/723/task/764/fd (opendir: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 765 gdbus root cwd unknown /proc/723/task/765/cwd (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 765 gdbus root rtd unknown /proc/723/task/765/root (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 765 gdbus root txt unknown /proc/723/task/765/exe (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:NetworkMa 723 765 gdbus root NOFD /proc/723/task/765/fd (opendir: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 root cwd unknown /proc/726/cwd (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 root rtd unknown /proc/726/root (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 root txt unknown /proc/726/exe (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 root NOFD /proc/726/fd (opendir: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 740 gmain root cwd unknown /proc/726/task/740/cwd (readlink: Permission denied) 2024-04-25T11:26:48.327 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 740 gmain root rtd unknown /proc/726/task/740/root (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 740 gmain root txt unknown /proc/726/task/740/exe (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:irqbalanc 726 740 gmain root NOFD /proc/726/task/740/fd (opendir: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:lsmd 727 libstoragemgmt cwd unknown /proc/727/cwd (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:lsmd 727 libstoragemgmt rtd unknown /proc/727/root (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:lsmd 727 libstoragemgmt txt unknown /proc/727/exe (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:lsmd 727 libstoragemgmt NOFD /proc/727/fd (opendir: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:mcelog 728 root cwd unknown /proc/728/cwd (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:mcelog 728 root rtd unknown /proc/728/root (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:mcelog 728 root txt unknown /proc/728/exe (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:mcelog 728 root NOFD /proc/728/fd (opendir: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:smartd 729 root cwd unknown /proc/729/cwd (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:smartd 729 root rtd unknown /proc/729/root (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:smartd 729 root txt unknown /proc/729/exe (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:smartd 729 root NOFD /proc/729/fd (opendir: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-l 734 root cwd unknown /proc/734/cwd (readlink: Permission denied) 2024-04-25T11:26:48.328 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-l 734 root rtd unknown /proc/734/root (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-l 734 root txt unknown /proc/734/exe (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:systemd-l 734 root NOFD /proc/734/fd (opendir: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 800 root cwd unknown /proc/800/cwd (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 800 root rtd unknown /proc/800/root (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 800 root txt unknown /proc/800/exe (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 800 root NOFD /proc/800/fd (opendir: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 root cwd unknown /proc/804/cwd (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 root rtd unknown /proc/804/root (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 root txt unknown /proc/804/exe (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 root NOFD /proc/804/fd (opendir: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 805 gssproxy root cwd unknown /proc/804/task/805/cwd (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 805 gssproxy root rtd unknown /proc/804/task/805/root (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 805 gssproxy root txt unknown /proc/804/task/805/exe (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 805 gssproxy root NOFD /proc/804/task/805/fd (opendir: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 806 gssproxy root cwd unknown /proc/804/task/806/cwd (readlink: Permission denied) 2024-04-25T11:26:48.329 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 806 gssproxy root rtd unknown /proc/804/task/806/root (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 806 gssproxy root txt unknown /proc/804/task/806/exe (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 806 gssproxy root NOFD /proc/804/task/806/fd (opendir: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 807 gssproxy root cwd unknown /proc/804/task/807/cwd (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 807 gssproxy root rtd unknown /proc/804/task/807/root (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 807 gssproxy root txt unknown /proc/804/task/807/exe (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 807 gssproxy root NOFD /proc/804/task/807/fd (opendir: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 808 gssproxy root cwd unknown /proc/804/task/808/cwd (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 808 gssproxy root rtd unknown /proc/804/task/808/root (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 808 gssproxy root txt unknown /proc/804/task/808/exe (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 808 gssproxy root NOFD /proc/804/task/808/fd (opendir: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 809 gssproxy root cwd unknown /proc/804/task/809/cwd (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 809 gssproxy root rtd unknown /proc/804/task/809/root (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 809 gssproxy root txt unknown /proc/804/task/809/exe (readlink: Permission denied) 2024-04-25T11:26:48.330 INFO:tasks.workunit.client.0.smithi080.stdout:gssproxy 804 809 gssproxy root NOFD /proc/804/task/809/fd (opendir: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:atd 811 root cwd unknown /proc/811/cwd (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:atd 811 root rtd unknown /proc/811/root (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:atd 811 root txt unknown /proc/811/exe (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:atd 811 root NOFD /proc/811/fd (opendir: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:crond 812 root cwd unknown /proc/812/cwd (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:crond 812 root rtd unknown /proc/812/root (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:crond 812 root txt unknown /proc/812/exe (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:crond 812 root NOFD /proc/812/fd (opendir: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:nrpe 836 nrpe cwd unknown /proc/836/cwd (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:nrpe 836 nrpe rtd unknown /proc/836/root (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:nrpe 836 nrpe txt unknown /proc/836/exe (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:nrpe 836 nrpe NOFD /proc/836/fd (opendir: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5161 root cwd unknown /proc/5161/cwd (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5161 root rtd unknown /proc/5161/root (readlink: Permission denied) 2024-04-25T11:26:48.331 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5161 root txt unknown /proc/5161/exe (readlink: Permission denied) 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5161 root NOFD /proc/5161/fd (opendir: Permission denied) 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5163 root cwd unknown /proc/5163/cwd (readlink: Permission denied) 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5163 root rtd unknown /proc/5163/root (readlink: Permission denied) 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5163 root txt unknown /proc/5163/exe (readlink: Permission denied) 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:agetty 5163 root NOFD /proc/5163/fd (opendir: Permission denied) 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu cwd DIR 8,1 4096 2 / 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu rtd DIR 8,1 4096 2 / 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu txt REG 8,1 98216 18583 /usr/lib/systemd/systemd 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu DEL REG 8,1 61581 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-25T11:26:48.332 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu DEL REG 8,1 62167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 28552 7287 /usr/lib64/libattr.so.1.1.2501 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 40496 7288 /usr/lib64/libacl.so.1.1.2301 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-25T11:26:48.333 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 107424 7663 /usr/lib64/libkmod.so.2.3.6 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 3785856 46432 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 2157904 46429 /usr/lib64/systemd/libsystemd-core-252.so 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 1u unix 0x0000000000000000 0t0 24759 type=STREAM (CONNECTED) 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 2u unix 0x0000000000000000 0t0 24759 type=STREAM (CONNECTED) 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 3u unix 0x0000000000000000 0t0 24787 type=DGRAM (CONNECTED) 2024-04-25T11:26:48.334 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 4u a_inode 0,14 0 2081 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 5u a_inode 0,14 0 2081 [signalfd] 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 6r a_inode 0,14 0 2081 inotify 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 7r DIR 0,25 0 3609 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 8u a_inode 0,14 0 2081 [timerfd] 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 9u a_inode 0,14 0 2081 [eventpoll:10,13] 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 10r REG 0,20 0 24776 /proc/5171/mountinfo 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 11r a_inode 0,14 0 2081 inotify 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 12u unix 0x0000000000000000 0t0 24817 /run/user/1000/bus type=STREAM (LISTEN) 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 13r a_inode 0,14 0 2081 inotify 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 15u netlink 0t0 24799 KOBJECT_UEVENT 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 16u unix 0x0000000000000000 0t0 24804 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 17u unix 0x0000000000000000 0t0 24805 type=DGRAM (CONNECTED) 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 18u unix 0x0000000000000000 0t0 24806 type=DGRAM (CONNECTED) 2024-04-25T11:26:48.335 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 19u unix 0x0000000000000000 0t0 24807 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 20u unix 0x0000000000000000 0t0 24809 type=STREAM (CONNECTED) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 5171 ubuntu 21u a_inode 0,14 0 2081 [timerfd] 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 5173 ubuntu cwd unknown /proc/5173/cwd (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 5173 ubuntu rtd unknown /proc/5173/root (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 5173 ubuntu txt unknown /proc/5173/exe (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 5173 ubuntu NOFD /proc/5173/fd (opendir: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:tls-strp 5524 root cwd unknown /proc/5524/cwd (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:tls-strp 5524 root rtd unknown /proc/5524/root (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:tls-strp 5524 root txt unknown /proc/5524/exe (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:tls-strp 5524 root NOFD /proc/5524/fd (opendir: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 polkitd cwd unknown /proc/5604/cwd (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 polkitd rtd unknown /proc/5604/root (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 polkitd txt unknown /proc/5604/exe (readlink: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 polkitd NOFD /proc/5604/fd (opendir: Permission denied) 2024-04-25T11:26:48.336 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5606 gmain polkitd cwd unknown /proc/5604/task/5606/cwd (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5606 gmain polkitd rtd unknown /proc/5604/task/5606/root (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5606 gmain polkitd txt unknown /proc/5604/task/5606/exe (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5606 gmain polkitd NOFD /proc/5604/task/5606/fd (opendir: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5607 gdbus polkitd cwd unknown /proc/5604/task/5607/cwd (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5607 gdbus polkitd rtd unknown /proc/5604/task/5607/root (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5607 gdbus polkitd txt unknown /proc/5604/task/5607/exe (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5607 gdbus polkitd NOFD /proc/5604/task/5607/fd (opendir: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5608 JS\x20Hel polkitd cwd unknown /proc/5604/task/5608/cwd (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5608 JS\x20Hel polkitd rtd unknown /proc/5604/task/5608/root (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5608 JS\x20Hel polkitd txt unknown /proc/5604/task/5608/exe (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5608 JS\x20Hel polkitd NOFD /proc/5604/task/5608/fd (opendir: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5609 JS\x20Hel polkitd cwd unknown /proc/5604/task/5609/cwd (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5609 JS\x20Hel polkitd rtd unknown /proc/5604/task/5609/root (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5609 JS\x20Hel polkitd txt unknown /proc/5604/task/5609/exe (readlink: Permission denied) 2024-04-25T11:26:48.337 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5609 JS\x20Hel polkitd NOFD /proc/5604/task/5609/fd (opendir: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5610 JS\x20Hel polkitd cwd unknown /proc/5604/task/5610/cwd (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5610 JS\x20Hel polkitd rtd unknown /proc/5604/task/5610/root (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5610 JS\x20Hel polkitd txt unknown /proc/5604/task/5610/exe (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5610 JS\x20Hel polkitd NOFD /proc/5604/task/5610/fd (opendir: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5611 JS\x20Hel polkitd cwd unknown /proc/5604/task/5611/cwd (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5611 JS\x20Hel polkitd rtd unknown /proc/5604/task/5611/root (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5611 JS\x20Hel polkitd txt unknown /proc/5604/task/5611/exe (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5611 JS\x20Hel polkitd NOFD /proc/5604/task/5611/fd (opendir: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5612 JS\x20Hel polkitd cwd unknown /proc/5604/task/5612/cwd (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5612 JS\x20Hel polkitd rtd unknown /proc/5604/task/5612/root (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5612 JS\x20Hel polkitd txt unknown /proc/5604/task/5612/exe (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5612 JS\x20Hel polkitd NOFD /proc/5604/task/5612/fd (opendir: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5613 JS\x20Hel polkitd cwd unknown /proc/5604/task/5613/cwd (readlink: Permission denied) 2024-04-25T11:26:48.338 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5613 JS\x20Hel polkitd rtd unknown /proc/5604/task/5613/root (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5613 JS\x20Hel polkitd txt unknown /proc/5604/task/5613/exe (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5613 JS\x20Hel polkitd NOFD /proc/5604/task/5613/fd (opendir: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5614 JS\x20Hel polkitd cwd unknown /proc/5604/task/5614/cwd (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5614 JS\x20Hel polkitd rtd unknown /proc/5604/task/5614/root (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5614 JS\x20Hel polkitd txt unknown /proc/5604/task/5614/exe (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5614 JS\x20Hel polkitd NOFD /proc/5604/task/5614/fd (opendir: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5615 JS\x20Hel polkitd cwd unknown /proc/5604/task/5615/cwd (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5615 JS\x20Hel polkitd rtd unknown /proc/5604/task/5615/root (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5615 JS\x20Hel polkitd txt unknown /proc/5604/task/5615/exe (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5615 JS\x20Hel polkitd NOFD /proc/5604/task/5615/fd (opendir: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5616 polkitd polkitd cwd unknown /proc/5604/task/5616/cwd (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5616 polkitd polkitd rtd unknown /proc/5604/task/5616/root (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5616 polkitd polkitd txt unknown /proc/5604/task/5616/exe (readlink: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:polkitd 5604 5616 polkitd polkitd NOFD /proc/5604/task/5616/fd (opendir: Permission denied) 2024-04-25T11:26:48.339 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 root cwd unknown /proc/5834/cwd (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 root rtd unknown /proc/5834/root (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 root txt unknown /proc/5834/exe (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 root NOFD /proc/5834/fd (opendir: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5836 in:imjour root cwd unknown /proc/5834/task/5836/cwd (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5836 in:imjour root rtd unknown /proc/5834/task/5836/root (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5836 in:imjour root txt unknown /proc/5834/task/5836/exe (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5836 in:imjour root NOFD /proc/5834/task/5836/fd (opendir: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5837 rs:main root cwd unknown /proc/5834/task/5837/cwd (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5837 rs:main root rtd unknown /proc/5834/task/5837/root (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5837 rs:main root txt unknown /proc/5834/task/5837/exe (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:rsyslogd 5834 5837 rs:main root NOFD /proc/5834/task/5837/fd (opendir: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 9181 root cwd unknown /proc/9181/cwd (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 9181 root rtd unknown /proc/9181/root (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 9181 root txt unknown /proc/9181/exe (readlink: Permission denied) 2024-04-25T11:26:48.340 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 9181 root NOFD /proc/9181/fd (opendir: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19230 root cwd unknown /proc/19230/cwd (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19230 root rtd unknown /proc/19230/root (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19230 root txt unknown /proc/19230/exe (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19230 root NOFD /proc/19230/fd (opendir: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19259 root cwd unknown /proc/19259/cwd (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19259 root rtd unknown /proc/19259/root (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19259 root txt unknown /proc/19259/exe (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19259 root NOFD /proc/19259/fd (opendir: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19288 root cwd unknown /proc/19288/cwd (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19288 root rtd unknown /proc/19288/root (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19288 root txt unknown /proc/19288/exe (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19288 root NOFD /proc/19288/fd (opendir: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19317 root cwd unknown /proc/19317/cwd (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19317 root rtd unknown /proc/19317/root (readlink: Permission denied) 2024-04-25T11:26:48.341 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19317 root txt unknown /proc/19317/exe (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19317 root NOFD /proc/19317/fd (opendir: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19346 root cwd unknown /proc/19346/cwd (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19346 root rtd unknown /proc/19346/root (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19346 root txt unknown /proc/19346/exe (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:kdmflush/ 19346 root NOFD /proc/19346/fd (opendir: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfsalloc 19510 root cwd unknown /proc/19510/cwd (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfsalloc 19510 root rtd unknown /proc/19510/root (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfsalloc 19510 root txt unknown /proc/19510/exe (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfsalloc 19510 root NOFD /proc/19510/fd (opendir: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfs_mru_c 19511 root cwd unknown /proc/19511/cwd (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfs_mru_c 19511 root rtd unknown /proc/19511/root (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfs_mru_c 19511 root txt unknown /proc/19511/exe (readlink: Permission denied) 2024-04-25T11:26:48.342 INFO:tasks.workunit.client.0.smithi080.stdout:xfs_mru_c 19511 root NOFD /proc/19511/fd (opendir: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-buf/d 19512 root cwd unknown /proc/19512/cwd (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-buf/d 19512 root rtd unknown /proc/19512/root (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-buf/d 19512 root txt unknown /proc/19512/exe (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-buf/d 19512 root NOFD /proc/19512/fd (opendir: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-conv/ 19513 root cwd unknown /proc/19513/cwd (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-conv/ 19513 root rtd unknown /proc/19513/root (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-conv/ 19513 root txt unknown /proc/19513/exe (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-conv/ 19513 root NOFD /proc/19513/fd (opendir: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-recla 19514 root cwd unknown /proc/19514/cwd (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-recla 19514 root rtd unknown /proc/19514/root (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-recla 19514 root txt unknown /proc/19514/exe (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-recla 19514 root NOFD /proc/19514/fd (opendir: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-block 19515 root cwd unknown /proc/19515/cwd (readlink: Permission denied) 2024-04-25T11:26:48.343 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-block 19515 root rtd unknown /proc/19515/root (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-block 19515 root txt unknown /proc/19515/exe (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-block 19515 root NOFD /proc/19515/fd (opendir: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-inode 19516 root cwd unknown /proc/19516/cwd (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-inode 19516 root rtd unknown /proc/19516/root (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-inode 19516 root txt unknown /proc/19516/exe (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-inode 19516 root NOFD /proc/19516/fd (opendir: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-log/d 19517 root cwd unknown /proc/19517/cwd (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-log/d 19517 root rtd unknown /proc/19517/root (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-log/d 19517 root txt unknown /proc/19517/exe (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-log/d 19517 root NOFD /proc/19517/fd (opendir: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-cil/d 19518 root cwd unknown /proc/19518/cwd (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-cil/d 19518 root rtd unknown /proc/19518/root (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-cil/d 19518 root txt unknown /proc/19518/exe (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfs-cil/d 19518 root NOFD /proc/19518/fd (opendir: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfsaild/d 19519 root cwd unknown /proc/19519/cwd (readlink: Permission denied) 2024-04-25T11:26:48.344 INFO:tasks.workunit.client.0.smithi080.stdout:xfsaild/d 19519 root rtd unknown /proc/19519/root (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:xfsaild/d 19519 root txt unknown /proc/19519/exe (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:xfsaild/d 19519 root NOFD /proc/19519/fd (opendir: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20447 root cwd unknown /proc/20447/cwd (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20447 root rtd unknown /proc/20447/root (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20447 root txt unknown /proc/20447/exe (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20447 root NOFD /proc/20447/fd (opendir: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20450 ubuntu cwd unknown /proc/20450/cwd (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20450 ubuntu rtd unknown /proc/20450/root (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20450 ubuntu txt unknown /proc/20450/exe (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 20450 ubuntu NOFD /proc/20450/fd (opendir: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:chronyd 20511 chrony cwd unknown /proc/20511/cwd (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:chronyd 20511 chrony rtd unknown /proc/20511/root (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:chronyd 20511 chrony txt unknown /proc/20511/exe (readlink: Permission denied) 2024-04-25T11:26:48.345 INFO:tasks.workunit.client.0.smithi080.stdout:chronyd 20511 chrony NOFD /proc/20511/fd (opendir: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 20790 root cwd unknown /proc/20790/cwd (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 20790 root rtd unknown /proc/20790/root (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 20790 root txt unknown /proc/20790/exe (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 20790 root NOFD /proc/20790/fd (opendir: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-cras 20799 ceph cwd unknown /proc/20799/cwd (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-cras 20799 ceph rtd unknown /proc/20799/root (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-cras 20799 ceph txt unknown /proc/20799/exe (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-cras 20799 ceph NOFD /proc/20799/fd (opendir: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 20807 root cwd unknown /proc/20807/cwd (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 20807 root rtd unknown /proc/20807/root (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 20807 root txt unknown /proc/20807/exe (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 20807 root NOFD /proc/20807/fd (opendir: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 21435 root cwd unknown /proc/21435/cwd (readlink: Permission denied) 2024-04-25T11:26:48.346 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 21435 root rtd unknown /proc/21435/root (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 21435 root txt unknown /proc/21435/exe (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 21435 root NOFD /proc/21435/fd (opendir: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 21735 root cwd unknown /proc/21735/cwd (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 21735 root rtd unknown /proc/21735/root (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 21735 root txt unknown /proc/21735/exe (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 21735 root NOFD /proc/21735/fd (opendir: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28106 root cwd unknown /proc/28106/cwd (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28106 root rtd unknown /proc/28106/root (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28106 root txt unknown /proc/28106/exe (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28106 root NOFD /proc/28106/fd (opendir: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28123 root cwd unknown /proc/28123/cwd (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28123 root rtd unknown /proc/28123/root (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28123 root txt unknown /proc/28123/exe (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28123 root NOFD /proc/28123/fd (opendir: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28124 root cwd unknown /proc/28124/cwd (readlink: Permission denied) 2024-04-25T11:26:48.347 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28124 root rtd unknown /proc/28124/root (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28124 root txt unknown /proc/28124/exe (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 28124 root NOFD /proc/28124/fd (opendir: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28141 root cwd unknown /proc/28141/cwd (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28141 root rtd unknown /proc/28141/root (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28141 root txt unknown /proc/28141/exe (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 28141 root NOFD /proc/28141/fd (opendir: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 29069 root cwd unknown /proc/29069/cwd (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 29069 root rtd unknown /proc/29069/root (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 29069 root txt unknown /proc/29069/exe (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 29069 root NOFD /proc/29069/fd (opendir: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29122 root cwd unknown /proc/29122/cwd (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29122 root rtd unknown /proc/29122/root (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29122 root txt unknown /proc/29122/exe (readlink: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29122 root NOFD /proc/29122/fd (opendir: Permission denied) 2024-04-25T11:26:48.348 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29124 root cwd unknown /proc/29124/cwd (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29124 root rtd unknown /proc/29124/root (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29124 root txt unknown /proc/29124/exe (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29124 root NOFD /proc/29124/fd (opendir: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 ceph cwd unknown /proc/29126/cwd (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 ceph rtd unknown /proc/29126/root (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 ceph txt unknown /proc/29126/exe (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 ceph NOFD /proc/29126/fd (opendir: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29127 log ceph cwd unknown /proc/29126/task/29127/cwd (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29127 log ceph rtd unknown /proc/29126/task/29127/root (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29127 log ceph txt unknown /proc/29126/task/29127/exe (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29127 log ceph NOFD /proc/29126/task/29127/fd (opendir: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29128 service ceph cwd unknown /proc/29126/task/29128/cwd (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29128 service ceph rtd unknown /proc/29126/task/29128/root (readlink: Permission denied) 2024-04-25T11:26:48.349 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29128 service ceph txt unknown /proc/29126/task/29128/exe (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29128 service ceph NOFD /proc/29126/task/29128/fd (opendir: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29129 admin_soc ceph cwd unknown /proc/29126/task/29129/cwd (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29129 admin_soc ceph rtd unknown /proc/29126/task/29129/root (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29129 admin_soc ceph txt unknown /proc/29126/task/29129/exe (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29129 admin_soc ceph NOFD /proc/29126/task/29129/fd (opendir: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29130 signal_ha ceph cwd unknown /proc/29126/task/29130/cwd (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29130 signal_ha ceph rtd unknown /proc/29126/task/29130/root (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29130 signal_ha ceph txt unknown /proc/29126/task/29130/exe (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29130 signal_ha ceph NOFD /proc/29126/task/29130/fd (opendir: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29131 rocksdb:l ceph cwd unknown /proc/29126/task/29131/cwd (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29131 rocksdb:l ceph rtd unknown /proc/29126/task/29131/root (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29131 rocksdb:l ceph txt unknown /proc/29126/task/29131/exe (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29131 rocksdb:l ceph NOFD /proc/29126/task/29131/fd (opendir: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29132 rocksdb:h ceph cwd unknown /proc/29126/task/29132/cwd (readlink: Permission denied) 2024-04-25T11:26:48.350 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29132 rocksdb:h ceph rtd unknown /proc/29126/task/29132/root (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29132 rocksdb:h ceph txt unknown /proc/29126/task/29132/exe (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29132 rocksdb:h ceph NOFD /proc/29126/task/29132/fd (opendir: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29148 ceph-mon ceph cwd unknown /proc/29126/task/29148/cwd (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29148 ceph-mon ceph rtd unknown /proc/29126/task/29148/root (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29148 ceph-mon ceph txt unknown /proc/29126/task/29148/exe (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29148 ceph-mon ceph NOFD /proc/29126/task/29148/fd (opendir: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29149 fn_monsto ceph cwd unknown /proc/29126/task/29149/cwd (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29149 fn_monsto ceph rtd unknown /proc/29126/task/29149/root (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29149 fn_monsto ceph txt unknown /proc/29126/task/29149/exe (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29149 fn_monsto ceph NOFD /proc/29126/task/29149/fd (opendir: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29150 msgr-work ceph cwd unknown /proc/29126/task/29150/cwd (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29150 msgr-work ceph rtd unknown /proc/29126/task/29150/root (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29150 msgr-work ceph txt unknown /proc/29126/task/29150/exe (readlink: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29150 msgr-work ceph NOFD /proc/29126/task/29150/fd (opendir: Permission denied) 2024-04-25T11:26:48.351 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29151 msgr-work ceph cwd unknown /proc/29126/task/29151/cwd (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29151 msgr-work ceph rtd unknown /proc/29126/task/29151/root (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29151 msgr-work ceph txt unknown /proc/29126/task/29151/exe (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29151 msgr-work ceph NOFD /proc/29126/task/29151/fd (opendir: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29152 msgr-work ceph cwd unknown /proc/29126/task/29152/cwd (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29152 msgr-work ceph rtd unknown /proc/29126/task/29152/root (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29152 msgr-work ceph txt unknown /proc/29126/task/29152/exe (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29152 msgr-work ceph NOFD /proc/29126/task/29152/fd (opendir: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29153 OpHistory ceph cwd unknown /proc/29126/task/29153/cwd (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29153 OpHistory ceph rtd unknown /proc/29126/task/29153/root (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29153 OpHistory ceph txt unknown /proc/29126/task/29153/exe (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29153 OpHistory ceph NOFD /proc/29126/task/29153/fd (opendir: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29154 fin ceph cwd unknown /proc/29126/task/29154/cwd (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29154 fin ceph rtd unknown /proc/29126/task/29154/root (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29154 fin ceph txt unknown /proc/29126/task/29154/exe (readlink: Permission denied) 2024-04-25T11:26:48.352 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29154 fin ceph NOFD /proc/29126/task/29154/fd (opendir: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29155 safe_time ceph cwd unknown /proc/29126/task/29155/cwd (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29155 safe_time ceph rtd unknown /proc/29126/task/29155/root (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29155 safe_time ceph txt unknown /proc/29126/task/29155/exe (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29155 safe_time ceph NOFD /proc/29126/task/29155/fd (opendir: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29156 cpu_tp ceph cwd unknown /proc/29126/task/29156/cwd (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29156 cpu_tp ceph rtd unknown /proc/29126/task/29156/root (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29156 cpu_tp ceph txt unknown /proc/29126/task/29156/exe (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29156 cpu_tp ceph NOFD /proc/29126/task/29156/fd (opendir: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29157 cpu_tp ceph cwd unknown /proc/29126/task/29157/cwd (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29157 cpu_tp ceph rtd unknown /proc/29126/task/29157/root (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29157 cpu_tp ceph txt unknown /proc/29126/task/29157/exe (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29157 cpu_tp ceph NOFD /proc/29126/task/29157/fd (opendir: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29158 cpu_tp ceph cwd unknown /proc/29126/task/29158/cwd (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29158 cpu_tp ceph rtd unknown /proc/29126/task/29158/root (readlink: Permission denied) 2024-04-25T11:26:48.353 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29158 cpu_tp ceph txt unknown /proc/29126/task/29158/exe (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29158 cpu_tp ceph NOFD /proc/29126/task/29158/fd (opendir: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29159 cpu_tp ceph cwd unknown /proc/29126/task/29159/cwd (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29159 cpu_tp ceph rtd unknown /proc/29126/task/29159/root (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29159 cpu_tp ceph txt unknown /proc/29126/task/29159/exe (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29159 cpu_tp ceph NOFD /proc/29126/task/29159/fd (opendir: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29160 ms_dispat ceph cwd unknown /proc/29126/task/29160/cwd (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29160 ms_dispat ceph rtd unknown /proc/29126/task/29160/root (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29160 ms_dispat ceph txt unknown /proc/29126/task/29160/exe (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29160 ms_dispat ceph NOFD /proc/29126/task/29160/fd (opendir: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29161 ms_local ceph cwd unknown /proc/29126/task/29161/cwd (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29161 ms_local ceph rtd unknown /proc/29126/task/29161/root (readlink: Permission denied) 2024-04-25T11:26:48.354 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29161 ms_local ceph txt unknown /proc/29126/task/29161/exe (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29161 ms_local ceph NOFD /proc/29126/task/29161/fd (opendir: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29162 safe_time ceph cwd unknown /proc/29126/task/29162/cwd (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29162 safe_time ceph rtd unknown /proc/29126/task/29162/root (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29162 safe_time ceph txt unknown /proc/29126/task/29162/exe (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29162 safe_time ceph NOFD /proc/29126/task/29162/fd (opendir: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29163 ms_dispat ceph cwd unknown /proc/29126/task/29163/cwd (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29163 ms_dispat ceph rtd unknown /proc/29126/task/29163/root (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29163 ms_dispat ceph txt unknown /proc/29126/task/29163/exe (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29163 ms_dispat ceph NOFD /proc/29126/task/29163/fd (opendir: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29164 ms_local ceph cwd unknown /proc/29126/task/29164/cwd (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29164 ms_local ceph rtd unknown /proc/29126/task/29164/root (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29164 ms_local ceph txt unknown /proc/29126/task/29164/exe (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 29164 ms_local ceph NOFD /proc/29126/task/29164/fd (opendir: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 67849 rstore_co ceph cwd unknown /proc/29126/task/67849/cwd (readlink: Permission denied) 2024-04-25T11:26:48.355 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 67849 rstore_co ceph rtd unknown /proc/29126/task/67849/root (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 67849 rstore_co ceph txt unknown /proc/29126/task/67849/exe (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mon 29126 67849 rstore_co ceph NOFD /proc/29126/task/67849/fd (opendir: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29355 root cwd unknown /proc/29355/cwd (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29355 root rtd unknown /proc/29355/root (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29355 root txt unknown /proc/29355/exe (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 29355 root NOFD /proc/29355/fd (opendir: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29357 root cwd unknown /proc/29357/cwd (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29357 root rtd unknown /proc/29357/root (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29357 root txt unknown /proc/29357/exe (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 29357 root NOFD /proc/29357/fd (opendir: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 ceph cwd unknown /proc/29359/cwd (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 ceph rtd unknown /proc/29359/root (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 ceph txt unknown /proc/29359/exe (readlink: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 ceph NOFD /proc/29359/fd (opendir: Permission denied) 2024-04-25T11:26:48.356 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80261 log ceph cwd unknown /proc/29359/task/80261/cwd (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80261 log ceph rtd unknown /proc/29359/task/80261/root (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80261 log ceph txt unknown /proc/29359/task/80261/exe (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80261 log ceph NOFD /proc/29359/task/80261/fd (opendir: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80263 msgr-work ceph cwd unknown /proc/29359/task/80263/cwd (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80263 msgr-work ceph rtd unknown /proc/29359/task/80263/root (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80263 msgr-work ceph txt unknown /proc/29359/task/80263/exe (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80263 msgr-work ceph NOFD /proc/29359/task/80263/fd (opendir: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80264 msgr-work ceph cwd unknown /proc/29359/task/80264/cwd (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80264 msgr-work ceph rtd unknown /proc/29359/task/80264/root (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80264 msgr-work ceph txt unknown /proc/29359/task/80264/exe (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80264 msgr-work ceph NOFD /proc/29359/task/80264/fd (opendir: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80265 msgr-work ceph cwd unknown /proc/29359/task/80265/cwd (readlink: Permission denied) 2024-04-25T11:26:48.357 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80265 msgr-work ceph rtd unknown /proc/29359/task/80265/root (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80265 msgr-work ceph txt unknown /proc/29359/task/80265/exe (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80265 msgr-work ceph NOFD /proc/29359/task/80265/fd (opendir: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80269 service ceph cwd unknown /proc/29359/task/80269/cwd (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80269 service ceph rtd unknown /proc/29359/task/80269/root (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80269 service ceph txt unknown /proc/29359/task/80269/exe (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80269 service ceph NOFD /proc/29359/task/80269/fd (opendir: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80270 admin_soc ceph cwd unknown /proc/29359/task/80270/cwd (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80270 admin_soc ceph rtd unknown /proc/29359/task/80270/root (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80270 admin_soc ceph txt unknown /proc/29359/task/80270/exe (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80270 admin_soc ceph NOFD /proc/29359/task/80270/fd (opendir: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80271 ceph_time ceph cwd unknown /proc/29359/task/80271/cwd (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80271 ceph_time ceph rtd unknown /proc/29359/task/80271/root (readlink: Permission denied) 2024-04-25T11:26:48.358 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80271 ceph_time ceph txt unknown /proc/29359/task/80271/exe (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80271 ceph_time ceph NOFD /proc/29359/task/80271/fd (opendir: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80272 fn_anonym ceph cwd unknown /proc/29359/task/80272/cwd (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80272 fn_anonym ceph rtd unknown /proc/29359/task/80272/root (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80272 fn_anonym ceph txt unknown /proc/29359/task/80272/exe (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80272 fn_anonym ceph NOFD /proc/29359/task/80272/fd (opendir: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80273 signal_ha ceph cwd unknown /proc/29359/task/80273/cwd (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80273 signal_ha ceph rtd unknown /proc/29359/task/80273/root (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80273 signal_ha ceph txt unknown /proc/29359/task/80273/exe (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80273 signal_ha ceph NOFD /proc/29359/task/80273/fd (opendir: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80274 mgrsb-fin ceph cwd unknown /proc/29359/task/80274/cwd (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80274 mgrsb-fin ceph rtd unknown /proc/29359/task/80274/root (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80274 mgrsb-fin ceph txt unknown /proc/29359/task/80274/exe (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80274 mgrsb-fin ceph NOFD /proc/29359/task/80274/fd (opendir: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80275 ms_dispat ceph cwd unknown /proc/29359/task/80275/cwd (readlink: Permission denied) 2024-04-25T11:26:48.359 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80275 ms_dispat ceph rtd unknown /proc/29359/task/80275/root (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80275 ms_dispat ceph txt unknown /proc/29359/task/80275/exe (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80275 ms_dispat ceph NOFD /proc/29359/task/80275/fd (opendir: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80276 ms_local ceph cwd unknown /proc/29359/task/80276/cwd (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80276 ms_local ceph rtd unknown /proc/29359/task/80276/root (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80276 ms_local ceph txt unknown /proc/29359/task/80276/exe (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80276 ms_local ceph NOFD /proc/29359/task/80276/fd (opendir: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80277 io_contex ceph cwd unknown /proc/29359/task/80277/cwd (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80277 io_contex ceph rtd unknown /proc/29359/task/80277/root (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80277 io_contex ceph txt unknown /proc/29359/task/80277/exe (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80277 io_contex ceph NOFD /proc/29359/task/80277/fd (opendir: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80278 io_contex ceph cwd unknown /proc/29359/task/80278/cwd (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80278 io_contex ceph rtd unknown /proc/29359/task/80278/root (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80278 io_contex ceph txt unknown /proc/29359/task/80278/exe (readlink: Permission denied) 2024-04-25T11:26:48.360 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80278 io_contex ceph NOFD /proc/29359/task/80278/fd (opendir: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80279 safe_time ceph cwd unknown /proc/29359/task/80279/cwd (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80279 safe_time ceph rtd unknown /proc/29359/task/80279/root (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80279 safe_time ceph txt unknown /proc/29359/task/80279/exe (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80279 safe_time ceph NOFD /proc/29359/task/80279/fd (opendir: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80280 safe_time ceph cwd unknown /proc/29359/task/80280/cwd (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80280 safe_time ceph rtd unknown /proc/29359/task/80280/root (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80280 safe_time ceph txt unknown /proc/29359/task/80280/exe (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80280 safe_time ceph NOFD /proc/29359/task/80280/fd (opendir: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80281 safe_time ceph cwd unknown /proc/29359/task/80281/cwd (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80281 safe_time ceph rtd unknown /proc/29359/task/80281/root (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80281 safe_time ceph txt unknown /proc/29359/task/80281/exe (readlink: Permission denied) 2024-04-25T11:26:48.361 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80281 safe_time ceph NOFD /proc/29359/task/80281/fd (opendir: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80282 fn_anonym ceph cwd unknown /proc/29359/task/80282/cwd (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80282 fn_anonym ceph rtd unknown /proc/29359/task/80282/root (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80282 fn_anonym ceph txt unknown /proc/29359/task/80282/exe (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80282 fn_anonym ceph NOFD /proc/29359/task/80282/fd (opendir: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80283 flusher ceph cwd unknown /proc/29359/task/80283/cwd (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80283 flusher ceph rtd unknown /proc/29359/task/80283/root (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80283 flusher ceph txt unknown /proc/29359/task/80283/exe (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80283 flusher ceph NOFD /proc/29359/task/80283/fd (opendir: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80284 safe_time ceph cwd unknown /proc/29359/task/80284/cwd (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80284 safe_time ceph rtd unknown /proc/29359/task/80284/root (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80284 safe_time ceph txt unknown /proc/29359/task/80284/exe (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 80284 safe_time ceph NOFD /proc/29359/task/80284/fd (opendir: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81254 OpHistory ceph cwd unknown /proc/29359/task/81254/cwd (readlink: Permission denied) 2024-04-25T11:26:48.362 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81254 OpHistory ceph rtd unknown /proc/29359/task/81254/root (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81254 OpHistory ceph txt unknown /proc/29359/task/81254/exe (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81254 OpHistory ceph NOFD /proc/29359/task/81254/fd (opendir: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81255 mgr-fin ceph cwd unknown /proc/29359/task/81255/cwd (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81255 mgr-fin ceph rtd unknown /proc/29359/task/81255/root (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81255 mgr-fin ceph txt unknown /proc/29359/task/81255/exe (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81255 mgr-fin ceph NOFD /proc/29359/task/81255/fd (opendir: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81256 ms_dispat ceph cwd unknown /proc/29359/task/81256/cwd (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81256 ms_dispat ceph rtd unknown /proc/29359/task/81256/root (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81256 ms_dispat ceph txt unknown /proc/29359/task/81256/exe (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81256 ms_dispat ceph NOFD /proc/29359/task/81256/fd (opendir: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81257 ms_local ceph cwd unknown /proc/29359/task/81257/cwd (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81257 ms_local ceph rtd unknown /proc/29359/task/81257/root (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81257 ms_local ceph txt unknown /proc/29359/task/81257/exe (readlink: Permission denied) 2024-04-25T11:26:48.363 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81257 ms_local ceph NOFD /proc/29359/task/81257/fd (opendir: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81258 safe_time ceph cwd unknown /proc/29359/task/81258/cwd (readlink: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81258 safe_time ceph rtd unknown /proc/29359/task/81258/root (readlink: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81258 safe_time ceph txt unknown /proc/29359/task/81258/exe (readlink: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81258 safe_time ceph NOFD /proc/29359/task/81258/fd (opendir: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81259 cmdfin ceph cwd unknown /proc/29359/task/81259/cwd (readlink: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81259 cmdfin ceph rtd unknown /proc/29359/task/81259/root (readlink: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81259 cmdfin ceph txt unknown /proc/29359/task/81259/exe (readlink: Permission denied) 2024-04-25T11:26:48.364 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81259 cmdfin ceph NOFD /proc/29359/task/81259/fd (opendir: Permission denied) 2024-04-25T11:26:48.365 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81263 io_contex ceph cwd unknown /proc/29359/task/81263/cwd (readlink: Permission denied) 2024-04-25T11:26:48.365 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81263 io_contex ceph rtd unknown /proc/29359/task/81263/root (readlink: Permission denied) 2024-04-25T11:26:48.365 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81263 io_contex ceph txt unknown /proc/29359/task/81263/exe (readlink: Permission denied) 2024-04-25T11:26:48.365 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81263 io_contex ceph NOFD /proc/29359/task/81263/fd (opendir: Permission denied) 2024-04-25T11:26:48.365 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81264 io_contex ceph cwd unknown /proc/29359/task/81264/cwd (readlink: Permission denied) 2024-04-25T11:26:48.365 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81264 io_contex ceph rtd unknown /proc/29359/task/81264/root (readlink: Permission denied) 2024-04-25T11:26:48.366 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81264 io_contex ceph txt unknown /proc/29359/task/81264/exe (readlink: Permission denied) 2024-04-25T11:26:48.366 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81264 io_contex ceph NOFD /proc/29359/task/81264/fd (opendir: Permission denied) 2024-04-25T11:26:48.366 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81265 ceph_time ceph cwd unknown /proc/29359/task/81265/cwd (readlink: Permission denied) 2024-04-25T11:26:48.366 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81265 ceph_time ceph rtd unknown /proc/29359/task/81265/root (readlink: Permission denied) 2024-04-25T11:26:48.366 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81265 ceph_time ceph txt unknown /proc/29359/task/81265/exe (readlink: Permission denied) 2024-04-25T11:26:48.367 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81265 ceph_time ceph NOFD /proc/29359/task/81265/fd (opendir: Permission denied) 2024-04-25T11:26:48.367 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81266 ms_dispat ceph cwd unknown /proc/29359/task/81266/cwd (readlink: Permission denied) 2024-04-25T11:26:48.367 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81266 ms_dispat ceph rtd unknown /proc/29359/task/81266/root (readlink: Permission denied) 2024-04-25T11:26:48.367 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81266 ms_dispat ceph txt unknown /proc/29359/task/81266/exe (readlink: Permission denied) 2024-04-25T11:26:48.367 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81266 ms_dispat ceph NOFD /proc/29359/task/81266/fd (opendir: Permission denied) 2024-04-25T11:26:48.367 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81267 ms_local ceph cwd unknown /proc/29359/task/81267/cwd (readlink: Permission denied) 2024-04-25T11:26:48.368 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81267 ms_local ceph rtd unknown /proc/29359/task/81267/root (readlink: Permission denied) 2024-04-25T11:26:48.368 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81267 ms_local ceph txt unknown /proc/29359/task/81267/exe (readlink: Permission denied) 2024-04-25T11:26:48.368 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81267 ms_local ceph NOFD /proc/29359/task/81267/fd (opendir: Permission denied) 2024-04-25T11:26:48.368 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81268 safe_time ceph cwd unknown /proc/29359/task/81268/cwd (readlink: Permission denied) 2024-04-25T11:26:48.368 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81268 safe_time ceph rtd unknown /proc/29359/task/81268/root (readlink: Permission denied) 2024-04-25T11:26:48.369 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81268 safe_time ceph txt unknown /proc/29359/task/81268/exe (readlink: Permission denied) 2024-04-25T11:26:48.369 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81268 safe_time ceph NOFD /proc/29359/task/81268/fd (opendir: Permission denied) 2024-04-25T11:26:48.369 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81269 safe_time ceph cwd unknown /proc/29359/task/81269/cwd (readlink: Permission denied) 2024-04-25T11:26:48.369 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81269 safe_time ceph rtd unknown /proc/29359/task/81269/root (readlink: Permission denied) 2024-04-25T11:26:48.369 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81269 safe_time ceph txt unknown /proc/29359/task/81269/exe (readlink: Permission denied) 2024-04-25T11:26:48.369 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81269 safe_time ceph NOFD /proc/29359/task/81269/fd (opendir: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81270 balancer ceph cwd unknown /proc/29359/task/81270/cwd (readlink: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81270 balancer ceph rtd unknown /proc/29359/task/81270/root (readlink: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81270 balancer ceph txt unknown /proc/29359/task/81270/exe (readlink: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81270 balancer ceph NOFD /proc/29359/task/81270/fd (opendir: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81271 m-fin-bal ceph cwd unknown /proc/29359/task/81271/cwd (readlink: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81271 m-fin-bal ceph rtd unknown /proc/29359/task/81271/root (readlink: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81271 m-fin-bal ceph txt unknown /proc/29359/task/81271/exe (readlink: Permission denied) 2024-04-25T11:26:48.370 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81271 m-fin-bal ceph NOFD /proc/29359/task/81271/fd (opendir: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81272 mgr-fin ceph cwd unknown /proc/29359/task/81272/cwd (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81272 mgr-fin ceph rtd unknown /proc/29359/task/81272/root (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81272 mgr-fin ceph txt unknown /proc/29359/task/81272/exe (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81272 mgr-fin ceph NOFD /proc/29359/task/81272/fd (opendir: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81273 mgr-fin ceph cwd unknown /proc/29359/task/81273/cwd (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81273 mgr-fin ceph rtd unknown /proc/29359/task/81273/root (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81273 mgr-fin ceph txt unknown /proc/29359/task/81273/exe (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81273 mgr-fin ceph NOFD /proc/29359/task/81273/fd (opendir: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81274 mgr-fin ceph cwd unknown /proc/29359/task/81274/cwd (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81274 mgr-fin ceph rtd unknown /proc/29359/task/81274/root (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81274 mgr-fin ceph txt unknown /proc/29359/task/81274/exe (readlink: Permission denied) 2024-04-25T11:26:48.371 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81274 mgr-fin ceph NOFD /proc/29359/task/81274/fd (opendir: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81275 mgr-fin ceph cwd unknown /proc/29359/task/81275/cwd (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81275 mgr-fin ceph rtd unknown /proc/29359/task/81275/root (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81275 mgr-fin ceph txt unknown /proc/29359/task/81275/exe (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81275 mgr-fin ceph NOFD /proc/29359/task/81275/fd (opendir: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81276 mgr-fin ceph cwd unknown /proc/29359/task/81276/cwd (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81276 mgr-fin ceph rtd unknown /proc/29359/task/81276/root (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81276 mgr-fin ceph txt unknown /proc/29359/task/81276/exe (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81276 mgr-fin ceph NOFD /proc/29359/task/81276/fd (opendir: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81277 mgr-fin ceph cwd unknown /proc/29359/task/81277/cwd (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81277 mgr-fin ceph rtd unknown /proc/29359/task/81277/root (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81277 mgr-fin ceph txt unknown /proc/29359/task/81277/exe (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81277 mgr-fin ceph NOFD /proc/29359/task/81277/fd (opendir: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81278 mgr-fin ceph cwd unknown /proc/29359/task/81278/cwd (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81278 mgr-fin ceph rtd unknown /proc/29359/task/81278/root (readlink: Permission denied) 2024-04-25T11:26:48.372 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81278 mgr-fin ceph txt unknown /proc/29359/task/81278/exe (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81278 mgr-fin ceph NOFD /proc/29359/task/81278/fd (opendir: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81279 mgr-fin ceph cwd unknown /proc/29359/task/81279/cwd (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81279 mgr-fin ceph rtd unknown /proc/29359/task/81279/root (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81279 mgr-fin ceph txt unknown /proc/29359/task/81279/exe (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81279 mgr-fin ceph NOFD /proc/29359/task/81279/fd (opendir: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81280 mgr-fin ceph cwd unknown /proc/29359/task/81280/cwd (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81280 mgr-fin ceph rtd unknown /proc/29359/task/81280/root (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81280 mgr-fin ceph txt unknown /proc/29359/task/81280/exe (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81280 mgr-fin ceph NOFD /proc/29359/task/81280/fd (opendir: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81281 mgr-fin ceph cwd unknown /proc/29359/task/81281/cwd (readlink: Permission denied) 2024-04-25T11:26:48.373 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81281 mgr-fin ceph rtd unknown /proc/29359/task/81281/root (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81281 mgr-fin ceph txt unknown /proc/29359/task/81281/exe (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81281 mgr-fin ceph NOFD /proc/29359/task/81281/fd (opendir: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81282 mgr-fin ceph cwd unknown /proc/29359/task/81282/cwd (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81282 mgr-fin ceph rtd unknown /proc/29359/task/81282/root (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81282 mgr-fin ceph txt unknown /proc/29359/task/81282/exe (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81282 mgr-fin ceph NOFD /proc/29359/task/81282/fd (opendir: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81283 mgr-fin ceph cwd unknown /proc/29359/task/81283/cwd (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81283 mgr-fin ceph rtd unknown /proc/29359/task/81283/root (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81283 mgr-fin ceph txt unknown /proc/29359/task/81283/exe (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81283 mgr-fin ceph NOFD /proc/29359/task/81283/fd (opendir: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81284 mgr-fin ceph cwd unknown /proc/29359/task/81284/cwd (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81284 mgr-fin ceph rtd unknown /proc/29359/task/81284/root (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81284 mgr-fin ceph txt unknown /proc/29359/task/81284/exe (readlink: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81284 mgr-fin ceph NOFD /proc/29359/task/81284/fd (opendir: Permission denied) 2024-04-25T11:26:48.374 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81285 mgr-fin ceph cwd unknown /proc/29359/task/81285/cwd (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81285 mgr-fin ceph rtd unknown /proc/29359/task/81285/root (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81285 mgr-fin ceph txt unknown /proc/29359/task/81285/exe (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81285 mgr-fin ceph NOFD /proc/29359/task/81285/fd (opendir: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81286 mgr-fin ceph cwd unknown /proc/29359/task/81286/cwd (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81286 mgr-fin ceph rtd unknown /proc/29359/task/81286/root (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81286 mgr-fin ceph txt unknown /proc/29359/task/81286/exe (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81286 mgr-fin ceph NOFD /proc/29359/task/81286/fd (opendir: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81287 mgr-fin ceph cwd unknown /proc/29359/task/81287/cwd (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81287 mgr-fin ceph rtd unknown /proc/29359/task/81287/root (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81287 mgr-fin ceph txt unknown /proc/29359/task/81287/exe (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81287 mgr-fin ceph NOFD /proc/29359/task/81287/fd (opendir: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81288 cephadm ceph cwd unknown /proc/29359/task/81288/cwd (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81288 cephadm ceph rtd unknown /proc/29359/task/81288/root (readlink: Permission denied) 2024-04-25T11:26:48.375 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81288 cephadm ceph txt unknown /proc/29359/task/81288/exe (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81288 cephadm ceph NOFD /proc/29359/task/81288/fd (opendir: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81289 m-fin-cep ceph cwd unknown /proc/29359/task/81289/cwd (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81289 m-fin-cep ceph rtd unknown /proc/29359/task/81289/root (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81289 m-fin-cep ceph txt unknown /proc/29359/task/81289/exe (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81289 m-fin-cep ceph NOFD /proc/29359/task/81289/fd (opendir: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81290 mgr-fin ceph cwd unknown /proc/29359/task/81290/cwd (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81290 mgr-fin ceph rtd unknown /proc/29359/task/81290/root (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81290 mgr-fin ceph txt unknown /proc/29359/task/81290/exe (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81290 mgr-fin ceph NOFD /proc/29359/task/81290/fd (opendir: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81291 mgr-fin ceph cwd unknown /proc/29359/task/81291/cwd (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81291 mgr-fin ceph rtd unknown /proc/29359/task/81291/root (readlink: Permission denied) 2024-04-25T11:26:48.376 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81291 mgr-fin ceph txt unknown /proc/29359/task/81291/exe (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81291 mgr-fin ceph NOFD /proc/29359/task/81291/fd (opendir: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81292 crash ceph cwd unknown /proc/29359/task/81292/cwd (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81292 crash ceph rtd unknown /proc/29359/task/81292/root (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81292 crash ceph txt unknown /proc/29359/task/81292/exe (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81292 crash ceph NOFD /proc/29359/task/81292/fd (opendir: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81293 m-fin-cra ceph cwd unknown /proc/29359/task/81293/cwd (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81293 m-fin-cra ceph rtd unknown /proc/29359/task/81293/root (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81293 m-fin-cra ceph txt unknown /proc/29359/task/81293/exe (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81293 m-fin-cra ceph NOFD /proc/29359/task/81293/fd (opendir: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81294 cephadm ceph cwd unknown /proc/29359/task/81294/cwd (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81294 cephadm ceph rtd unknown /proc/29359/task/81294/root (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81294 cephadm ceph txt unknown /proc/29359/task/81294/exe (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81294 cephadm ceph NOFD /proc/29359/task/81294/fd (opendir: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81295 mgr-fin ceph cwd unknown /proc/29359/task/81295/cwd (readlink: Permission denied) 2024-04-25T11:26:48.377 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81295 mgr-fin ceph rtd unknown /proc/29359/task/81295/root (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81295 mgr-fin ceph txt unknown /proc/29359/task/81295/exe (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81295 mgr-fin ceph NOFD /proc/29359/task/81295/fd (opendir: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81296 mgr-fin ceph cwd unknown /proc/29359/task/81296/cwd (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81296 mgr-fin ceph rtd unknown /proc/29359/task/81296/root (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81296 mgr-fin ceph txt unknown /proc/29359/task/81296/exe (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81296 mgr-fin ceph NOFD /proc/29359/task/81296/fd (opendir: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81297 mgr-fin ceph cwd unknown /proc/29359/task/81297/cwd (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81297 mgr-fin ceph rtd unknown /proc/29359/task/81297/root (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81297 mgr-fin ceph txt unknown /proc/29359/task/81297/exe (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81297 mgr-fin ceph NOFD /proc/29359/task/81297/fd (opendir: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81298 dashboard ceph cwd unknown /proc/29359/task/81298/cwd (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81298 dashboard ceph rtd unknown /proc/29359/task/81298/root (readlink: Permission denied) 2024-04-25T11:26:48.378 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81298 dashboard ceph txt unknown /proc/29359/task/81298/exe (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81298 dashboard ceph NOFD /proc/29359/task/81298/fd (opendir: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81299 m-fin-das ceph cwd unknown /proc/29359/task/81299/cwd (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81299 m-fin-das ceph rtd unknown /proc/29359/task/81299/root (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81299 m-fin-das ceph txt unknown /proc/29359/task/81299/exe (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81299 m-fin-das ceph NOFD /proc/29359/task/81299/fd (opendir: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81300 devicehea ceph cwd unknown /proc/29359/task/81300/cwd (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81300 devicehea ceph rtd unknown /proc/29359/task/81300/root (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81300 devicehea ceph txt unknown /proc/29359/task/81300/exe (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81300 devicehea ceph NOFD /proc/29359/task/81300/fd (opendir: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81301 m-fin-dev ceph cwd unknown /proc/29359/task/81301/cwd (readlink: Permission denied) 2024-04-25T11:26:48.379 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81301 m-fin-dev ceph rtd unknown /proc/29359/task/81301/root (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81301 m-fin-dev ceph txt unknown /proc/29359/task/81301/exe (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81301 m-fin-dev ceph NOFD /proc/29359/task/81301/fd (opendir: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81303 m-fin-ios ceph cwd unknown /proc/29359/task/81303/cwd (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81303 m-fin-ios ceph rtd unknown /proc/29359/task/81303/root (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81303 m-fin-ios ceph txt unknown /proc/29359/task/81303/exe (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81303 m-fin-ios ceph NOFD /proc/29359/task/81303/fd (opendir: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81304 mgr-fin ceph cwd unknown /proc/29359/task/81304/cwd (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81304 mgr-fin ceph rtd unknown /proc/29359/task/81304/root (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81304 mgr-fin ceph txt unknown /proc/29359/task/81304/exe (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81304 mgr-fin ceph NOFD /proc/29359/task/81304/fd (opendir: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81306 m-fin-nfs ceph cwd unknown /proc/29359/task/81306/cwd (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81306 m-fin-nfs ceph rtd unknown /proc/29359/task/81306/root (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81306 m-fin-nfs ceph txt unknown /proc/29359/task/81306/exe (readlink: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81306 m-fin-nfs ceph NOFD /proc/29359/task/81306/fd (opendir: Permission denied) 2024-04-25T11:26:48.380 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81307 mgr-fin ceph cwd unknown /proc/29359/task/81307/cwd (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81307 mgr-fin ceph rtd unknown /proc/29359/task/81307/root (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81307 mgr-fin ceph txt unknown /proc/29359/task/81307/exe (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81307 mgr-fin ceph NOFD /proc/29359/task/81307/fd (opendir: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81308 mgr-fin ceph cwd unknown /proc/29359/task/81308/cwd (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81308 mgr-fin ceph rtd unknown /proc/29359/task/81308/root (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81308 mgr-fin ceph txt unknown /proc/29359/task/81308/exe (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81308 mgr-fin ceph NOFD /proc/29359/task/81308/fd (opendir: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81310 m-fin-orc ceph cwd unknown /proc/29359/task/81310/cwd (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81310 m-fin-orc ceph rtd unknown /proc/29359/task/81310/root (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81310 m-fin-orc ceph txt unknown /proc/29359/task/81310/exe (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81310 m-fin-orc ceph NOFD /proc/29359/task/81310/fd (opendir: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81311 pg_autosc ceph cwd unknown /proc/29359/task/81311/cwd (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81311 pg_autosc ceph rtd unknown /proc/29359/task/81311/root (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81311 pg_autosc ceph txt unknown /proc/29359/task/81311/exe (readlink: Permission denied) 2024-04-25T11:26:48.381 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81311 pg_autosc ceph NOFD /proc/29359/task/81311/fd (opendir: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81312 m-fin-pg_ ceph cwd unknown /proc/29359/task/81312/cwd (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81312 m-fin-pg_ ceph rtd unknown /proc/29359/task/81312/root (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81312 m-fin-pg_ ceph txt unknown /proc/29359/task/81312/exe (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81312 m-fin-pg_ ceph NOFD /proc/29359/task/81312/fd (opendir: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81313 mgr-fin ceph cwd unknown /proc/29359/task/81313/cwd (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81313 mgr-fin ceph rtd unknown /proc/29359/task/81313/root (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81313 mgr-fin ceph txt unknown /proc/29359/task/81313/exe (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81313 mgr-fin ceph NOFD /proc/29359/task/81313/fd (opendir: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81314 mgr-fin ceph cwd unknown /proc/29359/task/81314/cwd (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81314 mgr-fin ceph rtd unknown /proc/29359/task/81314/root (readlink: Permission denied) 2024-04-25T11:26:48.382 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81314 mgr-fin ceph txt unknown /proc/29359/task/81314/exe (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81314 mgr-fin ceph NOFD /proc/29359/task/81314/fd (opendir: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81315 progress ceph cwd unknown /proc/29359/task/81315/cwd (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81315 progress ceph rtd unknown /proc/29359/task/81315/root (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81315 progress ceph txt unknown /proc/29359/task/81315/exe (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81315 progress ceph NOFD /proc/29359/task/81315/fd (opendir: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81316 m-fin-pro ceph cwd unknown /proc/29359/task/81316/cwd (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81316 m-fin-pro ceph rtd unknown /proc/29359/task/81316/root (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81316 m-fin-pro ceph txt unknown /proc/29359/task/81316/exe (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81316 m-fin-pro ceph NOFD /proc/29359/task/81316/fd (opendir: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81317 mgr-fin ceph cwd unknown /proc/29359/task/81317/cwd (readlink: Permission denied) 2024-04-25T11:26:48.383 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81317 mgr-fin ceph rtd unknown /proc/29359/task/81317/root (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81317 mgr-fin ceph txt unknown /proc/29359/task/81317/exe (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81317 mgr-fin ceph NOFD /proc/29359/task/81317/fd (opendir: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81319 mgr-fin ceph cwd unknown /proc/29359/task/81319/cwd (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81319 mgr-fin ceph rtd unknown /proc/29359/task/81319/root (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81319 mgr-fin ceph txt unknown /proc/29359/task/81319/exe (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81319 mgr-fin ceph NOFD /proc/29359/task/81319/fd (opendir: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81324 io_contex ceph cwd unknown /proc/29359/task/81324/cwd (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81324 io_contex ceph rtd unknown /proc/29359/task/81324/root (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81324 io_contex ceph txt unknown /proc/29359/task/81324/exe (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81324 io_contex ceph NOFD /proc/29359/task/81324/fd (opendir: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81325 io_contex ceph cwd unknown /proc/29359/task/81325/cwd (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81325 io_contex ceph rtd unknown /proc/29359/task/81325/root (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81325 io_contex ceph txt unknown /proc/29359/task/81325/exe (readlink: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81325 io_contex ceph NOFD /proc/29359/task/81325/fd (opendir: Permission denied) 2024-04-25T11:26:48.384 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81326 ceph_time ceph cwd unknown /proc/29359/task/81326/cwd (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81326 ceph_time ceph rtd unknown /proc/29359/task/81326/root (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81326 ceph_time ceph txt unknown /proc/29359/task/81326/exe (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81326 ceph_time ceph NOFD /proc/29359/task/81326/fd (opendir: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81327 ms_dispat ceph cwd unknown /proc/29359/task/81327/cwd (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81327 ms_dispat ceph rtd unknown /proc/29359/task/81327/root (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81327 ms_dispat ceph txt unknown /proc/29359/task/81327/exe (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81327 ms_dispat ceph NOFD /proc/29359/task/81327/fd (opendir: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81328 ms_local ceph cwd unknown /proc/29359/task/81328/cwd (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81328 ms_local ceph rtd unknown /proc/29359/task/81328/root (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81328 ms_local ceph txt unknown /proc/29359/task/81328/exe (readlink: Permission denied) 2024-04-25T11:26:48.385 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81328 ms_local ceph NOFD /proc/29359/task/81328/fd (opendir: Permission denied) 2024-04-25T11:26:48.386 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81329 safe_time ceph cwd unknown /proc/29359/task/81329/cwd (readlink: Permission denied) 2024-04-25T11:26:48.386 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81329 safe_time ceph rtd unknown /proc/29359/task/81329/root (readlink: Permission denied) 2024-04-25T11:26:48.386 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81329 safe_time ceph txt unknown /proc/29359/task/81329/exe (readlink: Permission denied) 2024-04-25T11:26:48.386 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81329 safe_time ceph NOFD /proc/29359/task/81329/fd (opendir: Permission denied) 2024-04-25T11:26:48.386 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81330 safe_time ceph cwd unknown /proc/29359/task/81330/cwd (readlink: Permission denied) 2024-04-25T11:26:48.386 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81330 safe_time ceph rtd unknown /proc/29359/task/81330/root (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81330 safe_time ceph txt unknown /proc/29359/task/81330/exe (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81330 safe_time ceph NOFD /proc/29359/task/81330/fd (opendir: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81331 mgr-fin ceph cwd unknown /proc/29359/task/81331/cwd (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81331 mgr-fin ceph rtd unknown /proc/29359/task/81331/root (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81331 mgr-fin ceph txt unknown /proc/29359/task/81331/exe (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81331 mgr-fin ceph NOFD /proc/29359/task/81331/fd (opendir: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81333 m-fin-rbd ceph cwd unknown /proc/29359/task/81333/cwd (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81333 m-fin-rbd ceph rtd unknown /proc/29359/task/81333/root (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81333 m-fin-rbd ceph txt unknown /proc/29359/task/81333/exe (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81333 m-fin-rbd ceph NOFD /proc/29359/task/81333/fd (opendir: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81334 restful ceph cwd unknown /proc/29359/task/81334/cwd (readlink: Permission denied) 2024-04-25T11:26:48.387 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81334 restful ceph rtd unknown /proc/29359/task/81334/root (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81334 restful ceph txt unknown /proc/29359/task/81334/exe (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81334 restful ceph NOFD /proc/29359/task/81334/fd (opendir: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81335 m-fin-res ceph cwd unknown /proc/29359/task/81335/cwd (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81335 m-fin-res ceph rtd unknown /proc/29359/task/81335/root (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81335 m-fin-res ceph txt unknown /proc/29359/task/81335/exe (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81335 m-fin-res ceph NOFD /proc/29359/task/81335/fd (opendir: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81336 mgr-fin ceph cwd unknown /proc/29359/task/81336/cwd (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81336 mgr-fin ceph rtd unknown /proc/29359/task/81336/root (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81336 mgr-fin ceph txt unknown /proc/29359/task/81336/exe (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81336 mgr-fin ceph NOFD /proc/29359/task/81336/fd (opendir: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81337 mgr-fin ceph cwd unknown /proc/29359/task/81337/cwd (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81337 mgr-fin ceph rtd unknown /proc/29359/task/81337/root (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81337 mgr-fin ceph txt unknown /proc/29359/task/81337/exe (readlink: Permission denied) 2024-04-25T11:26:48.388 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81337 mgr-fin ceph NOFD /proc/29359/task/81337/fd (opendir: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81338 mgr-fin ceph cwd unknown /proc/29359/task/81338/cwd (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81338 mgr-fin ceph rtd unknown /proc/29359/task/81338/root (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81338 mgr-fin ceph txt unknown /proc/29359/task/81338/exe (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81338 mgr-fin ceph NOFD /proc/29359/task/81338/fd (opendir: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81339 mgr-fin ceph cwd unknown /proc/29359/task/81339/cwd (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81339 mgr-fin ceph rtd unknown /proc/29359/task/81339/root (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81339 mgr-fin ceph txt unknown /proc/29359/task/81339/exe (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81339 mgr-fin ceph NOFD /proc/29359/task/81339/fd (opendir: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81344 mgr-fin ceph cwd unknown /proc/29359/task/81344/cwd (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81344 mgr-fin ceph rtd unknown /proc/29359/task/81344/root (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81344 mgr-fin ceph txt unknown /proc/29359/task/81344/exe (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81344 mgr-fin ceph NOFD /proc/29359/task/81344/fd (opendir: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81352 mgr-fin ceph cwd unknown /proc/29359/task/81352/cwd (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81352 mgr-fin ceph rtd unknown /proc/29359/task/81352/root (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81352 mgr-fin ceph txt unknown /proc/29359/task/81352/exe (readlink: Permission denied) 2024-04-25T11:26:48.389 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81352 mgr-fin ceph NOFD /proc/29359/task/81352/fd (opendir: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81361 io_contex ceph cwd unknown /proc/29359/task/81361/cwd (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81361 io_contex ceph rtd unknown /proc/29359/task/81361/root (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81361 io_contex ceph txt unknown /proc/29359/task/81361/exe (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81361 io_contex ceph NOFD /proc/29359/task/81361/fd (opendir: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81362 io_contex ceph cwd unknown /proc/29359/task/81362/cwd (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81362 io_contex ceph rtd unknown /proc/29359/task/81362/root (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81362 io_contex ceph txt unknown /proc/29359/task/81362/exe (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81362 io_contex ceph NOFD /proc/29359/task/81362/fd (opendir: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81363 ceph_time ceph cwd unknown /proc/29359/task/81363/cwd (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81363 ceph_time ceph rtd unknown /proc/29359/task/81363/root (readlink: Permission denied) 2024-04-25T11:26:48.390 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81363 ceph_time ceph txt unknown /proc/29359/task/81363/exe (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81363 ceph_time ceph NOFD /proc/29359/task/81363/fd (opendir: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81364 ms_dispat ceph cwd unknown /proc/29359/task/81364/cwd (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81364 ms_dispat ceph rtd unknown /proc/29359/task/81364/root (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81364 ms_dispat ceph txt unknown /proc/29359/task/81364/exe (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81364 ms_dispat ceph NOFD /proc/29359/task/81364/fd (opendir: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81366 ms_local ceph cwd unknown /proc/29359/task/81366/cwd (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81366 ms_local ceph rtd unknown /proc/29359/task/81366/root (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81366 ms_local ceph txt unknown /proc/29359/task/81366/exe (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81366 ms_local ceph NOFD /proc/29359/task/81366/fd (opendir: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81367 safe_time ceph cwd unknown /proc/29359/task/81367/cwd (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81367 safe_time ceph rtd unknown /proc/29359/task/81367/root (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81367 safe_time ceph txt unknown /proc/29359/task/81367/exe (readlink: Permission denied) 2024-04-25T11:26:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81367 safe_time ceph NOFD /proc/29359/task/81367/fd (opendir: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81368 safe_time ceph cwd unknown /proc/29359/task/81368/cwd (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81368 safe_time ceph rtd unknown /proc/29359/task/81368/root (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81368 safe_time ceph txt unknown /proc/29359/task/81368/exe (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81368 safe_time ceph NOFD /proc/29359/task/81368/fd (opendir: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81376 m-fin-sna ceph cwd unknown /proc/29359/task/81376/cwd (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81376 m-fin-sna ceph rtd unknown /proc/29359/task/81376/root (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81376 m-fin-sna ceph txt unknown /proc/29359/task/81376/exe (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81376 m-fin-sna ceph NOFD /proc/29359/task/81376/fd (opendir: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81379 m-fin-sta ceph cwd unknown /proc/29359/task/81379/cwd (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81379 m-fin-sta ceph rtd unknown /proc/29359/task/81379/root (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81379 m-fin-sta ceph txt unknown /proc/29359/task/81379/exe (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81379 m-fin-sta ceph NOFD /proc/29359/task/81379/fd (opendir: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81380 telemetry ceph cwd unknown /proc/29359/task/81380/cwd (readlink: Permission denied) 2024-04-25T11:26:48.392 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81380 telemetry ceph rtd unknown /proc/29359/task/81380/root (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81380 telemetry ceph txt unknown /proc/29359/task/81380/exe (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81380 telemetry ceph NOFD /proc/29359/task/81380/fd (opendir: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81381 m-fin-tel ceph cwd unknown /proc/29359/task/81381/cwd (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81381 m-fin-tel ceph rtd unknown /proc/29359/task/81381/root (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81381 m-fin-tel ceph txt unknown /proc/29359/task/81381/exe (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81381 m-fin-tel ceph NOFD /proc/29359/task/81381/fd (opendir: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81390 mgr-fin ceph cwd unknown /proc/29359/task/81390/cwd (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81390 mgr-fin ceph rtd unknown /proc/29359/task/81390/root (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81390 mgr-fin ceph txt unknown /proc/29359/task/81390/exe (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81390 mgr-fin ceph NOFD /proc/29359/task/81390/fd (opendir: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81401 io_contex ceph cwd unknown /proc/29359/task/81401/cwd (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81401 io_contex ceph rtd unknown /proc/29359/task/81401/root (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81401 io_contex ceph txt unknown /proc/29359/task/81401/exe (readlink: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81401 io_contex ceph NOFD /proc/29359/task/81401/fd (opendir: Permission denied) 2024-04-25T11:26:48.393 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81402 io_contex ceph cwd unknown /proc/29359/task/81402/cwd (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81402 io_contex ceph rtd unknown /proc/29359/task/81402/root (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81402 io_contex ceph txt unknown /proc/29359/task/81402/exe (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81402 io_contex ceph NOFD /proc/29359/task/81402/fd (opendir: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81403 ceph_time ceph cwd unknown /proc/29359/task/81403/cwd (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81403 ceph_time ceph rtd unknown /proc/29359/task/81403/root (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81403 ceph_time ceph txt unknown /proc/29359/task/81403/exe (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81403 ceph_time ceph NOFD /proc/29359/task/81403/fd (opendir: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81404 ms_dispat ceph cwd unknown /proc/29359/task/81404/cwd (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81404 ms_dispat ceph rtd unknown /proc/29359/task/81404/root (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81404 ms_dispat ceph txt unknown /proc/29359/task/81404/exe (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81404 ms_dispat ceph NOFD /proc/29359/task/81404/fd (opendir: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81405 ms_local ceph cwd unknown /proc/29359/task/81405/cwd (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81405 ms_local ceph rtd unknown /proc/29359/task/81405/root (readlink: Permission denied) 2024-04-25T11:26:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81405 ms_local ceph txt unknown /proc/29359/task/81405/exe (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81405 ms_local ceph NOFD /proc/29359/task/81405/fd (opendir: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81406 safe_time ceph cwd unknown /proc/29359/task/81406/cwd (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81406 safe_time ceph rtd unknown /proc/29359/task/81406/root (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81406 safe_time ceph txt unknown /proc/29359/task/81406/exe (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81406 safe_time ceph NOFD /proc/29359/task/81406/fd (opendir: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81408 safe_time ceph cwd unknown /proc/29359/task/81408/cwd (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81408 safe_time ceph rtd unknown /proc/29359/task/81408/root (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81408 safe_time ceph txt unknown /proc/29359/task/81408/exe (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81408 safe_time ceph NOFD /proc/29359/task/81408/fd (opendir: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81410 mgr-fin ceph cwd unknown /proc/29359/task/81410/cwd (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81410 mgr-fin ceph rtd unknown /proc/29359/task/81410/root (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81410 mgr-fin ceph txt unknown /proc/29359/task/81410/exe (readlink: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81410 mgr-fin ceph NOFD /proc/29359/task/81410/fd (opendir: Permission denied) 2024-04-25T11:26:48.395 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81411 mgr-fin ceph cwd unknown /proc/29359/task/81411/cwd (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81411 mgr-fin ceph rtd unknown /proc/29359/task/81411/root (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81411 mgr-fin ceph txt unknown /proc/29359/task/81411/exe (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81411 mgr-fin ceph NOFD /proc/29359/task/81411/fd (opendir: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81412 mgr-fin ceph cwd unknown /proc/29359/task/81412/cwd (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81412 mgr-fin ceph rtd unknown /proc/29359/task/81412/root (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81412 mgr-fin ceph txt unknown /proc/29359/task/81412/exe (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81412 mgr-fin ceph NOFD /proc/29359/task/81412/fd (opendir: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81413 mgr-fin ceph cwd unknown /proc/29359/task/81413/cwd (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81413 mgr-fin ceph rtd unknown /proc/29359/task/81413/root (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81413 mgr-fin ceph txt unknown /proc/29359/task/81413/exe (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81413 mgr-fin ceph NOFD /proc/29359/task/81413/fd (opendir: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81414 mgr-fin ceph cwd unknown /proc/29359/task/81414/cwd (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81414 mgr-fin ceph rtd unknown /proc/29359/task/81414/root (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81414 mgr-fin ceph txt unknown /proc/29359/task/81414/exe (readlink: Permission denied) 2024-04-25T11:26:48.396 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81414 mgr-fin ceph NOFD /proc/29359/task/81414/fd (opendir: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81415 mgr-fin ceph cwd unknown /proc/29359/task/81415/cwd (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81415 mgr-fin ceph rtd unknown /proc/29359/task/81415/root (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81415 mgr-fin ceph txt unknown /proc/29359/task/81415/exe (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81415 mgr-fin ceph NOFD /proc/29359/task/81415/fd (opendir: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81416 mgr-fin ceph cwd unknown /proc/29359/task/81416/cwd (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81416 mgr-fin ceph rtd unknown /proc/29359/task/81416/root (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81416 mgr-fin ceph txt unknown /proc/29359/task/81416/exe (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81416 mgr-fin ceph NOFD /proc/29359/task/81416/fd (opendir: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81418 mgr-fin ceph cwd unknown /proc/29359/task/81418/cwd (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81418 mgr-fin ceph rtd unknown /proc/29359/task/81418/root (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81418 mgr-fin ceph txt unknown /proc/29359/task/81418/exe (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81418 mgr-fin ceph NOFD /proc/29359/task/81418/fd (opendir: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81419 mgr-fin ceph cwd unknown /proc/29359/task/81419/cwd (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81419 mgr-fin ceph rtd unknown /proc/29359/task/81419/root (readlink: Permission denied) 2024-04-25T11:26:48.397 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81419 mgr-fin ceph txt unknown /proc/29359/task/81419/exe (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81419 mgr-fin ceph NOFD /proc/29359/task/81419/fd (opendir: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81420 mgr-fin ceph cwd unknown /proc/29359/task/81420/cwd (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81420 mgr-fin ceph rtd unknown /proc/29359/task/81420/root (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81420 mgr-fin ceph txt unknown /proc/29359/task/81420/exe (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81420 mgr-fin ceph NOFD /proc/29359/task/81420/fd (opendir: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81421 mgr-fin ceph cwd unknown /proc/29359/task/81421/cwd (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81421 mgr-fin ceph rtd unknown /proc/29359/task/81421/root (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81421 mgr-fin ceph txt unknown /proc/29359/task/81421/exe (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81421 mgr-fin ceph NOFD /proc/29359/task/81421/fd (opendir: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81422 mgr-fin ceph cwd unknown /proc/29359/task/81422/cwd (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81422 mgr-fin ceph rtd unknown /proc/29359/task/81422/root (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81422 mgr-fin ceph txt unknown /proc/29359/task/81422/exe (readlink: Permission denied) 2024-04-25T11:26:48.398 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81422 mgr-fin ceph NOFD /proc/29359/task/81422/fd (opendir: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81424 m-fin-vol ceph cwd unknown /proc/29359/task/81424/cwd (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81424 m-fin-vol ceph rtd unknown /proc/29359/task/81424/root (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81424 m-fin-vol ceph txt unknown /proc/29359/task/81424/exe (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81424 m-fin-vol ceph NOFD /proc/29359/task/81424/fd (opendir: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81425 io_contex ceph cwd unknown /proc/29359/task/81425/cwd (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81425 io_contex ceph rtd unknown /proc/29359/task/81425/root (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81425 io_contex ceph txt unknown /proc/29359/task/81425/exe (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81425 io_contex ceph NOFD /proc/29359/task/81425/fd (opendir: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81426 io_contex ceph cwd unknown /proc/29359/task/81426/cwd (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81426 io_contex ceph rtd unknown /proc/29359/task/81426/root (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81426 io_contex ceph txt unknown /proc/29359/task/81426/exe (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81426 io_contex ceph NOFD /proc/29359/task/81426/fd (opendir: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81487 dashboard ceph cwd unknown /proc/29359/task/81487/cwd (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81487 dashboard ceph rtd unknown /proc/29359/task/81487/root (readlink: Permission denied) 2024-04-25T11:26:48.399 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81487 dashboard ceph txt unknown /proc/29359/task/81487/exe (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81487 dashboard ceph NOFD /proc/29359/task/81487/fd (opendir: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81488 dashboard ceph cwd unknown /proc/29359/task/81488/cwd (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81488 dashboard ceph rtd unknown /proc/29359/task/81488/root (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81488 dashboard ceph txt unknown /proc/29359/task/81488/exe (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81488 dashboard ceph NOFD /proc/29359/task/81488/fd (opendir: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81489 dashboard ceph cwd unknown /proc/29359/task/81489/cwd (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81489 dashboard ceph rtd unknown /proc/29359/task/81489/root (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81489 dashboard ceph txt unknown /proc/29359/task/81489/exe (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81489 dashboard ceph NOFD /proc/29359/task/81489/fd (opendir: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81490 dashboard ceph cwd unknown /proc/29359/task/81490/cwd (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81490 dashboard ceph rtd unknown /proc/29359/task/81490/root (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81490 dashboard ceph txt unknown /proc/29359/task/81490/exe (readlink: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81490 dashboard ceph NOFD /proc/29359/task/81490/fd (opendir: Permission denied) 2024-04-25T11:26:48.400 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81491 dashboard ceph cwd unknown /proc/29359/task/81491/cwd (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81491 dashboard ceph rtd unknown /proc/29359/task/81491/root (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81491 dashboard ceph txt unknown /proc/29359/task/81491/exe (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81491 dashboard ceph NOFD /proc/29359/task/81491/fd (opendir: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81492 dashboard ceph cwd unknown /proc/29359/task/81492/cwd (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81492 dashboard ceph rtd unknown /proc/29359/task/81492/root (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81492 dashboard ceph txt unknown /proc/29359/task/81492/exe (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81492 dashboard ceph NOFD /proc/29359/task/81492/fd (opendir: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81493 dashboard ceph cwd unknown /proc/29359/task/81493/cwd (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81493 dashboard ceph rtd unknown /proc/29359/task/81493/root (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81493 dashboard ceph txt unknown /proc/29359/task/81493/exe (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81493 dashboard ceph NOFD /proc/29359/task/81493/fd (opendir: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81494 dashboard ceph cwd unknown /proc/29359/task/81494/cwd (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81494 dashboard ceph rtd unknown /proc/29359/task/81494/root (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81494 dashboard ceph txt unknown /proc/29359/task/81494/exe (readlink: Permission denied) 2024-04-25T11:26:48.401 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81494 dashboard ceph NOFD /proc/29359/task/81494/fd (opendir: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81495 dashboard ceph cwd unknown /proc/29359/task/81495/cwd (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81495 dashboard ceph rtd unknown /proc/29359/task/81495/root (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81495 dashboard ceph txt unknown /proc/29359/task/81495/exe (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81495 dashboard ceph NOFD /proc/29359/task/81495/fd (opendir: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81496 dashboard ceph cwd unknown /proc/29359/task/81496/cwd (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81496 dashboard ceph rtd unknown /proc/29359/task/81496/root (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81496 dashboard ceph txt unknown /proc/29359/task/81496/exe (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81496 dashboard ceph NOFD /proc/29359/task/81496/fd (opendir: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81497 dashboard ceph cwd unknown /proc/29359/task/81497/cwd (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81497 dashboard ceph rtd unknown /proc/29359/task/81497/root (readlink: Permission denied) 2024-04-25T11:26:48.402 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81497 dashboard ceph txt unknown /proc/29359/task/81497/exe (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81497 dashboard ceph NOFD /proc/29359/task/81497/fd (opendir: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81562 dashboard ceph cwd unknown /proc/29359/task/81562/cwd (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81562 dashboard ceph rtd unknown /proc/29359/task/81562/root (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81562 dashboard ceph txt unknown /proc/29359/task/81562/exe (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81562 dashboard ceph NOFD /proc/29359/task/81562/fd (opendir: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81718 mgr-fin ceph cwd unknown /proc/29359/task/81718/cwd (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81718 mgr-fin ceph rtd unknown /proc/29359/task/81718/root (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81718 mgr-fin ceph txt unknown /proc/29359/task/81718/exe (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81718 mgr-fin ceph NOFD /proc/29359/task/81718/fd (opendir: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81719 mgr-fin ceph cwd unknown /proc/29359/task/81719/cwd (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81719 mgr-fin ceph rtd unknown /proc/29359/task/81719/root (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81719 mgr-fin ceph txt unknown /proc/29359/task/81719/exe (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81719 mgr-fin ceph NOFD /proc/29359/task/81719/fd (opendir: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81720 mgr-fin ceph cwd unknown /proc/29359/task/81720/cwd (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81720 mgr-fin ceph rtd unknown /proc/29359/task/81720/root (readlink: Permission denied) 2024-04-25T11:26:48.403 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81720 mgr-fin ceph txt unknown /proc/29359/task/81720/exe (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81720 mgr-fin ceph NOFD /proc/29359/task/81720/fd (opendir: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81721 mgr-fin ceph cwd unknown /proc/29359/task/81721/cwd (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81721 mgr-fin ceph rtd unknown /proc/29359/task/81721/root (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81721 mgr-fin ceph txt unknown /proc/29359/task/81721/exe (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81721 mgr-fin ceph NOFD /proc/29359/task/81721/fd (opendir: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81722 mgr-fin ceph cwd unknown /proc/29359/task/81722/cwd (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81722 mgr-fin ceph rtd unknown /proc/29359/task/81722/root (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81722 mgr-fin ceph txt unknown /proc/29359/task/81722/exe (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81722 mgr-fin ceph NOFD /proc/29359/task/81722/fd (opendir: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81723 mgr-fin ceph cwd unknown /proc/29359/task/81723/cwd (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81723 mgr-fin ceph rtd unknown /proc/29359/task/81723/root (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81723 mgr-fin ceph txt unknown /proc/29359/task/81723/exe (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81723 mgr-fin ceph NOFD /proc/29359/task/81723/fd (opendir: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81724 mgr-fin ceph cwd unknown /proc/29359/task/81724/cwd (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81724 mgr-fin ceph rtd unknown /proc/29359/task/81724/root (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81724 mgr-fin ceph txt unknown /proc/29359/task/81724/exe (readlink: Permission denied) 2024-04-25T11:26:48.404 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81724 mgr-fin ceph NOFD /proc/29359/task/81724/fd (opendir: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81725 mgr-fin ceph cwd unknown /proc/29359/task/81725/cwd (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81725 mgr-fin ceph rtd unknown /proc/29359/task/81725/root (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81725 mgr-fin ceph txt unknown /proc/29359/task/81725/exe (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81725 mgr-fin ceph NOFD /proc/29359/task/81725/fd (opendir: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81726 mgr-fin ceph cwd unknown /proc/29359/task/81726/cwd (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81726 mgr-fin ceph rtd unknown /proc/29359/task/81726/root (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81726 mgr-fin ceph txt unknown /proc/29359/task/81726/exe (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81726 mgr-fin ceph NOFD /proc/29359/task/81726/fd (opendir: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81727 mgr-fin ceph cwd unknown /proc/29359/task/81727/cwd (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81727 mgr-fin ceph rtd unknown /proc/29359/task/81727/root (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81727 mgr-fin ceph txt unknown /proc/29359/task/81727/exe (readlink: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81727 mgr-fin ceph NOFD /proc/29359/task/81727/fd (opendir: Permission denied) 2024-04-25T11:26:48.405 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81728 mgr-fin ceph cwd unknown /proc/29359/task/81728/cwd (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81728 mgr-fin ceph rtd unknown /proc/29359/task/81728/root (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81728 mgr-fin ceph txt unknown /proc/29359/task/81728/exe (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81728 mgr-fin ceph NOFD /proc/29359/task/81728/fd (opendir: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81753 mgr-fin ceph cwd unknown /proc/29359/task/81753/cwd (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81753 mgr-fin ceph rtd unknown /proc/29359/task/81753/root (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81753 mgr-fin ceph txt unknown /proc/29359/task/81753/exe (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81753 mgr-fin ceph NOFD /proc/29359/task/81753/fd (opendir: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81754 mgr-fin ceph cwd unknown /proc/29359/task/81754/cwd (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81754 mgr-fin ceph rtd unknown /proc/29359/task/81754/root (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81754 mgr-fin ceph txt unknown /proc/29359/task/81754/exe (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81754 mgr-fin ceph NOFD /proc/29359/task/81754/fd (opendir: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81755 mgr-fin ceph cwd unknown /proc/29359/task/81755/cwd (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81755 mgr-fin ceph rtd unknown /proc/29359/task/81755/root (readlink: Permission denied) 2024-04-25T11:26:48.406 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81755 mgr-fin ceph txt unknown /proc/29359/task/81755/exe (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81755 mgr-fin ceph NOFD /proc/29359/task/81755/fd (opendir: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81756 mgr-fin ceph cwd unknown /proc/29359/task/81756/cwd (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81756 mgr-fin ceph rtd unknown /proc/29359/task/81756/root (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81756 mgr-fin ceph txt unknown /proc/29359/task/81756/exe (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81756 mgr-fin ceph NOFD /proc/29359/task/81756/fd (opendir: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81757 mgr-fin ceph cwd unknown /proc/29359/task/81757/cwd (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81757 mgr-fin ceph rtd unknown /proc/29359/task/81757/root (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81757 mgr-fin ceph txt unknown /proc/29359/task/81757/exe (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81757 mgr-fin ceph NOFD /proc/29359/task/81757/fd (opendir: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81758 mgr-fin ceph cwd unknown /proc/29359/task/81758/cwd (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81758 mgr-fin ceph rtd unknown /proc/29359/task/81758/root (readlink: Permission denied) 2024-04-25T11:26:48.407 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81758 mgr-fin ceph txt unknown /proc/29359/task/81758/exe (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81758 mgr-fin ceph NOFD /proc/29359/task/81758/fd (opendir: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81759 mgr-fin ceph cwd unknown /proc/29359/task/81759/cwd (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81759 mgr-fin ceph rtd unknown /proc/29359/task/81759/root (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81759 mgr-fin ceph txt unknown /proc/29359/task/81759/exe (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81759 mgr-fin ceph NOFD /proc/29359/task/81759/fd (opendir: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81760 mgr-fin ceph cwd unknown /proc/29359/task/81760/cwd (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81760 mgr-fin ceph rtd unknown /proc/29359/task/81760/root (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81760 mgr-fin ceph txt unknown /proc/29359/task/81760/exe (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81760 mgr-fin ceph NOFD /proc/29359/task/81760/fd (opendir: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81761 mgr-fin ceph cwd unknown /proc/29359/task/81761/cwd (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81761 mgr-fin ceph rtd unknown /proc/29359/task/81761/root (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81761 mgr-fin ceph txt unknown /proc/29359/task/81761/exe (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81761 mgr-fin ceph NOFD /proc/29359/task/81761/fd (opendir: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81762 mgr-fin ceph cwd unknown /proc/29359/task/81762/cwd (readlink: Permission denied) 2024-04-25T11:26:48.408 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81762 mgr-fin ceph rtd unknown /proc/29359/task/81762/root (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81762 mgr-fin ceph txt unknown /proc/29359/task/81762/exe (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81762 mgr-fin ceph NOFD /proc/29359/task/81762/fd (opendir: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81763 mgr-fin ceph cwd unknown /proc/29359/task/81763/cwd (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81763 mgr-fin ceph rtd unknown /proc/29359/task/81763/root (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81763 mgr-fin ceph txt unknown /proc/29359/task/81763/exe (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81763 mgr-fin ceph NOFD /proc/29359/task/81763/fd (opendir: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81957 devicehea ceph cwd unknown /proc/29359/task/81957/cwd (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81957 devicehea ceph rtd unknown /proc/29359/task/81957/root (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81957 devicehea ceph txt unknown /proc/29359/task/81957/exe (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81957 devicehea ceph NOFD /proc/29359/task/81957/fd (opendir: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81969 io_contex ceph cwd unknown /proc/29359/task/81969/cwd (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81969 io_contex ceph rtd unknown /proc/29359/task/81969/root (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81969 io_contex ceph txt unknown /proc/29359/task/81969/exe (readlink: Permission denied) 2024-04-25T11:26:48.409 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81969 io_contex ceph NOFD /proc/29359/task/81969/fd (opendir: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81970 io_contex ceph cwd unknown /proc/29359/task/81970/cwd (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81970 io_contex ceph rtd unknown /proc/29359/task/81970/root (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81970 io_contex ceph txt unknown /proc/29359/task/81970/exe (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81970 io_contex ceph NOFD /proc/29359/task/81970/fd (opendir: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81971 ceph_time ceph cwd unknown /proc/29359/task/81971/cwd (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81971 ceph_time ceph rtd unknown /proc/29359/task/81971/root (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81971 ceph_time ceph txt unknown /proc/29359/task/81971/exe (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81971 ceph_time ceph NOFD /proc/29359/task/81971/fd (opendir: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81972 ms_dispat ceph cwd unknown /proc/29359/task/81972/cwd (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81972 ms_dispat ceph rtd unknown /proc/29359/task/81972/root (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81972 ms_dispat ceph txt unknown /proc/29359/task/81972/exe (readlink: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81972 ms_dispat ceph NOFD /proc/29359/task/81972/fd (opendir: Permission denied) 2024-04-25T11:26:48.410 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81973 ms_local ceph cwd unknown /proc/29359/task/81973/cwd (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81973 ms_local ceph rtd unknown /proc/29359/task/81973/root (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81973 ms_local ceph txt unknown /proc/29359/task/81973/exe (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81973 ms_local ceph NOFD /proc/29359/task/81973/fd (opendir: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81974 safe_time ceph cwd unknown /proc/29359/task/81974/cwd (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81974 safe_time ceph rtd unknown /proc/29359/task/81974/root (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81974 safe_time ceph txt unknown /proc/29359/task/81974/exe (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81974 safe_time ceph NOFD /proc/29359/task/81974/fd (opendir: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81975 safe_time ceph cwd unknown /proc/29359/task/81975/cwd (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81975 safe_time ceph rtd unknown /proc/29359/task/81975/root (readlink: Permission denied) 2024-04-25T11:26:48.411 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81975 safe_time ceph txt unknown /proc/29359/task/81975/exe (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 81975 safe_time ceph NOFD /proc/29359/task/81975/fd (opendir: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84407 ceph_time ceph cwd unknown /proc/29359/task/84407/cwd (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84407 ceph_time ceph rtd unknown /proc/29359/task/84407/root (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84407 ceph_time ceph txt unknown /proc/29359/task/84407/exe (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84407 ceph_time ceph NOFD /proc/29359/task/84407/fd (opendir: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84408 fn_anonym ceph cwd unknown /proc/29359/task/84408/cwd (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84408 fn_anonym ceph rtd unknown /proc/29359/task/84408/root (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84408 fn_anonym ceph txt unknown /proc/29359/task/84408/exe (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84408 fn_anonym ceph NOFD /proc/29359/task/84408/fd (opendir: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84409 safe_time ceph cwd unknown /proc/29359/task/84409/cwd (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84409 safe_time ceph rtd unknown /proc/29359/task/84409/root (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84409 safe_time ceph txt unknown /proc/29359/task/84409/exe (readlink: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84409 safe_time ceph NOFD /proc/29359/task/84409/fd (opendir: Permission denied) 2024-04-25T11:26:48.412 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84410 fn_anonym ceph cwd unknown /proc/29359/task/84410/cwd (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84410 fn_anonym ceph rtd unknown /proc/29359/task/84410/root (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84410 fn_anonym ceph txt unknown /proc/29359/task/84410/exe (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84410 fn_anonym ceph NOFD /proc/29359/task/84410/fd (opendir: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84411 flusher ceph cwd unknown /proc/29359/task/84411/cwd (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84411 flusher ceph rtd unknown /proc/29359/task/84411/root (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84411 flusher ceph txt unknown /proc/29359/task/84411/exe (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84411 flusher ceph NOFD /proc/29359/task/84411/fd (opendir: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84412 ms_dispat ceph cwd unknown /proc/29359/task/84412/cwd (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84412 ms_dispat ceph rtd unknown /proc/29359/task/84412/root (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84412 ms_dispat ceph txt unknown /proc/29359/task/84412/exe (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84412 ms_dispat ceph NOFD /proc/29359/task/84412/fd (opendir: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84413 ms_local ceph cwd unknown /proc/29359/task/84413/cwd (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84413 ms_local ceph rtd unknown /proc/29359/task/84413/root (readlink: Permission denied) 2024-04-25T11:26:48.413 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84413 ms_local ceph txt unknown /proc/29359/task/84413/exe (readlink: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84413 ms_local ceph NOFD /proc/29359/task/84413/fd (opendir: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84414 safe_time ceph cwd unknown /proc/29359/task/84414/cwd (readlink: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84414 safe_time ceph rtd unknown /proc/29359/task/84414/root (readlink: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84414 safe_time ceph txt unknown /proc/29359/task/84414/exe (readlink: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84414 safe_time ceph NOFD /proc/29359/task/84414/fd (opendir: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84415 m-fin-sna ceph cwd unknown /proc/29359/task/84415/cwd (readlink: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84415 m-fin-sna ceph rtd unknown /proc/29359/task/84415/root (readlink: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84415 m-fin-sna ceph txt unknown /proc/29359/task/84415/exe (readlink: Permission denied) 2024-04-25T11:26:48.414 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 84415 m-fin-sna ceph NOFD /proc/29359/task/84415/fd (opendir: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 85860 m-fin-sna ceph cwd unknown /proc/29359/task/85860/cwd (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 85860 m-fin-sna ceph rtd unknown /proc/29359/task/85860/root (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 85860 m-fin-sna ceph txt unknown /proc/29359/task/85860/exe (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mgr 29359 85860 m-fin-sna ceph NOFD /proc/29359/task/85860/fd (opendir: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 30507 root cwd unknown /proc/30507/cwd (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 30507 root rtd unknown /proc/30507/root (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 30507 root txt unknown /proc/30507/exe (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:systemd 30507 root NOFD /proc/30507/fd (opendir: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 30509 root cwd unknown /proc/30509/cwd (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 30509 root rtd unknown /proc/30509/root (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 30509 root txt unknown /proc/30509/exe (readlink: Permission denied) 2024-04-25T11:26:48.415 INFO:tasks.workunit.client.0.smithi080.stdout:(sd-pam) 30509 root NOFD /proc/30509/fd (opendir: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 32957 root cwd unknown /proc/32957/cwd (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 32957 root rtd unknown /proc/32957/root (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 32957 root txt unknown /proc/32957/exe (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 32957 root NOFD /proc/32957/fd (opendir: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 43897 root cwd unknown /proc/43897/cwd (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 43897 root rtd unknown /proc/43897/root (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 43897 root txt unknown /proc/43897/exe (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 43897 root NOFD /proc/43897/fd (opendir: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 43899 root cwd unknown /proc/43899/cwd (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 43899 root rtd unknown /proc/43899/root (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 43899 root txt unknown /proc/43899/exe (readlink: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 43899 root NOFD /proc/43899/fd (opendir: Permission denied) 2024-04-25T11:26:48.416 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 ceph cwd unknown /proc/43901/cwd (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 ceph rtd unknown /proc/43901/root (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 ceph txt unknown /proc/43901/exe (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 ceph NOFD /proc/43901/fd (opendir: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43902 log ceph cwd unknown /proc/43901/task/43902/cwd (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43902 log ceph rtd unknown /proc/43901/task/43902/root (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43902 log ceph txt unknown /proc/43901/task/43902/exe (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43902 log ceph NOFD /proc/43901/task/43902/fd (opendir: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43904 msgr-work ceph cwd unknown /proc/43901/task/43904/cwd (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43904 msgr-work ceph rtd unknown /proc/43901/task/43904/root (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43904 msgr-work ceph txt unknown /proc/43901/task/43904/exe (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43904 msgr-work ceph NOFD /proc/43901/task/43904/fd (opendir: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43905 msgr-work ceph cwd unknown /proc/43901/task/43905/cwd (readlink: Permission denied) 2024-04-25T11:26:48.417 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43905 msgr-work ceph rtd unknown /proc/43901/task/43905/root (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43905 msgr-work ceph txt unknown /proc/43901/task/43905/exe (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43905 msgr-work ceph NOFD /proc/43901/task/43905/fd (opendir: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43906 msgr-work ceph cwd unknown /proc/43901/task/43906/cwd (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43906 msgr-work ceph rtd unknown /proc/43901/task/43906/root (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43906 msgr-work ceph txt unknown /proc/43901/task/43906/exe (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43906 msgr-work ceph NOFD /proc/43901/task/43906/fd (opendir: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43910 service ceph cwd unknown /proc/43901/task/43910/cwd (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43910 service ceph rtd unknown /proc/43901/task/43910/root (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43910 service ceph txt unknown /proc/43901/task/43910/exe (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43910 service ceph NOFD /proc/43901/task/43910/fd (opendir: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43911 admin_soc ceph cwd unknown /proc/43901/task/43911/cwd (readlink: Permission denied) 2024-04-25T11:26:48.418 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43911 admin_soc ceph rtd unknown /proc/43901/task/43911/root (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43911 admin_soc ceph txt unknown /proc/43901/task/43911/exe (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 43911 admin_soc ceph NOFD /proc/43901/task/43911/fd (opendir: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44062 signal_ha ceph cwd unknown /proc/43901/task/44062/cwd (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44062 signal_ha ceph rtd unknown /proc/43901/task/44062/root (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44062 signal_ha ceph txt unknown /proc/43901/task/44062/exe (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44062 signal_ha ceph NOFD /proc/43901/task/44062/fd (opendir: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44063 io_contex ceph cwd unknown /proc/43901/task/44063/cwd (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44063 io_contex ceph rtd unknown /proc/43901/task/44063/root (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44063 io_contex ceph txt unknown /proc/43901/task/44063/exe (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44063 io_contex ceph NOFD /proc/43901/task/44063/fd (opendir: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44064 io_contex ceph cwd unknown /proc/43901/task/44064/cwd (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44064 io_contex ceph rtd unknown /proc/43901/task/44064/root (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44064 io_contex ceph txt unknown /proc/43901/task/44064/exe (readlink: Permission denied) 2024-04-25T11:26:48.419 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44064 io_contex ceph NOFD /proc/43901/task/44064/fd (opendir: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44170 OpHistory ceph cwd unknown /proc/43901/task/44170/cwd (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44170 OpHistory ceph rtd unknown /proc/43901/task/44170/root (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44170 OpHistory ceph txt unknown /proc/43901/task/44170/exe (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44170 OpHistory ceph NOFD /proc/43901/task/44170/fd (opendir: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44171 ceph_time ceph cwd unknown /proc/43901/task/44171/cwd (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44171 ceph_time ceph rtd unknown /proc/43901/task/44171/root (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44171 ceph_time ceph txt unknown /proc/43901/task/44171/exe (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44171 ceph_time ceph NOFD /proc/43901/task/44171/fd (opendir: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44356 ceph-osd ceph cwd unknown /proc/43901/task/44356/cwd (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44356 ceph-osd ceph rtd unknown /proc/43901/task/44356/root (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44356 ceph-osd ceph txt unknown /proc/43901/task/44356/exe (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44356 ceph-osd ceph NOFD /proc/43901/task/44356/fd (opendir: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44357 safe_time ceph cwd unknown /proc/43901/task/44357/cwd (readlink: Permission denied) 2024-04-25T11:26:48.420 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44357 safe_time ceph rtd unknown /proc/43901/task/44357/root (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44357 safe_time ceph txt unknown /proc/43901/task/44357/exe (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44357 safe_time ceph NOFD /proc/43901/task/44357/fd (opendir: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44358 safe_time ceph cwd unknown /proc/43901/task/44358/cwd (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44358 safe_time ceph rtd unknown /proc/43901/task/44358/root (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44358 safe_time ceph txt unknown /proc/43901/task/44358/exe (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44358 safe_time ceph NOFD /proc/43901/task/44358/fd (opendir: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44359 safe_time ceph cwd unknown /proc/43901/task/44359/cwd (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44359 safe_time ceph rtd unknown /proc/43901/task/44359/root (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44359 safe_time ceph txt unknown /proc/43901/task/44359/exe (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44359 safe_time ceph NOFD /proc/43901/task/44359/fd (opendir: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44360 safe_time ceph cwd unknown /proc/43901/task/44360/cwd (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44360 safe_time ceph rtd unknown /proc/43901/task/44360/root (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44360 safe_time ceph txt unknown /proc/43901/task/44360/exe (readlink: Permission denied) 2024-04-25T11:26:48.421 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44360 safe_time ceph NOFD /proc/43901/task/44360/fd (opendir: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44361 fn_anonym ceph cwd unknown /proc/43901/task/44361/cwd (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44361 fn_anonym ceph rtd unknown /proc/43901/task/44361/root (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44361 fn_anonym ceph txt unknown /proc/43901/task/44361/exe (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44361 fn_anonym ceph NOFD /proc/43901/task/44361/fd (opendir: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44366 rocksdb:l ceph cwd unknown /proc/43901/task/44366/cwd (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44366 rocksdb:l ceph rtd unknown /proc/43901/task/44366/root (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44366 rocksdb:l ceph txt unknown /proc/43901/task/44366/exe (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44366 rocksdb:l ceph NOFD /proc/43901/task/44366/fd (opendir: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44367 rocksdb:l ceph cwd unknown /proc/43901/task/44367/cwd (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44367 rocksdb:l ceph rtd unknown /proc/43901/task/44367/root (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44367 rocksdb:l ceph txt unknown /proc/43901/task/44367/exe (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44367 rocksdb:l ceph NOFD /proc/43901/task/44367/fd (opendir: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44368 rocksdb:l ceph cwd unknown /proc/43901/task/44368/cwd (readlink: Permission denied) 2024-04-25T11:26:48.422 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44368 rocksdb:l ceph rtd unknown /proc/43901/task/44368/root (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44368 rocksdb:l ceph txt unknown /proc/43901/task/44368/exe (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44368 rocksdb:l ceph NOFD /proc/43901/task/44368/fd (opendir: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44369 rocksdb:h ceph cwd unknown /proc/43901/task/44369/cwd (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44369 rocksdb:h ceph rtd unknown /proc/43901/task/44369/root (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44369 rocksdb:h ceph txt unknown /proc/43901/task/44369/exe (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44369 rocksdb:h ceph NOFD /proc/43901/task/44369/fd (opendir: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44771 bstore_ai ceph cwd unknown /proc/43901/task/44771/cwd (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44771 bstore_ai ceph rtd unknown /proc/43901/task/44771/root (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44771 bstore_ai ceph txt unknown /proc/43901/task/44771/exe (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 44771 bstore_ai ceph NOFD /proc/43901/task/44771/fd (opendir: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45034 bstore_ai ceph cwd unknown /proc/43901/task/45034/cwd (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45034 bstore_ai ceph rtd unknown /proc/43901/task/45034/root (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45034 bstore_ai ceph txt unknown /proc/43901/task/45034/exe (readlink: Permission denied) 2024-04-25T11:26:48.423 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45034 bstore_ai ceph NOFD /proc/43901/task/45034/fd (opendir: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45216 ceph-osd ceph cwd unknown /proc/43901/task/45216/cwd (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45216 ceph-osd ceph rtd unknown /proc/43901/task/45216/root (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45216 ceph-osd ceph txt unknown /proc/43901/task/45216/exe (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45216 ceph-osd ceph NOFD /proc/43901/task/45216/fd (opendir: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45217 cfin ceph cwd unknown /proc/43901/task/45217/cwd (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45217 cfin ceph rtd unknown /proc/43901/task/45217/root (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45217 cfin ceph txt unknown /proc/43901/task/45217/exe (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45217 cfin ceph NOFD /proc/43901/task/45217/fd (opendir: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45218 bstore_kv ceph cwd unknown /proc/43901/task/45218/cwd (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45218 bstore_kv ceph rtd unknown /proc/43901/task/45218/root (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45218 bstore_kv ceph txt unknown /proc/43901/task/45218/exe (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45218 bstore_kv ceph NOFD /proc/43901/task/45218/fd (opendir: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45219 bstore_kv ceph cwd unknown /proc/43901/task/45219/cwd (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45219 bstore_kv ceph rtd unknown /proc/43901/task/45219/root (readlink: Permission denied) 2024-04-25T11:26:48.424 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45219 bstore_kv ceph txt unknown /proc/43901/task/45219/exe (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45219 bstore_kv ceph NOFD /proc/43901/task/45219/fd (opendir: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45220 bstore_me ceph cwd unknown /proc/43901/task/45220/cwd (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45220 bstore_me ceph rtd unknown /proc/43901/task/45220/root (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45220 bstore_me ceph txt unknown /proc/43901/task/45220/exe (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45220 bstore_me ceph NOFD /proc/43901/task/45220/fd (opendir: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45221 ms_dispat ceph cwd unknown /proc/43901/task/45221/cwd (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45221 ms_dispat ceph rtd unknown /proc/43901/task/45221/root (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45221 ms_dispat ceph txt unknown /proc/43901/task/45221/exe (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45221 ms_dispat ceph NOFD /proc/43901/task/45221/fd (opendir: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45222 ms_local ceph cwd unknown /proc/43901/task/45222/cwd (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45222 ms_local ceph rtd unknown /proc/43901/task/45222/root (readlink: Permission denied) 2024-04-25T11:26:48.425 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45222 ms_local ceph txt unknown /proc/43901/task/45222/exe (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45222 ms_local ceph NOFD /proc/43901/task/45222/fd (opendir: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45223 safe_time ceph cwd unknown /proc/43901/task/45223/cwd (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45223 safe_time ceph rtd unknown /proc/43901/task/45223/root (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45223 safe_time ceph txt unknown /proc/43901/task/45223/exe (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45223 safe_time ceph NOFD /proc/43901/task/45223/fd (opendir: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45224 safe_time ceph cwd unknown /proc/43901/task/45224/cwd (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45224 safe_time ceph rtd unknown /proc/43901/task/45224/root (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45224 safe_time ceph txt unknown /proc/43901/task/45224/exe (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45224 safe_time ceph NOFD /proc/43901/task/45224/fd (opendir: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45225 ms_dispat ceph cwd unknown /proc/43901/task/45225/cwd (readlink: Permission denied) 2024-04-25T11:26:48.426 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45225 ms_dispat ceph rtd unknown /proc/43901/task/45225/root (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45225 ms_dispat ceph txt unknown /proc/43901/task/45225/exe (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45225 ms_dispat ceph NOFD /proc/43901/task/45225/fd (opendir: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45226 ms_local ceph cwd unknown /proc/43901/task/45226/cwd (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45226 ms_local ceph rtd unknown /proc/43901/task/45226/root (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45226 ms_local ceph txt unknown /proc/43901/task/45226/exe (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45226 ms_local ceph NOFD /proc/43901/task/45226/fd (opendir: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45227 ms_dispat ceph cwd unknown /proc/43901/task/45227/cwd (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45227 ms_dispat ceph rtd unknown /proc/43901/task/45227/root (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45227 ms_dispat ceph txt unknown /proc/43901/task/45227/exe (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45227 ms_dispat ceph NOFD /proc/43901/task/45227/fd (opendir: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45228 ms_local ceph cwd unknown /proc/43901/task/45228/cwd (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45228 ms_local ceph rtd unknown /proc/43901/task/45228/root (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45228 ms_local ceph txt unknown /proc/43901/task/45228/exe (readlink: Permission denied) 2024-04-25T11:26:48.427 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45228 ms_local ceph NOFD /proc/43901/task/45228/fd (opendir: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45229 ms_dispat ceph cwd unknown /proc/43901/task/45229/cwd (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45229 ms_dispat ceph rtd unknown /proc/43901/task/45229/root (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45229 ms_dispat ceph txt unknown /proc/43901/task/45229/exe (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45229 ms_dispat ceph NOFD /proc/43901/task/45229/fd (opendir: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45230 ms_local ceph cwd unknown /proc/43901/task/45230/cwd (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45230 ms_local ceph rtd unknown /proc/43901/task/45230/root (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45230 ms_local ceph txt unknown /proc/43901/task/45230/exe (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45230 ms_local ceph NOFD /proc/43901/task/45230/fd (opendir: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45231 ms_dispat ceph cwd unknown /proc/43901/task/45231/cwd (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45231 ms_dispat ceph rtd unknown /proc/43901/task/45231/root (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45231 ms_dispat ceph txt unknown /proc/43901/task/45231/exe (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45231 ms_dispat ceph NOFD /proc/43901/task/45231/fd (opendir: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45232 ms_local ceph cwd unknown /proc/43901/task/45232/cwd (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45232 ms_local ceph rtd unknown /proc/43901/task/45232/root (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45232 ms_local ceph txt unknown /proc/43901/task/45232/exe (readlink: Permission denied) 2024-04-25T11:26:48.428 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45232 ms_local ceph NOFD /proc/43901/task/45232/fd (opendir: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45233 ms_dispat ceph cwd unknown /proc/43901/task/45233/cwd (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45233 ms_dispat ceph rtd unknown /proc/43901/task/45233/root (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45233 ms_dispat ceph txt unknown /proc/43901/task/45233/exe (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45233 ms_dispat ceph NOFD /proc/43901/task/45233/fd (opendir: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45234 ms_local ceph cwd unknown /proc/43901/task/45234/cwd (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45234 ms_local ceph rtd unknown /proc/43901/task/45234/root (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45234 ms_local ceph txt unknown /proc/43901/task/45234/exe (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45234 ms_local ceph NOFD /proc/43901/task/45234/fd (opendir: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45235 ms_dispat ceph cwd unknown /proc/43901/task/45235/cwd (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45235 ms_dispat ceph rtd unknown /proc/43901/task/45235/root (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45235 ms_dispat ceph txt unknown /proc/43901/task/45235/exe (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45235 ms_dispat ceph NOFD /proc/43901/task/45235/fd (opendir: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45236 ms_local ceph cwd unknown /proc/43901/task/45236/cwd (readlink: Permission denied) 2024-04-25T11:26:48.429 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45236 ms_local ceph rtd unknown /proc/43901/task/45236/root (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45236 ms_local ceph txt unknown /proc/43901/task/45236/exe (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45236 ms_local ceph NOFD /proc/43901/task/45236/fd (opendir: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45237 fn_anonym ceph cwd unknown /proc/43901/task/45237/cwd (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45237 fn_anonym ceph rtd unknown /proc/43901/task/45237/root (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45237 fn_anonym ceph txt unknown /proc/43901/task/45237/exe (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45237 fn_anonym ceph NOFD /proc/43901/task/45237/fd (opendir: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45238 finisher ceph cwd unknown /proc/43901/task/45238/cwd (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45238 finisher ceph rtd unknown /proc/43901/task/45238/root (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45238 finisher ceph txt unknown /proc/43901/task/45238/exe (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45238 finisher ceph NOFD /proc/43901/task/45238/fd (opendir: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45239 safe_time ceph cwd unknown /proc/43901/task/45239/cwd (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45239 safe_time ceph rtd unknown /proc/43901/task/45239/root (readlink: Permission denied) 2024-04-25T11:26:48.430 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45239 safe_time ceph txt unknown /proc/43901/task/45239/exe (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45239 safe_time ceph NOFD /proc/43901/task/45239/fd (opendir: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45240 safe_time ceph cwd unknown /proc/43901/task/45240/cwd (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45240 safe_time ceph rtd unknown /proc/43901/task/45240/root (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45240 safe_time ceph txt unknown /proc/43901/task/45240/exe (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45240 safe_time ceph NOFD /proc/43901/task/45240/fd (opendir: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45241 ceph-osd ceph cwd unknown /proc/43901/task/45241/cwd (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45241 ceph-osd ceph rtd unknown /proc/43901/task/45241/root (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45241 ceph-osd ceph txt unknown /proc/43901/task/45241/exe (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45241 ceph-osd ceph NOFD /proc/43901/task/45241/fd (opendir: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45242 osd_srv_a ceph cwd unknown /proc/43901/task/45242/cwd (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45242 osd_srv_a ceph rtd unknown /proc/43901/task/45242/root (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45242 osd_srv_a ceph txt unknown /proc/43901/task/45242/exe (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45242 osd_srv_a ceph NOFD /proc/43901/task/45242/fd (opendir: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45243 tp_osd_tp ceph cwd unknown /proc/43901/task/45243/cwd (readlink: Permission denied) 2024-04-25T11:26:48.431 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45243 tp_osd_tp ceph rtd unknown /proc/43901/task/45243/root (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45243 tp_osd_tp ceph txt unknown /proc/43901/task/45243/exe (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45243 tp_osd_tp ceph NOFD /proc/43901/task/45243/fd (opendir: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45244 tp_osd_tp ceph cwd unknown /proc/43901/task/45244/cwd (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45244 tp_osd_tp ceph rtd unknown /proc/43901/task/45244/root (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45244 tp_osd_tp ceph txt unknown /proc/43901/task/45244/exe (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45244 tp_osd_tp ceph NOFD /proc/43901/task/45244/fd (opendir: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45245 tp_osd_tp ceph cwd unknown /proc/43901/task/45245/cwd (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45245 tp_osd_tp ceph rtd unknown /proc/43901/task/45245/root (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45245 tp_osd_tp ceph txt unknown /proc/43901/task/45245/exe (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45245 tp_osd_tp ceph NOFD /proc/43901/task/45245/fd (opendir: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45246 tp_osd_tp ceph cwd unknown /proc/43901/task/45246/cwd (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45246 tp_osd_tp ceph rtd unknown /proc/43901/task/45246/root (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45246 tp_osd_tp ceph txt unknown /proc/43901/task/45246/exe (readlink: Permission denied) 2024-04-25T11:26:48.432 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45246 tp_osd_tp ceph NOFD /proc/43901/task/45246/fd (opendir: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45247 tp_osd_tp ceph cwd unknown /proc/43901/task/45247/cwd (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45247 tp_osd_tp ceph rtd unknown /proc/43901/task/45247/root (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45247 tp_osd_tp ceph txt unknown /proc/43901/task/45247/exe (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45247 tp_osd_tp ceph NOFD /proc/43901/task/45247/fd (opendir: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45248 tp_osd_tp ceph cwd unknown /proc/43901/task/45248/cwd (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45248 tp_osd_tp ceph rtd unknown /proc/43901/task/45248/root (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45248 tp_osd_tp ceph txt unknown /proc/43901/task/45248/exe (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45248 tp_osd_tp ceph NOFD /proc/43901/task/45248/fd (opendir: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45249 tp_osd_tp ceph cwd unknown /proc/43901/task/45249/cwd (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45249 tp_osd_tp ceph rtd unknown /proc/43901/task/45249/root (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45249 tp_osd_tp ceph txt unknown /proc/43901/task/45249/exe (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45249 tp_osd_tp ceph NOFD /proc/43901/task/45249/fd (opendir: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45250 tp_osd_tp ceph cwd unknown /proc/43901/task/45250/cwd (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45250 tp_osd_tp ceph rtd unknown /proc/43901/task/45250/root (readlink: Permission denied) 2024-04-25T11:26:48.433 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45250 tp_osd_tp ceph txt unknown /proc/43901/task/45250/exe (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45250 tp_osd_tp ceph NOFD /proc/43901/task/45250/fd (opendir: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45251 tp_osd_tp ceph cwd unknown /proc/43901/task/45251/cwd (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45251 tp_osd_tp ceph rtd unknown /proc/43901/task/45251/root (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45251 tp_osd_tp ceph txt unknown /proc/43901/task/45251/exe (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45251 tp_osd_tp ceph NOFD /proc/43901/task/45251/fd (opendir: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45252 tp_osd_tp ceph cwd unknown /proc/43901/task/45252/cwd (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45252 tp_osd_tp ceph rtd unknown /proc/43901/task/45252/root (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45252 tp_osd_tp ceph txt unknown /proc/43901/task/45252/exe (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45252 tp_osd_tp ceph NOFD /proc/43901/task/45252/fd (opendir: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45253 tp_osd_tp ceph cwd unknown /proc/43901/task/45253/cwd (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45253 tp_osd_tp ceph rtd unknown /proc/43901/task/45253/root (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45253 tp_osd_tp ceph txt unknown /proc/43901/task/45253/exe (readlink: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45253 tp_osd_tp ceph NOFD /proc/43901/task/45253/fd (opendir: Permission denied) 2024-04-25T11:26:48.434 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45254 tp_osd_tp ceph cwd unknown /proc/43901/task/45254/cwd (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45254 tp_osd_tp ceph rtd unknown /proc/43901/task/45254/root (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45254 tp_osd_tp ceph txt unknown /proc/43901/task/45254/exe (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45254 tp_osd_tp ceph NOFD /proc/43901/task/45254/fd (opendir: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45255 tp_osd_tp ceph cwd unknown /proc/43901/task/45255/cwd (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45255 tp_osd_tp ceph rtd unknown /proc/43901/task/45255/root (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45255 tp_osd_tp ceph txt unknown /proc/43901/task/45255/exe (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45255 tp_osd_tp ceph NOFD /proc/43901/task/45255/fd (opendir: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45256 tp_osd_tp ceph cwd unknown /proc/43901/task/45256/cwd (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45256 tp_osd_tp ceph rtd unknown /proc/43901/task/45256/root (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45256 tp_osd_tp ceph txt unknown /proc/43901/task/45256/exe (readlink: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45256 tp_osd_tp ceph NOFD /proc/43901/task/45256/fd (opendir: Permission denied) 2024-04-25T11:26:48.435 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45257 tp_osd_tp ceph cwd unknown /proc/43901/task/45257/cwd (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45257 tp_osd_tp ceph rtd unknown /proc/43901/task/45257/root (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45257 tp_osd_tp ceph txt unknown /proc/43901/task/45257/exe (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45257 tp_osd_tp ceph NOFD /proc/43901/task/45257/fd (opendir: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45258 tp_osd_tp ceph cwd unknown /proc/43901/task/45258/cwd (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45258 tp_osd_tp ceph rtd unknown /proc/43901/task/45258/root (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45258 tp_osd_tp ceph txt unknown /proc/43901/task/45258/exe (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45258 tp_osd_tp ceph NOFD /proc/43901/task/45258/fd (opendir: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45259 osd_srv_h ceph cwd unknown /proc/43901/task/45259/cwd (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45259 osd_srv_h ceph rtd unknown /proc/43901/task/45259/root (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45259 osd_srv_h ceph txt unknown /proc/43901/task/45259/exe (readlink: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 43901 45259 osd_srv_h ceph NOFD /proc/43901/task/45259/fd (opendir: Permission denied) 2024-04-25T11:26:48.436 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 45276 root cwd unknown /proc/45276/cwd (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 45276 root rtd unknown /proc/45276/root (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 45276 root txt unknown /proc/45276/exe (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 45276 root NOFD /proc/45276/fd (opendir: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 45305 root cwd unknown /proc/45305/cwd (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 45305 root rtd unknown /proc/45305/root (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 45305 root txt unknown /proc/45305/exe (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 45305 root NOFD /proc/45305/fd (opendir: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 47853 root cwd unknown /proc/47853/cwd (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 47853 root rtd unknown /proc/47853/root (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 47853 root txt unknown /proc/47853/exe (readlink: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 47853 root NOFD /proc/47853/fd (opendir: Permission denied) 2024-04-25T11:26:48.437 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50097 root cwd unknown /proc/50097/cwd (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50097 root rtd unknown /proc/50097/root (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50097 root txt unknown /proc/50097/exe (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50097 root NOFD /proc/50097/fd (opendir: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50098 root cwd unknown /proc/50098/cwd (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50098 root rtd unknown /proc/50098/root (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50098 root txt unknown /proc/50098/exe (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/7 50098 root NOFD /proc/50098/fd (opendir: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 50149 root cwd unknown /proc/50149/cwd (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 50149 root rtd unknown /proc/50149/root (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 50149 root txt unknown /proc/50149/exe (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 50149 root NOFD /proc/50149/fd (opendir: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 50701 root cwd unknown /proc/50701/cwd (readlink: Permission denied) 2024-04-25T11:26:48.438 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 50701 root rtd unknown /proc/50701/root (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 50701 root txt unknown /proc/50701/exe (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 50701 root NOFD /proc/50701/fd (opendir: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 50703 root cwd unknown /proc/50703/cwd (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 50703 root rtd unknown /proc/50703/root (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 50703 root txt unknown /proc/50703/exe (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 50703 root NOFD /proc/50703/fd (opendir: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 ceph cwd unknown /proc/50705/cwd (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 ceph rtd unknown /proc/50705/root (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 ceph txt unknown /proc/50705/exe (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 ceph NOFD /proc/50705/fd (opendir: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50706 log ceph cwd unknown /proc/50705/task/50706/cwd (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50706 log ceph rtd unknown /proc/50705/task/50706/root (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50706 log ceph txt unknown /proc/50705/task/50706/exe (readlink: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50706 log ceph NOFD /proc/50705/task/50706/fd (opendir: Permission denied) 2024-04-25T11:26:48.439 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50708 msgr-work ceph cwd unknown /proc/50705/task/50708/cwd (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50708 msgr-work ceph rtd unknown /proc/50705/task/50708/root (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50708 msgr-work ceph txt unknown /proc/50705/task/50708/exe (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50708 msgr-work ceph NOFD /proc/50705/task/50708/fd (opendir: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50709 msgr-work ceph cwd unknown /proc/50705/task/50709/cwd (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50709 msgr-work ceph rtd unknown /proc/50705/task/50709/root (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50709 msgr-work ceph txt unknown /proc/50705/task/50709/exe (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50709 msgr-work ceph NOFD /proc/50705/task/50709/fd (opendir: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50710 msgr-work ceph cwd unknown /proc/50705/task/50710/cwd (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50710 msgr-work ceph rtd unknown /proc/50705/task/50710/root (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50710 msgr-work ceph txt unknown /proc/50705/task/50710/exe (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50710 msgr-work ceph NOFD /proc/50705/task/50710/fd (opendir: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50714 service ceph cwd unknown /proc/50705/task/50714/cwd (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50714 service ceph rtd unknown /proc/50705/task/50714/root (readlink: Permission denied) 2024-04-25T11:26:48.440 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50714 service ceph txt unknown /proc/50705/task/50714/exe (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50714 service ceph NOFD /proc/50705/task/50714/fd (opendir: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50715 admin_soc ceph cwd unknown /proc/50705/task/50715/cwd (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50715 admin_soc ceph rtd unknown /proc/50705/task/50715/root (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50715 admin_soc ceph txt unknown /proc/50705/task/50715/exe (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50715 admin_soc ceph NOFD /proc/50705/task/50715/fd (opendir: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50857 signal_ha ceph cwd unknown /proc/50705/task/50857/cwd (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50857 signal_ha ceph rtd unknown /proc/50705/task/50857/root (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50857 signal_ha ceph txt unknown /proc/50705/task/50857/exe (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50857 signal_ha ceph NOFD /proc/50705/task/50857/fd (opendir: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50858 io_contex ceph cwd unknown /proc/50705/task/50858/cwd (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50858 io_contex ceph rtd unknown /proc/50705/task/50858/root (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50858 io_contex ceph txt unknown /proc/50705/task/50858/exe (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50858 io_contex ceph NOFD /proc/50705/task/50858/fd (opendir: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50859 io_contex ceph cwd unknown /proc/50705/task/50859/cwd (readlink: Permission denied) 2024-04-25T11:26:48.441 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50859 io_contex ceph rtd unknown /proc/50705/task/50859/root (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50859 io_contex ceph txt unknown /proc/50705/task/50859/exe (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50859 io_contex ceph NOFD /proc/50705/task/50859/fd (opendir: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50971 OpHistory ceph cwd unknown /proc/50705/task/50971/cwd (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50971 OpHistory ceph rtd unknown /proc/50705/task/50971/root (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50971 OpHistory ceph txt unknown /proc/50705/task/50971/exe (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50971 OpHistory ceph NOFD /proc/50705/task/50971/fd (opendir: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50972 ceph_time ceph cwd unknown /proc/50705/task/50972/cwd (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50972 ceph_time ceph rtd unknown /proc/50705/task/50972/root (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50972 ceph_time ceph txt unknown /proc/50705/task/50972/exe (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 50972 ceph_time ceph NOFD /proc/50705/task/50972/fd (opendir: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51149 ceph-osd ceph cwd unknown /proc/50705/task/51149/cwd (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51149 ceph-osd ceph rtd unknown /proc/50705/task/51149/root (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51149 ceph-osd ceph txt unknown /proc/50705/task/51149/exe (readlink: Permission denied) 2024-04-25T11:26:48.442 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51149 ceph-osd ceph NOFD /proc/50705/task/51149/fd (opendir: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51150 safe_time ceph cwd unknown /proc/50705/task/51150/cwd (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51150 safe_time ceph rtd unknown /proc/50705/task/51150/root (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51150 safe_time ceph txt unknown /proc/50705/task/51150/exe (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51150 safe_time ceph NOFD /proc/50705/task/51150/fd (opendir: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51151 safe_time ceph cwd unknown /proc/50705/task/51151/cwd (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51151 safe_time ceph rtd unknown /proc/50705/task/51151/root (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51151 safe_time ceph txt unknown /proc/50705/task/51151/exe (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51151 safe_time ceph NOFD /proc/50705/task/51151/fd (opendir: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51152 safe_time ceph cwd unknown /proc/50705/task/51152/cwd (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51152 safe_time ceph rtd unknown /proc/50705/task/51152/root (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51152 safe_time ceph txt unknown /proc/50705/task/51152/exe (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51152 safe_time ceph NOFD /proc/50705/task/51152/fd (opendir: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51154 safe_time ceph cwd unknown /proc/50705/task/51154/cwd (readlink: Permission denied) 2024-04-25T11:26:48.443 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51154 safe_time ceph rtd unknown /proc/50705/task/51154/root (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51154 safe_time ceph txt unknown /proc/50705/task/51154/exe (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51154 safe_time ceph NOFD /proc/50705/task/51154/fd (opendir: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51155 fn_anonym ceph cwd unknown /proc/50705/task/51155/cwd (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51155 fn_anonym ceph rtd unknown /proc/50705/task/51155/root (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51155 fn_anonym ceph txt unknown /proc/50705/task/51155/exe (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51155 fn_anonym ceph NOFD /proc/50705/task/51155/fd (opendir: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51159 rocksdb:l ceph cwd unknown /proc/50705/task/51159/cwd (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51159 rocksdb:l ceph rtd unknown /proc/50705/task/51159/root (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51159 rocksdb:l ceph txt unknown /proc/50705/task/51159/exe (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51159 rocksdb:l ceph NOFD /proc/50705/task/51159/fd (opendir: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51160 rocksdb:l ceph cwd unknown /proc/50705/task/51160/cwd (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51160 rocksdb:l ceph rtd unknown /proc/50705/task/51160/root (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51160 rocksdb:l ceph txt unknown /proc/50705/task/51160/exe (readlink: Permission denied) 2024-04-25T11:26:48.444 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51160 rocksdb:l ceph NOFD /proc/50705/task/51160/fd (opendir: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51161 rocksdb:l ceph cwd unknown /proc/50705/task/51161/cwd (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51161 rocksdb:l ceph rtd unknown /proc/50705/task/51161/root (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51161 rocksdb:l ceph txt unknown /proc/50705/task/51161/exe (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51161 rocksdb:l ceph NOFD /proc/50705/task/51161/fd (opendir: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51162 rocksdb:h ceph cwd unknown /proc/50705/task/51162/cwd (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51162 rocksdb:h ceph rtd unknown /proc/50705/task/51162/root (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51162 rocksdb:h ceph txt unknown /proc/50705/task/51162/exe (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51162 rocksdb:h ceph NOFD /proc/50705/task/51162/fd (opendir: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51579 bstore_ai ceph cwd unknown /proc/50705/task/51579/cwd (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51579 bstore_ai ceph rtd unknown /proc/50705/task/51579/root (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51579 bstore_ai ceph txt unknown /proc/50705/task/51579/exe (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51579 bstore_ai ceph NOFD /proc/50705/task/51579/fd (opendir: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51806 bstore_ai ceph cwd unknown /proc/50705/task/51806/cwd (readlink: Permission denied) 2024-04-25T11:26:48.445 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51806 bstore_ai ceph rtd unknown /proc/50705/task/51806/root (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51806 bstore_ai ceph txt unknown /proc/50705/task/51806/exe (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 51806 bstore_ai ceph NOFD /proc/50705/task/51806/fd (opendir: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52003 ceph-osd ceph cwd unknown /proc/50705/task/52003/cwd (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52003 ceph-osd ceph rtd unknown /proc/50705/task/52003/root (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52003 ceph-osd ceph txt unknown /proc/50705/task/52003/exe (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52003 ceph-osd ceph NOFD /proc/50705/task/52003/fd (opendir: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52005 cfin ceph cwd unknown /proc/50705/task/52005/cwd (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52005 cfin ceph rtd unknown /proc/50705/task/52005/root (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52005 cfin ceph txt unknown /proc/50705/task/52005/exe (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52005 cfin ceph NOFD /proc/50705/task/52005/fd (opendir: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52006 bstore_kv ceph cwd unknown /proc/50705/task/52006/cwd (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52006 bstore_kv ceph rtd unknown /proc/50705/task/52006/root (readlink: Permission denied) 2024-04-25T11:26:48.446 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52006 bstore_kv ceph txt unknown /proc/50705/task/52006/exe (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52006 bstore_kv ceph NOFD /proc/50705/task/52006/fd (opendir: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52007 bstore_kv ceph cwd unknown /proc/50705/task/52007/cwd (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52007 bstore_kv ceph rtd unknown /proc/50705/task/52007/root (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52007 bstore_kv ceph txt unknown /proc/50705/task/52007/exe (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52007 bstore_kv ceph NOFD /proc/50705/task/52007/fd (opendir: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52008 bstore_me ceph cwd unknown /proc/50705/task/52008/cwd (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52008 bstore_me ceph rtd unknown /proc/50705/task/52008/root (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52008 bstore_me ceph txt unknown /proc/50705/task/52008/exe (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52008 bstore_me ceph NOFD /proc/50705/task/52008/fd (opendir: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52019 ms_dispat ceph cwd unknown /proc/50705/task/52019/cwd (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52019 ms_dispat ceph rtd unknown /proc/50705/task/52019/root (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52019 ms_dispat ceph txt unknown /proc/50705/task/52019/exe (readlink: Permission denied) 2024-04-25T11:26:48.447 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52019 ms_dispat ceph NOFD /proc/50705/task/52019/fd (opendir: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52020 ms_local ceph cwd unknown /proc/50705/task/52020/cwd (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52020 ms_local ceph rtd unknown /proc/50705/task/52020/root (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52020 ms_local ceph txt unknown /proc/50705/task/52020/exe (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52020 ms_local ceph NOFD /proc/50705/task/52020/fd (opendir: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52021 safe_time ceph cwd unknown /proc/50705/task/52021/cwd (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52021 safe_time ceph rtd unknown /proc/50705/task/52021/root (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52021 safe_time ceph txt unknown /proc/50705/task/52021/exe (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52021 safe_time ceph NOFD /proc/50705/task/52021/fd (opendir: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52022 safe_time ceph cwd unknown /proc/50705/task/52022/cwd (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52022 safe_time ceph rtd unknown /proc/50705/task/52022/root (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52022 safe_time ceph txt unknown /proc/50705/task/52022/exe (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52022 safe_time ceph NOFD /proc/50705/task/52022/fd (opendir: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52023 ms_dispat ceph cwd unknown /proc/50705/task/52023/cwd (readlink: Permission denied) 2024-04-25T11:26:48.448 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52023 ms_dispat ceph rtd unknown /proc/50705/task/52023/root (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52023 ms_dispat ceph txt unknown /proc/50705/task/52023/exe (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52023 ms_dispat ceph NOFD /proc/50705/task/52023/fd (opendir: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52024 ms_local ceph cwd unknown /proc/50705/task/52024/cwd (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52024 ms_local ceph rtd unknown /proc/50705/task/52024/root (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52024 ms_local ceph txt unknown /proc/50705/task/52024/exe (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52024 ms_local ceph NOFD /proc/50705/task/52024/fd (opendir: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52025 ms_dispat ceph cwd unknown /proc/50705/task/52025/cwd (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52025 ms_dispat ceph rtd unknown /proc/50705/task/52025/root (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52025 ms_dispat ceph txt unknown /proc/50705/task/52025/exe (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52025 ms_dispat ceph NOFD /proc/50705/task/52025/fd (opendir: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52026 ms_local ceph cwd unknown /proc/50705/task/52026/cwd (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52026 ms_local ceph rtd unknown /proc/50705/task/52026/root (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52026 ms_local ceph txt unknown /proc/50705/task/52026/exe (readlink: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52026 ms_local ceph NOFD /proc/50705/task/52026/fd (opendir: Permission denied) 2024-04-25T11:26:48.449 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52027 ms_dispat ceph cwd unknown /proc/50705/task/52027/cwd (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52027 ms_dispat ceph rtd unknown /proc/50705/task/52027/root (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52027 ms_dispat ceph txt unknown /proc/50705/task/52027/exe (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52027 ms_dispat ceph NOFD /proc/50705/task/52027/fd (opendir: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52028 ms_local ceph cwd unknown /proc/50705/task/52028/cwd (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52028 ms_local ceph rtd unknown /proc/50705/task/52028/root (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52028 ms_local ceph txt unknown /proc/50705/task/52028/exe (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52028 ms_local ceph NOFD /proc/50705/task/52028/fd (opendir: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52029 ms_dispat ceph cwd unknown /proc/50705/task/52029/cwd (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52029 ms_dispat ceph rtd unknown /proc/50705/task/52029/root (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52029 ms_dispat ceph txt unknown /proc/50705/task/52029/exe (readlink: Permission denied) 2024-04-25T11:26:48.450 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52029 ms_dispat ceph NOFD /proc/50705/task/52029/fd (opendir: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52030 ms_local ceph cwd unknown /proc/50705/task/52030/cwd (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52030 ms_local ceph rtd unknown /proc/50705/task/52030/root (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52030 ms_local ceph txt unknown /proc/50705/task/52030/exe (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52030 ms_local ceph NOFD /proc/50705/task/52030/fd (opendir: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52031 ms_dispat ceph cwd unknown /proc/50705/task/52031/cwd (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52031 ms_dispat ceph rtd unknown /proc/50705/task/52031/root (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52031 ms_dispat ceph txt unknown /proc/50705/task/52031/exe (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52031 ms_dispat ceph NOFD /proc/50705/task/52031/fd (opendir: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52032 ms_local ceph cwd unknown /proc/50705/task/52032/cwd (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52032 ms_local ceph rtd unknown /proc/50705/task/52032/root (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52032 ms_local ceph txt unknown /proc/50705/task/52032/exe (readlink: Permission denied) 2024-04-25T11:26:48.451 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52032 ms_local ceph NOFD /proc/50705/task/52032/fd (opendir: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52033 ms_dispat ceph cwd unknown /proc/50705/task/52033/cwd (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52033 ms_dispat ceph rtd unknown /proc/50705/task/52033/root (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52033 ms_dispat ceph txt unknown /proc/50705/task/52033/exe (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52033 ms_dispat ceph NOFD /proc/50705/task/52033/fd (opendir: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52034 ms_local ceph cwd unknown /proc/50705/task/52034/cwd (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52034 ms_local ceph rtd unknown /proc/50705/task/52034/root (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52034 ms_local ceph txt unknown /proc/50705/task/52034/exe (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52034 ms_local ceph NOFD /proc/50705/task/52034/fd (opendir: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52035 fn_anonym ceph cwd unknown /proc/50705/task/52035/cwd (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52035 fn_anonym ceph rtd unknown /proc/50705/task/52035/root (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52035 fn_anonym ceph txt unknown /proc/50705/task/52035/exe (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52035 fn_anonym ceph NOFD /proc/50705/task/52035/fd (opendir: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52036 finisher ceph cwd unknown /proc/50705/task/52036/cwd (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52036 finisher ceph rtd unknown /proc/50705/task/52036/root (readlink: Permission denied) 2024-04-25T11:26:48.452 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52036 finisher ceph txt unknown /proc/50705/task/52036/exe (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52036 finisher ceph NOFD /proc/50705/task/52036/fd (opendir: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52037 safe_time ceph cwd unknown /proc/50705/task/52037/cwd (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52037 safe_time ceph rtd unknown /proc/50705/task/52037/root (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52037 safe_time ceph txt unknown /proc/50705/task/52037/exe (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52037 safe_time ceph NOFD /proc/50705/task/52037/fd (opendir: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52038 safe_time ceph cwd unknown /proc/50705/task/52038/cwd (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52038 safe_time ceph rtd unknown /proc/50705/task/52038/root (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52038 safe_time ceph txt unknown /proc/50705/task/52038/exe (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52038 safe_time ceph NOFD /proc/50705/task/52038/fd (opendir: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52039 ceph-osd ceph cwd unknown /proc/50705/task/52039/cwd (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52039 ceph-osd ceph rtd unknown /proc/50705/task/52039/root (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52039 ceph-osd ceph txt unknown /proc/50705/task/52039/exe (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52039 ceph-osd ceph NOFD /proc/50705/task/52039/fd (opendir: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52040 osd_srv_a ceph cwd unknown /proc/50705/task/52040/cwd (readlink: Permission denied) 2024-04-25T11:26:48.453 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52040 osd_srv_a ceph rtd unknown /proc/50705/task/52040/root (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52040 osd_srv_a ceph txt unknown /proc/50705/task/52040/exe (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52040 osd_srv_a ceph NOFD /proc/50705/task/52040/fd (opendir: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52041 tp_osd_tp ceph cwd unknown /proc/50705/task/52041/cwd (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52041 tp_osd_tp ceph rtd unknown /proc/50705/task/52041/root (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52041 tp_osd_tp ceph txt unknown /proc/50705/task/52041/exe (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52041 tp_osd_tp ceph NOFD /proc/50705/task/52041/fd (opendir: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52042 tp_osd_tp ceph cwd unknown /proc/50705/task/52042/cwd (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52042 tp_osd_tp ceph rtd unknown /proc/50705/task/52042/root (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52042 tp_osd_tp ceph txt unknown /proc/50705/task/52042/exe (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52042 tp_osd_tp ceph NOFD /proc/50705/task/52042/fd (opendir: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52043 tp_osd_tp ceph cwd unknown /proc/50705/task/52043/cwd (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52043 tp_osd_tp ceph rtd unknown /proc/50705/task/52043/root (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52043 tp_osd_tp ceph txt unknown /proc/50705/task/52043/exe (readlink: Permission denied) 2024-04-25T11:26:48.454 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52043 tp_osd_tp ceph NOFD /proc/50705/task/52043/fd (opendir: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52044 tp_osd_tp ceph cwd unknown /proc/50705/task/52044/cwd (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52044 tp_osd_tp ceph rtd unknown /proc/50705/task/52044/root (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52044 tp_osd_tp ceph txt unknown /proc/50705/task/52044/exe (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52044 tp_osd_tp ceph NOFD /proc/50705/task/52044/fd (opendir: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52045 tp_osd_tp ceph cwd unknown /proc/50705/task/52045/cwd (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52045 tp_osd_tp ceph rtd unknown /proc/50705/task/52045/root (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52045 tp_osd_tp ceph txt unknown /proc/50705/task/52045/exe (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52045 tp_osd_tp ceph NOFD /proc/50705/task/52045/fd (opendir: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52046 tp_osd_tp ceph cwd unknown /proc/50705/task/52046/cwd (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52046 tp_osd_tp ceph rtd unknown /proc/50705/task/52046/root (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52046 tp_osd_tp ceph txt unknown /proc/50705/task/52046/exe (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52046 tp_osd_tp ceph NOFD /proc/50705/task/52046/fd (opendir: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52047 tp_osd_tp ceph cwd unknown /proc/50705/task/52047/cwd (readlink: Permission denied) 2024-04-25T11:26:48.455 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52047 tp_osd_tp ceph rtd unknown /proc/50705/task/52047/root (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52047 tp_osd_tp ceph txt unknown /proc/50705/task/52047/exe (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52047 tp_osd_tp ceph NOFD /proc/50705/task/52047/fd (opendir: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52048 tp_osd_tp ceph cwd unknown /proc/50705/task/52048/cwd (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52048 tp_osd_tp ceph rtd unknown /proc/50705/task/52048/root (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52048 tp_osd_tp ceph txt unknown /proc/50705/task/52048/exe (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52048 tp_osd_tp ceph NOFD /proc/50705/task/52048/fd (opendir: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52049 tp_osd_tp ceph cwd unknown /proc/50705/task/52049/cwd (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52049 tp_osd_tp ceph rtd unknown /proc/50705/task/52049/root (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52049 tp_osd_tp ceph txt unknown /proc/50705/task/52049/exe (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52049 tp_osd_tp ceph NOFD /proc/50705/task/52049/fd (opendir: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52050 tp_osd_tp ceph cwd unknown /proc/50705/task/52050/cwd (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52050 tp_osd_tp ceph rtd unknown /proc/50705/task/52050/root (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52050 tp_osd_tp ceph txt unknown /proc/50705/task/52050/exe (readlink: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52050 tp_osd_tp ceph NOFD /proc/50705/task/52050/fd (opendir: Permission denied) 2024-04-25T11:26:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52051 tp_osd_tp ceph cwd unknown /proc/50705/task/52051/cwd (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52051 tp_osd_tp ceph rtd unknown /proc/50705/task/52051/root (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52051 tp_osd_tp ceph txt unknown /proc/50705/task/52051/exe (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52051 tp_osd_tp ceph NOFD /proc/50705/task/52051/fd (opendir: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52052 tp_osd_tp ceph cwd unknown /proc/50705/task/52052/cwd (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52052 tp_osd_tp ceph rtd unknown /proc/50705/task/52052/root (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52052 tp_osd_tp ceph txt unknown /proc/50705/task/52052/exe (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52052 tp_osd_tp ceph NOFD /proc/50705/task/52052/fd (opendir: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52053 tp_osd_tp ceph cwd unknown /proc/50705/task/52053/cwd (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52053 tp_osd_tp ceph rtd unknown /proc/50705/task/52053/root (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52053 tp_osd_tp ceph txt unknown /proc/50705/task/52053/exe (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52053 tp_osd_tp ceph NOFD /proc/50705/task/52053/fd (opendir: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52054 tp_osd_tp ceph cwd unknown /proc/50705/task/52054/cwd (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52054 tp_osd_tp ceph rtd unknown /proc/50705/task/52054/root (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52054 tp_osd_tp ceph txt unknown /proc/50705/task/52054/exe (readlink: Permission denied) 2024-04-25T11:26:48.457 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52054 tp_osd_tp ceph NOFD /proc/50705/task/52054/fd (opendir: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52055 tp_osd_tp ceph cwd unknown /proc/50705/task/52055/cwd (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52055 tp_osd_tp ceph rtd unknown /proc/50705/task/52055/root (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52055 tp_osd_tp ceph txt unknown /proc/50705/task/52055/exe (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52055 tp_osd_tp ceph NOFD /proc/50705/task/52055/fd (opendir: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52056 tp_osd_tp ceph cwd unknown /proc/50705/task/52056/cwd (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52056 tp_osd_tp ceph rtd unknown /proc/50705/task/52056/root (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52056 tp_osd_tp ceph txt unknown /proc/50705/task/52056/exe (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52056 tp_osd_tp ceph NOFD /proc/50705/task/52056/fd (opendir: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52057 osd_srv_h ceph cwd unknown /proc/50705/task/52057/cwd (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52057 osd_srv_h ceph rtd unknown /proc/50705/task/52057/root (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52057 osd_srv_h ceph txt unknown /proc/50705/task/52057/exe (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 50705 52057 osd_srv_h ceph NOFD /proc/50705/task/52057/fd (opendir: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 52058 root cwd unknown /proc/52058/cwd (readlink: Permission denied) 2024-04-25T11:26:48.458 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 52058 root rtd unknown /proc/52058/root (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 52058 root txt unknown /proc/52058/exe (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 52058 root NOFD /proc/52058/fd (opendir: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 52075 root cwd unknown /proc/52075/cwd (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 52075 root rtd unknown /proc/52075/root (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 52075 root txt unknown /proc/52075/exe (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 52075 root NOFD /proc/52075/fd (opendir: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 54827 root cwd unknown /proc/54827/cwd (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 54827 root rtd unknown /proc/54827/root (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 54827 root txt unknown /proc/54827/exe (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 54827 root NOFD /proc/54827/fd (opendir: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 56533 root cwd unknown /proc/56533/cwd (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 56533 root rtd unknown /proc/56533/root (readlink: Permission denied) 2024-04-25T11:26:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 56533 root txt unknown /proc/56533/exe (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/0 56533 root NOFD /proc/56533/fd (opendir: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 56663 root cwd unknown /proc/56663/cwd (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 56663 root rtd unknown /proc/56663/root (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 56663 root txt unknown /proc/56663/exe (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 56663 root NOFD /proc/56663/fd (opendir: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 57283 root cwd unknown /proc/57283/cwd (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 57283 root rtd unknown /proc/57283/root (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 57283 root txt unknown /proc/57283/exe (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 57283 root NOFD /proc/57283/fd (opendir: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 57285 root cwd unknown /proc/57285/cwd (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 57285 root rtd unknown /proc/57285/root (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 57285 root txt unknown /proc/57285/exe (readlink: Permission denied) 2024-04-25T11:26:48.460 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 57285 root NOFD /proc/57285/fd (opendir: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 ceph cwd unknown /proc/57287/cwd (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 ceph rtd unknown /proc/57287/root (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 ceph txt unknown /proc/57287/exe (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 ceph NOFD /proc/57287/fd (opendir: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57288 log ceph cwd unknown /proc/57287/task/57288/cwd (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57288 log ceph rtd unknown /proc/57287/task/57288/root (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57288 log ceph txt unknown /proc/57287/task/57288/exe (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57288 log ceph NOFD /proc/57287/task/57288/fd (opendir: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57290 msgr-work ceph cwd unknown /proc/57287/task/57290/cwd (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57290 msgr-work ceph rtd unknown /proc/57287/task/57290/root (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57290 msgr-work ceph txt unknown /proc/57287/task/57290/exe (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57290 msgr-work ceph NOFD /proc/57287/task/57290/fd (opendir: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57291 msgr-work ceph cwd unknown /proc/57287/task/57291/cwd (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57291 msgr-work ceph rtd unknown /proc/57287/task/57291/root (readlink: Permission denied) 2024-04-25T11:26:48.461 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57291 msgr-work ceph txt unknown /proc/57287/task/57291/exe (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57291 msgr-work ceph NOFD /proc/57287/task/57291/fd (opendir: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57292 msgr-work ceph cwd unknown /proc/57287/task/57292/cwd (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57292 msgr-work ceph rtd unknown /proc/57287/task/57292/root (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57292 msgr-work ceph txt unknown /proc/57287/task/57292/exe (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57292 msgr-work ceph NOFD /proc/57287/task/57292/fd (opendir: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57296 service ceph cwd unknown /proc/57287/task/57296/cwd (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57296 service ceph rtd unknown /proc/57287/task/57296/root (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57296 service ceph txt unknown /proc/57287/task/57296/exe (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57296 service ceph NOFD /proc/57287/task/57296/fd (opendir: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57297 admin_soc ceph cwd unknown /proc/57287/task/57297/cwd (readlink: Permission denied) 2024-04-25T11:26:48.462 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57297 admin_soc ceph rtd unknown /proc/57287/task/57297/root (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57297 admin_soc ceph txt unknown /proc/57287/task/57297/exe (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57297 admin_soc ceph NOFD /proc/57287/task/57297/fd (opendir: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57451 signal_ha ceph cwd unknown /proc/57287/task/57451/cwd (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57451 signal_ha ceph rtd unknown /proc/57287/task/57451/root (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57451 signal_ha ceph txt unknown /proc/57287/task/57451/exe (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57451 signal_ha ceph NOFD /proc/57287/task/57451/fd (opendir: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57452 io_contex ceph cwd unknown /proc/57287/task/57452/cwd (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57452 io_contex ceph rtd unknown /proc/57287/task/57452/root (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57452 io_contex ceph txt unknown /proc/57287/task/57452/exe (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57452 io_contex ceph NOFD /proc/57287/task/57452/fd (opendir: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57453 io_contex ceph cwd unknown /proc/57287/task/57453/cwd (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57453 io_contex ceph rtd unknown /proc/57287/task/57453/root (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57453 io_contex ceph txt unknown /proc/57287/task/57453/exe (readlink: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57453 io_contex ceph NOFD /proc/57287/task/57453/fd (opendir: Permission denied) 2024-04-25T11:26:48.463 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57555 OpHistory ceph cwd unknown /proc/57287/task/57555/cwd (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57555 OpHistory ceph rtd unknown /proc/57287/task/57555/root (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57555 OpHistory ceph txt unknown /proc/57287/task/57555/exe (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57555 OpHistory ceph NOFD /proc/57287/task/57555/fd (opendir: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57556 ceph_time ceph cwd unknown /proc/57287/task/57556/cwd (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57556 ceph_time ceph rtd unknown /proc/57287/task/57556/root (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57556 ceph_time ceph txt unknown /proc/57287/task/57556/exe (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57556 ceph_time ceph NOFD /proc/57287/task/57556/fd (opendir: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57607 ceph-osd ceph cwd unknown /proc/57287/task/57607/cwd (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57607 ceph-osd ceph rtd unknown /proc/57287/task/57607/root (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57607 ceph-osd ceph txt unknown /proc/57287/task/57607/exe (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57607 ceph-osd ceph NOFD /proc/57287/task/57607/fd (opendir: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57612 ceph-osd ceph cwd unknown /proc/57287/task/57612/cwd (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57612 ceph-osd ceph rtd unknown /proc/57287/task/57612/root (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57612 ceph-osd ceph txt unknown /proc/57287/task/57612/exe (readlink: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57612 ceph-osd ceph NOFD /proc/57287/task/57612/fd (opendir: Permission denied) 2024-04-25T11:26:48.464 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57621 ceph-osd ceph cwd unknown /proc/57287/task/57621/cwd (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57621 ceph-osd ceph rtd unknown /proc/57287/task/57621/root (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57621 ceph-osd ceph txt unknown /proc/57287/task/57621/exe (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57621 ceph-osd ceph NOFD /proc/57287/task/57621/fd (opendir: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57639 ceph-osd ceph cwd unknown /proc/57287/task/57639/cwd (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57639 ceph-osd ceph rtd unknown /proc/57287/task/57639/root (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57639 ceph-osd ceph txt unknown /proc/57287/task/57639/exe (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57639 ceph-osd ceph NOFD /proc/57287/task/57639/fd (opendir: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57676 ceph-osd ceph cwd unknown /proc/57287/task/57676/cwd (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57676 ceph-osd ceph rtd unknown /proc/57287/task/57676/root (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57676 ceph-osd ceph txt unknown /proc/57287/task/57676/exe (readlink: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57676 ceph-osd ceph NOFD /proc/57287/task/57676/fd (opendir: Permission denied) 2024-04-25T11:26:48.465 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57681 ceph-osd ceph cwd unknown /proc/57287/task/57681/cwd (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57681 ceph-osd ceph rtd unknown /proc/57287/task/57681/root (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57681 ceph-osd ceph txt unknown /proc/57287/task/57681/exe (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57681 ceph-osd ceph NOFD /proc/57287/task/57681/fd (opendir: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57707 ceph-osd ceph cwd unknown /proc/57287/task/57707/cwd (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57707 ceph-osd ceph rtd unknown /proc/57287/task/57707/root (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57707 ceph-osd ceph txt unknown /proc/57287/task/57707/exe (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57707 ceph-osd ceph NOFD /proc/57287/task/57707/fd (opendir: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57732 ceph-osd ceph cwd unknown /proc/57287/task/57732/cwd (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57732 ceph-osd ceph rtd unknown /proc/57287/task/57732/root (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57732 ceph-osd ceph txt unknown /proc/57287/task/57732/exe (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57732 ceph-osd ceph NOFD /proc/57287/task/57732/fd (opendir: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57733 ceph-osd ceph cwd unknown /proc/57287/task/57733/cwd (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57733 ceph-osd ceph rtd unknown /proc/57287/task/57733/root (readlink: Permission denied) 2024-04-25T11:26:48.466 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57733 ceph-osd ceph txt unknown /proc/57287/task/57733/exe (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57733 ceph-osd ceph NOFD /proc/57287/task/57733/fd (opendir: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57735 safe_time ceph cwd unknown /proc/57287/task/57735/cwd (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57735 safe_time ceph rtd unknown /proc/57287/task/57735/root (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57735 safe_time ceph txt unknown /proc/57287/task/57735/exe (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57735 safe_time ceph NOFD /proc/57287/task/57735/fd (opendir: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57736 safe_time ceph cwd unknown /proc/57287/task/57736/cwd (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57736 safe_time ceph rtd unknown /proc/57287/task/57736/root (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57736 safe_time ceph txt unknown /proc/57287/task/57736/exe (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57736 safe_time ceph NOFD /proc/57287/task/57736/fd (opendir: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57737 safe_time ceph cwd unknown /proc/57287/task/57737/cwd (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57737 safe_time ceph rtd unknown /proc/57287/task/57737/root (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57737 safe_time ceph txt unknown /proc/57287/task/57737/exe (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57737 safe_time ceph NOFD /proc/57287/task/57737/fd (opendir: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57738 safe_time ceph cwd unknown /proc/57287/task/57738/cwd (readlink: Permission denied) 2024-04-25T11:26:48.467 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57738 safe_time ceph rtd unknown /proc/57287/task/57738/root (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57738 safe_time ceph txt unknown /proc/57287/task/57738/exe (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57738 safe_time ceph NOFD /proc/57287/task/57738/fd (opendir: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57739 fn_anonym ceph cwd unknown /proc/57287/task/57739/cwd (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57739 fn_anonym ceph rtd unknown /proc/57287/task/57739/root (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57739 fn_anonym ceph txt unknown /proc/57287/task/57739/exe (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57739 fn_anonym ceph NOFD /proc/57287/task/57739/fd (opendir: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57743 rocksdb:l ceph cwd unknown /proc/57287/task/57743/cwd (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57743 rocksdb:l ceph rtd unknown /proc/57287/task/57743/root (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57743 rocksdb:l ceph txt unknown /proc/57287/task/57743/exe (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57743 rocksdb:l ceph NOFD /proc/57287/task/57743/fd (opendir: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57744 rocksdb:l ceph cwd unknown /proc/57287/task/57744/cwd (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57744 rocksdb:l ceph rtd unknown /proc/57287/task/57744/root (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57744 rocksdb:l ceph txt unknown /proc/57287/task/57744/exe (readlink: Permission denied) 2024-04-25T11:26:48.468 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57744 rocksdb:l ceph NOFD /proc/57287/task/57744/fd (opendir: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57745 rocksdb:l ceph cwd unknown /proc/57287/task/57745/cwd (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57745 rocksdb:l ceph rtd unknown /proc/57287/task/57745/root (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57745 rocksdb:l ceph txt unknown /proc/57287/task/57745/exe (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57745 rocksdb:l ceph NOFD /proc/57287/task/57745/fd (opendir: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57746 rocksdb:h ceph cwd unknown /proc/57287/task/57746/cwd (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57746 rocksdb:h ceph rtd unknown /proc/57287/task/57746/root (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57746 rocksdb:h ceph txt unknown /proc/57287/task/57746/exe (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 57746 rocksdb:h ceph NOFD /proc/57287/task/57746/fd (opendir: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58205 bstore_ai ceph cwd unknown /proc/57287/task/58205/cwd (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58205 bstore_ai ceph rtd unknown /proc/57287/task/58205/root (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58205 bstore_ai ceph txt unknown /proc/57287/task/58205/exe (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58205 bstore_ai ceph NOFD /proc/57287/task/58205/fd (opendir: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58390 bstore_ai ceph cwd unknown /proc/57287/task/58390/cwd (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58390 bstore_ai ceph rtd unknown /proc/57287/task/58390/root (readlink: Permission denied) 2024-04-25T11:26:48.469 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58390 bstore_ai ceph txt unknown /proc/57287/task/58390/exe (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58390 bstore_ai ceph NOFD /proc/57287/task/58390/fd (opendir: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58572 ceph-osd ceph cwd unknown /proc/57287/task/58572/cwd (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58572 ceph-osd ceph rtd unknown /proc/57287/task/58572/root (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58572 ceph-osd ceph txt unknown /proc/57287/task/58572/exe (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58572 ceph-osd ceph NOFD /proc/57287/task/58572/fd (opendir: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58573 cfin ceph cwd unknown /proc/57287/task/58573/cwd (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58573 cfin ceph rtd unknown /proc/57287/task/58573/root (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58573 cfin ceph txt unknown /proc/57287/task/58573/exe (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58573 cfin ceph NOFD /proc/57287/task/58573/fd (opendir: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58574 bstore_kv ceph cwd unknown /proc/57287/task/58574/cwd (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58574 bstore_kv ceph rtd unknown /proc/57287/task/58574/root (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58574 bstore_kv ceph txt unknown /proc/57287/task/58574/exe (readlink: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58574 bstore_kv ceph NOFD /proc/57287/task/58574/fd (opendir: Permission denied) 2024-04-25T11:26:48.470 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58575 bstore_kv ceph cwd unknown /proc/57287/task/58575/cwd (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58575 bstore_kv ceph rtd unknown /proc/57287/task/58575/root (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58575 bstore_kv ceph txt unknown /proc/57287/task/58575/exe (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58575 bstore_kv ceph NOFD /proc/57287/task/58575/fd (opendir: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58576 bstore_me ceph cwd unknown /proc/57287/task/58576/cwd (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58576 bstore_me ceph rtd unknown /proc/57287/task/58576/root (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58576 bstore_me ceph txt unknown /proc/57287/task/58576/exe (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58576 bstore_me ceph NOFD /proc/57287/task/58576/fd (opendir: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58577 ms_dispat ceph cwd unknown /proc/57287/task/58577/cwd (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58577 ms_dispat ceph rtd unknown /proc/57287/task/58577/root (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58577 ms_dispat ceph txt unknown /proc/57287/task/58577/exe (readlink: Permission denied) 2024-04-25T11:26:48.471 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58577 ms_dispat ceph NOFD /proc/57287/task/58577/fd (opendir: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58578 ms_local ceph cwd unknown /proc/57287/task/58578/cwd (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58578 ms_local ceph rtd unknown /proc/57287/task/58578/root (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58578 ms_local ceph txt unknown /proc/57287/task/58578/exe (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58578 ms_local ceph NOFD /proc/57287/task/58578/fd (opendir: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58579 safe_time ceph cwd unknown /proc/57287/task/58579/cwd (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58579 safe_time ceph rtd unknown /proc/57287/task/58579/root (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58579 safe_time ceph txt unknown /proc/57287/task/58579/exe (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58579 safe_time ceph NOFD /proc/57287/task/58579/fd (opendir: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58580 safe_time ceph cwd unknown /proc/57287/task/58580/cwd (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58580 safe_time ceph rtd unknown /proc/57287/task/58580/root (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58580 safe_time ceph txt unknown /proc/57287/task/58580/exe (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58580 safe_time ceph NOFD /proc/57287/task/58580/fd (opendir: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58581 ms_dispat ceph cwd unknown /proc/57287/task/58581/cwd (readlink: Permission denied) 2024-04-25T11:26:48.472 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58581 ms_dispat ceph rtd unknown /proc/57287/task/58581/root (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58581 ms_dispat ceph txt unknown /proc/57287/task/58581/exe (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58581 ms_dispat ceph NOFD /proc/57287/task/58581/fd (opendir: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58582 ms_local ceph cwd unknown /proc/57287/task/58582/cwd (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58582 ms_local ceph rtd unknown /proc/57287/task/58582/root (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58582 ms_local ceph txt unknown /proc/57287/task/58582/exe (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58582 ms_local ceph NOFD /proc/57287/task/58582/fd (opendir: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58583 ms_dispat ceph cwd unknown /proc/57287/task/58583/cwd (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58583 ms_dispat ceph rtd unknown /proc/57287/task/58583/root (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58583 ms_dispat ceph txt unknown /proc/57287/task/58583/exe (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58583 ms_dispat ceph NOFD /proc/57287/task/58583/fd (opendir: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58584 ms_local ceph cwd unknown /proc/57287/task/58584/cwd (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58584 ms_local ceph rtd unknown /proc/57287/task/58584/root (readlink: Permission denied) 2024-04-25T11:26:48.473 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58584 ms_local ceph txt unknown /proc/57287/task/58584/exe (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58584 ms_local ceph NOFD /proc/57287/task/58584/fd (opendir: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58585 ms_dispat ceph cwd unknown /proc/57287/task/58585/cwd (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58585 ms_dispat ceph rtd unknown /proc/57287/task/58585/root (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58585 ms_dispat ceph txt unknown /proc/57287/task/58585/exe (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58585 ms_dispat ceph NOFD /proc/57287/task/58585/fd (opendir: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58586 ms_local ceph cwd unknown /proc/57287/task/58586/cwd (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58586 ms_local ceph rtd unknown /proc/57287/task/58586/root (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58586 ms_local ceph txt unknown /proc/57287/task/58586/exe (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58586 ms_local ceph NOFD /proc/57287/task/58586/fd (opendir: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58587 ms_dispat ceph cwd unknown /proc/57287/task/58587/cwd (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58587 ms_dispat ceph rtd unknown /proc/57287/task/58587/root (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58587 ms_dispat ceph txt unknown /proc/57287/task/58587/exe (readlink: Permission denied) 2024-04-25T11:26:48.474 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58587 ms_dispat ceph NOFD /proc/57287/task/58587/fd (opendir: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58588 ms_local ceph cwd unknown /proc/57287/task/58588/cwd (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58588 ms_local ceph rtd unknown /proc/57287/task/58588/root (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58588 ms_local ceph txt unknown /proc/57287/task/58588/exe (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58588 ms_local ceph NOFD /proc/57287/task/58588/fd (opendir: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58589 ms_dispat ceph cwd unknown /proc/57287/task/58589/cwd (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58589 ms_dispat ceph rtd unknown /proc/57287/task/58589/root (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58589 ms_dispat ceph txt unknown /proc/57287/task/58589/exe (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58589 ms_dispat ceph NOFD /proc/57287/task/58589/fd (opendir: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58590 ms_local ceph cwd unknown /proc/57287/task/58590/cwd (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58590 ms_local ceph rtd unknown /proc/57287/task/58590/root (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58590 ms_local ceph txt unknown /proc/57287/task/58590/exe (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58590 ms_local ceph NOFD /proc/57287/task/58590/fd (opendir: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58591 ms_dispat ceph cwd unknown /proc/57287/task/58591/cwd (readlink: Permission denied) 2024-04-25T11:26:48.475 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58591 ms_dispat ceph rtd unknown /proc/57287/task/58591/root (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58591 ms_dispat ceph txt unknown /proc/57287/task/58591/exe (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58591 ms_dispat ceph NOFD /proc/57287/task/58591/fd (opendir: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58592 ms_local ceph cwd unknown /proc/57287/task/58592/cwd (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58592 ms_local ceph rtd unknown /proc/57287/task/58592/root (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58592 ms_local ceph txt unknown /proc/57287/task/58592/exe (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58592 ms_local ceph NOFD /proc/57287/task/58592/fd (opendir: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58593 fn_anonym ceph cwd unknown /proc/57287/task/58593/cwd (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58593 fn_anonym ceph rtd unknown /proc/57287/task/58593/root (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58593 fn_anonym ceph txt unknown /proc/57287/task/58593/exe (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58593 fn_anonym ceph NOFD /proc/57287/task/58593/fd (opendir: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58594 finisher ceph cwd unknown /proc/57287/task/58594/cwd (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58594 finisher ceph rtd unknown /proc/57287/task/58594/root (readlink: Permission denied) 2024-04-25T11:26:48.476 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58594 finisher ceph txt unknown /proc/57287/task/58594/exe (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58594 finisher ceph NOFD /proc/57287/task/58594/fd (opendir: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58595 safe_time ceph cwd unknown /proc/57287/task/58595/cwd (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58595 safe_time ceph rtd unknown /proc/57287/task/58595/root (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58595 safe_time ceph txt unknown /proc/57287/task/58595/exe (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58595 safe_time ceph NOFD /proc/57287/task/58595/fd (opendir: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58596 safe_time ceph cwd unknown /proc/57287/task/58596/cwd (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58596 safe_time ceph rtd unknown /proc/57287/task/58596/root (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58596 safe_time ceph txt unknown /proc/57287/task/58596/exe (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58596 safe_time ceph NOFD /proc/57287/task/58596/fd (opendir: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58597 ceph-osd ceph cwd unknown /proc/57287/task/58597/cwd (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58597 ceph-osd ceph rtd unknown /proc/57287/task/58597/root (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58597 ceph-osd ceph txt unknown /proc/57287/task/58597/exe (readlink: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58597 ceph-osd ceph NOFD /proc/57287/task/58597/fd (opendir: Permission denied) 2024-04-25T11:26:48.477 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58598 osd_srv_a ceph cwd unknown /proc/57287/task/58598/cwd (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58598 osd_srv_a ceph rtd unknown /proc/57287/task/58598/root (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58598 osd_srv_a ceph txt unknown /proc/57287/task/58598/exe (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58598 osd_srv_a ceph NOFD /proc/57287/task/58598/fd (opendir: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58599 tp_osd_tp ceph cwd unknown /proc/57287/task/58599/cwd (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58599 tp_osd_tp ceph rtd unknown /proc/57287/task/58599/root (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58599 tp_osd_tp ceph txt unknown /proc/57287/task/58599/exe (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58599 tp_osd_tp ceph NOFD /proc/57287/task/58599/fd (opendir: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58600 tp_osd_tp ceph cwd unknown /proc/57287/task/58600/cwd (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58600 tp_osd_tp ceph rtd unknown /proc/57287/task/58600/root (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58600 tp_osd_tp ceph txt unknown /proc/57287/task/58600/exe (readlink: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58600 tp_osd_tp ceph NOFD /proc/57287/task/58600/fd (opendir: Permission denied) 2024-04-25T11:26:48.478 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58601 tp_osd_tp ceph cwd unknown /proc/57287/task/58601/cwd (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58601 tp_osd_tp ceph rtd unknown /proc/57287/task/58601/root (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58601 tp_osd_tp ceph txt unknown /proc/57287/task/58601/exe (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58601 tp_osd_tp ceph NOFD /proc/57287/task/58601/fd (opendir: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58602 tp_osd_tp ceph cwd unknown /proc/57287/task/58602/cwd (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58602 tp_osd_tp ceph rtd unknown /proc/57287/task/58602/root (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58602 tp_osd_tp ceph txt unknown /proc/57287/task/58602/exe (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58602 tp_osd_tp ceph NOFD /proc/57287/task/58602/fd (opendir: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58603 tp_osd_tp ceph cwd unknown /proc/57287/task/58603/cwd (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58603 tp_osd_tp ceph rtd unknown /proc/57287/task/58603/root (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58603 tp_osd_tp ceph txt unknown /proc/57287/task/58603/exe (readlink: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58603 tp_osd_tp ceph NOFD /proc/57287/task/58603/fd (opendir: Permission denied) 2024-04-25T11:26:48.479 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58604 tp_osd_tp ceph cwd unknown /proc/57287/task/58604/cwd (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58604 tp_osd_tp ceph rtd unknown /proc/57287/task/58604/root (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58604 tp_osd_tp ceph txt unknown /proc/57287/task/58604/exe (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58604 tp_osd_tp ceph NOFD /proc/57287/task/58604/fd (opendir: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58605 tp_osd_tp ceph cwd unknown /proc/57287/task/58605/cwd (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58605 tp_osd_tp ceph rtd unknown /proc/57287/task/58605/root (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58605 tp_osd_tp ceph txt unknown /proc/57287/task/58605/exe (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58605 tp_osd_tp ceph NOFD /proc/57287/task/58605/fd (opendir: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58606 tp_osd_tp ceph cwd unknown /proc/57287/task/58606/cwd (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58606 tp_osd_tp ceph rtd unknown /proc/57287/task/58606/root (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58606 tp_osd_tp ceph txt unknown /proc/57287/task/58606/exe (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58606 tp_osd_tp ceph NOFD /proc/57287/task/58606/fd (opendir: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58607 tp_osd_tp ceph cwd unknown /proc/57287/task/58607/cwd (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58607 tp_osd_tp ceph rtd unknown /proc/57287/task/58607/root (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58607 tp_osd_tp ceph txt unknown /proc/57287/task/58607/exe (readlink: Permission denied) 2024-04-25T11:26:48.480 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58607 tp_osd_tp ceph NOFD /proc/57287/task/58607/fd (opendir: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58608 tp_osd_tp ceph cwd unknown /proc/57287/task/58608/cwd (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58608 tp_osd_tp ceph rtd unknown /proc/57287/task/58608/root (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58608 tp_osd_tp ceph txt unknown /proc/57287/task/58608/exe (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58608 tp_osd_tp ceph NOFD /proc/57287/task/58608/fd (opendir: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58609 tp_osd_tp ceph cwd unknown /proc/57287/task/58609/cwd (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58609 tp_osd_tp ceph rtd unknown /proc/57287/task/58609/root (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58609 tp_osd_tp ceph txt unknown /proc/57287/task/58609/exe (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58609 tp_osd_tp ceph NOFD /proc/57287/task/58609/fd (opendir: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58610 tp_osd_tp ceph cwd unknown /proc/57287/task/58610/cwd (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58610 tp_osd_tp ceph rtd unknown /proc/57287/task/58610/root (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58610 tp_osd_tp ceph txt unknown /proc/57287/task/58610/exe (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58610 tp_osd_tp ceph NOFD /proc/57287/task/58610/fd (opendir: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58611 tp_osd_tp ceph cwd unknown /proc/57287/task/58611/cwd (readlink: Permission denied) 2024-04-25T11:26:48.481 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58611 tp_osd_tp ceph rtd unknown /proc/57287/task/58611/root (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58611 tp_osd_tp ceph txt unknown /proc/57287/task/58611/exe (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58611 tp_osd_tp ceph NOFD /proc/57287/task/58611/fd (opendir: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58612 tp_osd_tp ceph cwd unknown /proc/57287/task/58612/cwd (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58612 tp_osd_tp ceph rtd unknown /proc/57287/task/58612/root (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58612 tp_osd_tp ceph txt unknown /proc/57287/task/58612/exe (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58612 tp_osd_tp ceph NOFD /proc/57287/task/58612/fd (opendir: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58613 tp_osd_tp ceph cwd unknown /proc/57287/task/58613/cwd (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58613 tp_osd_tp ceph rtd unknown /proc/57287/task/58613/root (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58613 tp_osd_tp ceph txt unknown /proc/57287/task/58613/exe (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58613 tp_osd_tp ceph NOFD /proc/57287/task/58613/fd (opendir: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58614 tp_osd_tp ceph cwd unknown /proc/57287/task/58614/cwd (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58614 tp_osd_tp ceph rtd unknown /proc/57287/task/58614/root (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58614 tp_osd_tp ceph txt unknown /proc/57287/task/58614/exe (readlink: Permission denied) 2024-04-25T11:26:48.482 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58614 tp_osd_tp ceph NOFD /proc/57287/task/58614/fd (opendir: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58615 osd_srv_h ceph cwd unknown /proc/57287/task/58615/cwd (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58615 osd_srv_h ceph rtd unknown /proc/57287/task/58615/root (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58615 osd_srv_h ceph txt unknown /proc/57287/task/58615/exe (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 57287 58615 osd_srv_h ceph NOFD /proc/57287/task/58615/fd (opendir: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 58710 root cwd unknown /proc/58710/cwd (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 58710 root rtd unknown /proc/58710/root (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 58710 root txt unknown /proc/58710/exe (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 58710 root NOFD /proc/58710/fd (opendir: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 58727 root cwd unknown /proc/58727/cwd (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 58727 root rtd unknown /proc/58727/root (readlink: Permission denied) 2024-04-25T11:26:48.483 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 58727 root txt unknown /proc/58727/exe (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 58727 root NOFD /proc/58727/fd (opendir: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 64061 root cwd unknown /proc/64061/cwd (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 64061 root rtd unknown /proc/64061/root (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 64061 root txt unknown /proc/64061/exe (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 64061 root NOFD /proc/64061/fd (opendir: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 64063 root cwd unknown /proc/64063/cwd (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 64063 root rtd unknown /proc/64063/root (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 64063 root txt unknown /proc/64063/exe (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 64063 root NOFD /proc/64063/fd (opendir: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 ceph cwd unknown /proc/64065/cwd (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 ceph rtd unknown /proc/64065/root (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 ceph txt unknown /proc/64065/exe (readlink: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 ceph NOFD /proc/64065/fd (opendir: Permission denied) 2024-04-25T11:26:48.484 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64066 log ceph cwd unknown /proc/64065/task/64066/cwd (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64066 log ceph rtd unknown /proc/64065/task/64066/root (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64066 log ceph txt unknown /proc/64065/task/64066/exe (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64066 log ceph NOFD /proc/64065/task/64066/fd (opendir: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64068 msgr-work ceph cwd unknown /proc/64065/task/64068/cwd (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64068 msgr-work ceph rtd unknown /proc/64065/task/64068/root (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64068 msgr-work ceph txt unknown /proc/64065/task/64068/exe (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64068 msgr-work ceph NOFD /proc/64065/task/64068/fd (opendir: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64069 msgr-work ceph cwd unknown /proc/64065/task/64069/cwd (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64069 msgr-work ceph rtd unknown /proc/64065/task/64069/root (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64069 msgr-work ceph txt unknown /proc/64065/task/64069/exe (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64069 msgr-work ceph NOFD /proc/64065/task/64069/fd (opendir: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64070 msgr-work ceph cwd unknown /proc/64065/task/64070/cwd (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64070 msgr-work ceph rtd unknown /proc/64065/task/64070/root (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64070 msgr-work ceph txt unknown /proc/64065/task/64070/exe (readlink: Permission denied) 2024-04-25T11:26:48.485 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64070 msgr-work ceph NOFD /proc/64065/task/64070/fd (opendir: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64074 service ceph cwd unknown /proc/64065/task/64074/cwd (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64074 service ceph rtd unknown /proc/64065/task/64074/root (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64074 service ceph txt unknown /proc/64065/task/64074/exe (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64074 service ceph NOFD /proc/64065/task/64074/fd (opendir: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64075 admin_soc ceph cwd unknown /proc/64065/task/64075/cwd (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64075 admin_soc ceph rtd unknown /proc/64065/task/64075/root (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64075 admin_soc ceph txt unknown /proc/64065/task/64075/exe (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64075 admin_soc ceph NOFD /proc/64065/task/64075/fd (opendir: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64217 signal_ha ceph cwd unknown /proc/64065/task/64217/cwd (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64217 signal_ha ceph rtd unknown /proc/64065/task/64217/root (readlink: Permission denied) 2024-04-25T11:26:48.486 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64217 signal_ha ceph txt unknown /proc/64065/task/64217/exe (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64217 signal_ha ceph NOFD /proc/64065/task/64217/fd (opendir: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64218 io_contex ceph cwd unknown /proc/64065/task/64218/cwd (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64218 io_contex ceph rtd unknown /proc/64065/task/64218/root (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64218 io_contex ceph txt unknown /proc/64065/task/64218/exe (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64218 io_contex ceph NOFD /proc/64065/task/64218/fd (opendir: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64219 io_contex ceph cwd unknown /proc/64065/task/64219/cwd (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64219 io_contex ceph rtd unknown /proc/64065/task/64219/root (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64219 io_contex ceph txt unknown /proc/64065/task/64219/exe (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64219 io_contex ceph NOFD /proc/64065/task/64219/fd (opendir: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64335 OpHistory ceph cwd unknown /proc/64065/task/64335/cwd (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64335 OpHistory ceph rtd unknown /proc/64065/task/64335/root (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64335 OpHistory ceph txt unknown /proc/64065/task/64335/exe (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64335 OpHistory ceph NOFD /proc/64065/task/64335/fd (opendir: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64336 ceph_time ceph cwd unknown /proc/64065/task/64336/cwd (readlink: Permission denied) 2024-04-25T11:26:48.487 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64336 ceph_time ceph rtd unknown /proc/64065/task/64336/root (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64336 ceph_time ceph txt unknown /proc/64065/task/64336/exe (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64336 ceph_time ceph NOFD /proc/64065/task/64336/fd (opendir: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64503 ceph-osd ceph cwd unknown /proc/64065/task/64503/cwd (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64503 ceph-osd ceph rtd unknown /proc/64065/task/64503/root (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64503 ceph-osd ceph txt unknown /proc/64065/task/64503/exe (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64503 ceph-osd ceph NOFD /proc/64065/task/64503/fd (opendir: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64504 safe_time ceph cwd unknown /proc/64065/task/64504/cwd (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64504 safe_time ceph rtd unknown /proc/64065/task/64504/root (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64504 safe_time ceph txt unknown /proc/64065/task/64504/exe (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64504 safe_time ceph NOFD /proc/64065/task/64504/fd (opendir: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64505 safe_time ceph cwd unknown /proc/64065/task/64505/cwd (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64505 safe_time ceph rtd unknown /proc/64065/task/64505/root (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64505 safe_time ceph txt unknown /proc/64065/task/64505/exe (readlink: Permission denied) 2024-04-25T11:26:48.488 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64505 safe_time ceph NOFD /proc/64065/task/64505/fd (opendir: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64506 safe_time ceph cwd unknown /proc/64065/task/64506/cwd (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64506 safe_time ceph rtd unknown /proc/64065/task/64506/root (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64506 safe_time ceph txt unknown /proc/64065/task/64506/exe (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64506 safe_time ceph NOFD /proc/64065/task/64506/fd (opendir: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64507 safe_time ceph cwd unknown /proc/64065/task/64507/cwd (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64507 safe_time ceph rtd unknown /proc/64065/task/64507/root (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64507 safe_time ceph txt unknown /proc/64065/task/64507/exe (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64507 safe_time ceph NOFD /proc/64065/task/64507/fd (opendir: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64508 fn_anonym ceph cwd unknown /proc/64065/task/64508/cwd (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64508 fn_anonym ceph rtd unknown /proc/64065/task/64508/root (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64508 fn_anonym ceph txt unknown /proc/64065/task/64508/exe (readlink: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64508 fn_anonym ceph NOFD /proc/64065/task/64508/fd (opendir: Permission denied) 2024-04-25T11:26:48.489 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64512 rocksdb:l ceph cwd unknown /proc/64065/task/64512/cwd (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64512 rocksdb:l ceph rtd unknown /proc/64065/task/64512/root (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64512 rocksdb:l ceph txt unknown /proc/64065/task/64512/exe (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64512 rocksdb:l ceph NOFD /proc/64065/task/64512/fd (opendir: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64513 rocksdb:l ceph cwd unknown /proc/64065/task/64513/cwd (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64513 rocksdb:l ceph rtd unknown /proc/64065/task/64513/root (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64513 rocksdb:l ceph txt unknown /proc/64065/task/64513/exe (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64513 rocksdb:l ceph NOFD /proc/64065/task/64513/fd (opendir: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64514 rocksdb:l ceph cwd unknown /proc/64065/task/64514/cwd (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64514 rocksdb:l ceph rtd unknown /proc/64065/task/64514/root (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64514 rocksdb:l ceph txt unknown /proc/64065/task/64514/exe (readlink: Permission denied) 2024-04-25T11:26:48.490 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64514 rocksdb:l ceph NOFD /proc/64065/task/64514/fd (opendir: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64515 rocksdb:h ceph cwd unknown /proc/64065/task/64515/cwd (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64515 rocksdb:h ceph rtd unknown /proc/64065/task/64515/root (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64515 rocksdb:h ceph txt unknown /proc/64065/task/64515/exe (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64515 rocksdb:h ceph NOFD /proc/64065/task/64515/fd (opendir: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64991 bstore_ai ceph cwd unknown /proc/64065/task/64991/cwd (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64991 bstore_ai ceph rtd unknown /proc/64065/task/64991/root (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64991 bstore_ai ceph txt unknown /proc/64065/task/64991/exe (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 64991 bstore_ai ceph NOFD /proc/64065/task/64991/fd (opendir: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65177 bstore_ai ceph cwd unknown /proc/64065/task/65177/cwd (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65177 bstore_ai ceph rtd unknown /proc/64065/task/65177/root (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65177 bstore_ai ceph txt unknown /proc/64065/task/65177/exe (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65177 bstore_ai ceph NOFD /proc/64065/task/65177/fd (opendir: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65359 ceph-osd ceph cwd unknown /proc/64065/task/65359/cwd (readlink: Permission denied) 2024-04-25T11:26:48.491 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65359 ceph-osd ceph rtd unknown /proc/64065/task/65359/root (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65359 ceph-osd ceph txt unknown /proc/64065/task/65359/exe (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65359 ceph-osd ceph NOFD /proc/64065/task/65359/fd (opendir: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65360 cfin ceph cwd unknown /proc/64065/task/65360/cwd (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65360 cfin ceph rtd unknown /proc/64065/task/65360/root (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65360 cfin ceph txt unknown /proc/64065/task/65360/exe (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65360 cfin ceph NOFD /proc/64065/task/65360/fd (opendir: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65361 bstore_kv ceph cwd unknown /proc/64065/task/65361/cwd (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65361 bstore_kv ceph rtd unknown /proc/64065/task/65361/root (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65361 bstore_kv ceph txt unknown /proc/64065/task/65361/exe (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65361 bstore_kv ceph NOFD /proc/64065/task/65361/fd (opendir: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65362 bstore_kv ceph cwd unknown /proc/64065/task/65362/cwd (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65362 bstore_kv ceph rtd unknown /proc/64065/task/65362/root (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65362 bstore_kv ceph txt unknown /proc/64065/task/65362/exe (readlink: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65362 bstore_kv ceph NOFD /proc/64065/task/65362/fd (opendir: Permission denied) 2024-04-25T11:26:48.492 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65363 bstore_me ceph cwd unknown /proc/64065/task/65363/cwd (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65363 bstore_me ceph rtd unknown /proc/64065/task/65363/root (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65363 bstore_me ceph txt unknown /proc/64065/task/65363/exe (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65363 bstore_me ceph NOFD /proc/64065/task/65363/fd (opendir: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65364 ms_dispat ceph cwd unknown /proc/64065/task/65364/cwd (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65364 ms_dispat ceph rtd unknown /proc/64065/task/65364/root (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65364 ms_dispat ceph txt unknown /proc/64065/task/65364/exe (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65364 ms_dispat ceph NOFD /proc/64065/task/65364/fd (opendir: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65365 ms_local ceph cwd unknown /proc/64065/task/65365/cwd (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65365 ms_local ceph rtd unknown /proc/64065/task/65365/root (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65365 ms_local ceph txt unknown /proc/64065/task/65365/exe (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65365 ms_local ceph NOFD /proc/64065/task/65365/fd (opendir: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65366 safe_time ceph cwd unknown /proc/64065/task/65366/cwd (readlink: Permission denied) 2024-04-25T11:26:48.493 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65366 safe_time ceph rtd unknown /proc/64065/task/65366/root (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65366 safe_time ceph txt unknown /proc/64065/task/65366/exe (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65366 safe_time ceph NOFD /proc/64065/task/65366/fd (opendir: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65367 safe_time ceph cwd unknown /proc/64065/task/65367/cwd (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65367 safe_time ceph rtd unknown /proc/64065/task/65367/root (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65367 safe_time ceph txt unknown /proc/64065/task/65367/exe (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65367 safe_time ceph NOFD /proc/64065/task/65367/fd (opendir: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65368 ms_dispat ceph cwd unknown /proc/64065/task/65368/cwd (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65368 ms_dispat ceph rtd unknown /proc/64065/task/65368/root (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65368 ms_dispat ceph txt unknown /proc/64065/task/65368/exe (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65368 ms_dispat ceph NOFD /proc/64065/task/65368/fd (opendir: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65369 ms_local ceph cwd unknown /proc/64065/task/65369/cwd (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65369 ms_local ceph rtd unknown /proc/64065/task/65369/root (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65369 ms_local ceph txt unknown /proc/64065/task/65369/exe (readlink: Permission denied) 2024-04-25T11:26:48.494 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65369 ms_local ceph NOFD /proc/64065/task/65369/fd (opendir: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65370 ms_dispat ceph cwd unknown /proc/64065/task/65370/cwd (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65370 ms_dispat ceph rtd unknown /proc/64065/task/65370/root (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65370 ms_dispat ceph txt unknown /proc/64065/task/65370/exe (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65370 ms_dispat ceph NOFD /proc/64065/task/65370/fd (opendir: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65371 ms_local ceph cwd unknown /proc/64065/task/65371/cwd (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65371 ms_local ceph rtd unknown /proc/64065/task/65371/root (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65371 ms_local ceph txt unknown /proc/64065/task/65371/exe (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65371 ms_local ceph NOFD /proc/64065/task/65371/fd (opendir: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65372 ms_dispat ceph cwd unknown /proc/64065/task/65372/cwd (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65372 ms_dispat ceph rtd unknown /proc/64065/task/65372/root (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65372 ms_dispat ceph txt unknown /proc/64065/task/65372/exe (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65372 ms_dispat ceph NOFD /proc/64065/task/65372/fd (opendir: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65373 ms_local ceph cwd unknown /proc/64065/task/65373/cwd (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65373 ms_local ceph rtd unknown /proc/64065/task/65373/root (readlink: Permission denied) 2024-04-25T11:26:48.495 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65373 ms_local ceph txt unknown /proc/64065/task/65373/exe (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65373 ms_local ceph NOFD /proc/64065/task/65373/fd (opendir: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65374 ms_dispat ceph cwd unknown /proc/64065/task/65374/cwd (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65374 ms_dispat ceph rtd unknown /proc/64065/task/65374/root (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65374 ms_dispat ceph txt unknown /proc/64065/task/65374/exe (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65374 ms_dispat ceph NOFD /proc/64065/task/65374/fd (opendir: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65375 ms_local ceph cwd unknown /proc/64065/task/65375/cwd (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65375 ms_local ceph rtd unknown /proc/64065/task/65375/root (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65375 ms_local ceph txt unknown /proc/64065/task/65375/exe (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65375 ms_local ceph NOFD /proc/64065/task/65375/fd (opendir: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65376 ms_dispat ceph cwd unknown /proc/64065/task/65376/cwd (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65376 ms_dispat ceph rtd unknown /proc/64065/task/65376/root (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65376 ms_dispat ceph txt unknown /proc/64065/task/65376/exe (readlink: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65376 ms_dispat ceph NOFD /proc/64065/task/65376/fd (opendir: Permission denied) 2024-04-25T11:26:48.496 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65377 ms_local ceph cwd unknown /proc/64065/task/65377/cwd (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65377 ms_local ceph rtd unknown /proc/64065/task/65377/root (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65377 ms_local ceph txt unknown /proc/64065/task/65377/exe (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65377 ms_local ceph NOFD /proc/64065/task/65377/fd (opendir: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65378 ms_dispat ceph cwd unknown /proc/64065/task/65378/cwd (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65378 ms_dispat ceph rtd unknown /proc/64065/task/65378/root (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65378 ms_dispat ceph txt unknown /proc/64065/task/65378/exe (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65378 ms_dispat ceph NOFD /proc/64065/task/65378/fd (opendir: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65379 ms_local ceph cwd unknown /proc/64065/task/65379/cwd (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65379 ms_local ceph rtd unknown /proc/64065/task/65379/root (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65379 ms_local ceph txt unknown /proc/64065/task/65379/exe (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65379 ms_local ceph NOFD /proc/64065/task/65379/fd (opendir: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65380 fn_anonym ceph cwd unknown /proc/64065/task/65380/cwd (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65380 fn_anonym ceph rtd unknown /proc/64065/task/65380/root (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65380 fn_anonym ceph txt unknown /proc/64065/task/65380/exe (readlink: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65380 fn_anonym ceph NOFD /proc/64065/task/65380/fd (opendir: Permission denied) 2024-04-25T11:26:48.497 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65381 finisher ceph cwd unknown /proc/64065/task/65381/cwd (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65381 finisher ceph rtd unknown /proc/64065/task/65381/root (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65381 finisher ceph txt unknown /proc/64065/task/65381/exe (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65381 finisher ceph NOFD /proc/64065/task/65381/fd (opendir: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65382 safe_time ceph cwd unknown /proc/64065/task/65382/cwd (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65382 safe_time ceph rtd unknown /proc/64065/task/65382/root (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65382 safe_time ceph txt unknown /proc/64065/task/65382/exe (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65382 safe_time ceph NOFD /proc/64065/task/65382/fd (opendir: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65383 safe_time ceph cwd unknown /proc/64065/task/65383/cwd (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65383 safe_time ceph rtd unknown /proc/64065/task/65383/root (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65383 safe_time ceph txt unknown /proc/64065/task/65383/exe (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65383 safe_time ceph NOFD /proc/64065/task/65383/fd (opendir: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65384 ceph-osd ceph cwd unknown /proc/64065/task/65384/cwd (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65384 ceph-osd ceph rtd unknown /proc/64065/task/65384/root (readlink: Permission denied) 2024-04-25T11:26:48.498 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65384 ceph-osd ceph txt unknown /proc/64065/task/65384/exe (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65384 ceph-osd ceph NOFD /proc/64065/task/65384/fd (opendir: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65385 osd_srv_a ceph cwd unknown /proc/64065/task/65385/cwd (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65385 osd_srv_a ceph rtd unknown /proc/64065/task/65385/root (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65385 osd_srv_a ceph txt unknown /proc/64065/task/65385/exe (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65385 osd_srv_a ceph NOFD /proc/64065/task/65385/fd (opendir: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65386 tp_osd_tp ceph cwd unknown /proc/64065/task/65386/cwd (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65386 tp_osd_tp ceph rtd unknown /proc/64065/task/65386/root (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65386 tp_osd_tp ceph txt unknown /proc/64065/task/65386/exe (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65386 tp_osd_tp ceph NOFD /proc/64065/task/65386/fd (opendir: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65387 tp_osd_tp ceph cwd unknown /proc/64065/task/65387/cwd (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65387 tp_osd_tp ceph rtd unknown /proc/64065/task/65387/root (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65387 tp_osd_tp ceph txt unknown /proc/64065/task/65387/exe (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65387 tp_osd_tp ceph NOFD /proc/64065/task/65387/fd (opendir: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65388 tp_osd_tp ceph cwd unknown /proc/64065/task/65388/cwd (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65388 tp_osd_tp ceph rtd unknown /proc/64065/task/65388/root (readlink: Permission denied) 2024-04-25T11:26:48.499 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65388 tp_osd_tp ceph txt unknown /proc/64065/task/65388/exe (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65388 tp_osd_tp ceph NOFD /proc/64065/task/65388/fd (opendir: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65389 tp_osd_tp ceph cwd unknown /proc/64065/task/65389/cwd (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65389 tp_osd_tp ceph rtd unknown /proc/64065/task/65389/root (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65389 tp_osd_tp ceph txt unknown /proc/64065/task/65389/exe (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65389 tp_osd_tp ceph NOFD /proc/64065/task/65389/fd (opendir: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65390 tp_osd_tp ceph cwd unknown /proc/64065/task/65390/cwd (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65390 tp_osd_tp ceph rtd unknown /proc/64065/task/65390/root (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65390 tp_osd_tp ceph txt unknown /proc/64065/task/65390/exe (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65390 tp_osd_tp ceph NOFD /proc/64065/task/65390/fd (opendir: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65391 tp_osd_tp ceph cwd unknown /proc/64065/task/65391/cwd (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65391 tp_osd_tp ceph rtd unknown /proc/64065/task/65391/root (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65391 tp_osd_tp ceph txt unknown /proc/64065/task/65391/exe (readlink: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65391 tp_osd_tp ceph NOFD /proc/64065/task/65391/fd (opendir: Permission denied) 2024-04-25T11:26:48.500 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65392 tp_osd_tp ceph cwd unknown /proc/64065/task/65392/cwd (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65392 tp_osd_tp ceph rtd unknown /proc/64065/task/65392/root (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65392 tp_osd_tp ceph txt unknown /proc/64065/task/65392/exe (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65392 tp_osd_tp ceph NOFD /proc/64065/task/65392/fd (opendir: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65393 tp_osd_tp ceph cwd unknown /proc/64065/task/65393/cwd (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65393 tp_osd_tp ceph rtd unknown /proc/64065/task/65393/root (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65393 tp_osd_tp ceph txt unknown /proc/64065/task/65393/exe (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65393 tp_osd_tp ceph NOFD /proc/64065/task/65393/fd (opendir: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65394 tp_osd_tp ceph cwd unknown /proc/64065/task/65394/cwd (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65394 tp_osd_tp ceph rtd unknown /proc/64065/task/65394/root (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65394 tp_osd_tp ceph txt unknown /proc/64065/task/65394/exe (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65394 tp_osd_tp ceph NOFD /proc/64065/task/65394/fd (opendir: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65395 tp_osd_tp ceph cwd unknown /proc/64065/task/65395/cwd (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65395 tp_osd_tp ceph rtd unknown /proc/64065/task/65395/root (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65395 tp_osd_tp ceph txt unknown /proc/64065/task/65395/exe (readlink: Permission denied) 2024-04-25T11:26:48.501 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65395 tp_osd_tp ceph NOFD /proc/64065/task/65395/fd (opendir: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65396 tp_osd_tp ceph cwd unknown /proc/64065/task/65396/cwd (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65396 tp_osd_tp ceph rtd unknown /proc/64065/task/65396/root (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65396 tp_osd_tp ceph txt unknown /proc/64065/task/65396/exe (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65396 tp_osd_tp ceph NOFD /proc/64065/task/65396/fd (opendir: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65397 tp_osd_tp ceph cwd unknown /proc/64065/task/65397/cwd (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65397 tp_osd_tp ceph rtd unknown /proc/64065/task/65397/root (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65397 tp_osd_tp ceph txt unknown /proc/64065/task/65397/exe (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65397 tp_osd_tp ceph NOFD /proc/64065/task/65397/fd (opendir: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65398 tp_osd_tp ceph cwd unknown /proc/64065/task/65398/cwd (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65398 tp_osd_tp ceph rtd unknown /proc/64065/task/65398/root (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65398 tp_osd_tp ceph txt unknown /proc/64065/task/65398/exe (readlink: Permission denied) 2024-04-25T11:26:48.502 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65398 tp_osd_tp ceph NOFD /proc/64065/task/65398/fd (opendir: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65399 tp_osd_tp ceph cwd unknown /proc/64065/task/65399/cwd (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65399 tp_osd_tp ceph rtd unknown /proc/64065/task/65399/root (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65399 tp_osd_tp ceph txt unknown /proc/64065/task/65399/exe (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65399 tp_osd_tp ceph NOFD /proc/64065/task/65399/fd (opendir: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65400 tp_osd_tp ceph cwd unknown /proc/64065/task/65400/cwd (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65400 tp_osd_tp ceph rtd unknown /proc/64065/task/65400/root (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65400 tp_osd_tp ceph txt unknown /proc/64065/task/65400/exe (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65400 tp_osd_tp ceph NOFD /proc/64065/task/65400/fd (opendir: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65401 tp_osd_tp ceph cwd unknown /proc/64065/task/65401/cwd (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65401 tp_osd_tp ceph rtd unknown /proc/64065/task/65401/root (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65401 tp_osd_tp ceph txt unknown /proc/64065/task/65401/exe (readlink: Permission denied) 2024-04-25T11:26:48.503 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65401 tp_osd_tp ceph NOFD /proc/64065/task/65401/fd (opendir: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65402 osd_srv_h ceph cwd unknown /proc/64065/task/65402/cwd (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65402 osd_srv_h ceph rtd unknown /proc/64065/task/65402/root (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65402 osd_srv_h ceph txt unknown /proc/64065/task/65402/exe (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-osd 64065 65402 osd_srv_h ceph NOFD /proc/64065/task/65402/fd (opendir: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 65498 root cwd unknown /proc/65498/cwd (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 65498 root rtd unknown /proc/65498/root (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 65498 root txt unknown /proc/65498/exe (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 65498 root NOFD /proc/65498/fd (opendir: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 65515 root cwd unknown /proc/65515/cwd (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 65515 root rtd unknown /proc/65515/root (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 65515 root txt unknown /proc/65515/exe (readlink: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 65515 root NOFD /proc/65515/fd (opendir: Permission denied) 2024-04-25T11:26:48.504 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 67815 root cwd unknown /proc/67815/cwd (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 67815 root rtd unknown /proc/67815/root (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 67815 root txt unknown /proc/67815/exe (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/3 67815 root NOFD /proc/67815/fd (opendir: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 67816 root cwd unknown /proc/67816/cwd (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 67816 root rtd unknown /proc/67816/root (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 67816 root txt unknown /proc/67816/exe (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/5 67816 root NOFD /proc/67816/fd (opendir: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 67894 root cwd unknown /proc/67894/cwd (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 67894 root rtd unknown /proc/67894/root (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 67894 root txt unknown /proc/67894/exe (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/6 67894 root NOFD /proc/67894/fd (opendir: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 67895 root cwd unknown /proc/67895/cwd (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 67895 root rtd unknown /proc/67895/root (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 67895 root txt unknown /proc/67895/exe (readlink: Permission denied) 2024-04-25T11:26:48.505 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 67895 root NOFD /proc/67895/fd (opendir: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68708 root cwd unknown /proc/68708/cwd (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68708 root rtd unknown /proc/68708/root (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68708 root txt unknown /proc/68708/exe (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68708 root NOFD /proc/68708/fd (opendir: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68725 root cwd unknown /proc/68725/cwd (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68725 root rtd unknown /proc/68725/root (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68725 root txt unknown /proc/68725/exe (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68725 root NOFD /proc/68725/fd (opendir: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68726 root cwd unknown /proc/68726/cwd (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68726 root rtd unknown /proc/68726/root (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68726 root txt unknown /proc/68726/exe (readlink: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68726 root NOFD /proc/68726/fd (opendir: Permission denied) 2024-04-25T11:26:48.506 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68743 root cwd unknown /proc/68743/cwd (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68743 root rtd unknown /proc/68743/root (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68743 root txt unknown /proc/68743/exe (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68743 root NOFD /proc/68743/fd (opendir: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68744 root cwd unknown /proc/68744/cwd (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68744 root rtd unknown /proc/68744/root (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68744 root txt unknown /proc/68744/exe (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68744 root NOFD /proc/68744/fd (opendir: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68761 root cwd unknown /proc/68761/cwd (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68761 root rtd unknown /proc/68761/root (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68761 root txt unknown /proc/68761/exe (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68761 root NOFD /proc/68761/fd (opendir: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68762 root cwd unknown /proc/68762/cwd (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68762 root rtd unknown /proc/68762/root (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68762 root txt unknown /proc/68762/exe (readlink: Permission denied) 2024-04-25T11:26:48.507 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 68762 root NOFD /proc/68762/fd (opendir: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68779 root cwd unknown /proc/68779/cwd (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68779 root rtd unknown /proc/68779/root (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68779 root txt unknown /proc/68779/exe (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:journalct 68779 root NOFD /proc/68779/fd (opendir: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69308 root cwd unknown /proc/69308/cwd (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69308 root rtd unknown /proc/69308/root (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69308 root txt unknown /proc/69308/exe (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69308 root NOFD /proc/69308/fd (opendir: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69310 root cwd unknown /proc/69310/cwd (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69310 root rtd unknown /proc/69310/root (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69310 root txt unknown /proc/69310/exe (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69310 root NOFD /proc/69310/fd (opendir: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 ceph cwd unknown /proc/69312/cwd (readlink: Permission denied) 2024-04-25T11:26:48.508 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 ceph rtd unknown /proc/69312/root (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 ceph txt unknown /proc/69312/exe (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 ceph NOFD /proc/69312/fd (opendir: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69313 log ceph cwd unknown /proc/69312/task/69313/cwd (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69313 log ceph rtd unknown /proc/69312/task/69313/root (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69313 log ceph txt unknown /proc/69312/task/69313/exe (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69313 log ceph NOFD /proc/69312/task/69313/fd (opendir: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69315 msgr-work ceph cwd unknown /proc/69312/task/69315/cwd (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69315 msgr-work ceph rtd unknown /proc/69312/task/69315/root (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69315 msgr-work ceph txt unknown /proc/69312/task/69315/exe (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69315 msgr-work ceph NOFD /proc/69312/task/69315/fd (opendir: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69316 msgr-work ceph cwd unknown /proc/69312/task/69316/cwd (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69316 msgr-work ceph rtd unknown /proc/69312/task/69316/root (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69316 msgr-work ceph txt unknown /proc/69312/task/69316/exe (readlink: Permission denied) 2024-04-25T11:26:48.509 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69316 msgr-work ceph NOFD /proc/69312/task/69316/fd (opendir: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69317 msgr-work ceph cwd unknown /proc/69312/task/69317/cwd (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69317 msgr-work ceph rtd unknown /proc/69312/task/69317/root (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69317 msgr-work ceph txt unknown /proc/69312/task/69317/exe (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69317 msgr-work ceph NOFD /proc/69312/task/69317/fd (opendir: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69321 service ceph cwd unknown /proc/69312/task/69321/cwd (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69321 service ceph rtd unknown /proc/69312/task/69321/root (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69321 service ceph txt unknown /proc/69312/task/69321/exe (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69321 service ceph NOFD /proc/69312/task/69321/fd (opendir: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69322 admin_soc ceph cwd unknown /proc/69312/task/69322/cwd (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69322 admin_soc ceph rtd unknown /proc/69312/task/69322/root (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69322 admin_soc ceph txt unknown /proc/69312/task/69322/exe (readlink: Permission denied) 2024-04-25T11:26:48.510 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69322 admin_soc ceph NOFD /proc/69312/task/69322/fd (opendir: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69323 signal_ha ceph cwd unknown /proc/69312/task/69323/cwd (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69323 signal_ha ceph rtd unknown /proc/69312/task/69323/root (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69323 signal_ha ceph txt unknown /proc/69312/task/69323/exe (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69323 signal_ha ceph NOFD /proc/69312/task/69323/fd (opendir: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69324 io_contex ceph cwd unknown /proc/69312/task/69324/cwd (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69324 io_contex ceph rtd unknown /proc/69312/task/69324/root (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69324 io_contex ceph txt unknown /proc/69312/task/69324/exe (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69324 io_contex ceph NOFD /proc/69312/task/69324/fd (opendir: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69325 io_contex ceph cwd unknown /proc/69312/task/69325/cwd (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69325 io_contex ceph rtd unknown /proc/69312/task/69325/root (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69325 io_contex ceph txt unknown /proc/69312/task/69325/exe (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69325 io_contex ceph NOFD /proc/69312/task/69325/fd (opendir: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69326 ms_dispat ceph cwd unknown /proc/69312/task/69326/cwd (readlink: Permission denied) 2024-04-25T11:26:48.511 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69326 ms_dispat ceph rtd unknown /proc/69312/task/69326/root (readlink: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69326 ms_dispat ceph txt unknown /proc/69312/task/69326/exe (readlink: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69326 ms_dispat ceph NOFD /proc/69312/task/69326/fd (opendir: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69327 ms_local ceph cwd unknown /proc/69312/task/69327/cwd (readlink: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69327 ms_local ceph rtd unknown /proc/69312/task/69327/root (readlink: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69327 ms_local ceph txt unknown /proc/69312/task/69327/exe (readlink: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69327 ms_local ceph NOFD /proc/69312/task/69327/fd (opendir: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69328 safe_time ceph cwd unknown /proc/69312/task/69328/cwd (readlink: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69328 safe_time ceph rtd unknown /proc/69312/task/69328/root (readlink: Permission denied) 2024-04-25T11:26:48.512 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69328 safe_time ceph txt unknown /proc/69312/task/69328/exe (readlink: Permission denied) 2024-04-25T11:26:48.513 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69328 safe_time ceph NOFD /proc/69312/task/69328/fd (opendir: Permission denied) 2024-04-25T11:26:48.513 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69329 safe_time ceph cwd unknown /proc/69312/task/69329/cwd (readlink: Permission denied) 2024-04-25T11:26:48.513 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69329 safe_time ceph rtd unknown /proc/69312/task/69329/root (readlink: Permission denied) 2024-04-25T11:26:48.513 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69329 safe_time ceph txt unknown /proc/69312/task/69329/exe (readlink: Permission denied) 2024-04-25T11:26:48.513 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69329 safe_time ceph NOFD /proc/69312/task/69329/fd (opendir: Permission denied) 2024-04-25T11:26:48.513 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69330 ceph-mds ceph cwd unknown /proc/69312/task/69330/cwd (readlink: Permission denied) 2024-04-25T11:26:48.513 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69330 ceph-mds ceph rtd unknown /proc/69312/task/69330/root (readlink: Permission denied) 2024-04-25T11:26:48.514 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69330 ceph-mds ceph txt unknown /proc/69312/task/69330/exe (readlink: Permission denied) 2024-04-25T11:26:48.514 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69330 ceph-mds ceph NOFD /proc/69312/task/69330/fd (opendir: Permission denied) 2024-04-25T11:26:48.514 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69401 safe_time ceph cwd unknown /proc/69312/task/69401/cwd (readlink: Permission denied) 2024-04-25T11:26:48.514 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69401 safe_time ceph rtd unknown /proc/69312/task/69401/root (readlink: Permission denied) 2024-04-25T11:26:48.514 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69401 safe_time ceph txt unknown /proc/69312/task/69401/exe (readlink: Permission denied) 2024-04-25T11:26:48.514 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69312 69401 safe_time ceph NOFD /proc/69312/task/69401/fd (opendir: Permission denied) 2024-04-25T11:26:48.515 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69656 root cwd unknown /proc/69656/cwd (readlink: Permission denied) 2024-04-25T11:26:48.515 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69656 root rtd unknown /proc/69656/root (readlink: Permission denied) 2024-04-25T11:26:48.515 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69656 root txt unknown /proc/69656/exe (readlink: Permission denied) 2024-04-25T11:26:48.515 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 69656 root NOFD /proc/69656/fd (opendir: Permission denied) 2024-04-25T11:26:48.515 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69658 root cwd unknown /proc/69658/cwd (readlink: Permission denied) 2024-04-25T11:26:48.515 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69658 root rtd unknown /proc/69658/root (readlink: Permission denied) 2024-04-25T11:26:48.515 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69658 root txt unknown /proc/69658/exe (readlink: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 69658 root NOFD /proc/69658/fd (opendir: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 ceph cwd unknown /proc/69660/cwd (readlink: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 ceph rtd unknown /proc/69660/root (readlink: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 ceph txt unknown /proc/69660/exe (readlink: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 ceph NOFD /proc/69660/fd (opendir: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69661 log ceph cwd unknown /proc/69660/task/69661/cwd (readlink: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69661 log ceph rtd unknown /proc/69660/task/69661/root (readlink: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69661 log ceph txt unknown /proc/69660/task/69661/exe (readlink: Permission denied) 2024-04-25T11:26:48.516 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69661 log ceph NOFD /proc/69660/task/69661/fd (opendir: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69663 msgr-work ceph cwd unknown /proc/69660/task/69663/cwd (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69663 msgr-work ceph rtd unknown /proc/69660/task/69663/root (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69663 msgr-work ceph txt unknown /proc/69660/task/69663/exe (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69663 msgr-work ceph NOFD /proc/69660/task/69663/fd (opendir: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69664 msgr-work ceph cwd unknown /proc/69660/task/69664/cwd (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69664 msgr-work ceph rtd unknown /proc/69660/task/69664/root (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69664 msgr-work ceph txt unknown /proc/69660/task/69664/exe (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69664 msgr-work ceph NOFD /proc/69660/task/69664/fd (opendir: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69665 msgr-work ceph cwd unknown /proc/69660/task/69665/cwd (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69665 msgr-work ceph rtd unknown /proc/69660/task/69665/root (readlink: Permission denied) 2024-04-25T11:26:48.517 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69665 msgr-work ceph txt unknown /proc/69660/task/69665/exe (readlink: Permission denied) 2024-04-25T11:26:48.518 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69665 msgr-work ceph NOFD /proc/69660/task/69665/fd (opendir: Permission denied) 2024-04-25T11:26:48.518 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69669 service ceph cwd unknown /proc/69660/task/69669/cwd (readlink: Permission denied) 2024-04-25T11:26:48.518 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69669 service ceph rtd unknown /proc/69660/task/69669/root (readlink: Permission denied) 2024-04-25T11:26:48.518 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69669 service ceph txt unknown /proc/69660/task/69669/exe (readlink: Permission denied) 2024-04-25T11:26:48.518 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69669 service ceph NOFD /proc/69660/task/69669/fd (opendir: Permission denied) 2024-04-25T11:26:48.518 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69670 admin_soc ceph cwd unknown /proc/69660/task/69670/cwd (readlink: Permission denied) 2024-04-25T11:26:48.519 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69670 admin_soc ceph rtd unknown /proc/69660/task/69670/root (readlink: Permission denied) 2024-04-25T11:26:48.519 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69670 admin_soc ceph txt unknown /proc/69660/task/69670/exe (readlink: Permission denied) 2024-04-25T11:26:48.519 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69670 admin_soc ceph NOFD /proc/69660/task/69670/fd (opendir: Permission denied) 2024-04-25T11:26:48.519 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69671 signal_ha ceph cwd unknown /proc/69660/task/69671/cwd (readlink: Permission denied) 2024-04-25T11:26:48.519 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69671 signal_ha ceph rtd unknown /proc/69660/task/69671/root (readlink: Permission denied) 2024-04-25T11:26:48.519 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69671 signal_ha ceph txt unknown /proc/69660/task/69671/exe (readlink: Permission denied) 2024-04-25T11:26:48.519 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69671 signal_ha ceph NOFD /proc/69660/task/69671/fd (opendir: Permission denied) 2024-04-25T11:26:48.520 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69672 io_contex ceph cwd unknown /proc/69660/task/69672/cwd (readlink: Permission denied) 2024-04-25T11:26:48.520 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69672 io_contex ceph rtd unknown /proc/69660/task/69672/root (readlink: Permission denied) 2024-04-25T11:26:48.520 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69672 io_contex ceph txt unknown /proc/69660/task/69672/exe (readlink: Permission denied) 2024-04-25T11:26:48.520 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69672 io_contex ceph NOFD /proc/69660/task/69672/fd (opendir: Permission denied) 2024-04-25T11:26:48.520 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69673 io_contex ceph cwd unknown /proc/69660/task/69673/cwd (readlink: Permission denied) 2024-04-25T11:26:48.520 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69673 io_contex ceph rtd unknown /proc/69660/task/69673/root (readlink: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69673 io_contex ceph txt unknown /proc/69660/task/69673/exe (readlink: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69673 io_contex ceph NOFD /proc/69660/task/69673/fd (opendir: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69674 ms_dispat ceph cwd unknown /proc/69660/task/69674/cwd (readlink: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69674 ms_dispat ceph rtd unknown /proc/69660/task/69674/root (readlink: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69674 ms_dispat ceph txt unknown /proc/69660/task/69674/exe (readlink: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69674 ms_dispat ceph NOFD /proc/69660/task/69674/fd (opendir: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69675 ms_local ceph cwd unknown /proc/69660/task/69675/cwd (readlink: Permission denied) 2024-04-25T11:26:48.521 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69675 ms_local ceph rtd unknown /proc/69660/task/69675/root (readlink: Permission denied) 2024-04-25T11:26:48.522 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69675 ms_local ceph txt unknown /proc/69660/task/69675/exe (readlink: Permission denied) 2024-04-25T11:26:48.522 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69675 ms_local ceph NOFD /proc/69660/task/69675/fd (opendir: Permission denied) 2024-04-25T11:26:48.522 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69676 safe_time ceph cwd unknown /proc/69660/task/69676/cwd (readlink: Permission denied) 2024-04-25T11:26:48.522 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69676 safe_time ceph rtd unknown /proc/69660/task/69676/root (readlink: Permission denied) 2024-04-25T11:26:48.522 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69676 safe_time ceph txt unknown /proc/69660/task/69676/exe (readlink: Permission denied) 2024-04-25T11:26:48.522 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69676 safe_time ceph NOFD /proc/69660/task/69676/fd (opendir: Permission denied) 2024-04-25T11:26:48.523 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69677 safe_time ceph cwd unknown /proc/69660/task/69677/cwd (readlink: Permission denied) 2024-04-25T11:26:48.523 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69677 safe_time ceph rtd unknown /proc/69660/task/69677/root (readlink: Permission denied) 2024-04-25T11:26:48.523 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69677 safe_time ceph txt unknown /proc/69660/task/69677/exe (readlink: Permission denied) 2024-04-25T11:26:48.523 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69677 safe_time ceph NOFD /proc/69660/task/69677/fd (opendir: Permission denied) 2024-04-25T11:26:48.523 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69678 ceph-mds ceph cwd unknown /proc/69660/task/69678/cwd (readlink: Permission denied) 2024-04-25T11:26:48.523 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69678 ceph-mds ceph rtd unknown /proc/69660/task/69678/root (readlink: Permission denied) 2024-04-25T11:26:48.523 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69678 ceph-mds ceph txt unknown /proc/69660/task/69678/exe (readlink: Permission denied) 2024-04-25T11:26:48.524 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69678 ceph-mds ceph NOFD /proc/69660/task/69678/fd (opendir: Permission denied) 2024-04-25T11:26:48.524 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69683 safe_time ceph cwd unknown /proc/69660/task/69683/cwd (readlink: Permission denied) 2024-04-25T11:26:48.524 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69683 safe_time ceph rtd unknown /proc/69660/task/69683/root (readlink: Permission denied) 2024-04-25T11:26:48.524 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69683 safe_time ceph txt unknown /proc/69660/task/69683/exe (readlink: Permission denied) 2024-04-25T11:26:48.524 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 69660 69683 safe_time ceph NOFD /proc/69660/task/69683/fd (opendir: Permission denied) 2024-04-25T11:26:48.524 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 70085 root cwd unknown /proc/70085/cwd (readlink: Permission denied) 2024-04-25T11:26:48.524 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 70085 root rtd unknown /proc/70085/root (readlink: Permission denied) 2024-04-25T11:26:48.525 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 70085 root txt unknown /proc/70085/exe (readlink: Permission denied) 2024-04-25T11:26:48.525 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/2 70085 root NOFD /proc/70085/fd (opendir: Permission denied) 2024-04-25T11:26:48.525 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70265 root cwd unknown /proc/70265/cwd (readlink: Permission denied) 2024-04-25T11:26:48.525 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70265 root rtd unknown /proc/70265/root (readlink: Permission denied) 2024-04-25T11:26:48.525 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70265 root txt unknown /proc/70265/exe (readlink: Permission denied) 2024-04-25T11:26:48.525 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70265 root NOFD /proc/70265/fd (opendir: Permission denied) 2024-04-25T11:26:48.525 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70267 root cwd unknown /proc/70267/cwd (readlink: Permission denied) 2024-04-25T11:26:48.526 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70267 root rtd unknown /proc/70267/root (readlink: Permission denied) 2024-04-25T11:26:48.526 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70267 root txt unknown /proc/70267/exe (readlink: Permission denied) 2024-04-25T11:26:48.526 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70267 root NOFD /proc/70267/fd (opendir: Permission denied) 2024-04-25T11:26:48.526 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 ceph cwd unknown /proc/70269/cwd (readlink: Permission denied) 2024-04-25T11:26:48.526 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 ceph rtd unknown /proc/70269/root (readlink: Permission denied) 2024-04-25T11:26:48.526 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 ceph txt unknown /proc/70269/exe (readlink: Permission denied) 2024-04-25T11:26:48.527 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 ceph NOFD /proc/70269/fd (opendir: Permission denied) 2024-04-25T11:26:48.527 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70270 log ceph cwd unknown /proc/70269/task/70270/cwd (readlink: Permission denied) 2024-04-25T11:26:48.527 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70270 log ceph rtd unknown /proc/70269/task/70270/root (readlink: Permission denied) 2024-04-25T11:26:48.527 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70270 log ceph txt unknown /proc/70269/task/70270/exe (readlink: Permission denied) 2024-04-25T11:26:48.527 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70270 log ceph NOFD /proc/70269/task/70270/fd (opendir: Permission denied) 2024-04-25T11:26:48.527 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70272 msgr-work ceph cwd unknown /proc/70269/task/70272/cwd (readlink: Permission denied) 2024-04-25T11:26:48.528 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70272 msgr-work ceph rtd unknown /proc/70269/task/70272/root (readlink: Permission denied) 2024-04-25T11:26:48.528 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70272 msgr-work ceph txt unknown /proc/70269/task/70272/exe (readlink: Permission denied) 2024-04-25T11:26:48.528 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70272 msgr-work ceph NOFD /proc/70269/task/70272/fd (opendir: Permission denied) 2024-04-25T11:26:48.528 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70273 msgr-work ceph cwd unknown /proc/70269/task/70273/cwd (readlink: Permission denied) 2024-04-25T11:26:48.528 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70273 msgr-work ceph rtd unknown /proc/70269/task/70273/root (readlink: Permission denied) 2024-04-25T11:26:48.528 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70273 msgr-work ceph txt unknown /proc/70269/task/70273/exe (readlink: Permission denied) 2024-04-25T11:26:48.528 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70273 msgr-work ceph NOFD /proc/70269/task/70273/fd (opendir: Permission denied) 2024-04-25T11:26:48.529 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70274 msgr-work ceph cwd unknown /proc/70269/task/70274/cwd (readlink: Permission denied) 2024-04-25T11:26:48.529 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70274 msgr-work ceph rtd unknown /proc/70269/task/70274/root (readlink: Permission denied) 2024-04-25T11:26:48.529 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70274 msgr-work ceph txt unknown /proc/70269/task/70274/exe (readlink: Permission denied) 2024-04-25T11:26:48.529 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70274 msgr-work ceph NOFD /proc/70269/task/70274/fd (opendir: Permission denied) 2024-04-25T11:26:48.529 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70278 service ceph cwd unknown /proc/70269/task/70278/cwd (readlink: Permission denied) 2024-04-25T11:26:48.529 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70278 service ceph rtd unknown /proc/70269/task/70278/root (readlink: Permission denied) 2024-04-25T11:26:48.529 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70278 service ceph txt unknown /proc/70269/task/70278/exe (readlink: Permission denied) 2024-04-25T11:26:48.530 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70278 service ceph NOFD /proc/70269/task/70278/fd (opendir: Permission denied) 2024-04-25T11:26:48.530 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70279 admin_soc ceph cwd unknown /proc/70269/task/70279/cwd (readlink: Permission denied) 2024-04-25T11:26:48.530 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70279 admin_soc ceph rtd unknown /proc/70269/task/70279/root (readlink: Permission denied) 2024-04-25T11:26:48.530 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70279 admin_soc ceph txt unknown /proc/70269/task/70279/exe (readlink: Permission denied) 2024-04-25T11:26:48.530 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70279 admin_soc ceph NOFD /proc/70269/task/70279/fd (opendir: Permission denied) 2024-04-25T11:26:48.530 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70280 signal_ha ceph cwd unknown /proc/70269/task/70280/cwd (readlink: Permission denied) 2024-04-25T11:26:48.531 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70280 signal_ha ceph rtd unknown /proc/70269/task/70280/root (readlink: Permission denied) 2024-04-25T11:26:48.531 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70280 signal_ha ceph txt unknown /proc/70269/task/70280/exe (readlink: Permission denied) 2024-04-25T11:26:48.531 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70280 signal_ha ceph NOFD /proc/70269/task/70280/fd (opendir: Permission denied) 2024-04-25T11:26:48.531 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70281 io_contex ceph cwd unknown /proc/70269/task/70281/cwd (readlink: Permission denied) 2024-04-25T11:26:48.531 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70281 io_contex ceph rtd unknown /proc/70269/task/70281/root (readlink: Permission denied) 2024-04-25T11:26:48.531 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70281 io_contex ceph txt unknown /proc/70269/task/70281/exe (readlink: Permission denied) 2024-04-25T11:26:48.532 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70281 io_contex ceph NOFD /proc/70269/task/70281/fd (opendir: Permission denied) 2024-04-25T11:26:48.532 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70282 io_contex ceph cwd unknown /proc/70269/task/70282/cwd (readlink: Permission denied) 2024-04-25T11:26:48.532 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70282 io_contex ceph rtd unknown /proc/70269/task/70282/root (readlink: Permission denied) 2024-04-25T11:26:48.532 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70282 io_contex ceph txt unknown /proc/70269/task/70282/exe (readlink: Permission denied) 2024-04-25T11:26:48.532 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70282 io_contex ceph NOFD /proc/70269/task/70282/fd (opendir: Permission denied) 2024-04-25T11:26:48.532 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70283 ms_dispat ceph cwd unknown /proc/70269/task/70283/cwd (readlink: Permission denied) 2024-04-25T11:26:48.532 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70283 ms_dispat ceph rtd unknown /proc/70269/task/70283/root (readlink: Permission denied) 2024-04-25T11:26:48.533 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70283 ms_dispat ceph txt unknown /proc/70269/task/70283/exe (readlink: Permission denied) 2024-04-25T11:26:48.533 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70283 ms_dispat ceph NOFD /proc/70269/task/70283/fd (opendir: Permission denied) 2024-04-25T11:26:48.533 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70284 ms_local ceph cwd unknown /proc/70269/task/70284/cwd (readlink: Permission denied) 2024-04-25T11:26:48.533 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70284 ms_local ceph rtd unknown /proc/70269/task/70284/root (readlink: Permission denied) 2024-04-25T11:26:48.533 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70284 ms_local ceph txt unknown /proc/70269/task/70284/exe (readlink: Permission denied) 2024-04-25T11:26:48.533 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70284 ms_local ceph NOFD /proc/70269/task/70284/fd (opendir: Permission denied) 2024-04-25T11:26:48.533 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70285 safe_time ceph cwd unknown /proc/70269/task/70285/cwd (readlink: Permission denied) 2024-04-25T11:26:48.534 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70285 safe_time ceph rtd unknown /proc/70269/task/70285/root (readlink: Permission denied) 2024-04-25T11:26:48.534 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70285 safe_time ceph txt unknown /proc/70269/task/70285/exe (readlink: Permission denied) 2024-04-25T11:26:48.534 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70285 safe_time ceph NOFD /proc/70269/task/70285/fd (opendir: Permission denied) 2024-04-25T11:26:48.534 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70286 safe_time ceph cwd unknown /proc/70269/task/70286/cwd (readlink: Permission denied) 2024-04-25T11:26:48.534 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70286 safe_time ceph rtd unknown /proc/70269/task/70286/root (readlink: Permission denied) 2024-04-25T11:26:48.534 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70286 safe_time ceph txt unknown /proc/70269/task/70286/exe (readlink: Permission denied) 2024-04-25T11:26:48.534 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70286 safe_time ceph NOFD /proc/70269/task/70286/fd (opendir: Permission denied) 2024-04-25T11:26:48.535 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70287 ceph-mds ceph cwd unknown /proc/70269/task/70287/cwd (readlink: Permission denied) 2024-04-25T11:26:48.535 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70287 ceph-mds ceph rtd unknown /proc/70269/task/70287/root (readlink: Permission denied) 2024-04-25T11:26:48.535 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70287 ceph-mds ceph txt unknown /proc/70269/task/70287/exe (readlink: Permission denied) 2024-04-25T11:26:48.535 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70287 ceph-mds ceph NOFD /proc/70269/task/70287/fd (opendir: Permission denied) 2024-04-25T11:26:48.535 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70358 safe_time ceph cwd unknown /proc/70269/task/70358/cwd (readlink: Permission denied) 2024-04-25T11:26:48.535 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70358 safe_time ceph rtd unknown /proc/70269/task/70358/root (readlink: Permission denied) 2024-04-25T11:26:48.536 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70358 safe_time ceph txt unknown /proc/70269/task/70358/exe (readlink: Permission denied) 2024-04-25T11:26:48.536 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70269 70358 safe_time ceph NOFD /proc/70269/task/70358/fd (opendir: Permission denied) 2024-04-25T11:26:48.536 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70618 root cwd unknown /proc/70618/cwd (readlink: Permission denied) 2024-04-25T11:26:48.536 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70618 root rtd unknown /proc/70618/root (readlink: Permission denied) 2024-04-25T11:26:48.536 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70618 root txt unknown /proc/70618/exe (readlink: Permission denied) 2024-04-25T11:26:48.536 INFO:tasks.workunit.client.0.smithi080.stdout:conmon 70618 root NOFD /proc/70618/fd (opendir: Permission denied) 2024-04-25T11:26:48.536 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70620 root cwd unknown /proc/70620/cwd (readlink: Permission denied) 2024-04-25T11:26:48.537 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70620 root rtd unknown /proc/70620/root (readlink: Permission denied) 2024-04-25T11:26:48.537 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70620 root txt unknown /proc/70620/exe (readlink: Permission denied) 2024-04-25T11:26:48.537 INFO:tasks.workunit.client.0.smithi080.stdout:podman-in 70620 root NOFD /proc/70620/fd (opendir: Permission denied) 2024-04-25T11:26:48.537 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 ceph cwd unknown /proc/70622/cwd (readlink: Permission denied) 2024-04-25T11:26:48.537 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 ceph rtd unknown /proc/70622/root (readlink: Permission denied) 2024-04-25T11:26:48.537 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 ceph txt unknown /proc/70622/exe (readlink: Permission denied) 2024-04-25T11:26:48.537 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 ceph NOFD /proc/70622/fd (opendir: Permission denied) 2024-04-25T11:26:48.538 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70623 log ceph cwd unknown /proc/70622/task/70623/cwd (readlink: Permission denied) 2024-04-25T11:26:48.538 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70623 log ceph rtd unknown /proc/70622/task/70623/root (readlink: Permission denied) 2024-04-25T11:26:48.538 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70623 log ceph txt unknown /proc/70622/task/70623/exe (readlink: Permission denied) 2024-04-25T11:26:48.538 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70623 log ceph NOFD /proc/70622/task/70623/fd (opendir: Permission denied) 2024-04-25T11:26:48.538 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70625 msgr-work ceph cwd unknown /proc/70622/task/70625/cwd (readlink: Permission denied) 2024-04-25T11:26:48.538 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70625 msgr-work ceph rtd unknown /proc/70622/task/70625/root (readlink: Permission denied) 2024-04-25T11:26:48.539 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70625 msgr-work ceph txt unknown /proc/70622/task/70625/exe (readlink: Permission denied) 2024-04-25T11:26:48.539 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70625 msgr-work ceph NOFD /proc/70622/task/70625/fd (opendir: Permission denied) 2024-04-25T11:26:48.539 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70626 msgr-work ceph cwd unknown /proc/70622/task/70626/cwd (readlink: Permission denied) 2024-04-25T11:26:48.539 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70626 msgr-work ceph rtd unknown /proc/70622/task/70626/root (readlink: Permission denied) 2024-04-25T11:26:48.539 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70626 msgr-work ceph txt unknown /proc/70622/task/70626/exe (readlink: Permission denied) 2024-04-25T11:26:48.539 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70626 msgr-work ceph NOFD /proc/70622/task/70626/fd (opendir: Permission denied) 2024-04-25T11:26:48.539 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70627 msgr-work ceph cwd unknown /proc/70622/task/70627/cwd (readlink: Permission denied) 2024-04-25T11:26:48.540 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70627 msgr-work ceph rtd unknown /proc/70622/task/70627/root (readlink: Permission denied) 2024-04-25T11:26:48.540 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70627 msgr-work ceph txt unknown /proc/70622/task/70627/exe (readlink: Permission denied) 2024-04-25T11:26:48.540 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70627 msgr-work ceph NOFD /proc/70622/task/70627/fd (opendir: Permission denied) 2024-04-25T11:26:48.540 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70631 service ceph cwd unknown /proc/70622/task/70631/cwd (readlink: Permission denied) 2024-04-25T11:26:48.540 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70631 service ceph rtd unknown /proc/70622/task/70631/root (readlink: Permission denied) 2024-04-25T11:26:48.540 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70631 service ceph txt unknown /proc/70622/task/70631/exe (readlink: Permission denied) 2024-04-25T11:26:48.541 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70631 service ceph NOFD /proc/70622/task/70631/fd (opendir: Permission denied) 2024-04-25T11:26:48.541 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70632 admin_soc ceph cwd unknown /proc/70622/task/70632/cwd (readlink: Permission denied) 2024-04-25T11:26:48.541 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70632 admin_soc ceph rtd unknown /proc/70622/task/70632/root (readlink: Permission denied) 2024-04-25T11:26:48.541 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70632 admin_soc ceph txt unknown /proc/70622/task/70632/exe (readlink: Permission denied) 2024-04-25T11:26:48.541 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70632 admin_soc ceph NOFD /proc/70622/task/70632/fd (opendir: Permission denied) 2024-04-25T11:26:48.541 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70633 signal_ha ceph cwd unknown /proc/70622/task/70633/cwd (readlink: Permission denied) 2024-04-25T11:26:48.542 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70633 signal_ha ceph rtd unknown /proc/70622/task/70633/root (readlink: Permission denied) 2024-04-25T11:26:48.542 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70633 signal_ha ceph txt unknown /proc/70622/task/70633/exe (readlink: Permission denied) 2024-04-25T11:26:48.542 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70633 signal_ha ceph NOFD /proc/70622/task/70633/fd (opendir: Permission denied) 2024-04-25T11:26:48.542 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70634 io_contex ceph cwd unknown /proc/70622/task/70634/cwd (readlink: Permission denied) 2024-04-25T11:26:48.542 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70634 io_contex ceph rtd unknown /proc/70622/task/70634/root (readlink: Permission denied) 2024-04-25T11:26:48.542 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70634 io_contex ceph txt unknown /proc/70622/task/70634/exe (readlink: Permission denied) 2024-04-25T11:26:48.543 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70634 io_contex ceph NOFD /proc/70622/task/70634/fd (opendir: Permission denied) 2024-04-25T11:26:48.543 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70635 io_contex ceph cwd unknown /proc/70622/task/70635/cwd (readlink: Permission denied) 2024-04-25T11:26:48.543 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70635 io_contex ceph rtd unknown /proc/70622/task/70635/root (readlink: Permission denied) 2024-04-25T11:26:48.543 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70635 io_contex ceph txt unknown /proc/70622/task/70635/exe (readlink: Permission denied) 2024-04-25T11:26:48.543 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70635 io_contex ceph NOFD /proc/70622/task/70635/fd (opendir: Permission denied) 2024-04-25T11:26:48.543 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70636 ms_dispat ceph cwd unknown /proc/70622/task/70636/cwd (readlink: Permission denied) 2024-04-25T11:26:48.543 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70636 ms_dispat ceph rtd unknown /proc/70622/task/70636/root (readlink: Permission denied) 2024-04-25T11:26:48.544 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70636 ms_dispat ceph txt unknown /proc/70622/task/70636/exe (readlink: Permission denied) 2024-04-25T11:26:48.544 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70636 ms_dispat ceph NOFD /proc/70622/task/70636/fd (opendir: Permission denied) 2024-04-25T11:26:48.544 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70637 ms_local ceph cwd unknown /proc/70622/task/70637/cwd (readlink: Permission denied) 2024-04-25T11:26:48.544 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70637 ms_local ceph rtd unknown /proc/70622/task/70637/root (readlink: Permission denied) 2024-04-25T11:26:48.544 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70637 ms_local ceph txt unknown /proc/70622/task/70637/exe (readlink: Permission denied) 2024-04-25T11:26:48.544 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70637 ms_local ceph NOFD /proc/70622/task/70637/fd (opendir: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70638 safe_time ceph cwd unknown /proc/70622/task/70638/cwd (readlink: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70638 safe_time ceph rtd unknown /proc/70622/task/70638/root (readlink: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70638 safe_time ceph txt unknown /proc/70622/task/70638/exe (readlink: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70638 safe_time ceph NOFD /proc/70622/task/70638/fd (opendir: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70639 safe_time ceph cwd unknown /proc/70622/task/70639/cwd (readlink: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70639 safe_time ceph rtd unknown /proc/70622/task/70639/root (readlink: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70639 safe_time ceph txt unknown /proc/70622/task/70639/exe (readlink: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70639 safe_time ceph NOFD /proc/70622/task/70639/fd (opendir: Permission denied) 2024-04-25T11:26:48.545 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70640 ceph-mds ceph cwd unknown /proc/70622/task/70640/cwd (readlink: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70640 ceph-mds ceph rtd unknown /proc/70622/task/70640/root (readlink: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70640 ceph-mds ceph txt unknown /proc/70622/task/70640/exe (readlink: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70640 ceph-mds ceph NOFD /proc/70622/task/70640/fd (opendir: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70665 safe_time ceph cwd unknown /proc/70622/task/70665/cwd (readlink: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70665 safe_time ceph rtd unknown /proc/70622/task/70665/root (readlink: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70665 safe_time ceph txt unknown /proc/70622/task/70665/exe (readlink: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-mds 70622 70665 safe_time ceph NOFD /proc/70622/task/70665/fd (opendir: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 74330 root cwd unknown /proc/74330/cwd (readlink: Permission denied) 2024-04-25T11:26:48.546 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 74330 root rtd unknown /proc/74330/root (readlink: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 74330 root txt unknown /proc/74330/exe (readlink: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 74330 root NOFD /proc/74330/fd (opendir: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80724 root cwd unknown /proc/80724/cwd (readlink: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80724 root rtd unknown /proc/80724/root (readlink: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80724 root txt unknown /proc/80724/exe (readlink: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80724 root NOFD /proc/80724/fd (opendir: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80725 root cwd unknown /proc/80725/cwd (readlink: Permission denied) 2024-04-25T11:26:48.547 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80725 root rtd unknown /proc/80725/root (readlink: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80725 root txt unknown /proc/80725/exe (readlink: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/1 80725 root NOFD /proc/80725/fd (opendir: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-msgr 80839 root cwd unknown /proc/80839/cwd (readlink: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-msgr 80839 root rtd unknown /proc/80839/root (readlink: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-msgr 80839 root txt unknown /proc/80839/exe (readlink: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-msgr 80839 root NOFD /proc/80839/fd (opendir: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-watc 80840 root cwd unknown /proc/80840/cwd (readlink: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-watc 80840 root rtd unknown /proc/80840/root (readlink: Permission denied) 2024-04-25T11:26:48.548 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-watc 80840 root txt unknown /proc/80840/exe (readlink: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-watc 80840 root NOFD /proc/80840/fd (opendir: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-comp 80841 root cwd unknown /proc/80841/cwd (readlink: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-comp 80841 root rtd unknown /proc/80841/root (readlink: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-comp 80841 root txt unknown /proc/80841/exe (readlink: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:ceph-comp 80841 root NOFD /proc/80841/fd (opendir: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81372 root cwd unknown /proc/81372/cwd (readlink: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81372 root rtd unknown /proc/81372/root (readlink: Permission denied) 2024-04-25T11:26:48.549 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81372 root txt unknown /proc/81372/exe (readlink: Permission denied) 2024-04-25T11:26:48.550 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81372 root NOFD /proc/81372/fd (opendir: Permission denied) 2024-04-25T11:26:48.550 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81451 root cwd unknown /proc/81451/cwd (readlink: Permission denied) 2024-04-25T11:26:48.550 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81451 root rtd unknown /proc/81451/root (readlink: Permission denied) 2024-04-25T11:26:48.550 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81451 root txt unknown /proc/81451/exe (readlink: Permission denied) 2024-04-25T11:26:48.550 INFO:tasks.workunit.client.0.smithi080.stdout:sshd 81451 root NOFD /proc/81451/fd (opendir: Permission denied) 2024-04-25T11:26:48.550 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 83778 root cwd unknown /proc/83778/cwd (readlink: Permission denied) 2024-04-25T11:26:48.550 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 83778 root rtd unknown /proc/83778/root (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 83778 root txt unknown /proc/83778/exe (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:sudo 83778 root NOFD /proc/83778/fd (opendir: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:daemon-he 83800 root cwd unknown /proc/83800/cwd (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:daemon-he 83800 root rtd unknown /proc/83800/root (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:daemon-he 83800 root txt unknown /proc/83800/exe (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:daemon-he 83800 root NOFD /proc/83800/fd (opendir: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:bash 83812 root cwd unknown /proc/83812/cwd (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:bash 83812 root rtd unknown /proc/83812/root (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:bash 83812 root txt unknown /proc/83812/exe (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:bash 83812 root NOFD /proc/83812/fd (opendir: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 84465 root cwd unknown /proc/84465/cwd (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 84465 root rtd unknown /proc/84465/root (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 84465 root txt unknown /proc/84465/exe (readlink: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/4 84465 root NOFD /proc/84465/fd (opendir: Permission denied) 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu cwd DIR 0,115 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T11:26:48.551 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu rtd DIR 8,1 4096 2 / 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu txt REG 8,1 41144 7580 /usr/bin/timeout 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-25T11:26:48.552 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu 0r FIFO 0,13 0t0 227078 pipe 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu 1w FIFO 0,13 0t0 227079 pipe 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:timeout 85355 ubuntu 2w FIFO 0,13 0t0 227080 pipe 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu cwd DIR 0,115 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu rtd DIR 8,1 4096 2 / 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu txt REG 8,1 1389072 7149 /usr/bin/bash 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-25T11:26:48.553 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 195080 7147 /usr/lib64/libtinfo.so.6.2 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu 0r FIFO 0,13 0t0 227078 pipe 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu 1w FIFO 0,13 0t0 227079 pipe 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu 2w FIFO 0,13 0t0 227080 pipe 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:fsync-tes 85373 ubuntu 255r REG 8,1 207 661291 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 85908 root cwd unknown /proc/85908/cwd (readlink: Permission denied) 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 85908 root rtd unknown /proc/85908/root (readlink: Permission denied) 2024-04-25T11:26:48.554 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 85908 root txt unknown /proc/85908/exe (readlink: Permission denied) 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:kworker/u 85908 root NOFD /proc/85908/fd (opendir: Permission denied) 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu cwd DIR 0,115 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu rtd DIR 8,1 4096 2 / 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu txt REG 8,1 179232 9797 /usr/bin/lsof 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-25T11:26:48.555 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 196224 8914 /usr/lib64/libtirpc.so.3.0.0 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu 0r FIFO 0,13 0t0 227078 pipe 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu 1w FIFO 0,13 0t0 227079 pipe 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu 2w FIFO 0,13 0t0 227080 pipe 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu 3r DIR 0,20 0 1 /proc 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu 4r DIR 0,20 0 237578 /proc/86612/fd 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu 5w FIFO 0,13 0t0 237583 pipe 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86612 ubuntu 6r FIFO 0,13 0t0 237584 pipe 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:sleep 86613 root cwd unknown /proc/86613/cwd (readlink: Permission denied) 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:sleep 86613 root rtd unknown /proc/86613/root (readlink: Permission denied) 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:sleep 86613 root txt unknown /proc/86613/exe (readlink: Permission denied) 2024-04-25T11:26:48.556 INFO:tasks.workunit.client.0.smithi080.stdout:sleep 86613 root NOFD /proc/86613/fd (opendir: Permission denied) 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu cwd DIR 0,115 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu rtd DIR 8,1 4096 2 / 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu txt REG 8,1 179232 9797 /usr/bin/lsof 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-25T11:26:48.557 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 196224 8914 /usr/lib64/libtirpc.so.3.0.0 2024-04-25T11:26:48.558 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-25T11:26:48.558 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-25T11:26:48.558 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-25T11:26:48.558 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu 4r FIFO 0,13 0t0 237583 pipe 2024-04-25T11:26:48.558 INFO:tasks.workunit.client.0.smithi080.stdout:lsof 86614 ubuntu 7w FIFO 0,13 0t0 237584 pipe 2024-04-25T11:26:48.558 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T11:26:48.558 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T11:26:48.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:48 smithi080 ceph-mon[29126]: pgmap v80: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-04-25T11:26:48.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:48 smithi082 ceph-mon[32440]: pgmap v80: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-04-25T11:26:48.560 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:48 smithi196 ceph-mon[32659]: pgmap v80: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-04-25T11:26:48.604 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-04-25T11:26:48.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T11:26:48.910 DEBUG:teuthology.parallel:result is None 2024-04-25T11:26:48.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T11:26:48.943 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T11:26:48.944 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-25T11:26:48.960 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:26:48.992 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-25T11:26:49.004 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-25T11:26:49.004 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T11:26:49.004 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:26:49.004 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-25T11:26:49.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-25T11:26:50.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:50 smithi196 ceph-mon[32659]: pgmap v81: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 865 KiB/s wr, 7 op/s 2024-04-25T11:26:50.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:50 smithi082 ceph-mon[32440]: pgmap v81: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 865 KiB/s wr, 7 op/s 2024-04-25T11:26:50.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:50 smithi080 ceph-mon[29126]: pgmap v81: 97 pgs: 97 active+clean; 348 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 865 KiB/s wr, 7 op/s 2024-04-25T11:26:52.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:52 smithi196 ceph-mon[32659]: pgmap v82: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 17 op/s 2024-04-25T11:26:52.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:52 smithi082 ceph-mon[32440]: pgmap v82: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 17 op/s 2024-04-25T11:26:52.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:52 smithi080 ceph-mon[29126]: pgmap v82: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 17 op/s 2024-04-25T11:26:54.429 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:54 smithi080 ceph-mon[29126]: pgmap v83: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-04-25T11:26:54.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:54 smithi196 ceph-mon[32659]: pgmap v83: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-04-25T11:26:54.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:54 smithi082 ceph-mon[32440]: pgmap v83: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-04-25T11:26:56.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:56 smithi196 ceph-mon[32659]: pgmap v84: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-04-25T11:26:56.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:56 smithi082 ceph-mon[32440]: pgmap v84: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-04-25T11:26:56.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:56 smithi080 ceph-mon[29126]: pgmap v84: 97 pgs: 97 active+clean; 466 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-04-25T11:26:58.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:26:58 smithi196 ceph-mon[32659]: pgmap v85: 97 pgs: 97 active+clean; 515 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 19 op/s 2024-04-25T11:26:58.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:26:58 smithi082 ceph-mon[32440]: pgmap v85: 97 pgs: 97 active+clean; 515 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 19 op/s 2024-04-25T11:26:58.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:26:58 smithi080 ceph-mon[29126]: pgmap v85: 97 pgs: 97 active+clean; 515 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 19 op/s 2024-04-25T11:26:59.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:26:59.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:26:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 -- 172.21.15.80:0/2756533962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 msgr2=0x7fb640101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 --2- 172.21.15.80:0/2756533962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb640101c10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb630009900 tx=0x7fb63002a3f0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 -- 172.21.15.80:0/2756533962 shutdown_connections 2024-04-25T11:26:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 --2- 172.21.15.80:0/2756533962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6401027c0 0x7fb640110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 --2- 172.21.15.80:0/2756533962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb640109fc0 0x7fb640102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 --2- 172.21.15.80:0/2756533962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb640101c10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 -- 172.21.15.80:0/2756533962 >> 172.21.15.80:0/2756533962 conn(0x7fb640077880 msgr2=0x7fb640077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 -- 172.21.15.80:0/2756533962 shutdown_connections 2024-04-25T11:26:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 -- 172.21.15.80:0/2756533962 wait complete. 2024-04-25T11:26:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.830+0000 7fb645b00640 1 Processor -- start 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb645b00640 1 -- start start 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb645b00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6401027c0 0x7fb64019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb645b00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb64019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb645b00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb640109fc0 0x7fb64019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb645b00640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb640113ce0 con 0x7fb640109b20 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb645b00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb640113b60 con 0x7fb640109fc0 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb645b00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb640113e60 con 0x7fb6401027c0 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb64019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb64019ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42490/0 (socket says 172.21.15.80:42490) 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 -- 172.21.15.80:0/2500705298 learned_addr learned my addr 172.21.15.80:0/2500705298 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6401027c0 0x7fb64019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63ffff640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb640109fc0 0x7fb64019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 -- 172.21.15.80:0/2500705298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6401027c0 msgr2=0x7fb64019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6401027c0 0x7fb64019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 -- 172.21.15.80:0/2500705298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb640109fc0 msgr2=0x7fb64019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb640109fc0 0x7fb64019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 -- 172.21.15.80:0/2500705298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64019f500 con 0x7fb640109b20 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63ffff640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb640109fc0 0x7fb64019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.831+0000 7fb63effd640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb64019ac80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c9a0 tx=0x7fb63400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.832+0000 7fb63cff9640 1 -- 172.21.15.80:0/2500705298 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb634014070 con 0x7fb640109b20 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.832+0000 7fb63cff9640 1 -- 172.21.15.80:0/2500705298 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb634004440 con 0x7fb640109b20 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.832+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64019f7f0 con 0x7fb640109b20 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.832+0000 7fb63cff9640 1 -- 172.21.15.80:0/2500705298 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63400f450 con 0x7fb640109b20 2024-04-25T11:26:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.832+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64019fd40 con 0x7fb640109b20 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 Processor -- start 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 -- start start 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb63cff9640 1 -- 172.21.15.80:0/2500705298 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fb634017070 con 0x7fb640109b20 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c2f390 0x55a732fcf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fcfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a732f35d80 con 0x55a732c0e6b0 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a732eef8b0 con 0x55a732c2f390 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.834+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a732f31d40 con 0x55a732c064d0 2024-04-25T11:26:59.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42496/0 (socket says 172.21.15.80:42496) 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 -- 172.21.15.80:0/3033521569 learned_addr learned my addr 172.21.15.80:0/3033521569 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63ffff640 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c2f390 0x55a732fcf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fcfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 -- 172.21.15.80:0/3033521569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 msgr2=0x55a732fcfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fcfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 -- 172.21.15.80:0/3033521569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c2f390 msgr2=0x55a732fcf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c2f390 0x55a732fcf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 -- 172.21.15.80:0/3033521569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a732ec0a40 con 0x55a732c0e6b0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63cff9640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb6280afc60 0x7fb6280b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63effd640 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe0d00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb6340dc250 tx=0x7fb6340e76c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1856a1ceddd80d74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63ffff640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb6280afc60 0x7fb6280b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb63cff9640 1 -- 172.21.15.80:0/2500705298 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb6340deb80 con 0x7fb640109b20 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.835+0000 7fb625ffb640 1 -- 172.21.15.80:0/3033521569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6340a2bf0 con 0x55a732c0e6b0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb625ffb640 1 -- 172.21.15.80:0/3033521569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6340a6840 con 0x55a732c0e6b0 2024-04-25T11:26:59.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb625ffb640 1 -- 172.21.15.80:0/3033521569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6340a64a0 con 0x55a732c0e6b0 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3033521569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 msgr2=0x55a732fe0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb63ffff640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb6280afc60 0x7fb6280b2170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb638005fd0 tx=0x7fb6380086a0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe0d00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb6340dc250 tx=0x7fb6340e76c0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3033521569 shutdown_connections 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe0d00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fcfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3033521569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c2f390 0x55a732fcf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3033521569 >> 172.21.15.80:0/3033521569 conn(0x55a732c234e0 msgr2=0x55a732fcc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3033521569 shutdown_connections 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.836+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3033521569 wait complete. 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 -- start start 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 Processor -- start 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fdea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c0e6b0 0x55a732fdefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c2f390 0x55a732fe4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a732fe1390 con 0x55a732c2f390 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a732ebcd10 con 0x55a732c0e6b0 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a732fe1510 con 0x55a732c064d0 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb64c9b4740 10 client.0 _ll_register_callbacks cb 0x55a732ee9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.837+0000 7fb63ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c2f390 0x55a732fe4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c2f390 0x55a732fe4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42504/0 (socket says 172.21.15.80:42504) 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 -- 172.21.15.80:0/3092682621 learned_addr learned my addr 172.21.15.80:0/3092682621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63effd640 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c0e6b0 0x55a732fdefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fdea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 -- 172.21.15.80:0/3092682621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 msgr2=0x55a732fdea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fdea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 -- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c0e6b0 msgr2=0x55a732fdefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c0e6b0 0x55a732fdefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 -- 172.21.15.80:0/3092682621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a732d117d0 con 0x55a732c2f390 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb63ffff640 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c2f390 0x55a732fe4910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb63801bda0 tx=0x7fb638004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3deb6140d8cf229a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb61effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb61effd640 1 -- 172.21.15.80:0/3092682621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63800ed40 con 0x55a732c2f390 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb61effd640 1 -- 172.21.15.80:0/3092682621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb638027480 con 0x55a732c2f390 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6340a6840 con 0x55a732c2f390 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb61effd640 1 -- 172.21.15.80:0/3092682621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb638027680 con 0x55a732c2f390 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb64c9b4740 10 client.16218 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.838+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a732c473f0 con 0x55a732c2f390 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb61effd640 1 -- 172.21.15.80:0/3092682621 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6340a6840 con 0x55a732c2f390 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb61effd640 1 -- 172.21.15.80:0/3092682621 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb63801c410 con 0x55a732c2f390 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb64c9b4740 10 client.16218 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb64c9b4740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb64c9b4740 20 client.16218 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732bedf60 0x55a732ff0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb64c9b4740 4 client.16218 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a732f43990 con 0x55a732bedf60 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.839+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732bedf60 0x55a732ff0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.840+0000 7fb61effd640 10 client.16218 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:59.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.840+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732bedf60 0x55a732ff0b40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bfff292711e6a67 server_cookie=312cf0863612ce79 in_seq=0 out_seq=0 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.840+0000 7fb61effd640 1 -- 172.21.15.80:0/3092682621 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a732f43990 con 0x55a732bedf60 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.840+0000 7fb61effd640 10 client.16218 handle_command_reply: tid=0 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.840+0000 7fb64c9b4740 1 client.16218 shutdown 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c2f390 msgr2=0x55a732fe4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c2f390 0x55a732fe4910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb63801bda0 tx=0x7fb638004a40 comp rx=0 tx=0).stop 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 shutdown_connections 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732bedf60 0x55a732ff0b40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c2f390 0x55a732fe4910 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c0e6b0 0x55a732fdefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb61effd640 0 client.16218 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:59.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/3092682621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c064d0 0x55a732fdea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 >> 172.21.15.80:0/3092682621 conn(0x55a732c234e0 msgr2=0x55a732fd16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:59.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 shutdown_connections 2024-04-25T11:26:59.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 1 -- 172.21.15.80:0/3092682621 wait complete. 2024-04-25T11:26:59.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.841+0000 7fb64c9b4740 20 client.16218 trim_cache size 0 max 16384 2024-04-25T11:26:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.858+0000 7fb64c9b4740 1 Processor -- start 2024-04-25T11:26:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb64c9b4740 1 -- start start 2024-04-25T11:26:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732bedf60 0x55a732fcc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a732fd1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c0e6b0 0x55a732fe4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401b00d0 con 0x55a732bedf60 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401ad9a0 con 0x55a732c064d0 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401ab7f0 con 0x55a732c0e6b0 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732bedf60 0x55a732fcc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732bedf60 0x55a732fcc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42508/0 (socket says 172.21.15.80:42508) 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 -- 172.21.15.80:0/2047851153 learned_addr learned my addr 172.21.15.80:0/2047851153 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63effd640 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a732fd1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 -- 172.21.15.80:0/2047851153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c0e6b0 msgr2=0x55a732fe4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c0e6b0 0x55a732fe4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 -- 172.21.15.80:0/2047851153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 msgr2=0x55a732fd1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a732fd1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 -- 172.21.15.80:0/2047851153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a732c070f0 con 0x55a732bedf60 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63effd640 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a732fd1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:26:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732bedf60 0x55a732fcc240 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb63002a910 tx=0x7fb630009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a707f7dd5d9111 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb6257fa640 1 -- 172.21.15.80:0/2047851153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630049070 con 0x55a732bedf60 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb6257fa640 1 -- 172.21.15.80:0/2047851153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb630031950 con 0x55a732bedf60 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.859+0000 7fb6257fa640 1 -- 172.21.15.80:0/2047851153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630035040 con 0x55a732bedf60 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 -- 172.21.15.80:0/2047851153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732bedf60 msgr2=0x55a732fcc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732bedf60 0x55a732fcc240 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb63002a910 tx=0x7fb630009260 comp rx=0 tx=0).stop 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 -- 172.21.15.80:0/2047851153 shutdown_connections 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732c0e6b0 0x55a732fe4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a732fd1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/2047851153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732bedf60 0x55a732fcc240 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 -- 172.21.15.80:0/2047851153 >> 172.21.15.80:0/2047851153 conn(0x55a732c234e0 msgr2=0x55a732fd16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 -- 172.21.15.80:0/2047851153 shutdown_connections 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.860+0000 7fb64c9b4740 1 -- 172.21.15.80:0/2047851153 wait complete. 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 -- start start 2024-04-25T11:26:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 Processor -- start 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732bedf60 0x55a733051290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a7330517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401abe60 con 0x55a732c0e6b0 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401ad2d0 con 0x55a732c064d0 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401ac530 con 0x55a732bedf60 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb64c9b4740 10 client.0 _ll_register_callbacks cb 0x7fb638008be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb63ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb63ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42518/0 (socket says 172.21.15.80:42518) 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb63ffff640 1 -- 172.21.15.80:0/4253731388 learned_addr learned my addr 172.21.15.80:0/4253731388 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732bedf60 0x55a733051290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.861+0000 7fb63effd640 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a7330517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb63ffff640 1 -- 172.21.15.80:0/4253731388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732bedf60 msgr2=0x55a733051290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb63ffff640 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732bedf60 0x55a733051290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb63ffff640 1 -- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 msgr2=0x55a7330517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb63ffff640 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a7330517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb63ffff640 1 -- 172.21.15.80:0/4253731388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a732ef64b0 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb63ffff640 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe62f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb638015040 tx=0x7fb63801cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08c2c57633ab96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb61effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb61effd640 1 -- 172.21.15.80:0/4253731388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63803f060 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb61effd640 1 -- 172.21.15.80:0/4253731388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb63800ed50 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb630031950 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb61effd640 1 -- 172.21.15.80:0/4253731388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb63800e780 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb64c9b4740 10 client.16224 fetch_fsmap learned FSMap version 24 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a733058700 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb61effd640 1 -- 172.21.15.80:0/4253731388 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb630031950 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb61effd640 1 -- 172.21.15.80:0/4253731388 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb638039030 con 0x55a732c0e6b0 2024-04-25T11:26:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb64c9b4740 10 client.16224 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb64c9b4740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb64c9b4740 20 client.16224 populate_metadata read hostname 'smithi080' 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.862+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732c2f390 0x55a73305ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb64c9b4740 4 client.16224 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a732f3d800 con 0x55a732c2f390 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732c2f390 0x55a73305ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb61effd640 10 client.16224 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb63f7fe640 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732c2f390 0x55a73305ae30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7bfd2a8c643301e server_cookie=165bdb7b77ddfcc9 in_seq=0 out_seq=0 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb61effd640 1 -- 172.21.15.80:0/4253731388 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a732f3d800 con 0x55a732c2f390 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb61effd640 10 client.16224 handle_command_reply: tid=0 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.863+0000 7fb64c9b4740 1 client.16224 shutdown 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 msgr2=0x55a732fe62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe62f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb638015040 tx=0x7fb63801cd00 comp rx=0 tx=0).stop 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 shutdown_connections 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a732c2f390 0x55a73305ae30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a732c0e6b0 0x55a732fe62f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a732c064d0 0x55a7330517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 --2- 172.21.15.80:0/4253731388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a732bedf60 0x55a733051290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb61effd640 0 client.16224 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 >> 172.21.15.80:0/4253731388 conn(0x55a732c234e0 msgr2=0x55a732fca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 shutdown_connections 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 1 -- 172.21.15.80:0/4253731388 wait complete. 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb64c9b4740 20 client.16224 trim_cache size 0 max 16384 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:26:59.862 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:26:59.863 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:26:59.863 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:26:59.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb6280afc60 msgr2=0x7fb6280b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb6280afc60 0x7fb6280b2170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb638005fd0 tx=0x7fb6380086a0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 msgr2=0x7fb64019ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb64019ac80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c9a0 tx=0x7fb63400ce60 comp rx=0 tx=0).stop 2024-04-25T11:26:59.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 shutdown_connections 2024-04-25T11:26:59.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb6280afc60 0x7fb6280b2170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb640109b20 0x7fb64019ac80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb640109fc0 0x7fb64019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 --2- 172.21.15.80:0/2500705298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6401027c0 0x7fb64019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.864+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 >> 172.21.15.80:0/2500705298 conn(0x7fb640077880 msgr2=0x7fb640105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:59.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.865+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 shutdown_connections 2024-04-25T11:26:59.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.865+0000 7fb645b00640 1 -- 172.21.15.80:0/2500705298 wait complete. 2024-04-25T11:26:59.868 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:26:59.868 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:26:59.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 -- 172.21.15.80:0/3553106191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107230 msgr2=0x7fc3d8107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/3553106191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107230 0x7fc3d8107640 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009900 tx=0x7fc3c802a410 comp rx=0 tx=0).stop 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 -- 172.21.15.80:0/3553106191 shutdown_connections 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/3553106191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107230 0x7fc3d8107640 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/3553106191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8107cb0 0x7fc3d810f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/3553106191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3d8103370 0x7fc3d8103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 -- 172.21.15.80:0/3553106191 >> 172.21.15.80:0/3553106191 conn(0x7fc3d80fd810 msgr2=0x7fc3d80ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 -- 172.21.15.80:0/3553106191 shutdown_connections 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.984+0000 7fc3dfed8640 1 -- 172.21.15.80:0/3553106191 wait complete. 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 Processor -- start 2024-04-25T11:26:59.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 -- start start 2024-04-25T11:26:59.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3d8103370 0x7fc3d819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8107230 0x7fc3d819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107cb0 0x7fc3d819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8112bb0 con 0x7fc3d8107cb0 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8112a30 con 0x7fc3d8107230 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dfed8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8112d30 con 0x7fc3d8103370 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107cb0 0x7fc3d819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107cb0 0x7fc3d819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42542/0 (socket says 172.21.15.80:42542) 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 -- 172.21.15.80:0/475240249 learned_addr learned my addr 172.21.15.80:0/475240249 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3ddc74640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3d8103370 0x7fc3d819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3dd473640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8107230 0x7fc3d819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 -- 172.21.15.80:0/475240249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3d8103370 msgr2=0x7fc3d819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3d8103370 0x7fc3d819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 -- 172.21.15.80:0/475240249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8107230 msgr2=0x7fc3d819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8107230 0x7fc3d819ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 -- 172.21.15.80:0/475240249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d819f4a0 con 0x7fc3d8107cb0 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3ddc74640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3d8103370 0x7fc3d819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.985+0000 7fc3de475640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107cb0 0x7fc3d819eee0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000d780 tx=0x7fc3d000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.986+0000 7fc3ceffd640 1 -- 172.21.15.80:0/475240249 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0017070 con 0x7fc3d8107cb0 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.986+0000 7fc3ceffd640 1 -- 172.21.15.80:0/475240249 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3d000de90 con 0x7fc3d8107cb0 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.986+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d819f790 con 0x7fc3d8107cb0 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.986+0000 7fc3ceffd640 1 -- 172.21.15.80:0/475240249 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0004c30 con 0x7fc3d8107cb0 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.986+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d819fc90 con 0x7fc3d8107cb0 2024-04-25T11:26:59.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.987+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d8069310 con 0x7fc3d8107cb0 2024-04-25T11:26:59.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.988+0000 7fc3ceffd640 1 -- 172.21.15.80:0/475240249 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fc3d0004dd0 con 0x7fc3d8107cb0 2024-04-25T11:26:59.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.989+0000 7fc3ceffd640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc3c40afc60 0x7fc3c40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:26:59.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.989+0000 7fc3ddc74640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc3c40afc60 0x7fc3c40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:26:59.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.989+0000 7fc3ceffd640 1 -- 172.21.15.80:0/475240249 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fc3d00deed0 con 0x7fc3d8107cb0 2024-04-25T11:26:59.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.989+0000 7fc3ddc74640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc3c40afc60 0x7fc3c40b2170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8069e60 tx=0x7fc3d4008350 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:26:59.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:26:59.992+0000 7fc3ceffd640 1 -- 172.21.15.80:0/475240249 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc3d00a7780 con 0x7fc3d8107cb0 2024-04-25T11:27:00.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.213+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3d819ba10 con 0x7fc3d8107cb0 2024-04-25T11:27:00.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.213+0000 7fc3ceffd640 1 -- 172.21.15.80:0/475240249 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7fc3d00a7080 con 0x7fc3d8107cb0 2024-04-25T11:27:00.206 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:27:00.206 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:27:00.206 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc3c40afc60 msgr2=0x7fc3c40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc3c40afc60 0x7fc3c40b2170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8069e60 tx=0x7fc3d4008350 comp rx=0 tx=0).stop 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107cb0 msgr2=0x7fc3d819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107cb0 0x7fc3d819eee0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000d780 tx=0x7fc3d000dc40 comp rx=0 tx=0).stop 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 shutdown_connections 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc3c40afc60 0x7fc3c40b2170 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d8107cb0 0x7fc3d819eee0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8107230 0x7fc3d819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 --2- 172.21.15.80:0/475240249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3d8103370 0x7fc3d819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.215+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 >> 172.21.15.80:0/475240249 conn(0x7fc3d80fd810 msgr2=0x7fc3d8106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.216+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 shutdown_connections 2024-04-25T11:27:00.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.216+0000 7fc3dfed8640 1 -- 172.21.15.80:0/475240249 wait complete. 2024-04-25T11:27:00.219 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:27:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 -- 172.21.15.80:0/3537157058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 msgr2=0x7f736010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 --2- 172.21.15.80:0/3537157058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736010f7a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7350009900 tx=0x7f735002a410 comp rx=0 tx=0).stop 2024-04-25T11:27:00.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 -- 172.21.15.80:0/3537157058 shutdown_connections 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 --2- 172.21.15.80:0/3537157058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736010f7a0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 --2- 172.21.15.80:0/3537157058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7360102af0 0x7f7360102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 --2- 172.21.15.80:0/3537157058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7360108a20 0x7f73601025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 -- 172.21.15.80:0/3537157058 >> 172.21.15.80:0/3537157058 conn(0x7f7360078100 msgr2=0x7f7360078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 -- 172.21.15.80:0/3537157058 shutdown_connections 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 -- 172.21.15.80:0/3537157058 wait complete. 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.338+0000 7f7367b0d640 1 Processor -- start 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f7367b0d640 1 -- start start 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f7367b0d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7360102af0 0x7f73601995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f7367b0d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7360108a20 0x7f7360199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f7367b0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736019de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f7367b0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7360112c00 con 0x7f736010d380 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f7367b0d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7360112a80 con 0x7f7360108a20 2024-04-25T11:27:00.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f7367b0d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7360112d80 con 0x7f7360102af0 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736019de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736019de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42560/0 (socket says 172.21.15.80:42560) 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 -- 172.21.15.80:0/2427614308 learned_addr learned my addr 172.21.15.80:0/2427614308 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73658a9640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7360102af0 0x7f73601995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73650a8640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7360108a20 0x7f7360199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 -- 172.21.15.80:0/2427614308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7360102af0 msgr2=0x7f73601995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7360102af0 0x7f73601995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 -- 172.21.15.80:0/2427614308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7360108a20 msgr2=0x7f7360199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7360108a20 0x7f7360199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 -- 172.21.15.80:0/2427614308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736019e440 con 0x7f736010d380 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73658a9640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7360102af0 0x7f73601995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.339+0000 7f73660aa640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736019de00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7350004770 tx=0x7f7350004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.340+0000 7f735effd640 1 -- 172.21.15.80:0/2427614308 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735003f030 con 0x7f736010d380 2024-04-25T11:27:00.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.340+0000 7f735effd640 1 -- 172.21.15.80:0/2427614308 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7350003aa0 con 0x7f736010d380 2024-04-25T11:27:00.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.340+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736019e6d0 con 0x7f736010d380 2024-04-25T11:27:00.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.340+0000 7f735effd640 1 -- 172.21.15.80:0/2427614308 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350035070 con 0x7f736010d380 2024-04-25T11:27:00.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.340+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736019ebc0 con 0x7f736010d380 2024-04-25T11:27:00.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.342+0000 7f736e9c1740 1 Processor -- start 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.342+0000 7f735effd640 1 -- 172.21.15.80:0/2427614308 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f7350042030 con 0x7f736010d380 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f736e9c1740 1 -- start start 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e894810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e894d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f736e9c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bf4e7f9d80 con 0x55bf4e4f3390 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f736e9c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf4e7b3a20 con 0x55bf4e4ca4d0 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f736e9c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bf4e7f5d40 con 0x55bf4e4d26b0 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e894810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e894810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42562/0 (socket says 172.21.15.80:42562) 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 -- 172.21.15.80:0/3248664144 learned_addr learned my addr 172.21.15.80:0/3248664144 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f735effd640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f73480afc60 0x7f73480b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73658a9640 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e894d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 -- 172.21.15.80:0/3248664144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 msgr2=0x55bf4e8a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73660aa640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f73480afc60 0x7f73480b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 -- 172.21.15.80:0/3248664144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 msgr2=0x55bf4e894d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e894d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73650a8640 1 -- 172.21.15.80:0/3248664144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf4e7bec30 con 0x55bf4e4f3390 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f73658a9640 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e894d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.343+0000 7f735effd640 1 -- 172.21.15.80:0/2427614308 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f73500ff8b0 con 0x7f736010d380 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.344+0000 7f73650a8640 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e894810 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f735400ae80 tx=0x7f7354011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762e1ee5c32661f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.344+0000 7f7347fff640 1 -- 172.21.15.80:0/3248664144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354012800 con 0x55bf4e4f3390 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.344+0000 7f7347fff640 1 -- 172.21.15.80:0/3248664144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7354012e50 con 0x55bf4e4f3390 2024-04-25T11:27:00.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.344+0000 7f7347fff640 1 -- 172.21.15.80:0/3248664144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735401ade0 con 0x55bf4e4f3390 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 -- 172.21.15.80:0/3248664144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 msgr2=0x55bf4e894810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f73660aa640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f73480afc60 0x7f73480b2170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f73500fd610 tx=0x7f73500952c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e894810 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f735400ae80 tx=0x7f7354011750 comp rx=0 tx=0).stop 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 -- 172.21.15.80:0/3248664144 shutdown_connections 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e894d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3248664144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e894810 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 -- 172.21.15.80:0/3248664144 >> 172.21.15.80:0/3248664144 conn(0x55bf4e4e74e0 msgr2=0x55bf4e890fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 -- 172.21.15.80:0/3248664144 shutdown_connections 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 -- 172.21.15.80:0/3248664144 wait complete. 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 -- start start 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.345+0000 7f736e9c1740 1 Processor -- start 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e89ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 0x55bf4e89f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e8ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f736e9c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bf4e8a3fa0 con 0x55bf4e4f3390 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f736e9c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf4e780dc0 con 0x55bf4e4ca4d0 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f736e9c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bf4e8a4120 con 0x55bf4e4d26b0 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f736e9c1740 10 client.0 _ll_register_callbacks cb 0x55bf4e79c600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e8ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e8ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42564/0 (socket says 172.21.15.80:42564) 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 -- 172.21.15.80:0/2594483515 learned_addr learned my addr 172.21.15.80:0/2594483515 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e89ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73658a9640 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 0x55bf4e89f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 -- 172.21.15.80:0/2594483515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 msgr2=0x55bf4e89f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 0x55bf4e89f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 -- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 msgr2=0x55bf4e89ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e89ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 -- 172.21.15.80:0/2594483515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf4e50b3f0 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73650a8640 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e8ad510 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f735401a790 tx=0x7f735401a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b7ca4887a75247 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73457fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73457fa640 1 -- 172.21.15.80:0/2594483515 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354023040 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.346+0000 7f73457fa640 1 -- 172.21.15.80:0/2594483515 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7354012800 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7354012e50 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f73457fa640 1 -- 172.21.15.80:0/2594483515 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7354012a00 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f736e9c1740 10 client.16242 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bf4e5d57d0 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f73457fa640 1 -- 172.21.15.80:0/2594483515 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7354012e50 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f73457fa640 1 -- 172.21.15.80:0/2594483515 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f735402ac50 con 0x55bf4e4f3390 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f736e9c1740 10 client.16242 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.347+0000 7f736e9c1740 10 client.16242 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.348+0000 7f736e9c1740 20 client.16242 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.348+0000 7f736e9c1740 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4b1f60 0x55bf4e8b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.348+0000 7f736e9c1740 4 client.16242 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:00.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.348+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf4e807990 con 0x55bf4e4b1f60 2024-04-25T11:27:00.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.348+0000 7f73658a9640 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4b1f60 0x55bf4e8b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.348+0000 7f73457fa640 10 client.16242 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:00.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.348+0000 7f73658a9640 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4b1f60 0x55bf4e8b37d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b57521d764428e8 server_cookie=42c33cf0349fb874 in_seq=0 out_seq=0 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f73457fa640 1 -- 172.21.15.80:0/2594483515 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bf4e807990 con 0x55bf4e4b1f60 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f73457fa640 10 client.16242 handle_command_reply: tid=0 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 client.16242 shutdown 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 msgr2=0x55bf4e8ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e8ad510 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f735401a790 tx=0x7f735401a9c0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 shutdown_connections 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4b1f60 0x55bf4e8b37d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4f3390 0x55bf4e8ad510 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4d26b0 0x55bf4e89f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f73457fa640 0 client.16242 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:00.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 --2- 172.21.15.80:0/2594483515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e89ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 >> 172.21.15.80:0/2594483515 conn(0x55bf4e4e74e0 msgr2=0x55bf4e896530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 shutdown_connections 2024-04-25T11:27:00.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.349+0000 7f736e9c1740 1 -- 172.21.15.80:0/2594483515 wait complete. 2024-04-25T11:27:00.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.350+0000 7f736e9c1740 20 client.16242 trim_cache size 0 max 16384 2024-04-25T11:27:00.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 Processor -- start 2024-04-25T11:27:00.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 -- start start 2024-04-25T11:27:00.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8964f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e890620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f73601b0040 con 0x55bf4e4d26b0 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f73601ad910 con 0x55bf4e4ca4d0 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f736e9c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f73601ab760 con 0x55bf4e4f3390 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f73658a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f73658a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42566/0 (socket says 172.21.15.80:42566) 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.363+0000 7f73658a9640 1 -- 172.21.15.80:0/3753039898 learned_addr learned my addr 172.21.15.80:0/3753039898 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73650a8640 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73650a8640 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e890620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73658a9640 1 -- 172.21.15.80:0/3753039898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 msgr2=0x55bf4e890620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73658a9640 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e890620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73658a9640 1 -- 172.21.15.80:0/3753039898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 msgr2=0x55bf4e8964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73658a9640 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73658a9640 1 -- 172.21.15.80:0/3753039898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf4e896010 con 0x55bf4e4d26b0 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73650a8640 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e890620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73658a9640 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8ad0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f735800bc00 tx=0x7f7358012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7631e6a1b3ac81f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73477fe640 1 -- 172.21.15.80:0/3753039898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735801f020 con 0x55bf4e4d26b0 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73477fe640 1 -- 172.21.15.80:0/3753039898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f735801ba50 con 0x55bf4e4d26b0 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.364+0000 7f73477fe640 1 -- 172.21.15.80:0/3753039898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358011e90 con 0x55bf4e4d26b0 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 -- 172.21.15.80:0/3753039898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 msgr2=0x55bf4e8ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8ad0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f735800bc00 tx=0x7f7358012820 comp rx=0 tx=0).stop 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 -- 172.21.15.80:0/3753039898 shutdown_connections 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8ad0f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e890620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 --2- 172.21.15.80:0/3753039898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 -- 172.21.15.80:0/3753039898 >> 172.21.15.80:0/3753039898 conn(0x55bf4e4e74e0 msgr2=0x55bf4e8a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 -- 172.21.15.80:0/3753039898 shutdown_connections 2024-04-25T11:27:00.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 -- 172.21.15.80:0/3753039898 wait complete. 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 -- start start 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.365+0000 7f736e9c1740 1 Processor -- start 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e9199e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f73601abdd0 con 0x55bf4e4d26b0 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f73601ad240 con 0x55bf4e4ca4d0 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f73601ac4a0 con 0x55bf4e4f3390 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 10 client.0 _ll_register_callbacks cb 0x7f735400ad80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42574/0 (socket says 172.21.15.80:42574) 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 -- 172.21.15.80:0/1625232039 learned_addr learned my addr 172.21.15.80:0/1625232039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73650a8640 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 -- 172.21.15.80:0/1625232039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 msgr2=0x55bf4e9199e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e9199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 -- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 msgr2=0x55bf4e8a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 -- 172.21.15.80:0/1625232039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf4e919f20 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73650a8640 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73658a9640 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a6cf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7358006010 tx=0x7f7358011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1cce84aa03d91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73457fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73457fa640 1 -- 172.21.15.80:0/1625232039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735801f050 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f73457fa640 1 -- 172.21.15.80:0/1625232039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7358011850 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.366+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f735801ba50 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f73457fa640 1 -- 172.21.15.80:0/1625232039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f735801b3a0 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 10 client.16248 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bf4e91b070 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f73457fa640 1 -- 172.21.15.80:0/1625232039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f735801ba50 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f73457fa640 1 -- 172.21.15.80:0/1625232039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f735802b070 con 0x55bf4e4d26b0 2024-04-25T11:27:00.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 10 client.16248 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 10 client.16248 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 20 client.16248 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4873a0 0x55bf4e91d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 4 client.16248 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf4e801800 con 0x55bf4e4873a0 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.367+0000 7f73650a8640 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4873a0 0x55bf4e91d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f73457fa640 10 client.16248 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f73650a8640 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4873a0 0x55bf4e91d7e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b38f3d7f33e2cabb server_cookie=c7e17c1a29b28b08 in_seq=0 out_seq=0 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f73457fa640 1 -- 172.21.15.80:0/1625232039 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf4e801800 con 0x55bf4e4873a0 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f73457fa640 10 client.16248 handle_command_reply: tid=0 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 client.16248 shutdown 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 msgr2=0x55bf4e8a6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a6cf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7358006010 tx=0x7f7358011d00 comp rx=0 tx=0).stop 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 shutdown_connections 2024-04-25T11:27:00.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55bf4e4873a0 0x55bf4e91d7e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf4e4d26b0 0x55bf4e8a6cf0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f73457fa640 0 client.16248 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf4e4f3390 0x55bf4e9199e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 --2- 172.21.15.80:0/1625232039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf4e4ca4d0 0x55bf4e8a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 >> 172.21.15.80:0/1625232039 conn(0x55bf4e4e74e0 msgr2=0x55bf4e8ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 shutdown_connections 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 1 -- 172.21.15.80:0/1625232039 wait complete. 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.368+0000 7f736e9c1740 20 client.16248 trim_cache size 0 max 16384 2024-04-25T11:27:00.367 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:27:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f73480afc60 msgr2=0x7f73480b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f73480afc60 0x7f73480b2170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f73500fd610 tx=0x7f73500952c0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 msgr2=0x7f736019de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736019de00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7350004770 tx=0x7f7350004270 comp rx=0 tx=0).stop 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 shutdown_connections 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f73480afc60 0x7f73480b2170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f736010d380 0x7f736019de00 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7360108a20 0x7f7360199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 --2- 172.21.15.80:0/2427614308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7360102af0 0x7f73601995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 >> 172.21.15.80:0/2427614308 conn(0x7f7360078100 msgr2=0x7f73601040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 shutdown_connections 2024-04-25T11:27:00.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.369+0000 7f7367b0d640 1 -- 172.21.15.80:0/2427614308 wait complete. 2024-04-25T11:27:00.372 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:27:00.393 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:00 smithi080 ceph-mon[29126]: pgmap v86: 97 pgs: 97 active+clean; 515 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 22 MiB/s wr, 15 op/s 2024-04-25T11:27:00.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:00 smithi196 ceph-mon[32659]: pgmap v86: 97 pgs: 97 active+clean; 515 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 22 MiB/s wr, 15 op/s 2024-04-25T11:27:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.490+0000 7f4139a84640 1 -- 172.21.15.80:0/630430374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109fc0 msgr2=0x7f4134103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.490+0000 7f4139a84640 1 --2- 172.21.15.80:0/630430374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109fc0 0x7f4134103c00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4128009900 tx=0x7f412802a410 comp rx=0 tx=0).stop 2024-04-25T11:27:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.490+0000 7f4139a84640 1 -- 172.21.15.80:0/630430374 shutdown_connections 2024-04-25T11:27:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.490+0000 7f4139a84640 1 --2- 172.21.15.80:0/630430374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109fc0 0x7f4134103c00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.490+0000 7f4139a84640 1 --2- 172.21.15.80:0/630430374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4134104270 0x7f4134110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.490+0000 7f4139a84640 1 --2- 172.21.15.80:0/630430374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4134109b20 0x7f41341036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.490+0000 7f4139a84640 1 -- 172.21.15.80:0/630430374 >> 172.21.15.80:0/630430374 conn(0x7f41340ff1e0 msgr2=0x7f4134101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.491+0000 7f4139a84640 1 -- 172.21.15.80:0/630430374 shutdown_connections 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.491+0000 7f4139a84640 1 -- 172.21.15.80:0/630430374 wait complete. 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.491+0000 7f4139a84640 1 Processor -- start 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.491+0000 7f4139a84640 1 -- start start 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4134104270 0x7f413419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109b20 0x7f413419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4134109fc0 0x7f413419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4134113d30 con 0x7f4134109b20 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4134113bb0 con 0x7f4134109fc0 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4134113eb0 con 0x7f4134104270 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109b20 0x7f413419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109b20 0x7f413419ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42588/0 (socket says 172.21.15.80:42588) 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 -- 172.21.15.80:0/240947627 learned_addr learned my addr 172.21.15.80:0/240947627 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f41337fe640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4134104270 0x7f413419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4133fff640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4134109fc0 0x7f413419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 -- 172.21.15.80:0/240947627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4134104270 msgr2=0x7f413419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4134104270 0x7f413419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 -- 172.21.15.80:0/240947627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4134109fc0 msgr2=0x7f413419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4134109fc0 0x7f413419eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 -- 172.21.15.80:0/240947627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413419f630 con 0x7f4134109b20 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f41337fe640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4134104270 0x7f413419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4132ffd640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109b20 0x7f413419ad30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f412802a930 tx=0x7f4128004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4130ff9640 1 -- 172.21.15.80:0/240947627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412803f030 con 0x7f4134109b20 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4130ff9640 1 -- 172.21.15.80:0/240947627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4128003aa0 con 0x7f4134109b20 2024-04-25T11:27:00.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413419f8c0 con 0x7f4134109b20 2024-04-25T11:27:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4130ff9640 1 -- 172.21.15.80:0/240947627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128035070 con 0x7f4134109b20 2024-04-25T11:27:00.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.492+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413419fdb0 con 0x7f4134109b20 2024-04-25T11:27:00.493 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:00 smithi082 ceph-mon[32440]: pgmap v86: 97 pgs: 97 active+clean; 515 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 22 MiB/s wr, 15 op/s 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 Processor -- start 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 -- start start 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4130ff9640 1 -- 172.21.15.80:0/240947627 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f4128042030 con 0x7f4134109b20 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f959d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91d34d0 0x55d7f959dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 0x55d7f95aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d7f9502d80 con 0x55d7f91fc390 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d7f94bca20 con 0x55d7f91d34d0 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4140a06740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d7f94fed40 con 0x55d7f91db6b0 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f959d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f959d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42604/0 (socket says 172.21.15.80:42604) 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 -- 172.21.15.80:0/3612568564 learned_addr learned my addr 172.21.15.80:0/3612568564 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f41337fe640 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91d34d0 0x55d7f959dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4132ffd640 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 0x55d7f95aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 -- 172.21.15.80:0/3612568564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 msgr2=0x55d7f95aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 0x55d7f95aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 -- 172.21.15.80:0/3612568564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91d34d0 msgr2=0x55d7f959dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91d34d0 0x55d7f959dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f4133fff640 1 -- 172.21.15.80:0/3612568564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f94c7c30 con 0x55d7f91fc390 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.495+0000 7f41337fe640 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91d34d0 0x55d7f959dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.496+0000 7f4133fff640 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f959d810 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f412c009df0 tx=0x7f412c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f4d9682c086285 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.496+0000 7f4130ff9640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f411c0afc60 0x7f411c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.496+0000 7f4119ffb640 1 -- 172.21.15.80:0/3612568564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c003970 con 0x55d7f91fc390 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.496+0000 7f41337fe640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f411c0afc60 0x7f411c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.496+0000 7f4119ffb640 1 -- 172.21.15.80:0/3612568564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c004030 con 0x55d7f91fc390 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.496+0000 7f4119ffb640 1 -- 172.21.15.80:0/3612568564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c011720 con 0x55d7f91fc390 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.496+0000 7f4130ff9640 1 -- 172.21.15.80:0/240947627 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f41280ff810 con 0x7f4134109b20 2024-04-25T11:27:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 -- 172.21.15.80:0/3612568564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 msgr2=0x55d7f959d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f41337fe640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f411c0afc60 0x7f411c0b2170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55d7f959efe0 tx=0x7f4124009320 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f959d810 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f412c009df0 tx=0x7f412c00f730 comp rx=0 tx=0).stop 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 -- 172.21.15.80:0/3612568564 shutdown_connections 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 0x55d7f95aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91d34d0 0x55d7f959dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 --2- 172.21.15.80:0/3612568564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f959d810 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 -- 172.21.15.80:0/3612568564 >> 172.21.15.80:0/3612568564 conn(0x55d7f91f04e0 msgr2=0x55d7f9599fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 -- 172.21.15.80:0/3612568564 shutdown_connections 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 -- 172.21.15.80:0/3612568564 wait complete. 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 -- start start 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.497+0000 7f4140a06740 1 Processor -- start 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4140a06740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91d34d0 0x55d7f95a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4140a06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95a8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4140a06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f95b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4140a06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d7f95aad90 con 0x55d7f91fc390 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4140a06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d7f9489dc0 con 0x55d7f91db6b0 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4140a06740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d7f95aaf10 con 0x55d7f91d34d0 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4140a06740 10 client.0 _ll_register_callbacks cb 0x55d7f94a5600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f95b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f95b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42612/0 (socket says 172.21.15.80:42612) 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 -- 172.21.15.80:0/947491203 learned_addr learned my addr 172.21.15.80:0/947491203 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f41337fe640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91d34d0 0x55d7f95a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4132ffd640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 -- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91d34d0 msgr2=0x55d7f95a8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91d34d0 0x55d7f95a8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 -- 172.21.15.80:0/947491203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 msgr2=0x55d7f95a8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95a8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 -- 172.21.15.80:0/947491203 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f92143f0 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4132ffd640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95a8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4133fff640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f95b4210 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f412c009960 tx=0x7f412c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ba441c70b4a6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.498+0000 7f4112ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4112ffd640 1 -- 172.21.15.80:0/947491203 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c004580 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4112ffd640 1 -- 172.21.15.80:0/947491203 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f412c004c50 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412c004030 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4112ffd640 1 -- 172.21.15.80:0/947491203 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f412c004e50 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 10 client.16260 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d7f92de7d0 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4112ffd640 1 -- 172.21.15.80:0/947491203 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c004030 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4112ffd640 1 -- 172.21.15.80:0/947491203 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f412c0057f0 con 0x55d7f91fc390 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 10 client.16260 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 10 client.16260 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:27:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 20 client.16260 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91baf60 0x55d7f95ba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 4 client.16260 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.499+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7f9510990 con 0x55d7f91baf60 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.500+0000 7f41337fe640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91baf60 0x55d7f95ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.500+0000 7f4112ffd640 10 client.16260 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.500+0000 7f41337fe640 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91baf60 0x55d7f95ba590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43954568ebaea7d server_cookie=eff4c86f9f56c700 in_seq=0 out_seq=0 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4112ffd640 1 -- 172.21.15.80:0/947491203 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d7f9510990 con 0x55d7f91baf60 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4112ffd640 10 client.16260 handle_command_reply: tid=0 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 client.16260 shutdown 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 msgr2=0x55d7f95b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f95b4210 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f412c009960 tx=0x7f412c004410 comp rx=0 tx=0).stop 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 shutdown_connections 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91fc390 0x55d7f95b4210 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91baf60 0x55d7f95ba590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95a8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 --2- 172.21.15.80:0/947491203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91d34d0 0x55d7f95a8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4112ffd640 0 client.16260 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 >> 172.21.15.80:0/947491203 conn(0x55d7f91f04e0 msgr2=0x55d7f959f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 shutdown_connections 2024-04-25T11:27:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 1 -- 172.21.15.80:0/947491203 wait complete. 2024-04-25T11:27:00.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.501+0000 7f4140a06740 20 client.16260 trim_cache size 0 max 16384 2024-04-25T11:27:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 Processor -- start 2024-04-25T11:27:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 -- start start 2024-04-25T11:27:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95a2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 0x55d7f95a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91fc390 0x55d7f95a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41341b2300 con 0x55d7f91d34d0 2024-04-25T11:27:00.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41341afbd0 con 0x55d7f91fc390 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f4140a06740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41341ada20 con 0x55d7f91db6b0 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95a2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42618/0 (socket says 172.21.15.80:42618) 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 -- 172.21.15.80:0/4121722781 learned_addr learned my addr 172.21.15.80:0/4121722781 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 -- 172.21.15.80:0/4121722781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 msgr2=0x55d7f95a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 --2- 172.21.15.80:0/4121722781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 0x55d7f95a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 -- 172.21.15.80:0/4121722781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91fc390 msgr2=0x55d7f95a77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 --2- 172.21.15.80:0/4121722781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91fc390 0x55d7f95a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.515+0000 7f41337fe640 1 -- 172.21.15.80:0/4121722781 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f959f010 con 0x55d7f91d34d0 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f41337fe640 1 --2- 172.21.15.80:0/4121722781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95a2510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f41240092f0 tx=0x7f4124016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d92be4e23cf9b5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f41197fa640 1 -- 172.21.15.80:0/4121722781 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412402e070 con 0x55d7f91d34d0 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f41197fa640 1 -- 172.21.15.80:0/4121722781 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124029a50 con 0x55d7f91d34d0 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f41197fa640 1 -- 172.21.15.80:0/4121722781 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412401f420 con 0x55d7f91d34d0 2024-04-25T11:27:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f4140a06740 1 -- 172.21.15.80:0/4121722781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 msgr2=0x55d7f95a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f4140a06740 1 --2- 172.21.15.80:0/4121722781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95a2510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f41240092f0 tx=0x7f4124016000 comp rx=0 tx=0).stop 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f4140a06740 1 -- 172.21.15.80:0/4121722781 shutdown_connections 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f4140a06740 1 --2- 172.21.15.80:0/4121722781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91fc390 0x55d7f95a77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f4140a06740 1 --2- 172.21.15.80:0/4121722781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91db6b0 0x55d7f95a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f4140a06740 1 --2- 172.21.15.80:0/4121722781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95a2510 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.516+0000 7f4140a06740 1 -- 172.21.15.80:0/4121722781 >> 172.21.15.80:0/4121722781 conn(0x55d7f91f04e0 msgr2=0x55d7f95a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 -- 172.21.15.80:0/4121722781 shutdown_connections 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 -- 172.21.15.80:0/4121722781 wait complete. 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 -- start start 2024-04-25T11:27:00.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 Processor -- start 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95abb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91fc390 0x55d7f961a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41341ae090 con 0x55d7f91d34d0 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41341af500 con 0x55d7f91db6b0 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41341ae760 con 0x55d7f91fc390 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f4140a06740 10 client.0 _ll_register_callbacks cb 0x7f412c009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f41337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f41337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95ab5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42622/0 (socket says 172.21.15.80:42622) 2024-04-25T11:27:00.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.517+0000 7f41337fe640 1 -- 172.21.15.80:0/322198708 learned_addr learned my addr 172.21.15.80:0/322198708 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4132ffd640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4133fff640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91fc390 0x55d7f961a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f41337fe640 1 -- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91fc390 msgr2=0x55d7f961a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f41337fe640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91fc390 0x55d7f961a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f41337fe640 1 -- 172.21.15.80:0/322198708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 msgr2=0x55d7f95abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f41337fe640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f41337fe640 1 -- 172.21.15.80:0/322198708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f961ad20 con 0x55d7f91d34d0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4133fff640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91fc390 0x55d7f961a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f41337fe640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95ab5e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4124022e20 tx=0x7f4124022e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369c440fc00097f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4112ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4112ffd640 1 -- 172.21.15.80:0/322198708 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124039060 con 0x55d7f91d34d0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4112ffd640 1 -- 172.21.15.80:0/322198708 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f4124020da0 con 0x55d7f91d34d0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4124029a50 con 0x55d7f91d34d0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4112ffd640 1 -- 172.21.15.80:0/322198708 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f412402e040 con 0x55d7f91d34d0 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4140a06740 10 client.16266 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d7f9622010 con 0x55d7f91d34d0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.518+0000 7f4112ffd640 1 -- 172.21.15.80:0/322198708 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124029a50 con 0x55d7f91d34d0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4112ffd640 1 -- 172.21.15.80:0/322198708 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f412400f040 con 0x55d7f91d34d0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4140a06740 10 client.16266 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4140a06740 10 client.16266 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4140a06740 20 client.16266 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4140a06740 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91903a0 0x55d7f96246e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4140a06740 4 client.16266 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d7f959e0e0 con 0x55d7f91903a0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4132ffd640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91903a0 0x55d7f96246e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4112ffd640 10 client.16266 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.519+0000 7f4132ffd640 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91903a0 0x55d7f96246e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ada9e98c25b976e server_cookie=be1f717e8c2d9bec in_seq=0 out_seq=0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4112ffd640 1 -- 172.21.15.80:0/322198708 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d7f959e0e0 con 0x55d7f91903a0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4112ffd640 10 client.16266 handle_command_reply: tid=0 2024-04-25T11:27:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 client.16266 shutdown 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 msgr2=0x55d7f95ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95ab5e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4124022e20 tx=0x7f4124022e50 comp rx=0 tx=0).stop 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 shutdown_connections 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d7f91903a0 0x55d7f96246e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d7f91fc390 0x55d7f961a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7f91db6b0 0x55d7f95abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4112ffd640 0 client.16266 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 --2- 172.21.15.80:0/322198708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d7f91d34d0 0x55d7f95ab5e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 >> 172.21.15.80:0/322198708 conn(0x55d7f91f04e0 msgr2=0x55d7f9599f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 shutdown_connections 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 1 -- 172.21.15.80:0/322198708 wait complete. 2024-04-25T11:27:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4140a06740 20 client.16266 trim_cache size 0 max 16384 2024-04-25T11:27:00.519 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:27:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f411c0afc60 msgr2=0x7f411c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4139a84640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f411c0afc60 0x7f411c0b2170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55d7f959efe0 tx=0x7f4124009320 comp rx=0 tx=0).stop 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109b20 msgr2=0x7f413419ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.520+0000 7f4139a84640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109b20 0x7f413419ad30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f412802a930 tx=0x7f4128004270 comp rx=0 tx=0).stop 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 shutdown_connections 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f411c0afc60 0x7f411c0b2170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4134109b20 0x7f413419ad30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4134109fc0 0x7f413419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 --2- 172.21.15.80:0/240947627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4134104270 0x7f413419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 >> 172.21.15.80:0/240947627 conn(0x7f41340ff1e0 msgr2=0x7f413410f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 shutdown_connections 2024-04-25T11:27:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.521+0000 7f4139a84640 1 -- 172.21.15.80:0/240947627 wait complete. 2024-04-25T11:27:00.524 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 -- 172.21.15.80:0/3492224003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea4108a20 msgr2=0x7f2ea41025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 --2- 172.21.15.80:0/3492224003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea4108a20 0x7f2ea41025b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009900 tx=0x7f2ea002a410 comp rx=0 tx=0).stop 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 -- 172.21.15.80:0/3492224003 shutdown_connections 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 --2- 172.21.15.80:0/3492224003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea410d380 0x7f2ea410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 --2- 172.21.15.80:0/3492224003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ea4102af0 0x7f2ea4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 --2- 172.21.15.80:0/3492224003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea4108a20 0x7f2ea41025b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 -- 172.21.15.80:0/3492224003 >> 172.21.15.80:0/3492224003 conn(0x7f2ea4078100 msgr2=0x7f2ea4078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 -- 172.21.15.80:0/3492224003 shutdown_connections 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.683+0000 7f2eaba40640 1 -- 172.21.15.80:0/3492224003 wait complete. 2024-04-25T11:27:00.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 Processor -- start 2024-04-25T11:27:00.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 -- start start 2024-04-25T11:27:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea4102af0 0x7f2ea419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ea4108a20 0x7f2ea419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea410d380 0x7f2ea419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea406ac30 con 0x7f2ea410d380 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea406aab0 con 0x7f2ea4102af0 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2eaba40640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea406adb0 con 0x7f2ea4108a20 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2ea9fdd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea410d380 0x7f2ea419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2ea9fdd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea410d380 0x7f2ea419ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42640/0 (socket says 172.21.15.80:42640) 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2ea9fdd640 1 -- 172.21.15.80:0/1660877375 learned_addr learned my addr 172.21.15.80:0/1660877375 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea4102af0 0x7f2ea419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.684+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ea4108a20 0x7f2ea419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2ea9fdd640 1 -- 172.21.15.80:0/1660877375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ea4108a20 msgr2=0x7f2ea419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2ea9fdd640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ea4108a20 0x7f2ea419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2ea9fdd640 1 -- 172.21.15.80:0/1660877375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea4102af0 msgr2=0x7f2ea419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2ea9fdd640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea4102af0 0x7f2ea419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2ea9fdd640 1 -- 172.21.15.80:0/1660877375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea419f540 con 0x7f2ea410d380 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea4102af0 0x7f2ea419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:27:00.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2ea9fdd640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea410d380 0x7f2ea419ef00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00eb10 tx=0x7f2e9c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2e9a7fc640 1 -- 172.21.15.80:0/1660877375 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c004b20 con 0x7f2ea410d380 2024-04-25T11:27:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea419f830 con 0x7f2ea410d380 2024-04-25T11:27:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2e9a7fc640 1 -- 172.21.15.80:0/1660877375 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e9c004cc0 con 0x7f2ea410d380 2024-04-25T11:27:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2e9a7fc640 1 -- 172.21.15.80:0/1660877375 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c010670 con 0x7f2ea410d380 2024-04-25T11:27:00.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.685+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea419fd30 con 0x7f2ea410d380 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.688+0000 7f2eb29cd740 1 Processor -- start 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.688+0000 7f2e9a7fc640 1 -- 172.21.15.80:0/1660877375 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f2e9c010830 con 0x7f2ea410d380 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.688+0000 7f2eb29cd740 1 -- start start 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43cc9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cc9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fc43c2ed80 con 0x55fc43928390 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fc43be8a20 con 0x55fc438ff4d0 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fc43c2ad40 con 0x55fc439076b0 2024-04-25T11:27:00.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43cc9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea97dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cc9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43cc9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42642/0 (socket says 172.21.15.80:42642) 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/2287144520 learned_addr learned my addr 172.21.15.80:0/2287144520 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2e9a7fc640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2e900afc60 0x7f2e900b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/2287144520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 msgr2=0x55fc43cd66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/2287144520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 msgr2=0x55fc43cc9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cc9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/2287144520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc43bf3c30 con 0x55fc43928390 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cc9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2ea9fdd640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2e900afc60 0x7f2e900b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.689+0000 7f2e9a7fc640 1 -- 172.21.15.80:0/1660877375 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f2e9c0df5d0 con 0x7f2ea410d380 2024-04-25T11:27:00.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.690+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43cc9810 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011590 tx=0x7f2e940098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d16bf180c5e2cab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.690+0000 7f2e8f7fe640 1 -- 172.21.15.80:0/2287144520 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9401a030 con 0x55fc43928390 2024-04-25T11:27:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.690+0000 7f2e8f7fe640 1 -- 172.21.15.80:0/2287144520 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e94005020 con 0x55fc43928390 2024-04-25T11:27:00.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.690+0000 7f2e8f7fe640 1 -- 172.21.15.80:0/2287144520 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94004b20 con 0x55fc43928390 2024-04-25T11:27:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 -- 172.21.15.80:0/2287144520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 msgr2=0x55fc43cc9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2ea9fdd640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2e900afc60 0x7f2e900b2170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0dcde0 tx=0x7f2e9c004a40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43cc9810 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011590 tx=0x7f2e940098b0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 -- 172.21.15.80:0/2287144520 shutdown_connections 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cc9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/2287144520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43cc9810 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 -- 172.21.15.80:0/2287144520 >> 172.21.15.80:0/2287144520 conn(0x55fc4391c4e0 msgr2=0x55fc43cc5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 -- 172.21.15.80:0/2287144520 shutdown_connections 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 -- 172.21.15.80:0/2287144520 wait complete. 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.691+0000 7f2eb29cd740 1 -- start start 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 1 Processor -- start 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cd4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43ce0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fc43cd6d90 con 0x55fc43928390 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fc43bb5dc0 con 0x55fc438ff4d0 2024-04-25T11:27:00.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fc43cd6f10 con 0x55fc439076b0 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2eb29cd740 10 client.0 _ll_register_callbacks cb 0x55fc43bd1600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2ea8fdb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43ce0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2ea8fdb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43ce0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42654/0 (socket says 172.21.15.80:42654) 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2ea97dc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/3547572910 learned_addr learned my addr 172.21.15.80:0/3547572910 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.692+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cd4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/3547572910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 msgr2=0x55fc43cd4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 msgr2=0x55fc43cd4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cd4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/3547572910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc439403f0 con 0x55fc43928390 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43ce0210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009eb0 tx=0x7f2e94009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97357bf81421d74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2e8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:00.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2e8cff9640 1 -- 172.21.15.80:0/3547572910 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9401a050 con 0x55fc43928390 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2e8cff9640 1 -- 172.21.15.80:0/3547572910 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f2e940048a0 con 0x55fc43928390 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e94005020 con 0x55fc43928390 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2e8cff9640 1 -- 172.21.15.80:0/3547572910 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e94033050 con 0x55fc43928390 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2eb29cd740 10 client.16278 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc43a0a7d0 con 0x55fc43928390 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.693+0000 7f2e8cff9640 1 -- 172.21.15.80:0/3547572910 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e94005020 con 0x55fc43928390 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2e8cff9640 1 -- 172.21.15.80:0/3547572910 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2e94003b30 con 0x55fc43928390 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2eb29cd740 10 client.16278 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2eb29cd740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2eb29cd740 20 client.16278 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438e6f60 0x55fc43ce64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2eb29cd740 4 client.16278 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc43c3c990 con 0x55fc438e6f60 2024-04-25T11:27:00.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.694+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438e6f60 0x55fc43ce64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.695+0000 7f2e8cff9640 10 client.16278 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:00.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.695+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438e6f60 0x55fc43ce64e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534b0bde7ac5a5da server_cookie=61dd563b0d1ccaaf in_seq=0 out_seq=0 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2e8cff9640 1 -- 172.21.15.80:0/3547572910 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fc43c3c990 con 0x55fc438e6f60 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2e8cff9640 10 client.16278 handle_command_reply: tid=0 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 client.16278 shutdown 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 msgr2=0x55fc43ce0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43ce0210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009eb0 tx=0x7f2e94009660 comp rx=0 tx=0).stop 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 shutdown_connections 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438e6f60 0x55fc43ce64e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc43928390 0x55fc43ce0210 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/3547572910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc438ff4d0 0x55fc43cd4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 >> 172.21.15.80:0/3547572910 conn(0x55fc4391c4e0 msgr2=0x55fc43ccb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2e8cff9640 0 client.16278 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 shutdown_connections 2024-04-25T11:27:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 1 -- 172.21.15.80:0/3547572910 wait complete. 2024-04-25T11:27:00.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.696+0000 7f2eb29cd740 20 client.16278 trim_cache size 0 max 16384 2024-04-25T11:27:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 Processor -- start 2024-04-25T11:27:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 -- start start 2024-04-25T11:27:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc438ff4d0 0x55fc43cc5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc439076b0 0x55fc43cd4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cdfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41b2080 con 0x55fc439076b0 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41af950 con 0x55fc43928390 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41ad7a0 con 0x55fc438ff4d0 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc439076b0 0x55fc43cd4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc439076b0 0x55fc43cd4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42664/0 (socket says 172.21.15.80:42664) 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 -- 172.21.15.80:0/1248195802 learned_addr learned my addr 172.21.15.80:0/1248195802 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cdfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc438ff4d0 0x55fc43cc5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 -- 172.21.15.80:0/1248195802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc438ff4d0 msgr2=0x55fc43cc5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc438ff4d0 0x55fc43cc5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 -- 172.21.15.80:0/1248195802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 msgr2=0x55fc43cdfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cdfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea97dc640 1 -- 172.21.15.80:0/1248195802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc43cd6f50 con 0x55fc439076b0 2024-04-25T11:27:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.711+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc438ff4d0 0x55fc43cc5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.712+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc439076b0 0x55fc43cd4590 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0032fd0 tx=0x7f2ea0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223e54decb730a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.712+0000 7f2e8effd640 1 -- 172.21.15.80:0/1248195802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0035040 con 0x55fc439076b0 2024-04-25T11:27:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.712+0000 7f2e8effd640 1 -- 172.21.15.80:0/1248195802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea004b070 con 0x55fc439076b0 2024-04-25T11:27:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.712+0000 7f2e8effd640 1 -- 172.21.15.80:0/1248195802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00049d0 con 0x55fc439076b0 2024-04-25T11:27:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 -- 172.21.15.80:0/1248195802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc439076b0 msgr2=0x55fc43cd4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc439076b0 0x55fc43cd4590 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0032fd0 tx=0x7f2ea0031400 comp rx=0 tx=0).stop 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 -- 172.21.15.80:0/1248195802 shutdown_connections 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc439076b0 0x55fc43cd4590 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cdfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/1248195802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc438ff4d0 0x55fc43cc5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 -- 172.21.15.80:0/1248195802 >> 172.21.15.80:0/1248195802 conn(0x55fc4391c4e0 msgr2=0x55fc43cc58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 -- 172.21.15.80:0/1248195802 shutdown_connections 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 -- 172.21.15.80:0/1248195802 wait complete. 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 -- start start 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 Processor -- start 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc438ff4d0 0x55fc43cdc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.713+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cd76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41ade10 con 0x55fc438ff4d0 2024-04-25T11:27:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41af280 con 0x55fc43928390 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41ae4e0 con 0x55fc439076b0 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 10 client.0 _ll_register_callbacks cb 0x7f2e94005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc438ff4d0 0x55fc43cdc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc438ff4d0 0x55fc43cdc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42678/0 (socket says 172.21.15.80:42678) 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/665352095 learned_addr learned my addr 172.21.15.80:0/665352095 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cd76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/665352095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 msgr2=0x55fc43cd71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 msgr2=0x55fc43cd76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cd76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 -- 172.21.15.80:0/665352095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc43cd7e30 con 0x55fc438ff4d0 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2ea8fdb640 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc438ff4d0 0x55fc43cdc7e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011590 tx=0x7f2e94009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3b3c004cd5635f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2e8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:00.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2e8cff9640 1 -- 172.21.15.80:0/665352095 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9403b070 con 0x55fc438ff4d0 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2e8cff9640 1 -- 172.21.15.80:0/665352095 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f2e94005b90 con 0x55fc438ff4d0 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea004b070 con 0x55fc438ff4d0 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2e8cff9640 1 -- 172.21.15.80:0/665352095 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e94047050 con 0x55fc438ff4d0 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 10 client.16284 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.714+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc43d4d500 con 0x55fc438ff4d0 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2e8cff9640 1 -- 172.21.15.80:0/665352095 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea004b070 con 0x55fc438ff4d0 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2e8cff9640 1 -- 172.21.15.80:0/665352095 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2e94003890 con 0x55fc438ff4d0 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2eb29cd740 10 client.16284 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2eb29cd740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2eb29cd740 20 client.16284 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438bc3a0 0x55fc43d4fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2eb29cd740 4 client.16284 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:27:00.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc43c36800 con 0x55fc438bc3a0 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.715+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438bc3a0 0x55fc43d4fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2e8cff9640 10 client.16284 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2ea97dc640 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438bc3a0 0x55fc43d4fc30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d807e7507db2f34 server_cookie=2a785b675d911148 in_seq=0 out_seq=0 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2e8cff9640 1 -- 172.21.15.80:0/665352095 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc43c36800 con 0x55fc438bc3a0 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2e8cff9640 10 client.16284 handle_command_reply: tid=0 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 client.16284 shutdown 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc438ff4d0 msgr2=0x55fc43cdc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc438ff4d0 0x55fc43cdc7e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011590 tx=0x7f2e94009660 comp rx=0 tx=0).stop 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 shutdown_connections 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55fc438bc3a0 0x55fc43d4fc30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc43928390 0x55fc43cd76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fc439076b0 0x55fc43cd71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2e8cff9640 0 client.16284 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:00.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 --2- 172.21.15.80:0/665352095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc438ff4d0 0x55fc43cdc7e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 >> 172.21.15.80:0/665352095 conn(0x55fc4391c4e0 msgr2=0x55fc43cd56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 shutdown_connections 2024-04-25T11:27:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 1 -- 172.21.15.80:0/665352095 wait complete. 2024-04-25T11:27:00.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.716+0000 7f2eb29cd740 20 client.16284 trim_cache size 0 max 16384 2024-04-25T11:27:00.716 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2e900afc60 msgr2=0x7f2e900b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2e900afc60 0x7f2e900b2170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0dcde0 tx=0x7f2e9c004a40 comp rx=0 tx=0).stop 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea410d380 msgr2=0x7f2ea419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea410d380 0x7f2ea419ef00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00eb10 tx=0x7f2e9c00c2d0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 shutdown_connections 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2e900afc60 0x7f2e900b2170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ea410d380 0x7f2ea419ef00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ea4108a20 0x7f2ea419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 --2- 172.21.15.80:0/1660877375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea4102af0 0x7f2ea419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 >> 172.21.15.80:0/1660877375 conn(0x7f2ea4078100 msgr2=0x7f2ea41040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 shutdown_connections 2024-04-25T11:27:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:00.717+0000 7f2eaba40640 1 -- 172.21.15.80:0/1660877375 wait complete. 2024-04-25T11:27:01.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:01 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/475240249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:27:01.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:01 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/475240249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:27:01.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:01 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/475240249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:27:01.721 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:27:01.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:27:01.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 -- 172.21.15.80:0/3181922963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 msgr2=0x7f9c30110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3181922963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c30110560 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009ca0 tx=0x7f9c2802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 -- 172.21.15.80:0/3181922963 shutdown_connections 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3181922963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c30110560 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3181922963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c3010b660 0x7f9c3010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3181922963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c30104c00 0x7f9c30105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 -- 172.21.15.80:0/3181922963 >> 172.21.15.80:0/3181922963 conn(0x7f9c300fe260 msgr2=0x7f9c30100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 -- 172.21.15.80:0/3181922963 shutdown_connections 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 -- 172.21.15.80:0/3181922963 wait complete. 2024-04-25T11:27:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 Processor -- start 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.859+0000 7f9c37e51640 1 -- start start 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c37e51640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c30104c00 0x7f9c3019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c37e51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3010b660 0x7f9c3019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c37e51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c3019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c37e51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30113cf0 con 0x7f9c3010e050 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c37e51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30113b70 con 0x7f9c3010b660 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c37e51640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30113e70 con 0x7f9c30104c00 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c3019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c3019ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42692/0 (socket says 172.21.15.80:42692) 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 -- 172.21.15.80:0/3274450833 learned_addr learned my addr 172.21.15.80:0/3274450833 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c353ec640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3010b660 0x7f9c3019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c35bed640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c30104c00 0x7f9c3019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 -- 172.21.15.80:0/3274450833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c30104c00 msgr2=0x7f9c3019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c30104c00 0x7f9c3019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 -- 172.21.15.80:0/3274450833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3010b660 msgr2=0x7f9c3019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3010b660 0x7f9c3019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 -- 172.21.15.80:0/3274450833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3019f570 con 0x7f9c3010e050 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.860+0000 7f9c363ee640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c3019ef30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9c28005cc0 tx=0x7f9c2802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.861+0000 7f9c26ffd640 1 -- 172.21.15.80:0/3274450833 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28003bf0 con 0x7f9c3010e050 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.861+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3019f800 con 0x7f9c3010e050 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.861+0000 7f9c26ffd640 1 -- 172.21.15.80:0/3274450833 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c28003d90 con 0x7f9c3010e050 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.861+0000 7f9c26ffd640 1 -- 172.21.15.80:0/3274450833 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2802fbc0 con 0x7f9c3010e050 2024-04-25T11:27:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.861+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3019fd50 con 0x7f9c3010e050 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.863+0000 7f9c26ffd640 1 -- 172.21.15.80:0/3274450833 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f9c2802fd60 con 0x7f9c3010e050 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 Processor -- start 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 -- start start 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d901d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d901db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d901e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5652d8f83b00 con 0x5652d8c5c730 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5652d8f1f920 con 0x5652d8c54550 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5652d8f7fac0 con 0x5652d8c7d410 2024-04-25T11:27:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c26ffd640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c1c0afc60 0x7f9c1c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c353ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d901e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c353ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d901e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42708/0 (socket says 172.21.15.80:42708) 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c353ec640 1 -- 172.21.15.80:0/2639776771 learned_addr learned my addr 172.21.15.80:0/2639776771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c363ee640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c1c0afc60 0x7f9c1c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c35bed640 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d901db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.864+0000 7f9c353ec640 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d901d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c26ffd640 1 -- 172.21.15.80:0/3274450833 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f9c281005d0 con 0x7f9c3010e050 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c35bed640 1 -- 172.21.15.80:0/2639776771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 msgr2=0x5652d901d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c35bed640 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d901d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c35bed640 1 -- 172.21.15.80:0/2639776771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 msgr2=0x5652d901e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c35bed640 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d901e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c35bed640 1 -- 172.21.15.80:0/2639776771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d8d5d7e0 con 0x5652d8c54550 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c353ec640 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d901e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c363ee640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c1c0afc60 0x7f9c1c0b2170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c280fdef0 tx=0x7f9c280f6fe0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c35bed640 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d901db60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006c540 tx=0x7f9c2c00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df047ce9c361c63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c1bfff640 1 -- 172.21.15.80:0/2639776771 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c003dd0 con 0x5652d8c54550 2024-04-25T11:27:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c1bfff640 1 -- 172.21.15.80:0/2639776771 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c2c015070 con 0x5652d8c54550 2024-04-25T11:27:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.865+0000 7f9c1bfff640 1 -- 172.21.15.80:0/2639776771 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0116a0 con 0x5652d8c54550 2024-04-25T11:27:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 -- 172.21.15.80:0/2639776771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 msgr2=0x5652d901db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d901db60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006c540 tx=0x7f9c2c00bb20 comp rx=0 tx=0).stop 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 -- 172.21.15.80:0/2639776771 shutdown_connections 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d901e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d901db60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/2639776771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d901d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 -- 172.21.15.80:0/2639776771 >> 172.21.15.80:0/2639776771 conn(0x5652d8c71560 msgr2=0x5652d9019dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 -- 172.21.15.80:0/2639776771 shutdown_connections 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.866+0000 7f9c3edd6740 1 -- 172.21.15.80:0/2639776771 wait complete. 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 -- start start 2024-04-25T11:27:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 Processor -- start 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9027c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90281c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d902ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5652d902a970 con 0x5652d8c5c730 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5652d8f1d5d0 con 0x5652d8c54550 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5652d902aaf0 con 0x5652d8c7d410 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c3edd6740 10 client.0 _ll_register_callbacks cb 0x5652d8f0b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c35bed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.867+0000 7f9c35bed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90281c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42712/0 (socket says 172.21.15.80:42712) 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c35bed640 1 -- 172.21.15.80:0/1137257665 learned_addr learned my addr 172.21.15.80:0/1137257665 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c353ec640 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9027c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c353ec640 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d902ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c35bed640 1 -- 172.21.15.80:0/1137257665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 msgr2=0x5652d902ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c35bed640 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d902ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c35bed640 1 -- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 msgr2=0x5652d9027c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c35bed640 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9027c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c35bed640 1 -- 172.21.15.80:0/1137257665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d8dbdf70 con 0x5652d8c5c730 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c35bed640 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90281c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01acf0 tx=0x7f9c2c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87235cb628e0d6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c197fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c197fa640 1 -- 172.21.15.80:0/1137257665 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c003de0 con 0x5652d8c5c730 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c197fa640 1 -- 172.21.15.80:0/1137257665 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f9c2c01a470 con 0x5652d8c5c730 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c2c015070 con 0x5652d8c5c730 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c197fa640 1 -- 172.21.15.80:0/1137257665 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c2c01a670 con 0x5652d8c5c730 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c3edd6740 10 client.16296 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.868+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5652d8c55170 con 0x5652d8c5c730 2024-04-25T11:27:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c197fa640 1 -- 172.21.15.80:0/1137257665 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c2c015070 con 0x5652d8c5c730 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c197fa640 1 -- 172.21.15.80:0/1137257665 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9c2c011ce0 con 0x5652d8c5c730 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c3edd6740 10 client.16296 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c3edd6740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c3edd6740 20 client.16296 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c3c1f0 0x5652d9039f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c3edd6740 4 client.16296 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652d8f91710 con 0x5652d8c3c1f0 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.869+0000 7f9c353ec640 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c3c1f0 0x5652d9039f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.870+0000 7f9c197fa640 10 client.16296 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.870+0000 7f9c353ec640 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c3c1f0 0x5652d9039f60 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=748557e1ea85cd18 server_cookie=164b138cdcb52647 in_seq=0 out_seq=0 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.870+0000 7f9c197fa640 1 -- 172.21.15.80:0/1137257665 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5652d8f91710 con 0x5652d8c3c1f0 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.870+0000 7f9c197fa640 10 client.16296 handle_command_reply: tid=0 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.870+0000 7f9c3edd6740 1 client.16296 shutdown 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 msgr2=0x5652d90281c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90281c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01acf0 tx=0x7f9c2c005760 comp rx=0 tx=0).stop 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 shutdown_connections 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c3c1f0 0x5652d9039f60 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90281c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c7d410 0x5652d902ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/1137257665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9027c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c197fa640 0 client.16296 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 >> 172.21.15.80:0/1137257665 conn(0x5652d8c71560 msgr2=0x5652d901d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 shutdown_connections 2024-04-25T11:27:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 1 -- 172.21.15.80:0/1137257665 wait complete. 2024-04-25T11:27:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.871+0000 7f9c3edd6740 20 client.16296 trim_cache size 0 max 16384 2024-04-25T11:27:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 Processor -- start 2024-04-25T11:27:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 -- start start 2024-04-25T11:27:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c54550 0x5652d9027620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90217e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c7d410 0x5652d902dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301b2210 con 0x5652d8c5c730 2024-04-25T11:27:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301afae0 con 0x5652d8c7d410 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301ad930 con 0x5652d8c54550 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c35bed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c35bed640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42720/0 (socket says 172.21.15.80:42720) 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c35bed640 1 -- 172.21.15.80:0/245414866 learned_addr learned my addr 172.21.15.80:0/245414866 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c353ec640 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c7d410 0x5652d902dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c353ec640 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c54550 0x5652d9027620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c35bed640 1 -- 172.21.15.80:0/245414866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c54550 msgr2=0x5652d9027620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.889+0000 7f9c35bed640 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c54550 0x5652d9027620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c35bed640 1 -- 172.21.15.80:0/245414866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c7d410 msgr2=0x5652d902dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c35bed640 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c7d410 0x5652d902dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c35bed640 1 -- 172.21.15.80:0/245414866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d902a850 con 0x5652d8c5c730 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c353ec640 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c54550 0x5652d9027620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c35bed640 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90217e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0104e0 tx=0x7f9c2c00bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d44f9f881dfcb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c1b7fe640 1 -- 172.21.15.80:0/245414866 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c003de0 con 0x5652d8c5c730 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c1b7fe640 1 -- 172.21.15.80:0/245414866 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c2c015070 con 0x5652d8c5c730 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.890+0000 7f9c1b7fe640 1 -- 172.21.15.80:0/245414866 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c01ab40 con 0x5652d8c5c730 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 -- 172.21.15.80:0/245414866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 msgr2=0x5652d90217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90217e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0104e0 tx=0x7f9c2c00bb20 comp rx=0 tx=0).stop 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 -- 172.21.15.80:0/245414866 shutdown_connections 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c5c730 0x5652d90217e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c7d410 0x5652d902dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/245414866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c54550 0x5652d9027620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 -- 172.21.15.80:0/245414866 >> 172.21.15.80:0/245414866 conn(0x5652d8c71560 msgr2=0x5652d90210d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 -- 172.21.15.80:0/245414866 shutdown_connections 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 -- 172.21.15.80:0/245414866 wait complete. 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 -- start start 2024-04-25T11:27:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.891+0000 7f9c3edd6740 1 Processor -- start 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9034370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c5c730 0x5652d90348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c7d410 0x5652d902f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301adfa0 con 0x5652d8c7d410 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301af410 con 0x5652d8c54550 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301ae670 con 0x5652d8c5c730 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 10 client.0 _ll_register_callbacks cb 0x7f9c2c0043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c7d410 0x5652d902f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c7d410 0x5652d902f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42724/0 (socket says 172.21.15.80:42724) 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 -- 172.21.15.80:0/3693578198 learned_addr learned my addr 172.21.15.80:0/3693578198 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c35bed640 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c5c730 0x5652d90348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9034370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 -- 172.21.15.80:0/3693578198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c5c730 msgr2=0x5652d90348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c5c730 0x5652d90348b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 -- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 msgr2=0x5652d9034370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9034370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 -- 172.21.15.80:0/3693578198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d902ff60 con 0x5652d8c7d410 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c353ec640 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c7d410 0x5652d902f7d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x5652d901b0a0 tx=0x7f9c20014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5554a346fa7e6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c197fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c197fa640 1 -- 172.21.15.80:0/3693578198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200129c0 con 0x5652d8c7d410 2024-04-25T11:27:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c197fa640 1 -- 172.21.15.80:0/3693578198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f9c20012b60 con 0x5652d8c7d410 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.892+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c2c015070 con 0x5652d8c7d410 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c197fa640 1 -- 172.21.15.80:0/3693578198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c20005020 con 0x5652d8c7d410 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 10 client.16302 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5652d90a1ca0 con 0x5652d8c7d410 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c197fa640 1 -- 172.21.15.80:0/3693578198 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c2c015070 con 0x5652d8c7d410 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c197fa640 1 -- 172.21.15.80:0/3693578198 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9c200035f0 con 0x5652d8c7d410 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 10 client.16302 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 20 client.16302 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c11630 0x5652d90a4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 4 client.16302 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5652d9034e10 con 0x5652d8c11630 2024-04-25T11:27:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.893+0000 7f9c35bed640 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c11630 0x5652d90a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.894+0000 7f9c197fa640 10 client.16302 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.894+0000 7f9c35bed640 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c11630 0x5652d90a4490 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cca42d132a8922e4 server_cookie=f1c57104ebec0494 in_seq=0 out_seq=0 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c197fa640 1 -- 172.21.15.80:0/3693578198 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5652d9034e10 con 0x5652d8c11630 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c197fa640 10 client.16302 handle_command_reply: tid=0 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 client.16302 shutdown 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c7d410 msgr2=0x5652d902f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c7d410 0x5652d902f7d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x5652d901b0a0 tx=0x7f9c20014040 comp rx=0 tx=0).stop 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 shutdown_connections 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5652d8c11630 0x5652d90a4490 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5652d8c7d410 0x5652d902f7d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c197fa640 0 client.16302 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5652d8c5c730 0x5652d90348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 --2- 172.21.15.80:0/3693578198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652d8c54550 0x5652d9034370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 >> 172.21.15.80:0/3693578198 conn(0x5652d8c71560 msgr2=0x5652d90184c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 shutdown_connections 2024-04-25T11:27:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 1 -- 172.21.15.80:0/3693578198 wait complete. 2024-04-25T11:27:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.895+0000 7f9c3edd6740 20 client.16302 trim_cache size 0 max 16384 2024-04-25T11:27:01.893 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:27:01.893 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:27:01.893 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "85853397-ca6a-42c1-9eab-8489d9f7e4e3", 2024-04-25T11:27:01.893 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:27:01.893 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c1c0afc60 msgr2=0x7f9c1c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c1c0afc60 0x7f9c1c0b2170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c280fdef0 tx=0x7f9c280f6fe0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 msgr2=0x7f9c3019ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c3019ef30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9c28005cc0 tx=0x7f9c2802f380 comp rx=0 tx=0).stop 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 shutdown_connections 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c1c0afc60 0x7f9c1c0b2170 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c3010e050 0x7f9c3019ef30 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3010b660 0x7f9c3019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 --2- 172.21.15.80:0/3274450833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c30104c00 0x7f9c3019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 >> 172.21.15.80:0/3274450833 conn(0x7f9c300fe260 msgr2=0x7f9c3010e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 shutdown_connections 2024-04-25T11:27:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:01.896+0000 7f9c37e51640 1 -- 172.21.15.80:0/3274450833 wait complete. 2024-04-25T11:27:01.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:27:01.899 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:27:02.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2017772924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102720 msgr2=0x7fb2f0110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2017772924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102720 0x7fb2f0110570 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009ca0 tx=0x7fb2e802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2017772924 shutdown_connections 2024-04-25T11:27:02.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2017772924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102720 0x7fb2f0110570 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2017772924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2f0109f90 0x7fb2f01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2017772924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0109af0 0x7fb2f0101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2017772924 >> 172.21.15.80:0/2017772924 conn(0x7fb2f0077880 msgr2=0x7fb2f0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2017772924 shutdown_connections 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2017772924 wait complete. 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.017+0000 7fb2f5bb2640 1 Processor -- start 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2f5bb2640 1 -- start start 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2f5bb2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0102720 0x7fb2f019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2f5bb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0109af0 0x7fb2f019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2f5bb2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2f0109f90 0x7fb2f019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2f5bb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0113d30 con 0x7fb2f0109af0 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2f5bb2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0113bb0 con 0x7fb2f0102720 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2f5bb2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0113eb0 con 0x7fb2f0109f90 2024-04-25T11:27:02.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0109af0 0x7fb2f019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0109af0 0x7fb2f019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42738/0 (socket says 172.21.15.80:42738) 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 -- 172.21.15.80:0/2193342016 learned_addr learned my addr 172.21.15.80:0/2193342016 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0102720 0x7fb2f019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2effff640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2f0109f90 0x7fb2f019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 -- 172.21.15.80:0/2193342016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2f0109f90 msgr2=0x7fb2f019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2f0109f90 0x7fb2f019eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 -- 172.21.15.80:0/2193342016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0102720 msgr2=0x7fb2f019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0102720 0x7fb2f019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 -- 172.21.15.80:0/2193342016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f019f4f0 con 0x7fb2f0109af0 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0109af0 0x7fb2f019abf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400d740 tx=0x7fb2e400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:02.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.018+0000 7fb2ecff9640 1 -- 172.21.15.80:0/2193342016 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4017070 con 0x7fb2f0109af0 2024-04-25T11:27:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.019+0000 7fb2ecff9640 1 -- 172.21.15.80:0/2193342016 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e400de50 con 0x7fb2f0109af0 2024-04-25T11:27:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.019+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f019f7e0 con 0x7fb2f0109af0 2024-04-25T11:27:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.019+0000 7fb2ecff9640 1 -- 172.21.15.80:0/2193342016 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4004ce0 con 0x7fb2f0109af0 2024-04-25T11:27:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.019+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f019fce0 con 0x7fb2f0109af0 2024-04-25T11:27:02.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 Processor -- start 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2ecff9640 1 -- 172.21.15.80:0/2193342016 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fb2e4010460 con 0x7fb2f0109af0 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 -- start start 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd3712da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd3712dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd3713a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bd37093d80 con 0x55bd36d644d0 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd3704d8b0 con 0x55bd36d6c6b0 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2fca64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bd3708fd40 con 0x55bd36d8d390 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2ef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd3712dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2ef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd3712dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42748/0 (socket says 172.21.15.80:42748) 2024-04-25T11:27:02.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/2788595865 learned_addr learned my addr 172.21.15.80:0/2788595865 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.021+0000 7fb2effff640 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd3712da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd3713a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/2788595865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 msgr2=0x55bd3712da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd3712da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/2788595865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 msgr2=0x55bd3713a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd3713a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/2788595865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd3701ea40 con 0x55bd36d644d0 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ecff9640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb2d80afc60 0x7fb2d80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd3712dfa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009c80 tx=0x7fb2e00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f485ee6637b92a16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2effff640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb2d80afc60 0x7fb2d80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2ecff9640 1 -- 172.21.15.80:0/2193342016 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb2e40deb10 con 0x7fb2f0109af0 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2d5ffb640 1 -- 172.21.15.80:0/2788595865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0012450 con 0x55bd36d644d0 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2d5ffb640 1 -- 172.21.15.80:0/2788595865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e0012aa0 con 0x55bd36d644d0 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.022+0000 7fb2d5ffb640 1 -- 172.21.15.80:0/2788595865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000fad0 con 0x55bd36d644d0 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 -- 172.21.15.80:0/2788595865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 msgr2=0x55bd3712dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd3712dfa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009c80 tx=0x7fb2e00117b0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2effff640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb2d80afc60 0x7fb2d80b2170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8006010 tx=0x7fb2e8005d80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 -- 172.21.15.80:0/2788595865 shutdown_connections 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd3712dfa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd3713a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2788595865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd3712da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 -- 172.21.15.80:0/2788595865 >> 172.21.15.80:0/2788595865 conn(0x55bd36d814e0 msgr2=0x55bd3712a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:02.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 -- 172.21.15.80:0/2788595865 shutdown_connections 2024-04-25T11:27:02.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 -- 172.21.15.80:0/2788595865 wait complete. 2024-04-25T11:27:02.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.023+0000 7fb2fca64740 1 -- start start 2024-04-25T11:27:02.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 1 Processor -- start 2024-04-25T11:27:02.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd37138580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd37138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd37144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bd3713afe0 con 0x55bd36d644d0 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd3701ad10 con 0x55bd36d6c6b0 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bd3713b160 con 0x55bd36d8d390 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2fca64740 10 client.0 _ll_register_callbacks cb 0x55bd37047210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd37138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd37138580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42758/0 (socket says 172.21.15.80:42758) 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/3245772185 learned_addr learned my addr 172.21.15.80:0/3245772185 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2effff640 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd37144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd37138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/3245772185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 msgr2=0x55bd37144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd37144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 msgr2=0x55bd37138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd37138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.024+0000 7fb2ef7fe640 1 -- 172.21.15.80:0/3245772185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd36e6f7d0 con 0x55bd36d644d0 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd37138580 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0000c00 tx=0x7fb2e0009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dfe20a8d6405d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2ceffd640 1 -- 172.21.15.80:0/3245772185 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0028020 con 0x55bd36d644d0 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2ceffd640 1 -- 172.21.15.80:0/3245772185 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb2e0004450 con 0x55bd36d644d0 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2e0012aa0 con 0x55bd36d644d0 2024-04-25T11:27:02.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2ceffd640 1 -- 172.21.15.80:0/3245772185 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb2e0033050 con 0x55bd36d644d0 2024-04-25T11:27:02.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 10 client.16314 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:02.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bd36da53f0 con 0x55bd36d644d0 2024-04-25T11:27:02.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2ceffd640 1 -- 172.21.15.80:0/3245772185 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e0012aa0 con 0x55bd36d644d0 2024-04-25T11:27:02.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2ceffd640 1 -- 172.21.15.80:0/3245772185 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb2e00035f0 con 0x55bd36d644d0 2024-04-25T11:27:02.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 10 client.16314 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:02.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:02.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 20 client.16314 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d4bf60 0x55bd3714a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 4 client.16314 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd370a1990 con 0x55bd36d4bf60 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.025+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d4bf60 0x55bd3714a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.026+0000 7fb2ceffd640 10 client.16314 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.026+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d4bf60 0x55bd3714a580 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c329a296ba8018 server_cookie=8d80636e1a00647c in_seq=0 out_seq=0 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.026+0000 7fb2ceffd640 1 -- 172.21.15.80:0/3245772185 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bd370a1990 con 0x55bd36d4bf60 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.026+0000 7fb2ceffd640 10 client.16314 handle_command_reply: tid=0 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 client.16314 shutdown 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 msgr2=0x55bd37138580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd37138580 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0000c00 tx=0x7fb2e0009980 comp rx=0 tx=0).stop 2024-04-25T11:27:02.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 shutdown_connections 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d4bf60 0x55bd3714a580 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d8d390 0x55bd37144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd37138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 --2- 172.21.15.80:0/3245772185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d644d0 0x55bd37138580 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2ceffd640 0 client.16314 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 >> 172.21.15.80:0/3245772185 conn(0x55bd36d814e0 msgr2=0x55bd3712f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 shutdown_connections 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 1 -- 172.21.15.80:0/3245772185 wait complete. 2024-04-25T11:27:02.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.027+0000 7fb2fca64740 20 client.16314 trim_cache size 0 max 16384 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 Processor -- start 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 -- start start 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d644d0 0x55bd37137220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d6c6b0 0x55bd37140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd37140970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f01b2220 con 0x55bd36d8d390 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f01afaf0 con 0x55bd36d644d0 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2fca64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f01ad940 con 0x55bd36d6c6b0 2024-04-25T11:27:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd37140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd37140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42766/0 (socket says 172.21.15.80:42766) 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 -- 172.21.15.80:0/611006697 learned_addr learned my addr 172.21.15.80:0/611006697 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d644d0 0x55bd37137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d6c6b0 0x55bd37140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 -- 172.21.15.80:0/611006697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d6c6b0 msgr2=0x55bd37140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d6c6b0 0x55bd37140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 -- 172.21.15.80:0/611006697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d644d0 msgr2=0x55bd37137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d644d0 0x55bd37137220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2effff640 1 -- 172.21.15.80:0/611006697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd3714a8f0 con 0x55bd36d8d390 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.045+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d644d0 0x55bd37137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2effff640 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd37140970 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009ca0 tx=0x7fb2e8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8caf03f439dc231 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2d57fa640 1 -- 172.21.15.80:0/611006697 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80318e0 con 0x55bd36d8d390 2024-04-25T11:27:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2d57fa640 1 -- 172.21.15.80:0/611006697 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e8036050 con 0x55bd36d8d390 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2d57fa640 1 -- 172.21.15.80:0/611006697 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e802f610 con 0x55bd36d8d390 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2fca64740 1 -- 172.21.15.80:0/611006697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 msgr2=0x55bd37140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2fca64740 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd37140970 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009ca0 tx=0x7fb2e8040000 comp rx=0 tx=0).stop 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2fca64740 1 -- 172.21.15.80:0/611006697 shutdown_connections 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2fca64740 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd37140970 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2fca64740 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d6c6b0 0x55bd37140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.046+0000 7fb2fca64740 1 --2- 172.21.15.80:0/611006697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d644d0 0x55bd37137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 -- 172.21.15.80:0/611006697 >> 172.21.15.80:0/611006697 conn(0x55bd36d814e0 msgr2=0x55bd37136b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 -- 172.21.15.80:0/611006697 shutdown_connections 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 -- 172.21.15.80:0/611006697 wait complete. 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 -- start start 2024-04-25T11:27:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 Processor -- start 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d644d0 0x55bd371aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd371aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd3713b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f01adfb0 con 0x55bd36d8d390 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f01af420 con 0x55bd36d6c6b0 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f01ae680 con 0x55bd36d644d0 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2fca64740 10 client.0 _ll_register_callbacks cb 0x7fb2e0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.047+0000 7fb2effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd3713b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd3713b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42782/0 (socket says 172.21.15.80:42782) 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 -- 172.21.15.80:0/2898158347 learned_addr learned my addr 172.21.15.80:0/2898158347 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d644d0 0x55bd371aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2eeffd640 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd371aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 -- 172.21.15.80:0/2898158347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d644d0 msgr2=0x55bd371aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d644d0 0x55bd371aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 -- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 msgr2=0x55bd371aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd371aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 -- 172.21.15.80:0/2898158347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd36d650f0 con 0x55bd36d8d390 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2effff640 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd3713b7d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8005e30 tx=0x7fb2e8009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406b59610dc5c1b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2ceffd640 1 -- 172.21.15.80:0/2898158347 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8004250 con 0x55bd36d8d390 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2ceffd640 1 -- 172.21.15.80:0/2898158347 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb2e804f050 con 0x55bd36d8d390 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2e8036050 con 0x55bd36d8d390 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2ceffd640 1 -- 172.21.15.80:0/2898158347 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb2e80043f0 con 0x55bd36d8d390 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2fca64740 10 client.16320 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bd370544b0 con 0x55bd36d8d390 2024-04-25T11:27:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.048+0000 7fb2ceffd640 1 -- 172.21.15.80:0/2898158347 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e8036050 con 0x55bd36d8d390 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2ceffd640 1 -- 172.21.15.80:0/2898158347 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb2e80307c0 con 0x55bd36d8d390 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2fca64740 10 client.16320 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2fca64740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2fca64740 20 client.16320 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d213a0 0x55bd371b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2fca64740 4 client.16320 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bd3709b800 con 0x55bd36d213a0 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d213a0 0x55bd371b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2ceffd640 10 client.16320 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.049+0000 7fb2ef7fe640 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d213a0 0x55bd371b4360 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2a02520954d214f server_cookie=45b2646b6ef557aa in_seq=0 out_seq=0 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2ceffd640 1 -- 172.21.15.80:0/2898158347 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55bd3709b800 con 0x55bd36d213a0 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2ceffd640 10 client.16320 handle_command_reply: tid=0 2024-04-25T11:27:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 client.16320 shutdown 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 msgr2=0x55bd3713b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd3713b7d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8005e30 tx=0x7fb2e8009450 comp rx=0 tx=0).stop 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 shutdown_connections 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bd36d213a0 0x55bd371b4360 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd36d8d390 0x55bd3713b7d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd36d6c6b0 0x55bd371aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2ceffd640 0 client.16320 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 --2- 172.21.15.80:0/2898158347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd36d644d0 0x55bd371aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 >> 172.21.15.80:0/2898158347 conn(0x55bd36d814e0 msgr2=0x55bd371372a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 shutdown_connections 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 1 -- 172.21.15.80:0/2898158347 wait complete. 2024-04-25T11:27:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2fca64740 20 client.16320 trim_cache size 0 max 16384 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: "85853397-ca6a-42c1-9eab-8489d9f7e4e3": { 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "85853397-ca6a-42c1-9eab-8489d9f7e4e3", 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:27:02.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:27:02.053 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:27:02.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb2d80afc60 msgr2=0x7fb2d80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb2d80afc60 0x7fb2d80b2170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8006010 tx=0x7fb2e8005d80 comp rx=0 tx=0).stop 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0109af0 msgr2=0x7fb2f019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0109af0 0x7fb2f019abf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400d740 tx=0x7fb2e400dc00 comp rx=0 tx=0).stop 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 shutdown_connections 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb2d80afc60 0x7fb2d80b2170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0109af0 0x7fb2f019abf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2f0109f90 0x7fb2f019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 --2- 172.21.15.80:0/2193342016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0102720 0x7fb2f019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:02.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.050+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 >> 172.21.15.80:0/2193342016 conn(0x7fb2f0077880 msgr2=0x7fb2f0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:02.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.051+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 shutdown_connections 2024-04-25T11:27:02.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:02.051+0000 7fb2f5bb2640 1 -- 172.21.15.80:0/2193342016 wait complete. 2024-04-25T11:27:02.056 INFO:tasks.cephfs.filesystem:scrub status for tag:85853397-ca6a-42c1-9eab-8489d9f7e4e3 - {'path': '/', 'tag': '85853397-ca6a-42c1-9eab-8489d9f7e4e3', 'options': 'recursive,force'} 2024-04-25T11:27:02.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:02 smithi080 ceph-mon[29126]: pgmap v87: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 28 op/s 2024-04-25T11:27:02.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:02 smithi196 ceph-mon[32659]: pgmap v87: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 28 op/s 2024-04-25T11:27:02.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:02 smithi082 ceph-mon[32440]: pgmap v87: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 28 op/s 2024-04-25T11:27:03.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:03 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:27:03.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:03 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:03.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:03 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:27:03.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:03 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:03.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:03 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:27:03.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:03 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:27:03.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:03 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:03.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:03 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:27:03.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:03 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:03.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:03 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:27:03.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:03 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:27:03.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:03 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:03.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:03 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:27:03.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:03 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:03.627 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:03 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:27:04.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:04 smithi196 ceph-mon[32659]: pgmap v88: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-25T11:27:04.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:04 smithi082 ceph-mon[32440]: pgmap v88: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-25T11:27:04.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:04 smithi080 ceph-mon[29126]: pgmap v88: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-25T11:27:06.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:06 smithi196 ceph-mon[32659]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-25T11:27:06.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:06 smithi082 ceph-mon[32440]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-25T11:27:06.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:06 smithi080 ceph-mon[29126]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-25T11:27:08.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:08 smithi196 ceph-mon[32659]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-25T11:27:08.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:08 smithi082 ceph-mon[32440]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-25T11:27:08.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:08 smithi080 ceph-mon[29126]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-25T11:27:10.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:10 smithi196 ceph-mon[32659]: pgmap v91: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-04-25T11:27:10.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:10 smithi082 ceph-mon[32440]: pgmap v91: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-04-25T11:27:10.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:10 smithi080 ceph-mon[29126]: pgmap v91: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-04-25T11:27:12.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:12 smithi196 ceph-mon[32659]: pgmap v92: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-04-25T11:27:12.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:12 smithi082 ceph-mon[32440]: pgmap v92: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-04-25T11:27:12.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:12 smithi080 ceph-mon[29126]: pgmap v92: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-04-25T11:27:14.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:14 smithi196 ceph-mon[32659]: pgmap v93: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T11:27:14.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:14 smithi082 ceph-mon[32440]: pgmap v93: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T11:27:14.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:14 smithi080 ceph-mon[29126]: pgmap v93: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T11:27:16.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:16 smithi196 ceph-mon[32659]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T11:27:16.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:16 smithi082 ceph-mon[32440]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T11:27:16.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:16 smithi080 ceph-mon[29126]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T11:27:18.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:18 smithi196 ceph-mon[32659]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-25T11:27:18.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:18 smithi082 ceph-mon[32440]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-25T11:27:18.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:18 smithi080 ceph-mon[29126]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-25T11:27:20.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:20 smithi196 ceph-mon[32659]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-04-25T11:27:20.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:20 smithi082 ceph-mon[32440]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-04-25T11:27:20.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:20 smithi080 ceph-mon[29126]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-04-25T11:27:22.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:22 smithi082 ceph-mon[32440]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T11:27:22.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:22 smithi080 ceph-mon[29126]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T11:27:22.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:22 smithi196 ceph-mon[32659]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T11:27:23.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:23 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:27:23.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:23 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:27:23.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:23 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:27:24.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:24 smithi082 ceph-mon[32440]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:24.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:24 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:27:24.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:24 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:27:24.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:24 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:27:24.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:24 smithi080 ceph-mon[29126]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:24.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:24 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:27:24.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:24 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:27:24.527 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:24 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:27:24.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:24 smithi196 ceph-mon[32659]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:24.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:24 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:27:24.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:24 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:27:24.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:24 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:27:26.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:26 smithi082 ceph-mon[32440]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:26.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:26 smithi080 ceph-mon[29126]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:26.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:26 smithi196 ceph-mon[32659]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:28.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:28 smithi082 ceph-mon[32440]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:27:28.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:28 smithi080 ceph-mon[29126]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:27:28.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:28 smithi196 ceph-mon[32659]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:27:30.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:30 smithi082 ceph-mon[32440]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:30.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:30 smithi080 ceph-mon[29126]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:30.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:30 smithi196 ceph-mon[32659]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T11:27:32.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:27:32.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 -- 172.21.15.80:0/2424797157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454104260 msgr2=0x7ff454110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/2424797157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454104260 0x7ff454110630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009ca0 tx=0x7ff44c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 -- 172.21.15.80:0/2424797157 shutdown_connections 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/2424797157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454104260 0x7ff454110630 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/2424797157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff454109fb0 0x7ff454103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/2424797157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff454109b10 0x7ff4541036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 -- 172.21.15.80:0/2424797157 >> 172.21.15.80:0/2424797157 conn(0x7ff4540ff1d0 msgr2=0x7ff454101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 -- 172.21.15.80:0/2424797157 shutdown_connections 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.194+0000 7ff45a8b1640 1 -- 172.21.15.80:0/2424797157 wait complete. 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 Processor -- start 2024-04-25T11:27:32.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 -- start start 2024-04-25T11:27:32.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff454104260 0x7ff45419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454109b10 0x7ff45419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff454109fb0 0x7ff45419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff454113d20 con 0x7ff454109b10 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff454113ba0 con 0x7ff454104260 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff45a8b1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff454113ea0 con 0x7ff454109fb0 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.195+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454109b10 0x7ff45419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454109b10 0x7ff45419ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45104/0 (socket says 172.21.15.80:45104) 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 -- 172.21.15.80:0/1157394120 learned_addr learned my addr 172.21.15.80:0/1157394120 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff453fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff454104260 0x7ff45419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff458e4e640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff454109fb0 0x7ff45419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 -- 172.21.15.80:0/1157394120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff454109fb0 msgr2=0x7ff45419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff454109fb0 0x7ff45419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 -- 172.21.15.80:0/1157394120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff454104260 msgr2=0x7ff45419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff454104260 0x7ff45419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 -- 172.21.15.80:0/1157394120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45419f560 con 0x7ff454109b10 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff458e4e640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff454109fb0 0x7ff45419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454109b10 0x7ff45419ac60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff44800d740 tx=0x7ff44800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4517fa640 1 -- 172.21.15.80:0/1157394120 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448017070 con 0x7ff454109b10 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45419f850 con 0x7ff454109b10 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4517fa640 1 -- 172.21.15.80:0/1157394120 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff44800de50 con 0x7ff454109b10 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff4517fa640 1 -- 172.21.15.80:0/1157394120 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448003c30 con 0x7ff454109b10 2024-04-25T11:27:32.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.196+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4541a71d0 con 0x7ff454109b10 2024-04-25T11:27:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 Processor -- start 2024-04-25T11:27:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 -- start start 2024-04-25T11:27:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4517fa640 1 -- 172.21.15.80:0/1157394120 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff448004020 con 0x7ff454109b10 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1506a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1506fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b15138f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5627b146cd80 con 0x5627b11456b0 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5627b14268b0 con 0x5627b113d4d0 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4613fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5627b1468d40 con 0x5627b1166390 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b15138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b15138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45112/0 (socket says 172.21.15.80:45112) 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff4537fe640 1 -- 172.21.15.80:0/2926760535 learned_addr learned my addr 172.21.15.80:0/2926760535 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff453fff640 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1506fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.199+0000 7ff458e4e640 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1506a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4537fe640 1 -- 172.21.15.80:0/2926760535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 msgr2=0x5627b1506a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4537fe640 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1506a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4537fe640 1 -- 172.21.15.80:0/2926760535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 msgr2=0x5627b1506fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4537fe640 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1506fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4537fe640 1 -- 172.21.15.80:0/2926760535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b13f7a40 con 0x5627b11456b0 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4517fa640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff43c0afc60 0x7ff43c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4537fe640 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b15138f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff4480dc0b0 tx=0x7ff4480e7520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619b2cc29ec42416 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff458e4e640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff43c0afc60 0x7ff43c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff4517fa640 1 -- 172.21.15.80:0/1157394120 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff4480de9e0 con 0x7ff454109b10 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff43a7fc640 1 -- 172.21.15.80:0/2926760535 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480a2a50 con 0x5627b11456b0 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff43a7fc640 1 -- 172.21.15.80:0/2926760535 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4480a66a0 con 0x5627b11456b0 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.200+0000 7ff43a7fc640 1 -- 172.21.15.80:0/2926760535 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480a6300 con 0x5627b11456b0 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 -- 172.21.15.80:0/2926760535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 msgr2=0x5627b15138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff458e4e640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff43c0afc60 0x7ff43c0b2170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff44c004af0 tx=0x7ff44c005c30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b15138f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff4480dc0b0 tx=0x7ff4480e7520 comp rx=0 tx=0).stop 2024-04-25T11:27:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 -- 172.21.15.80:0/2926760535 shutdown_connections 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b15138f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1506fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 --2- 172.21.15.80:0/2926760535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1506a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 -- 172.21.15.80:0/2926760535 >> 172.21.15.80:0/2926760535 conn(0x5627b115a4e0 msgr2=0x5627b1503210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 -- 172.21.15.80:0/2926760535 shutdown_connections 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 -- 172.21.15.80:0/2926760535 wait complete. 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.201+0000 7ff4613fd740 1 -- start start 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 1 Processor -- start 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b113d4d0 0x5627b15115e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1511b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b1166390 0x5627b1517430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5627b1513fe0 con 0x5627b11456b0 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5627b13f3d10 con 0x5627b1166390 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5627b1514160 con 0x5627b113d4d0 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4613fd740 10 client.0 _ll_register_callbacks cb 0x5627b1420210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1511b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1511b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45116/0 (socket says 172.21.15.80:45116) 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4537fe640 1 -- 172.21.15.80:0/1604482889 learned_addr learned my addr 172.21.15.80:0/1604482889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff453fff640 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b113d4d0 0x5627b15115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff458e4e640 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b1166390 0x5627b1517430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4537fe640 1 -- 172.21.15.80:0/1604482889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b113d4d0 msgr2=0x5627b15115e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b113d4d0 0x5627b15115e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4537fe640 1 -- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b1166390 msgr2=0x5627b1517430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.202+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b1166390 0x5627b1517430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4537fe640 1 -- 172.21.15.80:0/1604482889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b12487d0 con 0x5627b11456b0 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1511b20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff4480a3e00 tx=0x7ff4480097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5357e7cb93077f69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4337fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4337fe640 1 -- 172.21.15.80:0/1604482889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448020040 con 0x5627b11456b0 2024-04-25T11:27:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4337fe640 1 -- 172.21.15.80:0/1604482889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff4480e2700 con 0x5627b11456b0 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4480a66a0 con 0x5627b11456b0 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4337fe640 1 -- 172.21.15.80:0/1604482889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff4480a64e0 con 0x5627b11456b0 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 10 client.16332 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5627b117e3f0 con 0x5627b11456b0 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4337fe640 1 -- 172.21.15.80:0/1604482889 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4480a66a0 con 0x5627b11456b0 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4337fe640 1 -- 172.21.15.80:0/1604482889 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff448004310 con 0x5627b11456b0 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 10 client.16332 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 20 client.16332 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b1124f60 0x5627b15234f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 4 client.16332 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.203+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627b147a990 con 0x5627b1124f60 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.204+0000 7ff453fff640 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b1124f60 0x5627b15234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.204+0000 7ff4337fe640 10 client.16332 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.204+0000 7ff453fff640 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b1124f60 0x5627b15234f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c92396cd5cf5e3 server_cookie=bea10147fe35078a in_seq=0 out_seq=0 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4337fe640 1 -- 172.21.15.80:0/1604482889 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5627b147a990 con 0x5627b1124f60 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4337fe640 10 client.16332 handle_command_reply: tid=0 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 client.16332 shutdown 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 msgr2=0x5627b1511b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1511b20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff4480a3e00 tx=0x7ff4480097b0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 shutdown_connections 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b1124f60 0x5627b15234f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1511b20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b1166390 0x5627b1517430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1604482889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b113d4d0 0x5627b15115e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4337fe640 0 client.16332 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 >> 172.21.15.80:0/1604482889 conn(0x5627b115a4e0 msgr2=0x5627b1508780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 shutdown_connections 2024-04-25T11:27:32.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 1 -- 172.21.15.80:0/1604482889 wait complete. 2024-04-25T11:27:32.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.205+0000 7ff4613fd740 20 client.16332 trim_cache size 0 max 16384 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 Processor -- start 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 -- start start 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b113d4d0 0x5627b1513520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b11456b0 0x5627b1517420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1517960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541b2310 con 0x5627b113d4d0 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541afbe0 con 0x5627b11456b0 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4613fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541ada30 con 0x5627b1166390 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b113d4d0 0x5627b1513520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b113d4d0 0x5627b1513520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45126/0 (socket says 172.21.15.80:45126) 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 -- 172.21.15.80:0/3839812625 learned_addr learned my addr 172.21.15.80:0/3839812625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff458e4e640 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1517960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4537fe640 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b11456b0 0x5627b1517420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 -- 172.21.15.80:0/3839812625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 msgr2=0x5627b1517960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1517960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 -- 172.21.15.80:0/3839812625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b11456b0 msgr2=0x5627b1517420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b11456b0 0x5627b1517420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff453fff640 1 -- 172.21.15.80:0/3839812625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b113e0f0 con 0x5627b113d4d0 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.224+0000 7ff4537fe640 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b11456b0 0x5627b1517420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.225+0000 7ff453fff640 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b113d4d0 0x5627b1513520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x5627b15041a0 tx=0x7ff4440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a679d60e77ce03f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.225+0000 7ff439ffb640 1 -- 172.21.15.80:0/3839812625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444025070 con 0x5627b113d4d0 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.225+0000 7ff439ffb640 1 -- 172.21.15.80:0/3839812625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4440205a0 con 0x5627b113d4d0 2024-04-25T11:27:32.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.225+0000 7ff439ffb640 1 -- 172.21.15.80:0/3839812625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440108f0 con 0x5627b113d4d0 2024-04-25T11:27:32.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 -- 172.21.15.80:0/3839812625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b113d4d0 msgr2=0x5627b1513520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b113d4d0 0x5627b1513520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x5627b15041a0 tx=0x7ff4440046c0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 -- 172.21.15.80:0/3839812625 shutdown_connections 2024-04-25T11:27:32.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1517960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b11456b0 0x5627b1517420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 --2- 172.21.15.80:0/3839812625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b113d4d0 0x5627b1513520 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 -- 172.21.15.80:0/3839812625 >> 172.21.15.80:0/3839812625 conn(0x5627b115a4e0 msgr2=0x5627b1508db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 -- 172.21.15.80:0/3839812625 shutdown_connections 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 -- 172.21.15.80:0/3839812625 wait complete. 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 -- start start 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.226+0000 7ff4613fd740 1 Processor -- start 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1587810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1587d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1581c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541ae0a0 con 0x5627b11456b0 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541af510 con 0x5627b113d4d0 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541ae770 con 0x5627b1166390 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 10 client.0 _ll_register_callbacks cb 0x7ff444009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:32.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1587d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1587d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45128/0 (socket says 172.21.15.80:45128) 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 -- 172.21.15.80:0/1725112249 learned_addr learned my addr 172.21.15.80:0/1725112249 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff453fff640 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1587810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 -- 172.21.15.80:0/1725112249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 msgr2=0x5627b1581c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff458e4e640 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1581c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1581c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 -- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 msgr2=0x5627b1587810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1587810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 -- 172.21.15.80:0/1725112249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b142d4b0 con 0x5627b11456b0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4537fe640 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1587d50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff4480dee60 tx=0x7ff4480e28d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3322c8d294d27c19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4337fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4337fe640 1 -- 172.21.15.80:0/1725112249 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448020070 con 0x5627b11456b0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4337fe640 1 -- 172.21.15.80:0/1725112249 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff4480a2e20 con 0x5627b11456b0 2024-04-25T11:27:32.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4440205a0 con 0x5627b11456b0 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.227+0000 7ff4337fe640 1 -- 172.21.15.80:0/1725112249 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff4480a6960 con 0x5627b11456b0 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 10 client.16338 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5627b158ec70 con 0x5627b11456b0 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4337fe640 1 -- 172.21.15.80:0/1725112249 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4440205a0 con 0x5627b11456b0 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4337fe640 1 -- 172.21.15.80:0/1725112249 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff4480af560 con 0x5627b11456b0 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 10 client.16338 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 20 client.16338 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b10fa3a0 0x5627b1591320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 4 client.16338 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5627b1474800 con 0x5627b10fa3a0 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.228+0000 7ff453fff640 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b10fa3a0 0x5627b1591320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff453fff640 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b10fa3a0 0x5627b1591320 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120e33abfc8c47e4 server_cookie=80b775fd166ae1b5 in_seq=0 out_seq=0 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4337fe640 10 client.16338 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4337fe640 1 -- 172.21.15.80:0/1725112249 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5627b1474800 con 0x5627b10fa3a0 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4337fe640 10 client.16338 handle_command_reply: tid=0 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 client.16338 shutdown 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 msgr2=0x5627b1587d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1587d50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff4480dee60 tx=0x7ff4480e28d0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 shutdown_connections 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5627b10fa3a0 0x5627b1591320 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5627b11456b0 0x5627b1587d50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4337fe640 0 client.16338 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5627b1166390 0x5627b1581c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 --2- 172.21.15.80:0/1725112249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5627b113d4d0 0x5627b1587810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 >> 172.21.15.80:0/1725112249 conn(0x5627b115a4e0 msgr2=0x5627b1508db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 shutdown_connections 2024-04-25T11:27:32.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 1 -- 172.21.15.80:0/1725112249 wait complete. 2024-04-25T11:27:32.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.229+0000 7ff4613fd740 20 client.16338 trim_cache size 0 max 16384 2024-04-25T11:27:32.228 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:27:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:27:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:27:32.228 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff43c0afc60 msgr2=0x7ff43c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff43c0afc60 0x7ff43c0b2170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff44c004af0 tx=0x7ff44c005c30 comp rx=0 tx=0).stop 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454109b10 msgr2=0x7ff45419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454109b10 0x7ff45419ac60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff44800d740 tx=0x7ff44800dc00 comp rx=0 tx=0).stop 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 shutdown_connections 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff43c0afc60 0x7ff43c0b2170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff454109b10 0x7ff45419ac60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff454109fb0 0x7ff45419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 --2- 172.21.15.80:0/1157394120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff454104260 0x7ff45419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 >> 172.21.15.80:0/1157394120 conn(0x7ff4540ff1d0 msgr2=0x7ff4541065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 shutdown_connections 2024-04-25T11:27:32.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.230+0000 7ff45a8b1640 1 -- 172.21.15.80:0/1157394120 wait complete. 2024-04-25T11:27:32.233 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:27:32.234 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 -- 172.21.15.80:0/2225730350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb9410b680 msgr2=0x7ffb9410daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 --2- 172.21.15.80:0/2225730350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb9410b680 0x7ffb9410daa0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009900 tx=0x7ffb8402a480 comp rx=0 tx=0).stop 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 -- 172.21.15.80:0/2225730350 shutdown_connections 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 --2- 172.21.15.80:0/2225730350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb9410b680 0x7ffb9410daa0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 --2- 172.21.15.80:0/2225730350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9410e070 0x7ffb94110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 --2- 172.21.15.80:0/2225730350 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb94104c20 0x7ffb94105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 -- 172.21.15.80:0/2225730350 >> 172.21.15.80:0/2225730350 conn(0x7ffb94078040 msgr2=0x7ffb94078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 -- 172.21.15.80:0/2225730350 shutdown_connections 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.351+0000 7ffb9b805640 1 -- 172.21.15.80:0/2225730350 wait complete. 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 Processor -- start 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 -- start start 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb94104c20 0x7ffb941024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9410b680 0x7ffb94102a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb9410e070 0x7ffb94102f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94113cd0 con 0x7ffb94104c20 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94113b50 con 0x7ffb9410b680 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb9b805640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94113e50 con 0x7ffb9410e070 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb94104c20 0x7ffb941024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb94104c20 0x7ffb941024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45138/0 (socket says 172.21.15.80:45138) 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 -- 172.21.15.80:0/1545766106 learned_addr learned my addr 172.21.15.80:0/1545766106 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 -- 172.21.15.80:0/1545766106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb9410e070 msgr2=0x7ffb94102f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb9410e070 0x7ffb94102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 -- 172.21.15.80:0/1545766106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9410b680 msgr2=0x7ffb94102a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9410b680 0x7ffb94102a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 -- 172.21.15.80:0/1545766106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb941a8a70 con 0x7ffb94104c20 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb995a1640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb94104c20 0x7ffb941024e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000e9f0 tx=0x7ffb9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.352+0000 7ffb8a7fc640 1 -- 172.21.15.80:0/1545766106 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9000cd80 con 0x7ffb94104c20 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.353+0000 7ffb8a7fc640 1 -- 172.21.15.80:0/1545766106 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb900054d0 con 0x7ffb94104c20 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.353+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb941a8d60 con 0x7ffb94104c20 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.353+0000 7ffb8a7fc640 1 -- 172.21.15.80:0/1545766106 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90010690 con 0x7ffb94104c20 2024-04-25T11:27:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.353+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb941a9200 con 0x7ffb94104c20 2024-04-25T11:27:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.354+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb9406a190 con 0x7ffb94104c20 2024-04-25T11:27:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.356+0000 7ffb8a7fc640 1 -- 172.21.15.80:0/1545766106 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ffb90004e30 con 0x7ffb94104c20 2024-04-25T11:27:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.356+0000 7ffb8a7fc640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb800afc60 0x7ffb800b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.357+0000 7ffb98da0640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb800afc60 0x7ffb800b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.357+0000 7ffb8a7fc640 1 -- 172.21.15.80:0/1545766106 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ffb900df790 con 0x7ffb94104c20 2024-04-25T11:27:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.357+0000 7ffb98da0640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb800afc60 0x7ffb800b2170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb8402a9a0 tx=0x7ffb84031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.360+0000 7ffb8a7fc640 1 -- 172.21.15.80:0/1545766106 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffb90053ff0 con 0x7ffb94104c20 2024-04-25T11:27:32.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:32 smithi080 ceph-mon[29126]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:27:32.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:32 smithi082 ceph-mon[32440]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:27:32.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.578+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb94103a10 con 0x7ffb94104c20 2024-04-25T11:27:32.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.579+0000 7ffb8a7fc640 1 -- 172.21.15.80:0/1545766106 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7ffb900a8040 con 0x7ffb94104c20 2024-04-25T11:27:32.571 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:27:32.571 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:27:32.571 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb800afc60 msgr2=0x7ffb800b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb800afc60 0x7ffb800b2170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb8402a9a0 tx=0x7ffb84031400 comp rx=0 tx=0).stop 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb94104c20 msgr2=0x7ffb941024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb94104c20 0x7ffb941024e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000e9f0 tx=0x7ffb9000edf0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 shutdown_connections 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffb800afc60 0x7ffb800b2170 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb9410e070 0x7ffb94102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9410b680 0x7ffb94102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 --2- 172.21.15.80:0/1545766106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb94104c20 0x7ffb941024e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 >> 172.21.15.80:0/1545766106 conn(0x7ffb94078040 msgr2=0x7ffb94101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 shutdown_connections 2024-04-25T11:27:32.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.581+0000 7ffb9b805640 1 -- 172.21.15.80:0/1545766106 wait complete. 2024-04-25T11:27:32.584 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:27:32.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:32 smithi196 ceph-mon[32659]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 -- 172.21.15.80:0/2406604453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 msgr2=0x7f32e01037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 --2- 172.21.15.80:0/2406604453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01037d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009ca0 tx=0x7f32d802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 -- 172.21.15.80:0/2406604453 shutdown_connections 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 --2- 172.21.15.80:0/2406604453 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32e0107d00 0x7f32e010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 --2- 172.21.15.80:0/2406604453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32e0107280 0x7f32e0107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 --2- 172.21.15.80:0/2406604453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01037d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 -- 172.21.15.80:0/2406604453 >> 172.21.15.80:0/2406604453 conn(0x7f32e0077920 msgr2=0x7f32e0077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 -- 172.21.15.80:0/2406604453 shutdown_connections 2024-04-25T11:27:32.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.703+0000 7f32e4e30640 1 -- 172.21.15.80:0/2406604453 wait complete. 2024-04-25T11:27:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 Processor -- start 2024-04-25T11:27:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 -- start start 2024-04-25T11:27:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32e0107280 0x7f32e01107e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32e0107d00 0x7f32e0110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f32e0113d20 con 0x7f32e01033c0 2024-04-25T11:27:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32e0113ba0 con 0x7f32e0107d00 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32e4e30640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32e0113ea0 con 0x7f32e0107280 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45158/0 (socket says 172.21.15.80:45158) 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 -- 172.21.15.80:0/3422779829 learned_addr learned my addr 172.21.15.80:0/3422779829 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32ded9d640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32e0107d00 0x7f32e0110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 -- 172.21.15.80:0/3422779829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32e0107280 msgr2=0x7f32e01107e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32e0107280 0x7f32e01107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 -- 172.21.15.80:0/3422779829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32e0107d00 msgr2=0x7f32e0110d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32e0107d00 0x7f32e0110d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32de59c640 1 -- 172.21.15.80:0/3422779829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e01a8ae0 con 0x7f32e01033c0 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.704+0000 7f32ded9d640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32e0107d00 0x7f32e0110d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.705+0000 7f32de59c640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01102a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f32d802ade0 tx=0x7f32d8031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.705+0000 7f32d77fe640 1 -- 172.21.15.80:0/3422779829 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d8003b70 con 0x7f32e01033c0 2024-04-25T11:27:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.705+0000 7f32d77fe640 1 -- 172.21.15.80:0/3422779829 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d8003d10 con 0x7f32e01033c0 2024-04-25T11:27:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.705+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e01a8d70 con 0x7f32e01033c0 2024-04-25T11:27:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.705+0000 7f32d77fe640 1 -- 172.21.15.80:0/3422779829 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d802fa50 con 0x7f32e01033c0 2024-04-25T11:27:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.705+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e01a9260 con 0x7f32e01033c0 2024-04-25T11:27:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.707+0000 7f32d77fe640 1 -- 172.21.15.80:0/3422779829 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f32d8004580 con 0x7f32e01033c0 2024-04-25T11:27:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.707+0000 7f32ebdb1740 1 Processor -- start 2024-04-25T11:27:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ebdb1740 1 -- start start 2024-04-25T11:27:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fea14390 0x5555fedb5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedb5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9f36b0 0x5555fedc26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5555fed1ad80 con 0x5555fe9eb4d0 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5555fecd4a20 con 0x5555fea14390 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5555fed16d40 con 0x5555fe9f36b0 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedb5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedb5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45170/0 (socket says 172.21.15.80:45170) 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 -- 172.21.15.80:0/1127835183 learned_addr learned my addr 172.21.15.80:0/1127835183 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9f36b0 0x5555fedc26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ded9d640 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fea14390 0x5555fedb5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32d77fe640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32cc0afc60 0x7f32cc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 -- 172.21.15.80:0/1127835183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9f36b0 msgr2=0x5555fedc26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9f36b0 0x5555fedc26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 -- 172.21.15.80:0/1127835183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fea14390 msgr2=0x5555fedb5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fea14390 0x5555fedb5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32de59c640 1 -- 172.21.15.80:0/1127835183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fecdfc30 con 0x5555fe9eb4d0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9f36b0 0x5555fedc26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ded9d640 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fea14390 0x5555fedb5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.708+0000 7f32ded9d640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32cc0afc60 0x7f32cc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.709+0000 7f32d77fe640 1 -- 172.21.15.80:0/3422779829 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f32d81004d0 con 0x7f32e01033c0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.709+0000 7f32de59c640 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedb5d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f32d80fdcb0 tx=0x7f32d808ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e789e8e1800c7552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.709+0000 7f32d4ff9640 1 -- 172.21.15.80:0/1127835183 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80c8560 con 0x5555fe9eb4d0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.709+0000 7f32ded9d640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32cc0afc60 0x7f32cc0b2170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5555fedb2980 tx=0x7f32d00046c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.709+0000 7f32d4ff9640 1 -- 172.21.15.80:0/1127835183 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d80c82a0 con 0x5555fe9eb4d0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.709+0000 7f32d4ff9640 1 -- 172.21.15.80:0/1127835183 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d8093f00 con 0x5555fe9eb4d0 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 -- 172.21.15.80:0/1127835183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 msgr2=0x5555fedb5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedb5d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f32d80fdcb0 tx=0x7f32d808ebb0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 -- 172.21.15.80:0/1127835183 shutdown_connections 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedb5d50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9f36b0 0x5555fedc26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/1127835183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fea14390 0x5555fedb5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 -- 172.21.15.80:0/1127835183 >> 172.21.15.80:0/1127835183 conn(0x5555fea084e0 msgr2=0x5555fedb1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 -- 172.21.15.80:0/1127835183 shutdown_connections 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 -- 172.21.15.80:0/1127835183 wait complete. 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 -- start start 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.710+0000 7f32ebdb1740 1 Processor -- start 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9eb4d0 0x5555fedc0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedc06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fea14390 0x5555fedcbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5555fecd4a20 con 0x5555fea14390 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5555feca1dc0 con 0x5555fe9f36b0 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5555fed1ad80 con 0x5555fe9eb4d0 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ebdb1740 10 client.0 _ll_register_callbacks cb 0x5555fecbd600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fea14390 0x5555fedcbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fea14390 0x5555fedcbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45180/0 (socket says 172.21.15.80:45180) 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 -- 172.21.15.80:0/2695381363 learned_addr learned my addr 172.21.15.80:0/2695381363 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32de59c640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9eb4d0 0x5555fedc0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedc06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 -- 172.21.15.80:0/2695381363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9eb4d0 msgr2=0x5555fedc0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9eb4d0 0x5555fedc0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 -- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 msgr2=0x5555fedc06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedc06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 -- 172.21.15.80:0/2695381363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fea2c3f0 con 0x5555fea14390 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32de59c640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9eb4d0 0x5555fedc0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedc06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32ded9d640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fea14390 0x5555fedcbe20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f32d00116c0 tx=0x7f32d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea52e8ba293e937 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.711+0000 7f32c5ffb640 1 -- 172.21.15.80:0/2695381363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0022070 con 0x5555fea14390 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32c5ffb640 1 -- 172.21.15.80:0/2695381363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f32d000ead0 con 0x5555fea14390 2024-04-25T11:27:32.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d80c82a0 con 0x5555fea14390 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32c5ffb640 1 -- 172.21.15.80:0/2695381363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32d002e050 con 0x5555fea14390 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 10 client.16356 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555feaf67d0 con 0x5555fea14390 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32c5ffb640 1 -- 172.21.15.80:0/2695381363 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d80c82a0 con 0x5555fea14390 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32c5ffb640 1 -- 172.21.15.80:0/2695381363 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f32d001ec60 con 0x5555fea14390 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 10 client.16356 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 10 client.16356 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 20 client.16356 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9d2f60 0x5555fedd2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 4 client.16356 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.712+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555fed28990 con 0x5555fe9d2f60 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.713+0000 7f32de59c640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9d2f60 0x5555fedd2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.713+0000 7f32c5ffb640 10 client.16356 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.713+0000 7f32de59c640 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9d2f60 0x5555fedd2210 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=951798c22c001433 server_cookie=5eb7f9a585ef83be in_seq=0 out_seq=0 2024-04-25T11:27:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32c5ffb640 1 -- 172.21.15.80:0/2695381363 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5555fed28990 con 0x5555fe9d2f60 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32c5ffb640 10 client.16356 handle_command_reply: tid=0 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 client.16356 shutdown 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fea14390 msgr2=0x5555fedcbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fea14390 0x5555fedcbe20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f32d00116c0 tx=0x7f32d0004730 comp rx=0 tx=0).stop 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 shutdown_connections 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9d2f60 0x5555fedd2210 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fea14390 0x5555fedcbe20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedc06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32c5ffb640 0 client.16356 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/2695381363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fe9eb4d0 0x5555fedc0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 >> 172.21.15.80:0/2695381363 conn(0x5555fea084e0 msgr2=0x5555fedb7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 shutdown_connections 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 1 -- 172.21.15.80:0/2695381363 wait complete. 2024-04-25T11:27:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.714+0000 7f32ebdb1740 20 client.16356 trim_cache size 0 max 16384 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.727+0000 7f32ebdb1740 1 Processor -- start 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.727+0000 7f32ebdb1740 1 -- start start 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedbee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedcba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 0x5555fedd79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01b44c0 con 0x5555fe9eb4d0 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01b1d90 con 0x5555fe9f36b0 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01afbe0 con 0x5555fea14390 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedbee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedbee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45196/0 (socket says 172.21.15.80:45196) 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 -- 172.21.15.80:0/4115532741 learned_addr learned my addr 172.21.15.80:0/4115532741 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedcba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 -- 172.21.15.80:0/4115532741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 msgr2=0x5555fedd79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 0x5555fedd79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 -- 172.21.15.80:0/4115532741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 msgr2=0x5555fedcba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedcba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 -- 172.21.15.80:0/4115532741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fedd25c0 con 0x5555fe9eb4d0 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedcba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32de59c640 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedbee30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f32d8004af0 tx=0x7f32d81060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141d2cf3be7030d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32c7fff640 1 -- 172.21.15.80:0/4115532741 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80c7f00 con 0x5555fe9eb4d0 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32c7fff640 1 -- 172.21.15.80:0/4115532741 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d8036070 con 0x5555fe9eb4d0 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.728+0000 7f32c7fff640 1 -- 172.21.15.80:0/4115532741 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80c80e0 con 0x5555fe9eb4d0 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 -- 172.21.15.80:0/4115532741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 msgr2=0x5555fedbee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedbee30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f32d8004af0 tx=0x7f32d81060e0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 -- 172.21.15.80:0/4115532741 shutdown_connections 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 0x5555fedd79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9f36b0 0x5555fedcba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/4115532741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9eb4d0 0x5555fedbee30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 -- 172.21.15.80:0/4115532741 >> 172.21.15.80:0/4115532741 conn(0x5555fea084e0 msgr2=0x5555fedbe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 -- 172.21.15.80:0/4115532741 shutdown_connections 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 -- 172.21.15.80:0/4115532741 wait complete. 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 -- start start 2024-04-25T11:27:32.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.729+0000 7f32ebdb1740 1 Processor -- start 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9eb4d0 0x5555fedc8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9f36b0 0x5555fedc37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 0x5555fedc3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01b0250 con 0x5555fe9f36b0 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01b16c0 con 0x5555fe9eb4d0 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01b0920 con 0x5555fea14390 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 10 client.0 _ll_register_callbacks cb 0x7f32d000d440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9f36b0 0x5555fedc37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9f36b0 0x5555fedc37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45208/0 (socket says 172.21.15.80:45208) 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 -- 172.21.15.80:0/3603108366 learned_addr learned my addr 172.21.15.80:0/3603108366 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32de59c640 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9eb4d0 0x5555fedc8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ded9d640 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 0x5555fedc3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 -- 172.21.15.80:0/3603108366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 msgr2=0x5555fedc3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 0x5555fedc3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 -- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9eb4d0 msgr2=0x5555fedc8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9eb4d0 0x5555fedc8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 -- 172.21.15.80:0/3603108366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fedc4580 con 0x5555fe9f36b0 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ddd9b640 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9f36b0 0x5555fedc37e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f32e00754b0 tx=0x7f32c80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34b81ec1752ab08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32c5ffb640 1 -- 172.21.15.80:0/3603108366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c801b420 con 0x5555fe9f36b0 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32c5ffb640 1 -- 172.21.15.80:0/3603108366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f32c800f420 con 0x5555fe9f36b0 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d8036070 con 0x5555fe9f36b0 2024-04-25T11:27:32.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32c5ffb640 1 -- 172.21.15.80:0/3603108366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32c800f620 con 0x5555fe9f36b0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 10 client.16362 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.730+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555fee3a590 con 0x5555fe9f36b0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32c5ffb640 1 -- 172.21.15.80:0/3603108366 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d8036070 con 0x5555fe9f36b0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32c5ffb640 1 -- 172.21.15.80:0/3603108366 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f32c801ba00 con 0x5555fe9f36b0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32ebdb1740 10 client.16362 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32ebdb1740 10 client.16362 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32ebdb1740 20 client.16362 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9a83a0 0x5555fee3ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32ebdb1740 4 client.16362 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555fed22800 con 0x5555fe9a83a0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32de59c640 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9a83a0 0x5555fee3ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32c5ffb640 10 client.16362 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.731+0000 7f32de59c640 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9a83a0 0x5555fee3ce00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df35c9918bb56fa7 server_cookie=6459659240d2c161 in_seq=0 out_seq=0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32c5ffb640 1 -- 172.21.15.80:0/3603108366 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555fed22800 con 0x5555fe9a83a0 2024-04-25T11:27:32.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32c5ffb640 10 client.16362 handle_command_reply: tid=0 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 client.16362 shutdown 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9f36b0 msgr2=0x5555fedc37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9f36b0 0x5555fedc37e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f32e00754b0 tx=0x7f32c80118d0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 shutdown_connections 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5555fe9a83a0 0x5555fee3ce00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5555fe9f36b0 0x5555fedc37e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32c5ffb640 0 client.16362 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5555fea14390 0x5555fedc3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 --2- 172.21.15.80:0/3603108366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555fe9eb4d0 0x5555fedc8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 >> 172.21.15.80:0/3603108366 conn(0x5555fea084e0 msgr2=0x5555fedb7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 shutdown_connections 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 1 -- 172.21.15.80:0/3603108366 wait complete. 2024-04-25T11:27:32.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32ebdb1740 20 client.16362 trim_cache size 0 max 16384 2024-04-25T11:27:32.733 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:27:32.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32cc0afc60 msgr2=0x7f32cc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32cc0afc60 0x7f32cc0b2170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5555fedb2980 tx=0x7f32d00046c0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 msgr2=0x7f32e01102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01102a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f32d802ade0 tx=0x7f32d8031770 comp rx=0 tx=0).stop 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 shutdown_connections 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32cc0afc60 0x7f32cc0b2170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32e0107d00 0x7f32e0110d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32e0107280 0x7f32e01107e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.732+0000 7f32e4e30640 1 --2- 172.21.15.80:0/3422779829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32e01033c0 0x7f32e01102a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.733+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 >> 172.21.15.80:0/3422779829 conn(0x7f32e0077920 msgr2=0x7f32e00ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.733+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 shutdown_connections 2024-04-25T11:27:32.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.733+0000 7f32e4e30640 1 -- 172.21.15.80:0/3422779829 wait complete. 2024-04-25T11:27:32.736 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:27:32.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 -- 172.21.15.80:0/252023960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d20109b40 msgr2=0x7f6d20101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 --2- 172.21.15.80:0/252023960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d20109b40 0x7f6d20101c10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009900 tx=0x7f6d1002a410 comp rx=0 tx=0).stop 2024-04-25T11:27:32.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 -- 172.21.15.80:0/252023960 shutdown_connections 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 --2- 172.21.15.80:0/252023960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d201027c0 0x7f6d20110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 --2- 172.21.15.80:0/252023960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d20109fe0 0x7f6d20102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 --2- 172.21.15.80:0/252023960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d20109b40 0x7f6d20101c10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 -- 172.21.15.80:0/252023960 >> 172.21.15.80:0/252023960 conn(0x7f6d20077920 msgr2=0x7f6d20077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 -- 172.21.15.80:0/252023960 shutdown_connections 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.853+0000 7f6d285c5640 1 -- 172.21.15.80:0/252023960 wait complete. 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 Processor -- start 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 -- start start 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d201027c0 0x7f6d2019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d20109b40 0x7f6d2019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d20109fe0 0x7f6d2019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20113d30 con 0x7f6d201027c0 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20113bb0 con 0x7f6d20109fe0 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d285c5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20113eb0 con 0x7f6d20109b40 2024-04-25T11:27:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d26361640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d201027c0 0x7f6d2019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d26361640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d201027c0 0x7f6d2019a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45226/0 (socket says 172.21.15.80:45226) 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.854+0000 7f6d26361640 1 -- 172.21.15.80:0/1446972289 learned_addr learned my addr 172.21.15.80:0/1446972289 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d25b60640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d20109b40 0x7f6d2019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26b62640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d20109fe0 0x7f6d2019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26361640 1 -- 172.21.15.80:0/1446972289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d20109b40 msgr2=0x7f6d2019ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26361640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d20109b40 0x7f6d2019ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26361640 1 -- 172.21.15.80:0/1446972289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d20109fe0 msgr2=0x7f6d2019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26361640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d20109fe0 0x7f6d2019efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26361640 1 -- 172.21.15.80:0/1446972289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2019f590 con 0x7f6d201027c0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26b62640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d20109fe0 0x7f6d2019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d25b60640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d20109b40 0x7f6d2019ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d26361640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d201027c0 0x7f6d2019a7b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6d10004270 tx=0x7f6d100042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d177fe640 1 -- 172.21.15.80:0/1446972289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1003f030 con 0x7f6d201027c0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d177fe640 1 -- 172.21.15.80:0/1446972289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d100044c0 con 0x7f6d201027c0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2019f820 con 0x7f6d201027c0 2024-04-25T11:27:32.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d177fe640 1 -- 172.21.15.80:0/1446972289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10035070 con 0x7f6d201027c0 2024-04-25T11:27:32.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.855+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2019fd10 con 0x7f6d201027c0 2024-04-25T11:27:32.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 Processor -- start 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 -- start start 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d177fe640 1 -- 172.21.15.80:0/1446972289 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f6d10042030 con 0x7f6d201027c0 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 0x55fea1ac0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ac0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16fe6b0 0x55fea1acd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fea1a25d80 con 0x55fea16f64d0 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fea19dfa20 con 0x55fea16fe6b0 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.858+0000 7f6d2f476740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fea1a21d40 con 0x55fea171f390 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ac0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ac0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45242/0 (socket says 172.21.15.80:45242) 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 -- 172.21.15.80:0/1185447062 learned_addr learned my addr 172.21.15.80:0/1185447062 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d25b60640 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16fe6b0 0x55fea1acd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26b62640 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 0x55fea1ac0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 -- 172.21.15.80:0/1185447062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 msgr2=0x55fea1ac0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 0x55fea1ac0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 -- 172.21.15.80:0/1185447062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16fe6b0 msgr2=0x55fea1acd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16fe6b0 0x55fea1acd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 -- 172.21.15.80:0/1185447062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea19eac30 con 0x55fea16f64d0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d25b60640 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16fe6b0 0x55fea1acd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d177fe640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6d0c0afc60 0x7f6d0c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26b62640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6d0c0afc60 0x7f6d0c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d26361640 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ac0d50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6d100fccc0 tx=0x7f6d10105cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824e16309fef8cb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d177fe640 1 -- 172.21.15.80:0/1446972289 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6d100ff5f0 con 0x7f6d201027c0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d14bfe640 1 -- 172.21.15.80:0/1185447062 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100c3660 con 0x55fea16f64d0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d14bfe640 1 -- 172.21.15.80:0/1185447062 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d100c72b0 con 0x55fea16f64d0 2024-04-25T11:27:32.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.859+0000 7f6d14bfe640 1 -- 172.21.15.80:0/1185447062 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100c6f10 con 0x55fea16f64d0 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 -- 172.21.15.80:0/1185447062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 msgr2=0x55fea1ac0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d26b62640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6d0c0afc60 0x7f6d0c0b2170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55fea1abd980 tx=0x7f6d180074a0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ac0d50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6d100fccc0 tx=0x7f6d10105cd0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 -- 172.21.15.80:0/1185447062 shutdown_connections 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ac0d50 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16fe6b0 0x55fea1acd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1185447062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 0x55fea1ac0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 -- 172.21.15.80:0/1185447062 >> 172.21.15.80:0/1185447062 conn(0x55fea17134e0 msgr2=0x55fea1abcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 -- 172.21.15.80:0/1185447062 shutdown_connections 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.860+0000 7f6d2f476740 1 -- 172.21.15.80:0/1185447062 wait complete. 2024-04-25T11:27:32.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 -- start start 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 Processor -- start 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16f64d0 0x55fea1acb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1acb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1ad6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fea1a25d80 con 0x55fea16fe6b0 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fea19acdc0 con 0x55fea171f390 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fea1acdbe0 con 0x55fea16f64d0 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d2f476740 10 client.0 _ll_register_callbacks cb 0x55fea19c8600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d25b60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1acb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d25b60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1acb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45252/0 (socket says 172.21.15.80:45252) 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d25b60640 1 -- 172.21.15.80:0/1394127109 learned_addr learned my addr 172.21.15.80:0/1394127109 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d26b62640 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1ad6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.861+0000 7f6d26361640 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16f64d0 0x55fea1acb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d25b60640 1 -- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16f64d0 msgr2=0x55fea1acb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d25b60640 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16f64d0 0x55fea1acb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d25b60640 1 -- 172.21.15.80:0/1394127109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 msgr2=0x55fea1ad6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d25b60640 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1ad6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d25b60640 1 -- 172.21.15.80:0/1394127109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea17373f0 con 0x55fea16fe6b0 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d25b60640 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1acb730 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00be80 tx=0x7f6d1c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefc6f4841ecc37e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d09ffb640 1 -- 172.21.15.80:0/1394127109 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c004220 con 0x55fea16fe6b0 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d09ffb640 1 -- 172.21.15.80:0/1394127109 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6d1c0043c0 con 0x55fea16fe6b0 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d100c72b0 con 0x55fea16fe6b0 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d09ffb640 1 -- 172.21.15.80:0/1394127109 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6d1c005020 con 0x55fea16fe6b0 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d2f476740 10 client.16374 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:32.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fea18017d0 con 0x55fea16fe6b0 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d09ffb640 1 -- 172.21.15.80:0/1394127109 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d100c72b0 con 0x55fea16fe6b0 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d09ffb640 1 -- 172.21.15.80:0/1394127109 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6d1c0035f0 con 0x55fea16fe6b0 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d2f476740 10 client.16374 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.862+0000 7f6d2f476740 10 client.16374 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.863+0000 7f6d2f476740 20 client.16374 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.863+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16ddf60 0x55fea1add440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.863+0000 7f6d2f476740 4 client.16374 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.863+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fea1a33990 con 0x55fea16ddf60 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.863+0000 7f6d26361640 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16ddf60 0x55fea1add440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.863+0000 7f6d09ffb640 10 client.16374 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:32.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.863+0000 7f6d26361640 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16ddf60 0x55fea1add440 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12e68ae7efb9341a server_cookie=1d38a2de6db74f71 in_seq=0 out_seq=0 2024-04-25T11:27:32.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d09ffb640 1 -- 172.21.15.80:0/1394127109 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fea1a33990 con 0x55fea16ddf60 2024-04-25T11:27:32.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d09ffb640 10 client.16374 handle_command_reply: tid=0 2024-04-25T11:27:32.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 client.16374 shutdown 2024-04-25T11:27:32.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 msgr2=0x55fea1acb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1acb730 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00be80 tx=0x7f6d1c0117b0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 shutdown_connections 2024-04-25T11:27:32.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1acb730 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16ddf60 0x55fea1add440 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1ad6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d09ffb640 0 client.16374 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 --2- 172.21.15.80:0/1394127109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16f64d0 0x55fea1acb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 >> 172.21.15.80:0/1394127109 conn(0x55fea17134e0 msgr2=0x55fea1ac2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 shutdown_connections 2024-04-25T11:27:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 1 -- 172.21.15.80:0/1394127109 wait complete. 2024-04-25T11:27:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.864+0000 7f6d2f476740 20 client.16374 trim_cache size 0 max 16384 2024-04-25T11:27:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 Processor -- start 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 -- start start 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16f64d0 0x55fea1abd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1abbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 0x55fea1ad6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d201b22c0 con 0x55fea16fe6b0 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d201afb90 con 0x55fea16f64d0 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d2f476740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6d201ad9e0 con 0x55fea171f390 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1abbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1abbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45256/0 (socket says 172.21.15.80:45256) 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 -- 172.21.15.80:0/139836974 learned_addr learned my addr 172.21.15.80:0/139836974 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 -- 172.21.15.80:0/139836974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 msgr2=0x55fea1ad6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 --2- 172.21.15.80:0/139836974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 0x55fea1ad6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 -- 172.21.15.80:0/139836974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16f64d0 msgr2=0x55fea1abd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 --2- 172.21.15.80:0/139836974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16f64d0 0x55fea1abd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.878+0000 7f6d25b60640 1 -- 172.21.15.80:0/139836974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea1ac9530 con 0x55fea16fe6b0 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d25b60640 1 --2- 172.21.15.80:0/139836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1abbd20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0039e0 tx=0x7f6d1c00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe16429dd689f270 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d0bfff640 1 -- 172.21.15.80:0/139836974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0051c0 con 0x55fea16fe6b0 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d0bfff640 1 -- 172.21.15.80:0/139836974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d1c005360 con 0x55fea16fe6b0 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d0bfff640 1 -- 172.21.15.80:0/139836974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c004050 con 0x55fea16fe6b0 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 -- 172.21.15.80:0/139836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 msgr2=0x55fea1abbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 --2- 172.21.15.80:0/139836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1abbd20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0039e0 tx=0x7f6d1c00b7e0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 -- 172.21.15.80:0/139836974 shutdown_connections 2024-04-25T11:27:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 --2- 172.21.15.80:0/139836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16fe6b0 0x55fea1abbd20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 --2- 172.21.15.80:0/139836974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea171f390 0x55fea1ad6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 --2- 172.21.15.80:0/139836974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea16f64d0 0x55fea1abd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 -- 172.21.15.80:0/139836974 >> 172.21.15.80:0/139836974 conn(0x55fea17134e0 msgr2=0x55fea1abb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.879+0000 7f6d2f476740 1 -- 172.21.15.80:0/139836974 shutdown_connections 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 -- 172.21.15.80:0/139836974 wait complete. 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 -- start start 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 Processor -- start 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ad3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16fe6b0 0x55fea1ace730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1acec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d201ae050 con 0x55fea16f64d0 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d201af4c0 con 0x55fea171f390 2024-04-25T11:27:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6d201ae720 con 0x55fea16fe6b0 2024-04-25T11:27:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d2f476740 10 client.0 _ll_register_callbacks cb 0x7f6d1c00b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26361640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ad3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26361640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ad3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45270/0 (socket says 172.21.15.80:45270) 2024-04-25T11:27:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26361640 1 -- 172.21.15.80:0/2181890372 learned_addr learned my addr 172.21.15.80:0/2181890372 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26b62640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1acec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d25b60640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16fe6b0 0x55fea1ace730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26361640 1 -- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16fe6b0 msgr2=0x55fea1ace730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26361640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16fe6b0 0x55fea1ace730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26361640 1 -- 172.21.15.80:0/2181890372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 msgr2=0x55fea1acec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.880+0000 7f6d26361640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1acec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d26361640 1 -- 172.21.15.80:0/2181890372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea1acf2b0 con 0x55fea16f64d0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d26b62640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1acec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d26361640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ad3390 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6d100fd350 tx=0x7f6d10009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcf423540cc703 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d09ffb640 1 -- 172.21.15.80:0/2181890372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10049030 con 0x55fea16f64d0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d09ffb640 1 -- 172.21.15.80:0/2181890372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6d10105320 con 0x55fea16f64d0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d1c005360 con 0x55fea16f64d0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d09ffb640 1 -- 172.21.15.80:0/2181890372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6d100c70f0 con 0x55fea16f64d0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 10 client.16380 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fea1b455a0 con 0x55fea16f64d0 2024-04-25T11:27:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d09ffb640 1 -- 172.21.15.80:0/2181890372 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d1c005360 con 0x55fea16f64d0 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d09ffb640 1 -- 172.21.15.80:0/2181890372 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6d100fcfd0 con 0x55fea16f64d0 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 10 client.16380 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 10 client.16380 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 20 client.16380 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16b33a0 0x55fea1b47b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 4 client.16380 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.881+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fea1ac10e0 con 0x55fea16b33a0 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d25b60640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16b33a0 0x55fea1b47b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d09ffb640 10 client.16380 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d25b60640 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16b33a0 0x55fea1b47b80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88223830dca973f server_cookie=f5ed4b958449281c in_seq=0 out_seq=0 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d09ffb640 1 -- 172.21.15.80:0/2181890372 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fea1ac10e0 con 0x55fea16b33a0 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d09ffb640 10 client.16380 handle_command_reply: tid=0 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 client.16380 shutdown 2024-04-25T11:27:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 msgr2=0x55fea1ad3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ad3390 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6d100fd350 tx=0x7f6d10009260 comp rx=0 tx=0).stop 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 shutdown_connections 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fea16b33a0 0x55fea1b47b80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea171f390 0x55fea1acec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fea16fe6b0 0x55fea1ace730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d09ffb640 0 client.16380 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 --2- 172.21.15.80:0/2181890372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fea16f64d0 0x55fea1ad3390 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.882+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 >> 172.21.15.80:0/2181890372 conn(0x55fea17134e0 msgr2=0x55fea1abbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 shutdown_connections 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d2f476740 1 -- 172.21.15.80:0/2181890372 wait complete. 2024-04-25T11:27:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d2f476740 20 client.16380 trim_cache size 0 max 16384 2024-04-25T11:27:32.883 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6d0c0afc60 msgr2=0x7f6d0c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6d0c0afc60 0x7f6d0c0b2170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55fea1abd980 tx=0x7f6d180074a0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d201027c0 msgr2=0x7f6d2019a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d201027c0 0x7f6d2019a7b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6d10004270 tx=0x7f6d100042a0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 shutdown_connections 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6d0c0afc60 0x7f6d0c0b2170 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d20109fe0 0x7f6d2019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d20109b40 0x7f6d2019ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 --2- 172.21.15.80:0/1446972289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d201027c0 0x7f6d2019a7b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 >> 172.21.15.80:0/1446972289 conn(0x7f6d20077920 msgr2=0x7f6d20105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 shutdown_connections 2024-04-25T11:27:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:32.883+0000 7f6d285c5640 1 -- 172.21.15.80:0/1446972289 wait complete. 2024-04-25T11:27:32.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:27:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 -- 172.21.15.80:0/2423167652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107b10 msgr2=0x7f514c10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 --2- 172.21.15.80:0/2423167652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107b10 0x7f514c10f2b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5144009ca0 tx=0x7f514402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 -- 172.21.15.80:0/2423167652 shutdown_connections 2024-04-25T11:27:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 --2- 172.21.15.80:0/2423167652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107b10 0x7f514c10f2b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 --2- 172.21.15.80:0/2423167652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c107050 0x7f514c107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 --2- 172.21.15.80:0/2423167652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f514c102ac0 0x7f514c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 -- 172.21.15.80:0/2423167652 >> 172.21.15.80:0/2423167652 conn(0x7f514c0fe080 msgr2=0x7f514c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 -- 172.21.15.80:0/2423167652 shutdown_connections 2024-04-25T11:27:32.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.005+0000 7f5152d9d640 1 -- 172.21.15.80:0/2423167652 wait complete. 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 Processor -- start 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 -- start start 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c102ac0 0x7f514c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107050 0x7f514c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f514c107b10 0x7f514c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f514c113b40 con 0x7f514c107050 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1139c0 con 0x7f514c102ac0 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5152d9d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f514c113cc0 con 0x7f514c107b10 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107050 0x7f514c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107050 0x7f514c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45284/0 (socket says 172.21.15.80:45284) 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 -- 172.21.15.80:0/237047002 learned_addr learned my addr 172.21.15.80:0/237047002 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f5151d9b640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c102ac0 0x7f514c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515259c640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f514c107b10 0x7f514c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 -- 172.21.15.80:0/237047002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f514c107b10 msgr2=0x7f514c19ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f514c107b10 0x7f514c19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 -- 172.21.15.80:0/237047002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c102ac0 msgr2=0x7f514c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c102ac0 0x7f514c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.006+0000 7f515159a640 1 -- 172.21.15.80:0/237047002 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c19f340 con 0x7f514c107050 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.007+0000 7f515159a640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107050 0x7f514c19aa40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f513c005fd0 tx=0x7f513c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.007+0000 7f5142ffd640 1 -- 172.21.15.80:0/237047002 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c017070 con 0x7f514c107050 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.007+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514c19f630 con 0x7f514c107050 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.007+0000 7f5142ffd640 1 -- 172.21.15.80:0/237047002 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f513c009c30 con 0x7f514c107050 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.007+0000 7f5142ffd640 1 -- 172.21.15.80:0/237047002 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c003d30 con 0x7f514c107050 2024-04-25T11:27:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.007+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514c1a6fb0 con 0x7f514c107050 2024-04-25T11:27:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.009+0000 7f5142ffd640 1 -- 172.21.15.80:0/237047002 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f513c003ed0 con 0x7f514c107050 2024-04-25T11:27:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.009+0000 7f515af8c740 1 Processor -- start 2024-04-25T11:27:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.009+0000 7f515af8c740 1 -- start start 2024-04-25T11:27:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515af8c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77fe390 0x555ab7b9f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515af8c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7b9ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515af8c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7bac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515af8c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555ab7b04d80 con 0x555ab77dd6b0 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515af8c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ab7abea20 con 0x555ab77d54d0 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515af8c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555ab7b00d40 con 0x555ab77fe390 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7bac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7bac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45290/0 (socket says 172.21.15.80:45290) 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 -- 172.21.15.80:0/2897673329 learned_addr learned my addr 172.21.15.80:0/2897673329 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f5142ffd640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51380afc50 0x7f51380b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f5151d9b640 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7b9ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515259c640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51380afc50 0x7f51380b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 -- 172.21.15.80:0/2897673329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77fe390 msgr2=0x555ab7b9f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77fe390 0x555ab7b9f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 -- 172.21.15.80:0/2897673329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 msgr2=0x555ab7b9ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7b9ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f515159a640 1 -- 172.21.15.80:0/2897673329 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab7ac9c30 con 0x555ab77dd6b0 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.010+0000 7f5142ffd640 1 -- 172.21.15.80:0/237047002 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f513c0dec60 con 0x7f514c107050 2024-04-25T11:27:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.011+0000 7f515159a640 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7bac870 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f513c0a6b10 tx=0x7f513c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c332452126208f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.011+0000 7f515259c640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51380afc50 0x7f51380b2160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f514402f500 tx=0x7f514402f310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.011+0000 7f5137fff640 1 -- 172.21.15.80:0/2897673329 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0a6920 con 0x555ab77dd6b0 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.011+0000 7f5137fff640 1 -- 172.21.15.80:0/2897673329 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f513c012e30 con 0x555ab77dd6b0 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.011+0000 7f5137fff640 1 -- 172.21.15.80:0/2897673329 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0ab1c0 con 0x555ab77dd6b0 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 -- 172.21.15.80:0/2897673329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 msgr2=0x555ab7bac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7bac870 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f513c0a6b10 tx=0x7f513c00bf60 comp rx=0 tx=0).stop 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 -- 172.21.15.80:0/2897673329 shutdown_connections 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7bac870 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7b9ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 --2- 172.21.15.80:0/2897673329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77fe390 0x555ab7b9f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 -- 172.21.15.80:0/2897673329 >> 172.21.15.80:0/2897673329 conn(0x555ab77f24e0 msgr2=0x555ab7b9c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 -- 172.21.15.80:0/2897673329 shutdown_connections 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 -- 172.21.15.80:0/2897673329 wait complete. 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 -- start start 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.012+0000 7f515af8c740 1 Processor -- start 2024-04-25T11:27:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77d54d0 0x555ab7baa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7baaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bb6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555ab7bacf00 con 0x555ab77dd6b0 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ab7a8bdc0 con 0x555ab77fe390 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555ab7bad080 con 0x555ab77d54d0 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 10 client.0 _ll_register_callbacks cb 0x555ab7aa7600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7baaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7baaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45294/0 (socket says 172.21.15.80:45294) 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 -- 172.21.15.80:0/612707940 learned_addr learned my addr 172.21.15.80:0/612707940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515259c640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bb6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f5151d9b640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77d54d0 0x555ab7baa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 -- 172.21.15.80:0/612707940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77d54d0 msgr2=0x555ab7baa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77d54d0 0x555ab7baa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 -- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 msgr2=0x555ab7bb6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bb6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 -- 172.21.15.80:0/612707940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab78163f0 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f5151d9b640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77d54d0 0x555ab7baa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515259c640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bb6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515159a640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7baaa00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f513c0a2e90 tx=0x7f513c0afdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a292b394119dbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f51357fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f51357fa640 1 -- 172.21.15.80:0/612707940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0e1070 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f51357fa640 1 -- 172.21.15.80:0/612707940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f513c0a30a0 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.013+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f513c012e30 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f51357fa640 1 -- 172.21.15.80:0/612707940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f513c009de0 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 10 client.16392 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ab78e07d0 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f51357fa640 1 -- 172.21.15.80:0/612707940 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f513c012e30 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f51357fa640 1 -- 172.21.15.80:0/612707940 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f513c0c0070 con 0x555ab77dd6b0 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 10 client.16392 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:33.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 20 client.16392 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77bcf60 0x555ab7bbc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 4 client.16392 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ab7b12990 con 0x555ab77bcf60 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.014+0000 7f5151d9b640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77bcf60 0x555ab7bbc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.015+0000 7f51357fa640 10 client.16392 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.015+0000 7f5151d9b640 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77bcf60 0x555ab7bbc6e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e907df30638c65d server_cookie=88e6506eedbe650e in_seq=0 out_seq=0 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.015+0000 7f51357fa640 1 -- 172.21.15.80:0/612707940 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555ab7b12990 con 0x555ab77bcf60 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.015+0000 7f51357fa640 10 client.16392 handle_command_reply: tid=0 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.015+0000 7f515af8c740 1 client.16392 shutdown 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 msgr2=0x555ab7baaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7baaa00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f513c0a2e90 tx=0x7f513c0afdc0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 shutdown_connections 2024-04-25T11:27:33.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77bcf60 0x555ab7bbc6e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77dd6b0 0x555ab7baaa00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bb6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 --2- 172.21.15.80:0/612707940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77d54d0 0x555ab7baa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f51357fa640 0 client.16392 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 >> 172.21.15.80:0/612707940 conn(0x555ab77f24e0 msgr2=0x555ab7ba1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 shutdown_connections 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 1 -- 172.21.15.80:0/612707940 wait complete. 2024-04-25T11:27:33.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.016+0000 7f515af8c740 20 client.16392 trim_cache size 0 max 16384 2024-04-25T11:27:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.029+0000 7f515af8c740 1 Processor -- start 2024-04-25T11:27:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.029+0000 7f515af8c740 1 -- start start 2024-04-25T11:27:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515af8c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7ba4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515af8c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7ba4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515af8c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77fe390 0x555ab7bb5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515af8c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1b2120 con 0x555ab77fe390 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515af8c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1af9f0 con 0x555ab77d54d0 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515af8c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1ad840 con 0x555ab77dd6b0 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77fe390 0x555ab7bb5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77fe390 0x555ab7bb5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45302/0 (socket says 172.21.15.80:45302) 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 -- 172.21.15.80:0/2591215537 learned_addr learned my addr 172.21.15.80:0/2591215537 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f5151d9b640 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7ba4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515159a640 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7ba4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 -- 172.21.15.80:0/2591215537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 msgr2=0x555ab7ba4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7ba4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 -- 172.21.15.80:0/2591215537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 msgr2=0x555ab7ba4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7ba4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 -- 172.21.15.80:0/2591215537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab7b9cd00 con 0x555ab77fe390 2024-04-25T11:27:33.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f5151d9b640 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7ba4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f515259c640 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77fe390 0x555ab7bb5d90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5144035000 tx=0x7f514403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d89d908f3e9adbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f51377fe640 1 -- 172.21.15.80:0/2591215537 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144031710 con 0x555ab77fe390 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f51377fe640 1 -- 172.21.15.80:0/2591215537 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f514404b070 con 0x555ab77fe390 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.030+0000 7f51377fe640 1 -- 172.21.15.80:0/2591215537 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144004790 con 0x555ab77fe390 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 -- 172.21.15.80:0/2591215537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77fe390 msgr2=0x555ab7bb5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77fe390 0x555ab7bb5d90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5144035000 tx=0x7f514403e000 comp rx=0 tx=0).stop 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 -- 172.21.15.80:0/2591215537 shutdown_connections 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77fe390 0x555ab7bb5d90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7ba4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 --2- 172.21.15.80:0/2591215537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77d54d0 0x555ab7ba4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 -- 172.21.15.80:0/2591215537 >> 172.21.15.80:0/2591215537 conn(0x555ab77f24e0 msgr2=0x555ab7bac270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 -- 172.21.15.80:0/2591215537 shutdown_connections 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.031+0000 7f515af8c740 1 -- 172.21.15.80:0/2591215537 wait complete. 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 -- start start 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 Processor -- start 2024-04-25T11:27:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77d54d0 0x555ab7c1cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7c1d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bbeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1adeb0 con 0x555ab77d54d0 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1af320 con 0x555ab77fe390 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1ae580 con 0x555ab77dd6b0 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515af8c740 10 client.0 _ll_register_callbacks cb 0x7f5148004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77d54d0 0x555ab7c1cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77d54d0 0x555ab7c1cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45316/0 (socket says 172.21.15.80:45316) 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 -- 172.21.15.80:0/3054631825 learned_addr learned my addr 172.21.15.80:0/3054631825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515159a640 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7c1d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f515259c640 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bbeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 -- 172.21.15.80:0/3054631825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 msgr2=0x555ab7c1d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7c1d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 -- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 msgr2=0x555ab7bbeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bbeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.032+0000 7f5151d9b640 1 -- 172.21.15.80:0/3054631825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab7bbf510 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f5151d9b640 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77d54d0 0x555ab7c1cf60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5148000c00 tx=0x7f514800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fa1916032434ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f51357fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f51357fa640 1 -- 172.21.15.80:0/3054631825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148005220 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f51357fa640 1 -- 172.21.15.80:0/3054631825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f51480053c0 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514404b070 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f51357fa640 1 -- 172.21.15.80:0/3054631825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f51480055c0 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 10 client.16398 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ab7c24620 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f51357fa640 1 -- 172.21.15.80:0/3054631825 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f514404b070 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f51357fa640 1 -- 172.21.15.80:0/3054631825 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f514801d750 con 0x555ab77d54d0 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 10 client.16398 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 20 client.16398 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77923a0 0x555ab7c26dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 4 client.16398 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.033+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ab7b0c800 con 0x555ab77923a0 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515159a640 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77923a0 0x555ab7c26dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f51357fa640 10 client.16398 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515159a640 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77923a0 0x555ab7c26dc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48f4fdf07500074 server_cookie=2291cd889a52e9b7 in_seq=0 out_seq=0 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f51357fa640 1 -- 172.21.15.80:0/3054631825 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ab7b0c800 con 0x555ab77923a0 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f51357fa640 10 client.16398 handle_command_reply: tid=0 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 client.16398 shutdown 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77d54d0 msgr2=0x555ab7c1cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77d54d0 0x555ab7c1cf60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5148000c00 tx=0x7f514800bdf0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 shutdown_connections 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555ab77923a0 0x555ab7c26dc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ab77fe390 0x555ab7bbeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ab77dd6b0 0x555ab7c1d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f51357fa640 0 client.16398 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.034+0000 7f515af8c740 1 --2- 172.21.15.80:0/3054631825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ab77d54d0 0x555ab7c1cf60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 >> 172.21.15.80:0/3054631825 conn(0x555ab77f24e0 msgr2=0x555ab7bb5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 shutdown_connections 2024-04-25T11:27:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f515af8c740 1 -- 172.21.15.80:0/3054631825 wait complete. 2024-04-25T11:27:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f515af8c740 20 client.16398 trim_cache size 0 max 16384 2024-04-25T11:27:33.033 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:27:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51380afc50 msgr2=0x7f51380b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51380afc50 0x7f51380b2160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f514402f500 tx=0x7f514402f310 comp rx=0 tx=0).stop 2024-04-25T11:27:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107050 msgr2=0x7f514c19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107050 0x7f514c19aa40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f513c005fd0 tx=0x7f513c00dde0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 shutdown_connections 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51380afc50 0x7f51380b2160 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c107050 0x7f514c19aa40 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f514c107b10 0x7f514c19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 --2- 172.21.15.80:0/237047002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f514c102ac0 0x7f514c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 >> 172.21.15.80:0/237047002 conn(0x7f514c0fe080 msgr2=0x7f514c1051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 shutdown_connections 2024-04-25T11:27:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:33.035+0000 7f5152d9d640 1 -- 172.21.15.80:0/237047002 wait complete. 2024-04-25T11:27:33.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:33 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1545766106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:27:33.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:33 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1545766106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:27:33.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:33 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1545766106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:27:34.039 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:27:34.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:27:34.039 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.171+0000 7f21d4a34640 1 -- 172.21.15.80:0/384892996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0109fc0 msgr2=0x7f21d0103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.171+0000 7f21d4a34640 1 --2- 172.21.15.80:0/384892996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0109fc0 0x7f21d0103c00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009900 tx=0x7f21c002a410 comp rx=0 tx=0).stop 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 -- 172.21.15.80:0/384892996 shutdown_connections 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 --2- 172.21.15.80:0/384892996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0109fc0 0x7f21d0103c00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 --2- 172.21.15.80:0/384892996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21d0104270 0x7f21d0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 --2- 172.21.15.80:0/384892996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d0109b20 0x7f21d01036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 -- 172.21.15.80:0/384892996 >> 172.21.15.80:0/384892996 conn(0x7f21d00ff1e0 msgr2=0x7f21d0101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 -- 172.21.15.80:0/384892996 shutdown_connections 2024-04-25T11:27:34.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 -- 172.21.15.80:0/384892996 wait complete. 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 Processor -- start 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.172+0000 7f21d4a34640 1 -- start start 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21d4a34640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0104270 0x7f21d019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21d4a34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d0109b20 0x7f21d019acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21d4a34640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21d0109fc0 0x7f21d019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21d4a34640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0113d10 con 0x7f21d0104270 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21d4a34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0113b90 con 0x7f21d0109b20 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21d4a34640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0113e90 con 0x7f21d0109fc0 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0104270 0x7f21d019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0104270 0x7f21d019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45322/0 (socket says 172.21.15.80:45322) 2024-04-25T11:27:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 -- 172.21.15.80:0/4255474373 learned_addr learned my addr 172.21.15.80:0/4255474373 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ced9d640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21d0109fc0 0x7f21d019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d0109b20 0x7f21d019acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 -- 172.21.15.80:0/4255474373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21d0109fc0 msgr2=0x7f21d019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21d0109fc0 0x7f21d019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 -- 172.21.15.80:0/4255474373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d0109b20 msgr2=0x7f21d019acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d0109b20 0x7f21d019acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 -- 172.21.15.80:0/4255474373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d019f5f0 con 0x7f21d0104270 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ced9d640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21d0109fc0 0x7f21d019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21ce59c640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0104270 0x7f21d019a790 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d770 tx=0x7f21c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.173+0000 7f21bf7fe640 1 -- 172.21.15.80:0/4255474373 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4017070 con 0x7f21d0104270 2024-04-25T11:27:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.174+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d019f8e0 con 0x7f21d0104270 2024-04-25T11:27:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.174+0000 7f21bf7fe640 1 -- 172.21.15.80:0/4255474373 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c4009c30 con 0x7f21d0104270 2024-04-25T11:27:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.174+0000 7f21bf7fe640 1 -- 172.21.15.80:0/4255474373 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c400f620 con 0x7f21d0104270 2024-04-25T11:27:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.174+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d01a7260 con 0x7f21d0104270 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.176+0000 7f21db9c4740 1 Processor -- start 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.176+0000 7f21db9c4740 1 -- start start 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21bf7fe640 1 -- 172.21.15.80:0/4255474373 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f21c401a070 con 0x7f21d0104270 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18a4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21db9c4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5648a180ab00 con 0x5648a1504410 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21db9c4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648a17a6920 con 0x5648a14db550 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21db9c4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5648a1806ac0 con 0x5648a14e3730 2024-04-25T11:27:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45332/0 (socket says 172.21.15.80:45332) 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 -- 172.21.15.80:0/1831305627 learned_addr learned my addr 172.21.15.80:0/1831305627 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ce59c640 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 -- 172.21.15.80:0/1831305627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 msgr2=0x5648a18a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 -- 172.21.15.80:0/1831305627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 msgr2=0x5648a18a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 -- 172.21.15.80:0/1831305627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a15e47e0 con 0x5648a1504410 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21bf7fe640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21b80afc60 0x7f21b80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ced9d640 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18a4620 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009fb0 tx=0x7f21c8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22767f7c997e3623 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.177+0000 7f21ce59c640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21b80afc60 0x7f21b80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.178+0000 7f21bcff9640 1 -- 172.21.15.80:0/1831305627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8016070 con 0x5648a1504410 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.178+0000 7f21bf7fe640 1 -- 172.21.15.80:0/4255474373 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f21c40deba0 con 0x7f21d0104270 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.178+0000 7f21bcff9640 1 -- 172.21.15.80:0/1831305627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c8012bc0 con 0x5648a1504410 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.178+0000 7f21bcff9640 1 -- 172.21.15.80:0/1831305627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c801bc70 con 0x5648a1504410 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- 172.21.15.80:0/1831305627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 msgr2=0x5648a18a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21ce59c640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21b80afc60 0x7f21b80b2170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c40dc3b0 tx=0x7f21c400de80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18a4620 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009fb0 tx=0x7f21c8010800 comp rx=0 tx=0).stop 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- 172.21.15.80:0/1831305627 shutdown_connections 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 --2- 172.21.15.80:0/1831305627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18a4620 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- 172.21.15.80:0/1831305627 >> 172.21.15.80:0/1831305627 conn(0x5648a14f8560 msgr2=0x5648a18a0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- 172.21.15.80:0/1831305627 shutdown_connections 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- 172.21.15.80:0/1831305627 wait complete. 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- start start 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 Processor -- start 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5648a18b1970 con 0x5648a1504410 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648a17a45d0 con 0x5648a14db550 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.179+0000 7f21db9c4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5648a18b1af0 con 0x5648a14e3730 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21db9c4740 10 client.0 _ll_register_callbacks cb 0x5648a1792080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45346/0 (socket says 172.21.15.80:45346) 2024-04-25T11:27:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 -- 172.21.15.80:0/3344806692 learned_addr learned my addr 172.21.15.80:0/3344806692 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 -- 172.21.15.80:0/3344806692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 msgr2=0x5648a18af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 -- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 msgr2=0x5648a18aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 -- 172.21.15.80:0/3344806692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a1644f70 con 0x5648a1504410 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21ced9d640 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4df0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f21c8010d00 tx=0x7f21c801b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abea2414822c885 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21b5ffb640 1 -- 172.21.15.80:0/3344806692 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8016040 con 0x5648a1504410 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21b5ffb640 1 -- 172.21.15.80:0/3344806692 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f21c801bab0 con 0x5648a1504410 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21c8012bc0 con 0x5648a1504410 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21b5ffb640 1 -- 172.21.15.80:0/3344806692 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f21c8009ae0 con 0x5648a1504410 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21db9c4740 10 client.16410 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.180+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5648a14dc170 con 0x5648a1504410 2024-04-25T11:27:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21b5ffb640 1 -- 172.21.15.80:0/3344806692 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c8012bc0 con 0x5648a1504410 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21b5ffb640 1 -- 172.21.15.80:0/3344806692 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f21c800f040 con 0x5648a1504410 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21db9c4740 10 client.16410 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21db9c4740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21db9c4740 20 client.16410 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21db9c4740 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a14c31f0 0x5648a18c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21db9c4740 4 client.16410 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648a1818710 con 0x5648a14c31f0 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a14c31f0 0x5648a18c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21b5ffb640 10 client.16410 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.181+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a14c31f0 0x5648a18c0e80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2c6fcf960fb3f22 server_cookie=1b1910d628dcfef4 in_seq=0 out_seq=0 2024-04-25T11:27:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21b5ffb640 1 -- 172.21.15.80:0/3344806692 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5648a1818710 con 0x5648a14c31f0 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21b5ffb640 10 client.16410 handle_command_reply: tid=0 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 client.16410 shutdown 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 msgr2=0x5648a18b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4df0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f21c8010d00 tx=0x7f21c801b910 comp rx=0 tx=0).stop 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 shutdown_connections 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a14c31f0 0x5648a18c0e80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4df0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 --2- 172.21.15.80:0/3344806692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21b5ffb640 0 client.16410 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 >> 172.21.15.80:0/3344806692 conn(0x5648a14f8560 msgr2=0x5648a18a4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 shutdown_connections 2024-04-25T11:27:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.182+0000 7f21db9c4740 1 -- 172.21.15.80:0/3344806692 wait complete. 2024-04-25T11:27:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.183+0000 7f21db9c4740 20 client.16410 trim_cache size 0 max 16384 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.200+0000 7f21db9c4740 1 Processor -- start 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.200+0000 7f21db9c4740 1 -- start start 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14db550 0x5648a18add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14e3730 0x5648a189fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21db9c4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01b23f0 con 0x5648a1504410 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21db9c4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01afcc0 con 0x5648a14e3730 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21db9c4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01adb10 con 0x5648a14db550 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45356/0 (socket says 172.21.15.80:45356) 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 -- 172.21.15.80:0/526575261 learned_addr learned my addr 172.21.15.80:0/526575261 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14db550 0x5648a18add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14e3730 0x5648a189fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 -- 172.21.15.80:0/526575261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14db550 msgr2=0x5648a18add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14db550 0x5648a18add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 -- 172.21.15.80:0/526575261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14e3730 msgr2=0x5648a189fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14e3730 0x5648a189fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 -- 172.21.15.80:0/526575261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a18aea60 con 0x5648a1504410 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21ced9d640 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4d60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f21c8005fd0 tx=0x7f21c8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e486245fb3671ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.201+0000 7f21b7fff640 1 -- 172.21.15.80:0/526575261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8016070 con 0x5648a1504410 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21b7fff640 1 -- 172.21.15.80:0/526575261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c803a070 con 0x5648a1504410 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21b7fff640 1 -- 172.21.15.80:0/526575261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c801bab0 con 0x5648a1504410 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 -- 172.21.15.80:0/526575261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 msgr2=0x5648a18b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4d60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f21c8005fd0 tx=0x7f21c8010800 comp rx=0 tx=0).stop 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 -- 172.21.15.80:0/526575261 shutdown_connections 2024-04-25T11:27:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a18b4d60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14e3730 0x5648a189fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 --2- 172.21.15.80:0/526575261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14db550 0x5648a18add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 -- 172.21.15.80:0/526575261 >> 172.21.15.80:0/526575261 conn(0x5648a14f8560 msgr2=0x5648a189f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 -- 172.21.15.80:0/526575261 shutdown_connections 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.202+0000 7f21db9c4740 1 -- 172.21.15.80:0/526575261 wait complete. 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 -- start start 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 Processor -- start 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a1927fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01ae180 con 0x5648a1504410 2024-04-25T11:27:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01af5f0 con 0x5648a14db550 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01ae850 con 0x5648a14e3730 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21db9c4740 10 client.0 _ll_register_callbacks cb 0x7f21c8013e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a1927fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a1927fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45366/0 (socket says 172.21.15.80:45366) 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 -- 172.21.15.80:0/411856220 learned_addr learned my addr 172.21.15.80:0/411856220 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 -- 172.21.15.80:0/411856220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 msgr2=0x5648a18b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18b9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 -- 172.21.15.80:0/411856220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 msgr2=0x5648a18b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.203+0000 7f21ced9d640 1 -- 172.21.15.80:0/411856220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a18b9ff0 con 0x5648a1504410 2024-04-25T11:27:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21ced9d640 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a1927fb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f21c80339d0 tx=0x7f21c8009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdbb37c5a5bebe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21b5ffb640 1 -- 172.21.15.80:0/411856220 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8016040 con 0x5648a1504410 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21b5ffb640 1 -- 172.21.15.80:0/411856220 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f21c8004c00 con 0x5648a1504410 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21c803a070 con 0x5648a1504410 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21b5ffb640 1 -- 172.21.15.80:0/411856220 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f21c8004e00 con 0x5648a1504410 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 10 client.16416 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5648a19295c0 con 0x5648a1504410 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21b5ffb640 1 -- 172.21.15.80:0/411856220 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c803a070 con 0x5648a1504410 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21b5ffb640 1 -- 172.21.15.80:0/411856220 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f21c8012510 con 0x5648a1504410 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 10 client.16416 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 20 client.16416 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a1498630 0x5648a192bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 4 client.16416 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5648a1812580 con 0x5648a1498630 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.204+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a1498630 0x5648a192bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.205+0000 7f21b5ffb640 10 client.16416 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.205+0000 7f21cdd9b640 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a1498630 0x5648a192bbe0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f0b436abcc19f6d server_cookie=115b1591a05e0403 in_seq=0 out_seq=0 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21b5ffb640 1 -- 172.21.15.80:0/411856220 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5648a1812580 con 0x5648a1498630 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21b5ffb640 10 client.16416 handle_command_reply: tid=0 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 client.16416 shutdown 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 msgr2=0x5648a1927fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a1927fb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f21c80339d0 tx=0x7f21c8009c80 comp rx=0 tx=0).stop 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 shutdown_connections 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5648a1498630 0x5648a192bbe0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5648a1504410 0x5648a1927fb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648a14e3730 0x5648a18b9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 --2- 172.21.15.80:0/411856220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a14db550 0x5648a18b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21b5ffb640 0 client.16416 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 >> 172.21.15.80:0/411856220 conn(0x5648a14f8560 msgr2=0x5648a18adaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 shutdown_connections 2024-04-25T11:27:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 1 -- 172.21.15.80:0/411856220 wait complete. 2024-04-25T11:27:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.206+0000 7f21db9c4740 20 client.16416 trim_cache size 0 max 16384 2024-04-25T11:27:34.205 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:27:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:27:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "c8581ae9-3116-4710-9a4e-9fa470d1d016", 2024-04-25T11:27:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:27:34.206 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21b80afc60 msgr2=0x7f21b80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21b80afc60 0x7f21b80b2170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c40dc3b0 tx=0x7f21c400de80 comp rx=0 tx=0).stop 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0104270 msgr2=0x7f21d019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0104270 0x7f21d019a790 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d770 tx=0x7f21c400dc30 comp rx=0 tx=0).stop 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 shutdown_connections 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21b80afc60 0x7f21b80b2170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21d0109fc0 0x7f21d019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d0109b20 0x7f21d019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 --2- 172.21.15.80:0/4255474373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21d0104270 0x7f21d019a790 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 >> 172.21.15.80:0/4255474373 conn(0x7f21d00ff1e0 msgr2=0x7f21d010f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 shutdown_connections 2024-04-25T11:27:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.207+0000 7f21d4a34640 1 -- 172.21.15.80:0/4255474373 wait complete. 2024-04-25T11:27:34.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:27:34.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:27:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 -- 172.21.15.80:0/3382160616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 msgr2=0x7f1938102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3382160616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f1938102b20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1928009900 tx=0x7f192802a410 comp rx=0 tx=0).stop 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 -- 172.21.15.80:0/3382160616 shutdown_connections 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3382160616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f1938102b20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3382160616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1938103190 0x7f193810f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3382160616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1938108a30 0x7f19381025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 -- 172.21.15.80:0/3382160616 >> 172.21.15.80:0/3382160616 conn(0x7f19380fe260 msgr2=0x7f1938100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 -- 172.21.15.80:0/3382160616 shutdown_connections 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.329+0000 7f193fc0c640 1 -- 172.21.15.80:0/3382160616 wait complete. 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 Processor -- start 2024-04-25T11:27:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 -- start start 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1938103190 0x7f193819b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1938108a30 0x7f193819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f193819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1938112c50 con 0x7f1938108ed0 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1938112ad0 con 0x7f1938108a30 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193fc0c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1938112dd0 con 0x7f1938103190 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193e1a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f193819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193e1a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f193819c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45380/0 (socket says 172.21.15.80:45380) 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.330+0000 7f193e1a9640 1 -- 172.21.15.80:0/3557035032 learned_addr learned my addr 172.21.15.80:0/3557035032 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193d9a8640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1938103190 0x7f193819b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1938108a30 0x7f193819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193e1a9640 1 -- 172.21.15.80:0/3557035032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1938103190 msgr2=0x7f193819b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193e1a9640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1938103190 0x7f193819b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193e1a9640 1 -- 172.21.15.80:0/3557035032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1938108a30 msgr2=0x7f193819baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193e1a9640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1938108a30 0x7f193819baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193e1a9640 1 -- 172.21.15.80:0/3557035032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19381a68c0 con 0x7f1938108ed0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193e1a9640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f193819c030 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f193000eaa0 tx=0x7f193000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f192effd640 1 -- 172.21.15.80:0/3557035032 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193000cdb0 con 0x7f1938108ed0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19381a6bb0 con 0x7f1938108ed0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f192effd640 1 -- 172.21.15.80:0/3557035032 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1930005020 con 0x7f1938108ed0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f192effd640 1 -- 172.21.15.80:0/3557035032 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300116d0 con 0x7f1938108ed0 2024-04-25T11:27:34.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.331+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19381a7120 con 0x7f1938108ed0 2024-04-25T11:27:34.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.334+0000 7f1946b98740 1 Processor -- start 2024-04-25T11:27:34.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.334+0000 7f192effd640 1 -- 172.21.15.80:0/3557035032 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1930011870 con 0x7f1938108ed0 2024-04-25T11:27:34.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f1946b98740 1 -- start start 2024-04-25T11:27:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f1946b98740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb74a390 0x5634cbaeaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f1946b98740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaeafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f1946b98740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7296b0 0x5634cbaf78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f1946b98740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5634cba50d80 con 0x5634cb7296b0 2024-04-25T11:27:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f1946b98740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5634cba0a8b0 con 0x5634cb7214d0 2024-04-25T11:27:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f1946b98740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5634cba4cd40 con 0x5634cb74a390 2024-04-25T11:27:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7296b0 0x5634cbaf78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f192effd640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f19240afc60 0x7f19240b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7296b0 0x5634cbaf78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45396/0 (socket says 172.21.15.80:45396) 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f193d1a7640 1 -- 172.21.15.80:0/990715167 learned_addr learned my addr 172.21.15.80:0/990715167 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f193d1a7640 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb74a390 0x5634cbaeaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f193d9a8640 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaeafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.335+0000 7f193e1a9640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f19240afc60 0x7f19240b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f192effd640 1 -- 172.21.15.80:0/3557035032 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f19300df100 con 0x7f1938108ed0 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f193d1a7640 1 -- 172.21.15.80:0/990715167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 msgr2=0x5634cbaeafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f193d1a7640 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaeafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f193d1a7640 1 -- 172.21.15.80:0/990715167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7296b0 msgr2=0x5634cbaf78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f193d1a7640 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7296b0 0x5634cbaf78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f193d1a7640 1 -- 172.21.15.80:0/990715167 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cb9dba40 con 0x5634cb74a390 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f193e1a9640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f19240afc60 0x7f19240b2170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f19300dc9b0 tx=0x7f1930075e50 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f193d1a7640 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb74a390 0x5634cbaeaa60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19280057c0 tx=0x7f1928031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49d1b493a639844 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f1923fff640 1 -- 172.21.15.80:0/990715167 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928035040 con 0x5634cb74a390 2024-04-25T11:27:34.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f1923fff640 1 -- 172.21.15.80:0/990715167 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1928032e30 con 0x5634cb74a390 2024-04-25T11:27:34.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.336+0000 7f1923fff640 1 -- 172.21.15.80:0/990715167 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928003c20 con 0x5634cb74a390 2024-04-25T11:27:34.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 -- 172.21.15.80:0/990715167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb74a390 msgr2=0x5634cbaeaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb74a390 0x5634cbaeaa60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19280057c0 tx=0x7f1928031400 comp rx=0 tx=0).stop 2024-04-25T11:27:34.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 -- 172.21.15.80:0/990715167 shutdown_connections 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7296b0 0x5634cbaf78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaeafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 --2- 172.21.15.80:0/990715167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb74a390 0x5634cbaeaa60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 -- 172.21.15.80:0/990715167 >> 172.21.15.80:0/990715167 conn(0x5634cb73e4e0 msgr2=0x5634cbae7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 -- 172.21.15.80:0/990715167 shutdown_connections 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 -- 172.21.15.80:0/990715167 wait complete. 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.337+0000 7f1946b98740 1 -- start start 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 1 Processor -- start 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaf5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbafb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5634cbaf7f80 con 0x5634cb74a390 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5634cb9d7d10 con 0x5634cb7214d0 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5634cbaf8100 con 0x5634cb7296b0 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f1946b98740 10 client.0 _ll_register_callbacks cb 0x5634cba04210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbafb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbafb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45412/0 (socket says 172.21.15.80:45412) 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 -- 172.21.15.80:0/3984774484 learned_addr learned my addr 172.21.15.80:0/3984774484 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d9a8640 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaf5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 -- 172.21.15.80:0/3984774484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 msgr2=0x5634cbaf5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaf5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 -- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 msgr2=0x5634cbaf5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.338+0000 7f193d1a7640 1 -- 172.21.15.80:0/3984774484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cb82c7d0 con 0x5634cb74a390 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbafb480 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1928000c00 tx=0x7f19280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694120844078a65d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f19217fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f19217fa640 1 -- 172.21.15.80:0/3984774484 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192804f070 con 0x5634cb74a390 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1928032e30 con 0x5634cb74a390 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f19217fa640 1 -- 172.21.15.80:0/3984774484 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1928004230 con 0x5634cb74a390 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f19217fa640 1 -- 172.21.15.80:0/3984774484 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f192805e050 con 0x5634cb74a390 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 10 client.16428 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:34.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5634cb7623f0 con 0x5634cb74a390 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f19217fa640 1 -- 172.21.15.80:0/3984774484 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1928032e30 con 0x5634cb74a390 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f19217fa640 1 -- 172.21.15.80:0/3984774484 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f192803a040 con 0x5634cb74a390 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 10 client.16428 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 20 client.16428 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb708f60 0x5634cbb07550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 4 client.16428 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.339+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634cba5e990 con 0x5634cb708f60 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.340+0000 7f193d9a8640 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb708f60 0x5634cbb07550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.340+0000 7f19217fa640 10 client.16428 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.340+0000 7f193d9a8640 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb708f60 0x5634cbb07550 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7292aaafabbee2ff server_cookie=a12e98936f8e0603 in_seq=0 out_seq=0 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f19217fa640 1 -- 172.21.15.80:0/3984774484 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5634cba5e990 con 0x5634cb708f60 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f19217fa640 10 client.16428 handle_command_reply: tid=0 2024-04-25T11:27:34.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 client.16428 shutdown 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 msgr2=0x5634cbafb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbafb480 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1928000c00 tx=0x7f19280057f0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 shutdown_connections 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb708f60 0x5634cbb07550 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbafb480 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaf5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f19217fa640 0 client.16428 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 --2- 172.21.15.80:0/3984774484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 >> 172.21.15.80:0/3984774484 conn(0x5634cb73e4e0 msgr2=0x5634cbaec780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 shutdown_connections 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 1 -- 172.21.15.80:0/3984774484 wait complete. 2024-04-25T11:27:34.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.341+0000 7f1946b98740 20 client.16428 trim_cache size 0 max 16384 2024-04-25T11:27:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.359+0000 7f1946b98740 1 Processor -- start 2024-04-25T11:27:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.359+0000 7f1946b98740 1 -- start start 2024-04-25T11:27:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f1946b98740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f1946b98740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaeed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f1946b98740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbaef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f1946b98740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f19381b2330 con 0x5634cb74a390 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f1946b98740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19381afc00 con 0x5634cb7214d0 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f1946b98740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f19381ada50 con 0x5634cb7296b0 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbaef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbaef2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45428/0 (socket says 172.21.15.80:45428) 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 -- 172.21.15.80:0/2046295056 learned_addr learned my addr 172.21.15.80:0/2046295056 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d9a8640 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaeed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 -- 172.21.15.80:0/2046295056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 msgr2=0x5634cbaeed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaeed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 -- 172.21.15.80:0/2046295056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 msgr2=0x5634cbaf4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 -- 172.21.15.80:0/2046295056 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cb7220f0 con 0x5634cb74a390 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f193d1a7640 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbaef2c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1928031740 tx=0x7f1928031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3a360a7c7dcdd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f19237fe640 1 -- 172.21.15.80:0/2046295056 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192804f070 con 0x5634cb74a390 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f19237fe640 1 -- 172.21.15.80:0/2046295056 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1928009780 con 0x5634cb74a390 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.360+0000 7f19237fe640 1 -- 172.21.15.80:0/2046295056 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192803d8a0 con 0x5634cb74a390 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 -- 172.21.15.80:0/2046295056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 msgr2=0x5634cbaef2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbaef2c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1928031740 tx=0x7f1928031400 comp rx=0 tx=0).stop 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 -- 172.21.15.80:0/2046295056 shutdown_connections 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb74a390 0x5634cbaef2c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbaeed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 --2- 172.21.15.80:0/2046295056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb7214d0 0x5634cbaf4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 -- 172.21.15.80:0/2046295056 >> 172.21.15.80:0/2046295056 conn(0x5634cb73e4e0 msgr2=0x5634cbaee670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 -- 172.21.15.80:0/2046295056 shutdown_connections 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.361+0000 7f1946b98740 1 -- 172.21.15.80:0/2046295056 wait complete. 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 -- start start 2024-04-25T11:27:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 Processor -- start 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7214d0 0x5634cbb01020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbb01560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb74a390 0x5634cbafe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f19381ae0c0 con 0x5634cb7214d0 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19381af530 con 0x5634cb74a390 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f19381ae790 con 0x5634cb7296b0 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f1946b98740 10 client.0 _ll_register_callbacks cb 0x7f1934005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7214d0 0x5634cbb01020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f193d1a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7214d0 0x5634cbb01020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45442/0 (socket says 172.21.15.80:45442) 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f193d1a7640 1 -- 172.21.15.80:0/3925960027 learned_addr learned my addr 172.21.15.80:0/3925960027 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f193d9a8640 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbb01560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.362+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb74a390 0x5634cbafe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f193d1a7640 1 -- 172.21.15.80:0/3925960027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 msgr2=0x5634cbb01560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbb01560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f193d1a7640 1 -- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb74a390 msgr2=0x5634cbafe4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb74a390 0x5634cbafe4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f193d1a7640 1 -- 172.21.15.80:0/3925960027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cba114b0 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f193d1a7640 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7214d0 0x5634cbb01020 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f192802a930 tx=0x7f1928032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b48724f9570692d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f19217fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f19217fa640 1 -- 172.21.15.80:0/3925960027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928035070 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f19217fa640 1 -- 172.21.15.80:0/3925960027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1928031cc0 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1928009780 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f19217fa640 1 -- 172.21.15.80:0/3925960027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f192804f040 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 10 client.16434 fetch_fsmap learned FSMap version 24 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5634cbb6edf0 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f19217fa640 1 -- 172.21.15.80:0/3925960027 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1928009780 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f19217fa640 1 -- 172.21.15.80:0/3925960027 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f19280053e0 con 0x5634cb7214d0 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 10 client.16434 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 20 client.16434 populate_metadata read hostname 'smithi080' 2024-04-25T11:27:34.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb6de3a0 0x5634cbb71290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 4 client.16434 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.363+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5634cba58800 con 0x5634cb6de3a0 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f193d9a8640 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb6de3a0 0x5634cbb71290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f19217fa640 10 client.16434 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f193d9a8640 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb6de3a0 0x5634cbb71290 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60872ca012ea7182 server_cookie=9cc008b213f8476e in_seq=0 out_seq=0 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f19217fa640 1 -- 172.21.15.80:0/3925960027 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5634cba58800 con 0x5634cb6de3a0 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f19217fa640 10 client.16434 handle_command_reply: tid=0 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f1946b98740 1 client.16434 shutdown 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7214d0 msgr2=0x5634cbb01020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.364+0000 7f1946b98740 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7214d0 0x5634cbb01020 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f192802a930 tx=0x7f1928032e30 comp rx=0 tx=0).stop 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 shutdown_connections 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5634cb6de3a0 0x5634cbb71290 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634cb74a390 0x5634cbafe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634cb7296b0 0x5634cbb01560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 --2- 172.21.15.80:0/3925960027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5634cb7214d0 0x5634cbb01020 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f19217fa640 0 client.16434 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 >> 172.21.15.80:0/3925960027 conn(0x5634cb73e4e0 msgr2=0x5634cbaef0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 shutdown_connections 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 1 -- 172.21.15.80:0/3925960027 wait complete. 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f1946b98740 20 client.16434 trim_cache size 0 max 16384 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "c8581ae9-3116-4710-9a4e-9fa470d1d016": { 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:27:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "c8581ae9-3116-4710-9a4e-9fa470d1d016", 2024-04-25T11:27:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:27:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:27:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:27:34.364 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:27:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f19240afc60 msgr2=0x7f19240b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f19240afc60 0x7f19240b2170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f19300dc9b0 tx=0x7f1930075e50 comp rx=0 tx=0).stop 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 msgr2=0x7f193819c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f193819c030 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f193000eaa0 tx=0x7f193000ef60 comp rx=0 tx=0).stop 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 shutdown_connections 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f19240afc60 0x7f19240b2170 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1938108ed0 0x7f193819c030 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1938108a30 0x7f193819baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 --2- 172.21.15.80:0/3557035032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1938103190 0x7f193819b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 >> 172.21.15.80:0/3557035032 conn(0x7f19380fe260 msgr2=0x7f19380fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 shutdown_connections 2024-04-25T11:27:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:27:34.365+0000 7f193fc0c640 1 -- 172.21.15.80:0/3557035032 wait complete. 2024-04-25T11:27:34.367 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:34 smithi080 ceph-mon[29126]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:34.368 INFO:tasks.cephfs.filesystem:scrub status for tag:c8581ae9-3116-4710-9a4e-9fa470d1d016 - {'path': '/', 'tag': 'c8581ae9-3116-4710-9a4e-9fa470d1d016', 'options': 'recursive,force'} 2024-04-25T11:27:34.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:34 smithi082 ceph-mon[32440]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:34.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:34 smithi196 ceph-mon[32659]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:35.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:35 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:27:35.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:35 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:35.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:35 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:27:35.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:35 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:35.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:35 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:27:35.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:35 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:35.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:35 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:27:35.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:35 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:35.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:35 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:27:35.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:35 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:35.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:35 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:27:35.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:35 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:27:36.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:36 smithi082 ceph-mon[32440]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:36.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:36 smithi080 ceph-mon[29126]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:36.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:36 smithi196 ceph-mon[32659]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:38.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:38 smithi082 ceph-mon[32440]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:38.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:38 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:27:38.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:38 smithi080 ceph-mon[29126]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:38.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:38 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:27:38.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:38 smithi196 ceph-mon[32659]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:38.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:38 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:27:40.489 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:40 smithi196 ceph-mon[32659]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:40.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:40 smithi082 ceph-mon[32440]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:40.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:40 smithi080 ceph-mon[29126]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:42.492 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:42 smithi082 ceph-mon[32440]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:42.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:42 smithi080 ceph-mon[29126]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:42.690 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:42 smithi196 ceph-mon[32659]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:44.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:44 smithi082 ceph-mon[32440]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:44.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:44 smithi080 ceph-mon[29126]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:44.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:44 smithi196 ceph-mon[32659]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:46.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:46 smithi082 ceph-mon[32440]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:46.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:46 smithi080 ceph-mon[29126]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:46.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:46 smithi196 ceph-mon[32659]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:27:48.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:48 smithi080 ceph-mon[29126]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:48.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:48 smithi196 ceph-mon[32659]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:48.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:48 smithi082 ceph-mon[32440]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:27:50.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:50 smithi080 ceph-mon[29126]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:50.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:50 smithi196 ceph-mon[32659]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:50.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:50 smithi082 ceph-mon[32440]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:52.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:52 smithi080 ceph-mon[29126]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:27:52.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:52 smithi196 ceph-mon[32659]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:27:52.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:52 smithi082 ceph-mon[32440]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:27:54.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:54 smithi080 ceph-mon[29126]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:54.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:54 smithi196 ceph-mon[32659]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:54.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:54 smithi082 ceph-mon[32440]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:56.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:56 smithi080 ceph-mon[29126]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:56.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:56 smithi196 ceph-mon[32659]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:56.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:56 smithi082 ceph-mon[32440]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:27:58.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:27:58 smithi080 ceph-mon[29126]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:27:58.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:27:58 smithi196 ceph-mon[32659]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:27:58.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:27:58 smithi082 ceph-mon[32440]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:00.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:00 smithi080 ceph-mon[29126]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:00.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:00 smithi196 ceph-mon[32659]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:00.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:00 smithi082 ceph-mon[32440]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:02.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:02 smithi080 ceph-mon[29126]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:28:02.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:02 smithi196 ceph-mon[32659]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:28:02.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:02 smithi082 ceph-mon[32440]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:28:04.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:28:04.369 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:28:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/2872842844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 msgr2=0x7f9cd010f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/2872842844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd010f4c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009ca0 tx=0x7f9cc802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/2872842844 shutdown_connections 2024-04-25T11:28:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/2872842844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd010f4c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/2872842844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cd0108ed0 0x7f9cd0102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/2872842844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd0108a30 0x7f9cd01025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/2872842844 >> 172.21.15.80:0/2872842844 conn(0x7f9cd00fe260 msgr2=0x7f9cd0100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/2872842844 shutdown_connections 2024-04-25T11:28:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.503+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/2872842844 wait complete. 2024-04-25T11:28:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 Processor -- start 2024-04-25T11:28:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 -- start start 2024-04-25T11:28:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd0108a30 0x7f9cd019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cd0108ed0 0x7f9cd019bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0112c70 con 0x7f9cd0103190 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0112af0 con 0x7f9cd0108ed0 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd6bfe640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0112df0 con 0x7f9cd0108a30 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd499a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd499a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd019b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47370/0 (socket says 172.21.15.80:47370) 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.504+0000 7f9cd499a640 1 -- 172.21.15.80:0/1003043075 learned_addr learned my addr 172.21.15.80:0/1003043075 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9ccffff640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd0108a30 0x7f9cd019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd519b640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cd0108ed0 0x7f9cd019bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd499a640 1 -- 172.21.15.80:0/1003043075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd0108a30 msgr2=0x7f9cd019ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd499a640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd0108a30 0x7f9cd019ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd499a640 1 -- 172.21.15.80:0/1003043075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cd0108ed0 msgr2=0x7f9cd019bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd499a640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cd0108ed0 0x7f9cd019bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd499a640 1 -- 172.21.15.80:0/1003043075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd01a67d0 con 0x7f9cd0103190 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd499a640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd019b550 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400d750 tx=0x7f9cc400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9ccdffb640 1 -- 172.21.15.80:0/1003043075 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4017070 con 0x7f9cd0103190 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9ccdffb640 1 -- 172.21.15.80:0/1003043075 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc40054d0 con 0x7f9cd0103190 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd01a6ac0 con 0x7f9cd0103190 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9ccdffb640 1 -- 172.21.15.80:0/1003043075 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4004c30 con 0x7f9cd0103190 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.505+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01a6fc0 con 0x7f9cd0103190 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.508+0000 7f9ccdffb640 1 -- 172.21.15.80:0/1003043075 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f9cc4004dd0 con 0x7f9cd0103190 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.508+0000 7f9cddb83740 1 Processor -- start 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cddb83740 1 -- start start 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961db390 0x55979657ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x55979657bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961ba6b0 0x5597965888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cddb83740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5597964e1d80 con 0x5597961db390 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cddb83740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55979649b8b0 con 0x5597961ba6b0 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cddb83740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5597964ddd40 con 0x5597961b24d0 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961db390 0x55979657ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961db390 0x55979657ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47376/0 (socket says 172.21.15.80:47376) 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 -- 172.21.15.80:0/2003661554 learned_addr learned my addr 172.21.15.80:0/2003661554 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9ccdffb640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9cc00afc60 0x7f9cc00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd499a640 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x55979657bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9ccffff640 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961ba6b0 0x5597965888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 -- 172.21.15.80:0/2003661554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 msgr2=0x55979657bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x55979657bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 -- 172.21.15.80:0/2003661554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961ba6b0 msgr2=0x5597965888f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961ba6b0 0x5597965888f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 -- 172.21.15.80:0/2003661554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55979646ca40 con 0x5597961db390 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9cd519b640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9cc00afc60 0x7f9cc00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.509+0000 7f9ccdffb640 1 -- 172.21.15.80:0/1003043075 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f9cc40dea00 con 0x7f9cd0103190 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.510+0000 7f9cd519b640 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961db390 0x55979657ba60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8035000 tx=0x7f9cc80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53937e12a227452c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.510+0000 7f9cbaffd640 1 -- 172.21.15.80:0/2003661554 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8003ab0 con 0x5597961db390 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.510+0000 7f9cbaffd640 1 -- 172.21.15.80:0/2003661554 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc8036040 con 0x5597961db390 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.510+0000 7f9cbaffd640 1 -- 172.21.15.80:0/2003661554 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc802f860 con 0x5597961db390 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 -- 172.21.15.80:0/2003661554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961db390 msgr2=0x55979657ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cd519b640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9cc00afc60 0x7f9cc00b2170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9cc804c000 tx=0x7f9cc8049000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961db390 0x55979657ba60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8035000 tx=0x7f9cc80099e0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 -- 172.21.15.80:0/2003661554 shutdown_connections 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961ba6b0 0x5597965888f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x55979657bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2003661554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961db390 0x55979657ba60 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 -- 172.21.15.80:0/2003661554 >> 172.21.15.80:0/2003661554 conn(0x5597961cf4e0 msgr2=0x559796578210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 -- 172.21.15.80:0/2003661554 shutdown_connections 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 -- 172.21.15.80:0/2003661554 wait complete. 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 -- start start 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.511+0000 7f9cddb83740 1 Processor -- start 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796586590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 0x559796592310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cddb83740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559796588e90 con 0x5597961ba6b0 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cddb83740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559796468d10 con 0x5597961db390 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cddb83740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559796589010 con 0x5597961b24d0 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cddb83740 10 client.0 _ll_register_callbacks cb 0x559796495210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47382/0 (socket says 172.21.15.80:47382) 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 -- 172.21.15.80:0/505200282 learned_addr learned my addr 172.21.15.80:0/505200282 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cd519b640 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 0x559796592310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9cd499a640 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796586590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 -- 172.21.15.80:0/505200282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 msgr2=0x559796586590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796586590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 -- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 msgr2=0x559796592310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 0x559796592310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 -- 172.21.15.80:0/505200282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597962bd7d0 con 0x5597961ba6b0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9ccffff640 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586ad0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc012810 tx=0x7f9cbc012cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e889bcabb6adca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.512+0000 7f9caffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9caffff640 1 -- 172.21.15.80:0/505200282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc010dc0 con 0x5597961ba6b0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9caffff640 1 -- 172.21.15.80:0/505200282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f9cbc005020 con 0x5597961ba6b0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cc8036040 con 0x5597961ba6b0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9caffff640 1 -- 172.21.15.80:0/505200282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9cbc005220 con 0x5597961ba6b0 2024-04-25T11:28:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 10 client.16446 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5597961f33f0 con 0x5597961ba6b0 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9caffff640 1 -- 172.21.15.80:0/505200282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc8036040 con 0x5597961ba6b0 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9caffff640 1 -- 172.21.15.80:0/505200282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9cbc01a430 con 0x5597961ba6b0 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 10 client.16446 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 20 client.16446 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559796199f60 0x559796598630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 4 client.16446 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597964ef990 con 0x559796199f60 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.513+0000 7f9cd499a640 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559796199f60 0x559796598630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.514+0000 7f9cd499a640 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559796199f60 0x559796598630 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4041e0384cbf3a server_cookie=552c9f04f446e469 in_seq=0 out_seq=0 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.514+0000 7f9caffff640 10 client.16446 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.514+0000 7f9caffff640 1 -- 172.21.15.80:0/505200282 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5597964ef990 con 0x559796199f60 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9caffff640 10 client.16446 handle_command_reply: tid=0 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 client.16446 shutdown 2024-04-25T11:28:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 msgr2=0x559796586ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586ad0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc012810 tx=0x7f9cbc012cd0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 shutdown_connections 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559796199f60 0x559796598630 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586ad0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 0x559796592310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9caffff640 0 client.16446 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 --2- 172.21.15.80:0/505200282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796586590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 >> 172.21.15.80:0/505200282 conn(0x5597961cf4e0 msgr2=0x55979657d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 shutdown_connections 2024-04-25T11:28:04.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 1 -- 172.21.15.80:0/505200282 wait complete. 2024-04-25T11:28:04.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.515+0000 7f9cddb83740 20 client.16446 trim_cache size 0 max 16384 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 Processor -- start 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 -- start start 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961b24d0 0x559796581b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961db390 0x559796585360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01b21f0 con 0x5597961ba6b0 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01afac0 con 0x5597961b24d0 2024-04-25T11:28:04.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cddb83740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01ad910 con 0x5597961db390 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47388/0 (socket says 172.21.15.80:47388) 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9ccffff640 1 -- 172.21.15.80:0/1115729026 learned_addr learned my addr 172.21.15.80:0/1115729026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cd499a640 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961b24d0 0x559796581b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9cd519b640 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961db390 0x559796585360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9ccffff640 1 -- 172.21.15.80:0/1115729026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961db390 msgr2=0x559796585360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.533+0000 7f9ccffff640 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961db390 0x559796585360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9ccffff640 1 -- 172.21.15.80:0/1115729026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961b24d0 msgr2=0x559796581b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9ccffff640 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961b24d0 0x559796581b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9ccffff640 1 -- 172.21.15.80:0/1115729026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597961b30f0 con 0x5597961ba6b0 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9cd519b640 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961db390 0x559796585360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9cd499a640 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961b24d0 0x559796581b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9ccffff640 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586590 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00a8b0 tx=0x7f9cbc01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157981fc62a4202b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9cba7fc640 1 -- 172.21.15.80:0/1115729026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc031070 con 0x5597961ba6b0 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9cba7fc640 1 -- 172.21.15.80:0/1115729026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cbc01a630 con 0x5597961ba6b0 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.534+0000 7f9cba7fc640 1 -- 172.21.15.80:0/1115729026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0122a0 con 0x5597961ba6b0 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 -- 172.21.15.80:0/1115729026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 msgr2=0x559796586590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586590 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00a8b0 tx=0x7f9cbc01bf80 comp rx=0 tx=0).stop 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 -- 172.21.15.80:0/1115729026 shutdown_connections 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796586590 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961db390 0x559796585360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 --2- 172.21.15.80:0/1115729026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961b24d0 0x559796581b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 -- 172.21.15.80:0/1115729026 >> 172.21.15.80:0/1115729026 conn(0x5597961cf4e0 msgr2=0x559796584c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 -- 172.21.15.80:0/1115729026 shutdown_connections 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 -- 172.21.15.80:0/1115729026 wait complete. 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 -- start start 2024-04-25T11:28:04.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.535+0000 7f9cddb83740 1 Processor -- start 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796589600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796589b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 0x5597965fe990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01adf80 con 0x5597961ba6b0 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01af3f0 con 0x5597961db390 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01ae650 con 0x5597961b24d0 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 10 client.0 _ll_register_callbacks cb 0x7f9cbc00a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796589b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796589b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47390/0 (socket says 172.21.15.80:47390) 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 -- 172.21.15.80:0/2617254592 learned_addr learned my addr 172.21.15.80:0/2617254592 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cd499a640 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796589600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 -- 172.21.15.80:0/2617254592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 msgr2=0x559796589600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796589600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 -- 172.21.15.80:0/2617254592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 msgr2=0x5597965fe990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 0x5597965fe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 -- 172.21.15.80:0/2617254592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597964a24b0 con 0x5597961ba6b0 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9ccffff640 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796589b40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc01a970 tx=0x7f9cbc010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1782f3dbcea46b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9caffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9caffff640 1 -- 172.21.15.80:0/2617254592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc031040 con 0x5597961ba6b0 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9caffff640 1 -- 172.21.15.80:0/2617254592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f9cbc0053c0 con 0x5597961ba6b0 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cbc01a630 con 0x5597961ba6b0 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9caffff640 1 -- 172.21.15.80:0/2617254592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9cbc0055e0 con 0x5597961ba6b0 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 10 client.16452 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:04.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.536+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5597965ffed0 con 0x5597961ba6b0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9caffff640 1 -- 172.21.15.80:0/2617254592 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cbc01a630 con 0x5597961ba6b0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9caffff640 1 -- 172.21.15.80:0/2617254592 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9cbc003af0 con 0x5597961ba6b0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cddb83740 10 client.16452 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cddb83740 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cddb83740 20 client.16452 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55979616f3a0 0x559796602590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cddb83740 4 client.16452 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597964e9800 con 0x55979616f3a0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cd499a640 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55979616f3a0 0x559796602590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9caffff640 10 client.16452 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.537+0000 7f9cd499a640 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55979616f3a0 0x559796602590 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84090eeacd42a243 server_cookie=a700da22b5e16df7 in_seq=0 out_seq=0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9caffff640 1 -- 172.21.15.80:0/2617254592 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5597964e9800 con 0x55979616f3a0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9caffff640 10 client.16452 handle_command_reply: tid=0 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 client.16452 shutdown 2024-04-25T11:28:04.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 msgr2=0x559796589b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796589b40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc01a970 tx=0x7f9cbc010dd0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 shutdown_connections 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55979616f3a0 0x559796602590 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597961ba6b0 0x559796589b40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597961db390 0x5597965fe990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9caffff640 0 client.16452 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 --2- 172.21.15.80:0/2617254592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597961b24d0 0x559796589600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 >> 172.21.15.80:0/2617254592 conn(0x5597961cf4e0 msgr2=0x559796587a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 shutdown_connections 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 1 -- 172.21.15.80:0/2617254592 wait complete. 2024-04-25T11:28:04.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cddb83740 20 client.16452 trim_cache size 0 max 16384 2024-04-25T11:28:04.541 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:28:04.541 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:28:04.541 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:28:04.541 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9cc00afc60 msgr2=0x7f9cc00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9cc00afc60 0x7f9cc00b2170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9cc804c000 tx=0x7f9cc8049000 comp rx=0 tx=0).stop 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 msgr2=0x7f9cd019b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.538+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd019b550 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400d750 tx=0x7f9cc400dc10 comp rx=0 tx=0).stop 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 shutdown_connections 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9cc00afc60 0x7f9cc00b2170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cd0108ed0 0x7f9cd019bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd0108a30 0x7f9cd019ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 --2- 172.21.15.80:0/1003043075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9cd0103190 0x7f9cd019b550 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 >> 172.21.15.80:0/1003043075 conn(0x7f9cd00fe260 msgr2=0x7f9cd0100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 shutdown_connections 2024-04-25T11:28:04.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.539+0000 7f9cd6bfe640 1 -- 172.21.15.80:0/1003043075 wait complete. 2024-04-25T11:28:04.543 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:04 smithi080 ceph-mon[29126]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:28:04.544 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:28:04.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 -- 172.21.15.80:0/2941660108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c10d380 msgr2=0x7f811c10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 --2- 172.21.15.80:0/2941660108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c10d380 0x7f811c10f7a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8114009ca0 tx=0x7f811402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 -- 172.21.15.80:0/2941660108 shutdown_connections 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 --2- 172.21.15.80:0/2941660108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c10d380 0x7f811c10f7a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 --2- 172.21.15.80:0/2941660108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f811c102af0 0x7f811c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 --2- 172.21.15.80:0/2941660108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c108a20 0x7f811c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 -- 172.21.15.80:0/2941660108 >> 172.21.15.80:0/2941660108 conn(0x7f811c078110 msgr2=0x7f811c078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 -- 172.21.15.80:0/2941660108 shutdown_connections 2024-04-25T11:28:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.661+0000 7f8120a61640 1 -- 172.21.15.80:0/2941660108 wait complete. 2024-04-25T11:28:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 Processor -- start 2024-04-25T11:28:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 -- start start 2024-04-25T11:28:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c102af0 0x7f811c199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f811c108a20 0x7f811c199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c10d380 0x7f811c19dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f811c112c00 con 0x7f811c102af0 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f811c112a80 con 0x7f811c10d380 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8120a61640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f811c112d80 con 0x7f811c108a20 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f811a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c102af0 0x7f811c199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f811a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c102af0 0x7f811c199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47414/0 (socket says 172.21.15.80:47414) 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f811a59c640 1 -- 172.21.15.80:0/1393230845 learned_addr learned my addr 172.21.15.80:0/1393230845 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f8119d9b640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f811c108a20 0x7f811c199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.662+0000 7f811ad9d640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c10d380 0x7f811c19dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f811a59c640 1 -- 172.21.15.80:0/1393230845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f811c108a20 msgr2=0x7f811c199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f811a59c640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f811c108a20 0x7f811c199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f811a59c640 1 -- 172.21.15.80:0/1393230845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c10d380 msgr2=0x7f811c19dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f811a59c640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c10d380 0x7f811c19dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f811a59c640 1 -- 172.21.15.80:0/1393230845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c19e340 con 0x7f811c102af0 2024-04-25T11:28:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f811a59c640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c102af0 0x7f811c199560 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f811000c9a0 tx=0x7f811000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f810b7fe640 1 -- 172.21.15.80:0/1393230845 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110014070 con 0x7f811c102af0 2024-04-25T11:28:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f810b7fe640 1 -- 172.21.15.80:0/1393230845 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8110004440 con 0x7f811c102af0 2024-04-25T11:28:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c19e630 con 0x7f811c102af0 2024-04-25T11:28:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f810b7fe640 1 -- 172.21.15.80:0/1393230845 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811000f450 con 0x7f811c102af0 2024-04-25T11:28:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.663+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c1a6030 con 0x7f811c102af0 2024-04-25T11:28:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.664+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c103cd0 con 0x7f811c102af0 2024-04-25T11:28:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.666+0000 7f810b7fe640 1 -- 172.21.15.80:0/1393230845 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f8110017070 con 0x7f811c102af0 2024-04-25T11:28:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.666+0000 7f810b7fe640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f81040afce0 0x7f81040b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.666+0000 7f810b7fe640 1 -- 172.21.15.80:0/1393230845 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f81100df2a0 con 0x7f811c102af0 2024-04-25T11:28:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.666+0000 7f8119d9b640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f81040afce0 0x7f81040b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.667+0000 7f8119d9b640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f81040afce0 0x7f81040b21f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f811c10e740 tx=0x7f810c00b390 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.670+0000 7f810b7fe640 1 -- 172.21.15.80:0/1393230845 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f811001e030 con 0x7f811c102af0 2024-04-25T11:28:04.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:04 smithi196 ceph-mon[32659]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:28:04.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:04 smithi082 ceph-mon[32440]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:28:04.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.884+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f811c06afa0 con 0x7f811c102af0 2024-04-25T11:28:04.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.885+0000 7f810b7fe640 1 -- 172.21.15.80:0/1393230845 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f81100a7bd0 con 0x7f811c102af0 2024-04-25T11:28:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:28:04.876 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:28:04.876 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:28:04.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f81040afce0 msgr2=0x7f81040b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f81040afce0 0x7f81040b21f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f811c10e740 tx=0x7f810c00b390 comp rx=0 tx=0).stop 2024-04-25T11:28:04.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c102af0 msgr2=0x7f811c199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:04.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c102af0 0x7f811c199560 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f811000c9a0 tx=0x7f811000ce60 comp rx=0 tx=0).stop 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 shutdown_connections 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f81040afce0 0x7f81040b21f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c10d380 0x7f811c19dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f811c108a20 0x7f811c199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 --2- 172.21.15.80:0/1393230845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c102af0 0x7f811c199560 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.887+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 >> 172.21.15.80:0/1393230845 conn(0x7f811c078110 msgr2=0x7f811c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.888+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 shutdown_connections 2024-04-25T11:28:04.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:04.888+0000 7f8120a61640 1 -- 172.21.15.80:0/1393230845 wait complete. 2024-04-25T11:28:04.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 -- 172.21.15.80:0/1324130154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c108a20 msgr2=0x7f3e0c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 --2- 172.21.15.80:0/1324130154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c108a20 0x7f3e0c1025b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009900 tx=0x7f3e0802a410 comp rx=0 tx=0).stop 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 -- 172.21.15.80:0/1324130154 shutdown_connections 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 --2- 172.21.15.80:0/1324130154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e0c10d380 0x7f3e0c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 --2- 172.21.15.80:0/1324130154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e0c102af0 0x7f3e0c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 --2- 172.21.15.80:0/1324130154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c108a20 0x7f3e0c1025b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 -- 172.21.15.80:0/1324130154 >> 172.21.15.80:0/1324130154 conn(0x7f3e0c078100 msgr2=0x7f3e0c078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 -- 172.21.15.80:0/1324130154 shutdown_connections 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 -- 172.21.15.80:0/1324130154 wait complete. 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 Processor -- start 2024-04-25T11:28:05.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.010+0000 7f3e135b4640 1 -- start start 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e0c102af0 0x7f3e0c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e0c108a20 0x7f3e0c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c10d380 0x7f3e0c19de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c112be0 con 0x7f3e0c10d380 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c112a60 con 0x7f3e0c102af0 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c112d60 con 0x7f3e0c108a20 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c10d380 0x7f3e0c19de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c10d380 0x7f3e0c19de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47434/0 (socket says 172.21.15.80:47434) 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 -- 172.21.15.80:0/659812492 learned_addr learned my addr 172.21.15.80:0/659812492 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11350640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e0c102af0 0x7f3e0c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e0c108a20 0x7f3e0c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 -- 172.21.15.80:0/659812492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e0c108a20 msgr2=0x7f3e0c199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e0c108a20 0x7f3e0c199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 -- 172.21.15.80:0/659812492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e0c102af0 msgr2=0x7f3e0c199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e0c102af0 0x7f3e0c199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 -- 172.21.15.80:0/659812492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c19e470 con 0x7f3e0c10d380 2024-04-25T11:28:05.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11350640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e0c102af0 0x7f3e0c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:05.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e11b51640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c10d380 0x7f3e0c19de30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400eb10 tx=0x7f3e0400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e027fc640 1 -- 172.21.15.80:0/659812492 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004b20 con 0x7f3e0c10d380 2024-04-25T11:28:05.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c19e760 con 0x7f3e0c10d380 2024-04-25T11:28:05.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e027fc640 1 -- 172.21.15.80:0/659812492 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e04004cc0 con 0x7f3e0c10d380 2024-04-25T11:28:05.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e027fc640 1 -- 172.21.15.80:0/659812492 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04010670 con 0x7f3e0c10d380 2024-04-25T11:28:05.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.011+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c1a60e0 con 0x7f3e0c10d380 2024-04-25T11:28:05.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 Processor -- start 2024-04-25T11:28:05.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e027fc640 1 -- 172.21.15.80:0/659812492 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f3e04005020 con 0x7f3e0c10d380 2024-04-25T11:28:05.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 -- start start 2024-04-25T11:28:05.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921d03390 0x5579220a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557922009d80 con 0x557921ce26b0 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557921fc3a20 con 0x557921cda4d0 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.014+0000 7f3e1a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557922005d40 con 0x557921d03390 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47438/0 (socket says 172.21.15.80:47438) 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3956485447 learned_addr learned my addr 172.21.15.80:0/3956485447 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e11350640 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e027fc640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3df80afc60 0x7f3df80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921d03390 0x5579220a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e11b51640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3df80afc60 0x7f3df80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3956485447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921d03390 msgr2=0x5579220a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921d03390 0x5579220a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3956485447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 msgr2=0x5579220a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e027fc640 1 -- 172.21.15.80:0/659812492 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f3e040df750 con 0x7f3e0c10d380 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3956485447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557921fcec30 con 0x557921ce26b0 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220b38b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005d00 tx=0x7f3dfc00e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c794bc62ce2d6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3df77fe640 1 -- 172.21.15.80:0/3956485447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc018030 con 0x557921ce26b0 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3e11b51640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3df80afc60 0x7f3df80b2170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e040dcf60 tx=0x7f3e04068040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3df77fe640 1 -- 172.21.15.80:0/3956485447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dfc0054d0 con 0x557921ce26b0 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.015+0000 7f3df77fe640 1 -- 172.21.15.80:0/3956485447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0126b0 con 0x557921ce26b0 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 -- 172.21.15.80:0/3956485447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 msgr2=0x5579220b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220b38b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005d00 tx=0x7f3dfc00e590 comp rx=0 tx=0).stop 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 -- 172.21.15.80:0/3956485447 shutdown_connections 2024-04-25T11:28:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220b38b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3956485447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921d03390 0x5579220a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 -- 172.21.15.80:0/3956485447 >> 172.21.15.80:0/3956485447 conn(0x557921cf74e0 msgr2=0x5579220a0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 -- 172.21.15.80:0/3956485447 shutdown_connections 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.016+0000 7f3e1a461740 1 -- 172.21.15.80:0/3956485447 wait complete. 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 -- start start 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 Processor -- start 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5579220b3fa0 con 0x557921d03390 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557921f90dc0 con 0x557921cda4d0 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5579220b4120 con 0x557921ce26b0 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e1a461740 10 client.0 _ll_register_callbacks cb 0x557921fac600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e10b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e10b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220bd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47448/0 (socket says 172.21.15.80:47448) 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.017+0000 7f3e10b4f640 1 -- 172.21.15.80:0/1875034961 learned_addr learned my addr 172.21.15.80:0/1875034961 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e11350640 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e10b4f640 1 -- 172.21.15.80:0/1875034961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 msgr2=0x5579220b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e10b4f640 1 -- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 msgr2=0x5579220b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e10b4f640 1 -- 172.21.15.80:0/1875034961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557921d1b3f0 con 0x557921d03390 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220bd4e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc004d90 tx=0x7f3dfc004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2950f2165d7488e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3df4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3df4ff9640 1 -- 172.21.15.80:0/1875034961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc018040 con 0x557921d03390 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3df4ff9640 1 -- 172.21.15.80:0/1875034961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f3dfc01d460 con 0x557921d03390 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dfc0054d0 con 0x557921d03390 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3df4ff9640 1 -- 172.21.15.80:0/1875034961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3dfc031050 con 0x557921d03390 2024-04-25T11:28:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e1a461740 10 client.16470 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557921de57d0 con 0x557921d03390 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.018+0000 7f3df4ff9640 1 -- 172.21.15.80:0/1875034961 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dfc0054d0 con 0x557921d03390 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3df4ff9640 1 -- 172.21.15.80:0/1875034961 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f3dfc00f040 con 0x557921d03390 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e1a461740 10 client.16470 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e1a461740 10 client.16470 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e1a461740 20 client.16470 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e1a461740 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921cc1f60 0x5579220c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e1a461740 4 client.16470 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557922017990 con 0x557921cc1f60 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e11350640 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921cc1f60 0x5579220c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3df4ff9640 10 client.16470 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.019+0000 7f3e11350640 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921cc1f60 0x5579220c3830 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=720d7f19dff2c8c0 server_cookie=35e5b4f5a000aa0c in_seq=0 out_seq=0 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3df4ff9640 1 -- 172.21.15.80:0/1875034961 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557922017990 con 0x557921cc1f60 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3df4ff9640 10 client.16470 handle_command_reply: tid=0 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 client.16470 shutdown 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 msgr2=0x5579220bd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220bd4e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc004d90 tx=0x7f3dfc004c90 comp rx=0 tx=0).stop 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 shutdown_connections 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921cc1f60 0x5579220c3830 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220bd4e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3df4ff9640 0 client.16470 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 --2- 172.21.15.80:0/1875034961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 >> 172.21.15.80:0/1875034961 conn(0x557921cf74e0 msgr2=0x5579220a6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 shutdown_connections 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 1 -- 172.21.15.80:0/1875034961 wait complete. 2024-04-25T11:28:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.020+0000 7f3e1a461740 20 client.16470 trim_cache size 0 max 16384 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 Processor -- start 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 -- start start 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220bd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1b0050 con 0x557921d03390 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1ad920 con 0x557921cda4d0 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e1a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1ab770 con 0x557921ce26b0 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47464/0 (socket says 172.21.15.80:47464) 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3364120317 learned_addr learned my addr 172.21.15.80:0/3364120317 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e11350640 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220bd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3364120317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 msgr2=0x5579220bd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220bd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3364120317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 msgr2=0x5579220b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.034+0000 7f3e10b4f640 1 -- 172.21.15.80:0/3364120317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579220acde0 con 0x557921d03390 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.035+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220c6850 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc004c60 tx=0x7f3dfc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c348b7e6a9362d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.035+0000 7f3df6ffd640 1 -- 172.21.15.80:0/3364120317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc03b020 con 0x557921d03390 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.035+0000 7f3df6ffd640 1 -- 172.21.15.80:0/3364120317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dfc004dc0 con 0x557921d03390 2024-04-25T11:28:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.035+0000 7f3df6ffd640 1 -- 172.21.15.80:0/3364120317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc018040 con 0x557921d03390 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- 172.21.15.80:0/3364120317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 msgr2=0x5579220c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220c6850 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc004c60 tx=0x7f3dfc000bc0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- 172.21.15.80:0/3364120317 shutdown_connections 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921d03390 0x5579220c6850 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921ce26b0 0x5579220bd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3364120317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921cda4d0 0x5579220b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- 172.21.15.80:0/3364120317 >> 172.21.15.80:0/3364120317 conn(0x557921cf74e0 msgr2=0x5579220b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- 172.21.15.80:0/3364120317 shutdown_connections 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- 172.21.15.80:0/3364120317 wait complete. 2024-04-25T11:28:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- start start 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 Processor -- start 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921cda4d0 0x5579220c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921d03390 0x557922123920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1abde0 con 0x557921ce26b0 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1ad250 con 0x557921d03390 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1ac4b0 con 0x557921cda4d0 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.036+0000 7f3e1a461740 10 client.0 _ll_register_callbacks cb 0x7f3e040093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47472/0 (socket says 172.21.15.80:47472) 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 -- 172.21.15.80:0/3737491414 learned_addr learned my addr 172.21.15.80:0/3737491414 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921cda4d0 0x5579220c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921d03390 0x557922123920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 -- 172.21.15.80:0/3737491414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921cda4d0 msgr2=0x5579220c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921cda4d0 0x5579220c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 -- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921d03390 msgr2=0x557922123920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921d03390 0x557922123920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 -- 172.21.15.80:0/3737491414 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557922123e90 con 0x557921ce26b0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e11350640 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220c4240 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005f70 tx=0x7f3e08032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c7c535d9ac6d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3df4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3df4ff9640 1 -- 172.21.15.80:0/3737491414 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08035040 con 0x557921ce26b0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3df4ff9640 1 -- 172.21.15.80:0/3737491414 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f3e08005040 con 0x557921ce26b0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dfc004dc0 con 0x557921ce26b0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3df4ff9640 1 -- 172.21.15.80:0/3737491414 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3e08052050 con 0x557921ce26b0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e1a461740 10 client.16476 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55792212b160 con 0x557921ce26b0 2024-04-25T11:28:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.037+0000 7f3df4ff9640 1 -- 172.21.15.80:0/3737491414 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dfc004dc0 con 0x557921ce26b0 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3df4ff9640 1 -- 172.21.15.80:0/3737491414 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f3e080046c0 con 0x557921ce26b0 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e1a461740 10 client.16476 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e1a461740 10 client.16476 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e1a461740 20 client.16476 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921c973a0 0x55792212d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e1a461740 4 client.16476 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557922011800 con 0x557921c973a0 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921c973a0 0x55792212d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3df4ff9640 10 client.16476 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.038+0000 7f3e10b4f640 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921c973a0 0x55792212d9a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48b4d8920f1aa161 server_cookie=ce792043aa8900b in_seq=0 out_seq=0 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3df4ff9640 1 -- 172.21.15.80:0/3737491414 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557922011800 con 0x557921c973a0 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3df4ff9640 10 client.16476 handle_command_reply: tid=0 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 client.16476 shutdown 2024-04-25T11:28:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 msgr2=0x5579220c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220c4240 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005f70 tx=0x7f3e08032f80 comp rx=0 tx=0).stop 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 shutdown_connections 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x557921c973a0 0x55792212d9a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557921ce26b0 0x5579220c4240 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3df4ff9640 0 client.16476 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557921d03390 0x557922123920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 --2- 172.21.15.80:0/3737491414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557921cda4d0 0x5579220c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 >> 172.21.15.80:0/3737491414 conn(0x557921cf74e0 msgr2=0x5579220a06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 shutdown_connections 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 1 -- 172.21.15.80:0/3737491414 wait complete. 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e1a461740 20 client.16476 trim_cache size 0 max 16384 2024-04-25T11:28:05.036 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:28:05.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3df80afc60 msgr2=0x7f3df80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3df80afc60 0x7f3df80b2170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e040dcf60 tx=0x7f3e04068040 comp rx=0 tx=0).stop 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c10d380 msgr2=0x7f3e0c19de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c10d380 0x7f3e0c19de30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400eb10 tx=0x7f3e0400c2d0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 shutdown_connections 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3df80afc60 0x7f3df80b2170 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e0c10d380 0x7f3e0c19de30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e0c108a20 0x7f3e0c199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 --2- 172.21.15.80:0/659812492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e0c102af0 0x7f3e0c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.039+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 >> 172.21.15.80:0/659812492 conn(0x7f3e0c078100 msgr2=0x7f3e0c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.040+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 shutdown_connections 2024-04-25T11:28:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.040+0000 7f3e135b4640 1 -- 172.21.15.80:0/659812492 wait complete. 2024-04-25T11:28:05.041 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:28:05.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 -- 172.21.15.80:0/2519305993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 msgr2=0x7f4184103300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 --2- 172.21.15.80:0/2519305993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f4184103300 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4170009900 tx=0x7f417002a480 comp rx=0 tx=0).stop 2024-04-25T11:28:05.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 -- 172.21.15.80:0/2519305993 shutdown_connections 2024-04-25T11:28:05.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 --2- 172.21.15.80:0/2519305993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f4184103300 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 --2- 172.21.15.80:0/2519305993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4184103990 0x7f418410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 --2- 172.21.15.80:0/2519305993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4184108a40 0x7f4184102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 -- 172.21.15.80:0/2519305993 >> 172.21.15.80:0/2519305993 conn(0x7f4184077880 msgr2=0x7f4184077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 -- 172.21.15.80:0/2519305993 shutdown_connections 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.160+0000 7f418af46640 1 -- 172.21.15.80:0/2519305993 wait complete. 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 Processor -- start 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 -- start start 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4184108a40 0x7f418419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f418419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f418419bcf0 0x7f41841a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4184112c10 con 0x7f4184108e50 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4184112a90 con 0x7f4184108a40 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f418af46640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4184112d90 con 0x7f418419bcf0 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f4183fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f418419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f4183fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f418419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47502/0 (socket says 172.21.15.80:47502) 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f4183fff640 1 -- 172.21.15.80:0/2254963256 learned_addr learned my addr 172.21.15.80:0/2254963256 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.161+0000 7f41894e3640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f418419bcf0 0x7f41841a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4188ce2640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4184108a40 0x7f418419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4183fff640 1 -- 172.21.15.80:0/2254963256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f418419bcf0 msgr2=0x7f41841a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4183fff640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f418419bcf0 0x7f41841a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4183fff640 1 -- 172.21.15.80:0/2254963256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4184108a40 msgr2=0x7f418419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4183fff640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4184108a40 0x7f418419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4183fff640 1 -- 172.21.15.80:0/2254963256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41841a6900 con 0x7f4184108e50 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4188ce2640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4184108a40 0x7f418419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4183fff640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f418419b7b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4170032fd0 tx=0x7f4170004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4181ffb640 1 -- 172.21.15.80:0/2254963256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417003f030 con 0x7f4184108e50 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4181ffb640 1 -- 172.21.15.80:0/2254963256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4170004490 con 0x7f4184108e50 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41841a6b90 con 0x7f4184108e50 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f4181ffb640 1 -- 172.21.15.80:0/2254963256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170035070 con 0x7f4184108e50 2024-04-25T11:28:05.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.162+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41841a7080 con 0x7f4184108e50 2024-04-25T11:28:05.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4181ffb640 1 -- 172.21.15.80:0/2254963256 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f4170042030 con 0x7f4184108e50 2024-04-25T11:28:05.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 Processor -- start 2024-04-25T11:28:05.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 -- start start 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0187810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdbd4d0 0x5633e0187d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdc56b0 0x5633e01946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5633e00ecd80 con 0x5633dfdc56b0 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5633e00a6a20 con 0x5633dfde6390 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4191df9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5633e00e8d40 con 0x5633dfdbd4d0 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4181ffb640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41740afc60 0x7f41740b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4183fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdc56b0 0x5633e01946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4183fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdc56b0 0x5633e01946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47510/0 (socket says 172.21.15.80:47510) 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4183fff640 1 -- 172.21.15.80:0/2232279256 learned_addr learned my addr 172.21.15.80:0/2232279256 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f41894e3640 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0187810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f4188ce2640 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdbd4d0 0x5633e0187d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.165+0000 7f41894e3640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41740afc60 0x7f41740b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f4181ffb640 1 -- 172.21.15.80:0/2254963256 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f41700ff530 con 0x7f4184108e50 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f4183fff640 1 -- 172.21.15.80:0/2232279256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdbd4d0 msgr2=0x5633e0187d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f4183fff640 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdbd4d0 0x5633e0187d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f4183fff640 1 -- 172.21.15.80:0/2232279256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 msgr2=0x5633e0187810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f4183fff640 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0187810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f4183fff640 1 -- 172.21.15.80:0/2232279256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e00b1c30 con 0x5633dfdc56b0 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f41894e3640 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0187810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f4183fff640 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdc56b0 0x5633e01946a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4170031440 tx=0x7f41700c36d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7182fc7ad711a93c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f41894e3640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41740afc60 0x7f41740b2170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5633e0184980 tx=0x7f417c007520 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f416effd640 1 -- 172.21.15.80:0/2232279256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170049070 con 0x5633dfdc56b0 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f416effd640 1 -- 172.21.15.80:0/2232279256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41700c71f0 con 0x5633dfdc56b0 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.166+0000 7f416effd640 1 -- 172.21.15.80:0/2232279256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41700d0540 con 0x5633dfdc56b0 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 -- 172.21.15.80:0/2232279256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdc56b0 msgr2=0x5633e01946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdc56b0 0x5633e01946a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4170031440 tx=0x7f41700c36d0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 -- 172.21.15.80:0/2232279256 shutdown_connections 2024-04-25T11:28:05.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdc56b0 0x5633e01946a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdbd4d0 0x5633e0187d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 --2- 172.21.15.80:0/2232279256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0187810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 -- 172.21.15.80:0/2232279256 >> 172.21.15.80:0/2232279256 conn(0x5633dfdda4e0 msgr2=0x5633e0183fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 -- 172.21.15.80:0/2232279256 shutdown_connections 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 -- 172.21.15.80:0/2232279256 wait complete. 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 -- start start 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.167+0000 7f4191df9740 1 Processor -- start 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4191df9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e01921e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4191df9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfdc56b0 0x5633e0192720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4191df9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfde6390 0x5633e019df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4191df9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5633e00ecd80 con 0x5633dfdbd4d0 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4191df9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5633e0073dc0 con 0x5633dfdc56b0 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4191df9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5633e0194be0 con 0x5633dfde6390 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4191df9740 10 client.0 _ll_register_callbacks cb 0x5633e008f600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:05.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e01921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e01921e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47514/0 (socket says 172.21.15.80:47514) 2024-04-25T11:28:05.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 -- 172.21.15.80:0/1917426206 learned_addr learned my addr 172.21.15.80:0/1917426206 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4183fff640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfdc56b0 0x5633e0192720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f41894e3640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfde6390 0x5633e019df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 -- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfde6390 msgr2=0x5633e019df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfde6390 0x5633e019df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 -- 172.21.15.80:0/1917426206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfdc56b0 msgr2=0x5633e0192720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfdc56b0 0x5633e0192720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 -- 172.21.15.80:0/1917426206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633dfdfe3f0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4183fff640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfdc56b0 0x5633e0192720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f41894e3640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfde6390 0x5633e019df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4188ce2640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e01921e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f417800bec0 tx=0x7f4178012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368f1084facf90b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.168+0000 7f4163fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4163fff640 1 -- 172.21.15.80:0/1917426206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178004230 con 0x5633dfdbd4d0 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4163fff640 1 -- 172.21.15.80:0/1917426206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f41780043d0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41700c71f0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4163fff640 1 -- 172.21.15.80:0/1917426206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4178010760 con 0x5633dfdbd4d0 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 10 client.16488 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5633dfec87d0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4163fff640 1 -- 172.21.15.80:0/1917426206 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41700c71f0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4163fff640 1 -- 172.21.15.80:0/1917426206 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4178003b90 con 0x5633dfdbd4d0 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 10 client.16488 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 10 client.16488 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 20 client.16488 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfda4f60 0x5633e01a4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 4 client.16488 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.169+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633e00fa990 con 0x5633dfda4f60 2024-04-25T11:28:05.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.170+0000 7f4183fff640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfda4f60 0x5633e01a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.170+0000 7f4183fff640 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfda4f60 0x5633e01a4420 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d27f84ce19d8cd1 server_cookie=a9118724d73b371 in_seq=0 out_seq=0 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.170+0000 7f4163fff640 10 client.16488 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4163fff640 1 -- 172.21.15.80:0/1917426206 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5633e00fa990 con 0x5633dfda4f60 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4163fff640 10 client.16488 handle_command_reply: tid=0 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 client.16488 shutdown 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 msgr2=0x5633e01921e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e01921e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f417800bec0 tx=0x7f4178012820 comp rx=0 tx=0).stop 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 shutdown_connections 2024-04-25T11:28:05.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfda4f60 0x5633e01a4420 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfde6390 0x5633e019df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfdc56b0 0x5633e0192720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4163fff640 0 client.16488 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 --2- 172.21.15.80:0/1917426206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e01921e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 >> 172.21.15.80:0/1917426206 conn(0x5633dfdda4e0 msgr2=0x5633e0189530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 shutdown_connections 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 1 -- 172.21.15.80:0/1917426206 wait complete. 2024-04-25T11:28:05.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.171+0000 7f4191df9740 20 client.16488 trim_cache size 0 max 16384 2024-04-25T11:28:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.184+0000 7f4191df9740 1 Processor -- start 2024-04-25T11:28:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4191df9740 1 -- start start 2024-04-25T11:28:05.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4191df9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e019db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4191df9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e0194120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4191df9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e01a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4191df9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41841b2270 con 0x5633dfdbd4d0 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4191df9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41841afb40 con 0x5633dfde6390 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4191df9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41841ad990 con 0x5633dfdc56b0 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47528/0 (socket says 172.21.15.80:47528) 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 -- 172.21.15.80:0/3417410233 learned_addr learned my addr 172.21.15.80:0/3417410233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 -- 172.21.15.80:0/3417410233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 msgr2=0x5633e0194120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4183fff640 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e0194120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e0194120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 -- 172.21.15.80:0/3417410233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 msgr2=0x5633e01a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e01a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 -- 172.21.15.80:0/3417410233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e0191620 con 0x5633dfdbd4d0 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4183fff640 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e0194120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f4188ce2640 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e019db40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4178000c00 tx=0x7f4178005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6eda3f5dbbfecf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f416e7fc640 1 -- 172.21.15.80:0/3417410233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417802a070 con 0x5633dfdbd4d0 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f416e7fc640 1 -- 172.21.15.80:0/3417410233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4178003fb0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.185+0000 7f416e7fc640 1 -- 172.21.15.80:0/3417410233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178000e60 con 0x5633dfdbd4d0 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 -- 172.21.15.80:0/3417410233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 msgr2=0x5633e019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e019db40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4178000c00 tx=0x7f4178005710 comp rx=0 tx=0).stop 2024-04-25T11:28:05.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 -- 172.21.15.80:0/3417410233 shutdown_connections 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e01a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e0194120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 --2- 172.21.15.80:0/3417410233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e019db40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 -- 172.21.15.80:0/3417410233 >> 172.21.15.80:0/3417410233 conn(0x5633dfdda4e0 msgr2=0x5633e0190f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 -- 172.21.15.80:0/3417410233 shutdown_connections 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.186+0000 7f4191df9740 1 -- 172.21.15.80:0/3417410233 wait complete. 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 -- start start 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 Processor -- start 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e0199d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e019a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0195290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41841ae000 con 0x5633dfdbd4d0 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41841af470 con 0x5633dfde6390 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41841ae6d0 con 0x5633dfdc56b0 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4191df9740 10 client.0 _ll_register_callbacks cb 0x7f417800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e0199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e0199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47530/0 (socket says 172.21.15.80:47530) 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 -- 172.21.15.80:0/2035769343 learned_addr learned my addr 172.21.15.80:0/2035769343 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4183fff640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f41894e3640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 -- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 msgr2=0x5633e019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 -- 172.21.15.80:0/2035769343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 msgr2=0x5633e0195290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0195290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f4188ce2640 1 -- 172.21.15.80:0/2035769343 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e0195900 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.187+0000 7f41894e3640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0195290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4188ce2640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e0199d40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f417801b570 tx=0x7f41780045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86eba7a1971b359 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4163fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4163fff640 1 -- 172.21.15.80:0/2035769343 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417803b060 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4163fff640 1 -- 172.21.15.80:0/2035769343 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f417801ba20 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4178003fb0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4163fff640 1 -- 172.21.15.80:0/2035769343 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f417802a070 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 10 client.16494 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5633e020bfc0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4163fff640 1 -- 172.21.15.80:0/2035769343 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4178003fb0 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4163fff640 1 -- 172.21.15.80:0/2035769343 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4178024500 con 0x5633dfdbd4d0 2024-04-25T11:28:05.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 10 client.16494 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 10 client.16494 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 20 client.16494 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfd7a3a0 0x5633e020e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 4 client.16494 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.188+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633e00f4800 con 0x5633dfd7a3a0 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.189+0000 7f4183fff640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfd7a3a0 0x5633e020e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.189+0000 7f4163fff640 10 client.16494 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.189+0000 7f4183fff640 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfd7a3a0 0x5633e020e630 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=62df498f57311dff server_cookie=e3402313028097bb in_seq=0 out_seq=0 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.189+0000 7f4163fff640 1 -- 172.21.15.80:0/2035769343 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633e00f4800 con 0x5633dfd7a3a0 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.189+0000 7f4163fff640 10 client.16494 handle_command_reply: tid=0 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.189+0000 7f4191df9740 1 client.16494 shutdown 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 msgr2=0x5633e0199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e0199d40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f417801b570 tx=0x7f41780045f0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 shutdown_connections 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5633dfd7a3a0 0x5633e020e630 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633dfde6390 0x5633e0195290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633dfdc56b0 0x5633e019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4163fff640 0 client.16494 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 --2- 172.21.15.80:0/2035769343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5633dfdbd4d0 0x5633e0199d40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 >> 172.21.15.80:0/2035769343 conn(0x5633dfdda4e0 msgr2=0x5633e0190f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 shutdown_connections 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 1 -- 172.21.15.80:0/2035769343 wait complete. 2024-04-25T11:28:05.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f4191df9740 20 client.16494 trim_cache size 0 max 16384 2024-04-25T11:28:05.190 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:28:05.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41740afc60 msgr2=0x7f41740b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41740afc60 0x7f41740b2170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5633e0184980 tx=0x7f417c007520 comp rx=0 tx=0).stop 2024-04-25T11:28:05.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 msgr2=0x7f418419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f418419b7b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4170032fd0 tx=0x7f4170004270 comp rx=0 tx=0).stop 2024-04-25T11:28:05.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 shutdown_connections 2024-04-25T11:28:05.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41740afc60 0x7f41740b2170 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4184108e50 0x7f418419b7b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f418419bcf0 0x7f41841a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 --2- 172.21.15.80:0/2254963256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4184108a40 0x7f418419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 >> 172.21.15.80:0/2254963256 conn(0x7f4184077880 msgr2=0x7f4184104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 shutdown_connections 2024-04-25T11:28:05.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.190+0000 7f418af46640 1 -- 172.21.15.80:0/2254963256 wait complete. 2024-04-25T11:28:05.193 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:28:05.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.316+0000 7f70a4f57640 1 -- 172.21.15.80:0/2436711898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108e50 msgr2=0x7f70a0103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.316+0000 7f70a4f57640 1 --2- 172.21.15.80:0/2436711898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108e50 0x7f70a0103200 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7088009900 tx=0x7f708802a480 comp rx=0 tx=0).stop 2024-04-25T11:28:05.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.316+0000 7f70a4f57640 1 -- 172.21.15.80:0/2436711898 shutdown_connections 2024-04-25T11:28:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.316+0000 7f70a4f57640 1 --2- 172.21.15.80:0/2436711898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a0108e50 0x7f70a0103200 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.316+0000 7f70a4f57640 1 --2- 172.21.15.80:0/2436711898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70a0103890 0x7f70a010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.316+0000 7f70a4f57640 1 --2- 172.21.15.80:0/2436711898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a0108a40 0x7f70a0102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.316+0000 7f70a4f57640 1 -- 172.21.15.80:0/2436711898 >> 172.21.15.80:0/2436711898 conn(0x7f70a0077880 msgr2=0x7f70a0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.317+0000 7f70a4f57640 1 -- 172.21.15.80:0/2436711898 shutdown_connections 2024-04-25T11:28:05.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.317+0000 7f70a4f57640 1 -- 172.21.15.80:0/2436711898 wait complete. 2024-04-25T11:28:05.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.317+0000 7f70a4f57640 1 Processor -- start 2024-04-25T11:28:05.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.317+0000 7f70a4f57640 1 -- start start 2024-04-25T11:28:05.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70a4f57640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70a0108a40 0x7f70a0199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70a4f57640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a0108e50 0x7f70a0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70a4f57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a019da50 0x7f70a019de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70a4f57640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112c00 con 0x7f70a019da50 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70a4f57640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112a80 con 0x7f70a0108e50 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70a4f57640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112d80 con 0x7f70a0108a40 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a019da50 0x7f70a019de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a019da50 0x7f70a019de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47548/0 (socket says 172.21.15.80:47548) 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 -- 172.21.15.80:0/3115313965 learned_addr learned my addr 172.21.15.80:0/3115313965 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709e59c640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70a0108a40 0x7f70a0199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f7097fff640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a0108e50 0x7f70a0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 -- 172.21.15.80:0/3115313965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70a0108a40 msgr2=0x7f70a0199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70a0108a40 0x7f70a0199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 -- 172.21.15.80:0/3115313965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a0108e50 msgr2=0x7f70a0199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a0108e50 0x7f70a0199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 -- 172.21.15.80:0/3115313965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a019e4a0 con 0x7f70a019da50 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f7097fff640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a0108e50 0x7f70a0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f709ed9d640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a019da50 0x7f70a019de60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f709800cad0 tx=0x7f709800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70977fe640 1 -- 172.21.15.80:0/3115313965 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709800ae20 con 0x7f70a019da50 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70977fe640 1 -- 172.21.15.80:0/3115313965 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7098005020 con 0x7f70a019da50 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a019e790 con 0x7f70a019da50 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.318+0000 7f70977fe640 1 -- 172.21.15.80:0/3115313965 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709800f6b0 con 0x7f70a019da50 2024-04-25T11:28:05.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.319+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a01a5f40 con 0x7f70a019da50 2024-04-25T11:28:05.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.321+0000 7f70977fe640 1 -- 172.21.15.80:0/3115313965 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f70980051d0 con 0x7f70a019da50 2024-04-25T11:28:05.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.321+0000 7f70abe07740 1 Processor -- start 2024-04-25T11:28:05.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.321+0000 7f70abe07740 1 -- start start 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70abe07740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d2544390 0x55c4d28e5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70abe07740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d251b4d0 0x55c4d28e5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70abe07740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d25236b0 0x55c4d28f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70abe07740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c4d284ad80 con 0x55c4d2544390 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70abe07740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c4d2804a20 con 0x55c4d251b4d0 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70abe07740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c4d2846d40 con 0x55c4d25236b0 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70977fe640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f708c0afc60 0x7f708c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d2544390 0x55c4d28e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d2544390 0x55c4d28e5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47554/0 (socket says 172.21.15.80:47554) 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 -- 172.21.15.80:0/2503567318 learned_addr learned my addr 172.21.15.80:0/2503567318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f709ed9d640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f708c0afc60 0x7f708c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d25236b0 0x55c4d28f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f709e59c640 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d251b4d0 0x55c4d28e5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 -- 172.21.15.80:0/2503567318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d25236b0 msgr2=0x55c4d28f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f70977fe640 1 -- 172.21.15.80:0/3115313965 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f70980df0e0 con 0x7f70a019da50 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d25236b0 0x55c4d28f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 -- 172.21.15.80:0/2503567318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d251b4d0 msgr2=0x55c4d28e5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d251b4d0 0x55c4d28e5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 -- 172.21.15.80:0/2503567318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4d280fc30 con 0x55c4d2544390 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f709e59c640 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d251b4d0 0x55c4d28e5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.322+0000 7f7097fff640 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d2544390 0x55c4d28e5810 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7088031440 tx=0x7f70880058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1265f261fc808ada server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.323+0000 7f709ed9d640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f708c0afc60 0x7f708c0b2170 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f709804c290 tx=0x7f7098005890 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.323+0000 7f7094ff9640 1 -- 172.21.15.80:0/2503567318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088035050 con 0x55c4d2544390 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.323+0000 7f7094ff9640 1 -- 172.21.15.80:0/2503567318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7088031760 con 0x55c4d2544390 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.323+0000 7f7094ff9640 1 -- 172.21.15.80:0/2503567318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70880046c0 con 0x55c4d2544390 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.323+0000 7f70abe07740 1 -- 172.21.15.80:0/2503567318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d2544390 msgr2=0x55c4d28e5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.323+0000 7f70abe07740 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d2544390 0x55c4d28e5810 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7088031440 tx=0x7f70880058b0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- 172.21.15.80:0/2503567318 shutdown_connections 2024-04-25T11:28:05.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d25236b0 0x55c4d28f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d251b4d0 0x55c4d28e5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 --2- 172.21.15.80:0/2503567318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d2544390 0x55c4d28e5810 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- 172.21.15.80:0/2503567318 >> 172.21.15.80:0/2503567318 conn(0x55c4d25384e0 msgr2=0x55c4d28e1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- 172.21.15.80:0/2503567318 shutdown_connections 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- 172.21.15.80:0/2503567318 wait complete. 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- start start 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 Processor -- start 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d251b4d0 0x55c4d28f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d25236b0 0x55c4d28f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d2544390 0x55c4d28fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c4d28f2d30 con 0x55c4d251b4d0 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c4d27d1dc0 con 0x55c4d25236b0 2024-04-25T11:28:05.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c4d28f2eb0 con 0x55c4d2544390 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f70abe07740 10 client.0 _ll_register_callbacks cb 0x55c4d27ed600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f7097fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d251b4d0 0x55c4d28f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.324+0000 7f7097fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d251b4d0 0x55c4d28f02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47558/0 (socket says 172.21.15.80:47558) 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7097fff640 1 -- 172.21.15.80:0/1380159115 learned_addr learned my addr 172.21.15.80:0/1380159115 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f709e59c640 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d25236b0 0x55c4d28f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7097fff640 1 -- 172.21.15.80:0/1380159115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d2544390 msgr2=0x55c4d28fc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7097fff640 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d2544390 0x55c4d28fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7097fff640 1 -- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d25236b0 msgr2=0x55c4d28f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7097fff640 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d25236b0 0x55c4d28f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7097fff640 1 -- 172.21.15.80:0/1380159115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4d255c3f0 con 0x55c4d251b4d0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7097fff640 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d251b4d0 0x55c4d28f02b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7088000c00 tx=0x7f7088005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c45dee44d437555 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7085ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7085ffb640 1 -- 172.21.15.80:0/1380159115 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088035040 con 0x55c4d251b4d0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7085ffb640 1 -- 172.21.15.80:0/1380159115 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7088003800 con 0x55c4d251b4d0 2024-04-25T11:28:05.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7088031760 con 0x55c4d251b4d0 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7085ffb640 1 -- 172.21.15.80:0/1380159115 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7088056050 con 0x55c4d251b4d0 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f70abe07740 10 client.16506 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c4d26267d0 con 0x55c4d251b4d0 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.325+0000 7f7085ffb640 1 -- 172.21.15.80:0/1380159115 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7088031760 con 0x55c4d251b4d0 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f7085ffb640 1 -- 172.21.15.80:0/1380159115 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f708803a840 con 0x55c4d251b4d0 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f70abe07740 10 client.16506 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f70abe07740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f70abe07740 20 client.16506 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f70abe07740 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d2502f60 0x55c4d2902450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f70abe07740 4 client.16506 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4d2858990 con 0x55c4d2502f60 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f709e59c640 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d2502f60 0x55c4d2902450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f7085ffb640 10 client.16506 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.326+0000 7f709e59c640 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d2502f60 0x55c4d2902450 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=100c2b9eddd74b13 server_cookie=20090fc5e5b208c in_seq=0 out_seq=0 2024-04-25T11:28:05.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.327+0000 7f7085ffb640 1 -- 172.21.15.80:0/1380159115 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c4d2858990 con 0x55c4d2502f60 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.327+0000 7f7085ffb640 10 client.16506 handle_command_reply: tid=0 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.327+0000 7f70abe07740 1 client.16506 shutdown 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.327+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d251b4d0 msgr2=0x55c4d28f02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.327+0000 7f70abe07740 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d251b4d0 0x55c4d28f02b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7088000c00 tx=0x7f7088005730 comp rx=0 tx=0).stop 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 shutdown_connections 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d2502f60 0x55c4d2902450 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d2544390 0x55c4d28fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d25236b0 0x55c4d28f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 --2- 172.21.15.80:0/1380159115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d251b4d0 0x55c4d28f02b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f7085ffb640 0 client.16506 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 >> 172.21.15.80:0/1380159115 conn(0x55c4d25384e0 msgr2=0x55c4d28e7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 shutdown_connections 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 1 -- 172.21.15.80:0/1380159115 wait complete. 2024-04-25T11:28:05.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.328+0000 7f70abe07740 20 client.16506 trim_cache size 0 max 16384 2024-04-25T11:28:05.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 Processor -- start 2024-04-25T11:28:05.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 -- start start 2024-04-25T11:28:05.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 0x55c4d28fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d28ef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d28ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01b1090 con 0x55c4d25236b0 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01ae960 con 0x55c4d2544390 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f70abe07740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01ac7b0 con 0x55c4d251b4d0 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f709e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d28ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f709e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d28ef010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47568/0 (socket says 172.21.15.80:47568) 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.341+0000 7f709e59c640 1 -- 172.21.15.80:0/2206184583 learned_addr learned my addr 172.21.15.80:0/2206184583 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f709e59c640 1 -- 172.21.15.80:0/2206184583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 msgr2=0x55c4d28fc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f709e59c640 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 0x55c4d28fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f7097fff640 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d28ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f709e59c640 1 -- 172.21.15.80:0/2206184583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 msgr2=0x55c4d28ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f709e59c640 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d28ea4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f709e59c640 1 -- 172.21.15.80:0/2206184583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4d28dd710 con 0x55c4d25236b0 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f709e59c640 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d28ef010 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7090004590 tx=0x7f709000bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e86d23bd0a636f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f7087fff640 1 -- 172.21.15.80:0/2206184583 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090003d80 con 0x55c4d25236b0 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f7087fff640 1 -- 172.21.15.80:0/2206184583 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7090012900 con 0x55c4d25236b0 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.342+0000 7f7087fff640 1 -- 172.21.15.80:0/2206184583 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709001d700 con 0x55c4d25236b0 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- 172.21.15.80:0/2206184583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 msgr2=0x55c4d28ef010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d28ef010 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7090004590 tx=0x7f709000bf70 comp rx=0 tx=0).stop 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- 172.21.15.80:0/2206184583 shutdown_connections 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d28ef010 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d28ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 --2- 172.21.15.80:0/2206184583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 0x55c4d28fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- 172.21.15.80:0/2206184583 >> 172.21.15.80:0/2206184583 conn(0x55c4d25384e0 msgr2=0x55c4d28e1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- 172.21.15.80:0/2206184583 shutdown_connections 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- 172.21.15.80:0/2206184583 wait complete. 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- start start 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 Processor -- start 2024-04-25T11:28:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 0x55c4d2905a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d2902df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d2903350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01ace20 con 0x55c4d25236b0 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01ae290 con 0x55c4d2544390 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01ad4f0 con 0x55c4d251b4d0 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f70abe07740 10 client.0 _ll_register_callbacks cb 0x7f7088031510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.343+0000 7f709e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d2902df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d2902df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47580/0 (socket says 172.21.15.80:47580) 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 -- 172.21.15.80:0/1452211775 learned_addr learned my addr 172.21.15.80:0/1452211775 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7097fff640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 0x55c4d2905a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7097fff640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d2903350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 -- 172.21.15.80:0/1452211775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 msgr2=0x55c4d2905a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 0x55c4d2905a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 -- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 msgr2=0x55c4d2903350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d2903350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 -- 172.21.15.80:0/1452211775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4d2903ae0 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7097fff640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d2903350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f709e59c640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d2902df0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f709000b700 tx=0x7f7090003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e7fc7e73457d5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7085ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7085ffb640 1 -- 172.21.15.80:0/1452211775 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090034060 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7085ffb640 1 -- 172.21.15.80:0/1452211775 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7090012650 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7090012900 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7085ffb640 1 -- 172.21.15.80:0/1452211775 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7090012ab0 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f70abe07740 10 client.16512 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c4d296e8f0 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.344+0000 7f7085ffb640 1 -- 172.21.15.80:0/1452211775 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7090012900 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f7085ffb640 1 -- 172.21.15.80:0/1452211775 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f709002e030 con 0x55c4d25236b0 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 10 client.16512 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:05.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 20 client.16512 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d24d83a0 0x55c4d2970fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 4 client.16512 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4d2852800 con 0x55c4d24d83a0 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f7097fff640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d24d83a0 0x55c4d2970fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f7097fff640 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d24d83a0 0x55c4d2970fd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a77acb903fb4756 server_cookie=7f53b3d1a3383b8e in_seq=0 out_seq=0 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f7085ffb640 10 client.16512 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f7085ffb640 1 -- 172.21.15.80:0/1452211775 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c4d2852800 con 0x55c4d24d83a0 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f7085ffb640 10 client.16512 handle_command_reply: tid=0 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 1 client.16512 shutdown 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 msgr2=0x55c4d2902df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.345+0000 7f70abe07740 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d2902df0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f709000b700 tx=0x7f7090003ce0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 shutdown_connections 2024-04-25T11:28:05.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c4d24d83a0 0x55c4d2970fd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c4d25236b0 0x55c4d2902df0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4d2544390 0x55c4d2903350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f7085ffb640 0 client.16512 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 --2- 172.21.15.80:0/1452211775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4d251b4d0 0x55c4d2905a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 >> 172.21.15.80:0/1452211775 conn(0x55c4d25384e0 msgr2=0x55c4d28e1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 shutdown_connections 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 1 -- 172.21.15.80:0/1452211775 wait complete. 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70abe07740 20 client.16512 trim_cache size 0 max 16384 2024-04-25T11:28:05.343 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:28:05.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f708c0afc60 msgr2=0x7f708c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f708c0afc60 0x7f708c0b2170 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f709804c290 tx=0x7f7098005890 comp rx=0 tx=0).stop 2024-04-25T11:28:05.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a019da50 msgr2=0x7f70a019de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:05.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a019da50 0x7f70a019de60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f709800cad0 tx=0x7f709800cf90 comp rx=0 tx=0).stop 2024-04-25T11:28:05.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 shutdown_connections 2024-04-25T11:28:05.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f708c0afc60 0x7f708c0b2170 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a019da50 0x7f70a019de60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a0108e50 0x7f70a0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 --2- 172.21.15.80:0/3115313965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70a0108a40 0x7f70a0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:05.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 >> 172.21.15.80:0/3115313965 conn(0x7f70a0077880 msgr2=0x7f70a01040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:05.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 shutdown_connections 2024-04-25T11:28:05.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:05.346+0000 7f70a4f57640 1 -- 172.21.15.80:0/3115313965 wait complete. 2024-04-25T11:28:05.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:05 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1393230845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:28:05.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:05 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1393230845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:28:05.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:05 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1393230845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:28:06.348 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:28:06.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:28:06.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:28:06.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 -- 172.21.15.80:0/200134030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba8102af0 msgr2=0x7f6ba8102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 --2- 172.21.15.80:0/200134030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba8102af0 0x7f6ba8102f00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009900 tx=0x7f6b9c02a410 comp rx=0 tx=0).stop 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 -- 172.21.15.80:0/200134030 shutdown_connections 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 --2- 172.21.15.80:0/200134030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba8102af0 0x7f6ba8102f00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 --2- 172.21.15.80:0/200134030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ba810d380 0x7f6ba810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 --2- 172.21.15.80:0/200134030 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ba8108a20 0x7f6ba81025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 -- 172.21.15.80:0/200134030 >> 172.21.15.80:0/200134030 conn(0x7f6ba8078100 msgr2=0x7f6ba8078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 -- 172.21.15.80:0/200134030 shutdown_connections 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.483+0000 7f6bad851640 1 -- 172.21.15.80:0/200134030 wait complete. 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 Processor -- start 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 -- start start 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ba8102af0 0x7f6ba81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ba8108a20 0x7f6ba8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba810d380 0x7f6ba8199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112be0 con 0x7f6ba810d380 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112a60 con 0x7f6ba8102af0 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6bad851640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112d60 con 0x7f6ba8108a20 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba810d380 0x7f6ba8199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba810d380 0x7f6ba8199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48602/0 (socket says 172.21.15.80:48602) 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 -- 172.21.15.80:0/998011083 learned_addr learned my addr 172.21.15.80:0/998011083 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ba8102af0 0x7f6ba81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ba8108a20 0x7f6ba8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 -- 172.21.15.80:0/998011083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ba8108a20 msgr2=0x7f6ba8199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ba8108a20 0x7f6ba8199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 -- 172.21.15.80:0/998011083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ba8102af0 msgr2=0x7f6ba81993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ba8102af0 0x7f6ba81993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.484+0000 7f6ba77fe640 1 -- 172.21.15.80:0/998011083 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba81a8a80 con 0x7f6ba810d380 2024-04-25T11:28:06.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.485+0000 7f6ba77fe640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba810d380 0x7f6ba8199e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000cad0 tx=0x7f6ba000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.485+0000 7f6bac84f640 1 -- 172.21.15.80:0/998011083 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000ae20 con 0x7f6ba810d380 2024-04-25T11:28:06.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.485+0000 7f6bac84f640 1 -- 172.21.15.80:0/998011083 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba0005020 con 0x7f6ba810d380 2024-04-25T11:28:06.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.485+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba81a8d70 con 0x7f6ba810d380 2024-04-25T11:28:06.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.485+0000 7f6bac84f640 1 -- 172.21.15.80:0/998011083 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000f6b0 con 0x7f6ba810d380 2024-04-25T11:28:06.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.485+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba81a9230 con 0x7f6ba810d380 2024-04-25T11:28:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.487+0000 7f6bac84f640 1 -- 172.21.15.80:0/998011083 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f6ba00051d0 con 0x7f6ba810d380 2024-04-25T11:28:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 Processor -- start 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 -- start start 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb302620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb302b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb3030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5559bb268b00 con 0x5559baf41730 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5559bb204920 con 0x5559baf62410 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5559bb264ac0 con 0x5559baf39550 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb3030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb3030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48616/0 (socket says 172.21.15.80:48616) 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 -- 172.21.15.80:0/2446154178 learned_addr learned my addr 172.21.15.80:0/2446154178 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bac84f640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6b900afce0 0x7f6b900b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb302620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb302b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba77fe640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6b900afce0 0x7f6b900b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 -- 172.21.15.80:0/2446154178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 msgr2=0x5559bb302b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb302b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 -- 172.21.15.80:0/2446154178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 msgr2=0x5559bb302620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb302620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6ba67fc640 1 -- 172.21.15.80:0/2446154178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559bb0427e0 con 0x5559baf41730 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.488+0000 7f6bac84f640 1 -- 172.21.15.80:0/998011083 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6ba00df030 con 0x7f6ba810d380 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.489+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb3030a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c000c00 tx=0x7f6b9c005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d164547ede40d0fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.489+0000 7f6b8dffb640 1 -- 172.21.15.80:0/2446154178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c035040 con 0x5559baf41730 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.489+0000 7f6ba77fe640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6b900afce0 0x7f6b900b21f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00a7170 tx=0x7f6ba0074a40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.489+0000 7f6b8dffb640 1 -- 172.21.15.80:0/2446154178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b9c0317e0 con 0x5559baf41730 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.489+0000 7f6b8dffb640 1 -- 172.21.15.80:0/2446154178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c003d00 con 0x5559baf41730 2024-04-25T11:28:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 -- 172.21.15.80:0/2446154178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 msgr2=0x5559bb3030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb3030a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c000c00 tx=0x7f6b9c005d90 comp rx=0 tx=0).stop 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 -- 172.21.15.80:0/2446154178 shutdown_connections 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb3030a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb302b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/2446154178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb302620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 -- 172.21.15.80:0/2446154178 >> 172.21.15.80:0/2446154178 conn(0x5559baf56560 msgr2=0x5559bb2fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 -- 172.21.15.80:0/2446154178 shutdown_connections 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 -- 172.21.15.80:0/2446154178 wait complete. 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 -- start start 2024-04-25T11:28:06.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.490+0000 7f6bb47e5740 1 Processor -- start 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf39550 0x5559bb30cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf41730 0x5559bb30d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb312dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5559bb30f910 con 0x5559baf39550 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5559bb2025d0 con 0x5559baf41730 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5559bb30fa90 con 0x5559baf62410 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 10 client.0 _ll_register_callbacks cb 0x5559bb1f0080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf39550 0x5559bb30cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf39550 0x5559bb30cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48626/0 (socket says 172.21.15.80:48626) 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 -- 172.21.15.80:0/1075228366 learned_addr learned my addr 172.21.15.80:0/1075228366 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf41730 0x5559bb30d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 -- 172.21.15.80:0/1075228366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 msgr2=0x5559bb312dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb312dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 -- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf41730 msgr2=0x5559bb30d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf41730 0x5559bb30d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 -- 172.21.15.80:0/1075228366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559bb0a2f70 con 0x5559baf39550 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf41730 0x5559bb30d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf39550 0x5559bb30cc50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c003920 tx=0x7f6b9c02aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88be95950da4d3e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6b86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6b86ffd640 1 -- 172.21.15.80:0/1075228366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c035070 con 0x5559baf39550 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6b86ffd640 1 -- 172.21.15.80:0/1075228366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6b9c031b10 con 0x5559baf39550 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.491+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b9c0317e0 con 0x5559baf39550 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6b86ffd640 1 -- 172.21.15.80:0/1075228366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b9c05a050 con 0x5559baf39550 2024-04-25T11:28:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 10 client.16524 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5559baf3a170 con 0x5559baf39550 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6b86ffd640 1 -- 172.21.15.80:0/1075228366 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b9c0317e0 con 0x5559baf39550 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6b86ffd640 1 -- 172.21.15.80:0/1075228366 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6b9c03a040 con 0x5559baf39550 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 10 client.16524 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 20 client.16524 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baf211f0 0x5559bb31ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 4 client.16524 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559bb276710 con 0x5559baf211f0 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.492+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baf211f0 0x5559bb31ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.493+0000 7f6b86ffd640 10 client.16524 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.493+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baf211f0 0x5559bb31ee50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713a8289abb9e1e server_cookie=7e3319b8a0f3331 in_seq=0 out_seq=0 2024-04-25T11:28:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6b86ffd640 1 -- 172.21.15.80:0/1075228366 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5559bb276710 con 0x5559baf211f0 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6b86ffd640 10 client.16524 handle_command_reply: tid=0 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 client.16524 shutdown 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf39550 msgr2=0x5559bb30cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf39550 0x5559bb30cc50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c003920 tx=0x7f6b9c02aa90 comp rx=0 tx=0).stop 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 shutdown_connections 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baf211f0 0x5559bb31ee50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb312dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf41730 0x5559bb30d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6b86ffd640 0 client.16524 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/1075228366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf39550 0x5559bb30cc50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 >> 172.21.15.80:0/1075228366 conn(0x5559baf56560 msgr2=0x5559bb304340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 shutdown_connections 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 1 -- 172.21.15.80:0/1075228366 wait complete. 2024-04-25T11:28:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.494+0000 7f6bb47e5740 20 client.16524 trim_cache size 0 max 16384 2024-04-25T11:28:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 Processor -- start 2024-04-25T11:28:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 -- start start 2024-04-25T11:28:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf39550 0x5559bb2fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb312d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb313270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81b4280 con 0x5559baf41730 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81b1b50 con 0x5559baf39550 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81af9a0 con 0x5559baf62410 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb312d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb312d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48632/0 (socket says 172.21.15.80:48632) 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/4175604489 learned_addr learned my addr 172.21.15.80:0/4175604489 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb313270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/4175604489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 msgr2=0x5559bb313270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb313270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/4175604489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf39550 msgr2=0x5559bb2fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf39550 0x5559bb2fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/4175604489 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559bb303bc0 con 0x5559baf41730 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb313270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.512+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb312d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6b98005fd0 tx=0x7f6b9800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade5285c87e7bfcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6b8d7fa640 1 -- 172.21.15.80:0/4175604489 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9801f020 con 0x5559baf41730 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6b8d7fa640 1 -- 172.21.15.80:0/4175604489 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b980054e0 con 0x5559baf41730 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6b8d7fa640 1 -- 172.21.15.80:0/4175604489 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9801b2c0 con 0x5559baf41730 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 -- 172.21.15.80:0/4175604489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 msgr2=0x5559bb312d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb312d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6b98005fd0 tx=0x7f6b9800b390 comp rx=0 tx=0).stop 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 -- 172.21.15.80:0/4175604489 shutdown_connections 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb312d30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf62410 0x5559bb313270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/4175604489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf39550 0x5559bb2fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 -- 172.21.15.80:0/4175604489 >> 172.21.15.80:0/4175604489 conn(0x5559baf56560 msgr2=0x5559bb304b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 -- 172.21.15.80:0/4175604489 shutdown_connections 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.513+0000 7f6bb47e5740 1 -- 172.21.15.80:0/4175604489 wait complete. 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 -- start start 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 Processor -- start 2024-04-25T11:28:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb3196d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb314a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb314f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81b0010 con 0x5559baf41730 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81b1480 con 0x5559baf62410 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81b06e0 con 0x5559baf39550 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6bb47e5740 10 client.0 _ll_register_callbacks cb 0x7f6b9c03d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6ba6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb314a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6ba6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb314a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48646/0 (socket says 172.21.15.80:48646) 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.514+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/386948475 learned_addr learned my addr 172.21.15.80:0/386948475 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb3196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/386948475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 msgr2=0x5559bb3196d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb314f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb3196d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 msgr2=0x5559bb314f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb314f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba6ffd640 1 -- 172.21.15.80:0/386948475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559bb315520 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6ba6ffd640 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb314a20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6b98004910 tx=0x7f6b98004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6a86030d5f4ad6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6b86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6b86ffd640 1 -- 172.21.15.80:0/386948475 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9801f030 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6b86ffd640 1 -- 172.21.15.80:0/386948475 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6b98004c40 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b980054e0 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6b86ffd640 1 -- 172.21.15.80:0/386948475 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b98004e40 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6bb47e5740 10 client.16530 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5559bb386c50 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6b86ffd640 1 -- 172.21.15.80:0/386948475 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b980054e0 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.515+0000 7f6b86ffd640 1 -- 172.21.15.80:0/386948475 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6b980314e0 con 0x5559baf41730 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6bb47e5740 10 client.16530 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6bb47e5740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6bb47e5740 20 client.16530 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baef6630 0x5559bb389380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6bb47e5740 4 client.16530 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:28:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5559bb270580 con 0x5559baef6630 2024-04-25T11:28:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baef6630 0x5559bb389380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6b86ffd640 10 client.16530 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.516+0000 7f6ba67fc640 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baef6630 0x5559bb389380 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d65ed95e80c383b server_cookie=916393e3fb78cc95 in_seq=0 out_seq=0 2024-04-25T11:28:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.517+0000 7f6b86ffd640 1 -- 172.21.15.80:0/386948475 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5559bb270580 con 0x5559baef6630 2024-04-25T11:28:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.517+0000 7f6b86ffd640 10 client.16530 handle_command_reply: tid=0 2024-04-25T11:28:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.517+0000 7f6bb47e5740 1 client.16530 shutdown 2024-04-25T11:28:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.517+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 msgr2=0x5559bb314a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.517+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb314a20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6b98004910 tx=0x7f6b98004940 comp rx=0 tx=0).stop 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 shutdown_connections 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5559baef6630 0x5559bb389380 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5559baf41730 0x5559bb314a20 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5559baf62410 0x5559bb314f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6b86ffd640 0 client.16530 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 --2- 172.21.15.80:0/386948475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5559baf39550 0x5559bb3196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 >> 172.21.15.80:0/386948475 conn(0x5559baf56560 msgr2=0x5559bb304af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 shutdown_connections 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 1 -- 172.21.15.80:0/386948475 wait complete. 2024-04-25T11:28:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bb47e5740 20 client.16530 trim_cache size 0 max 16384 2024-04-25T11:28:06.515 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:28:06.515 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:28:06.515 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "7a19d760-1d49-4716-912b-5e74f50144f7", 2024-04-25T11:28:06.515 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:28:06.515 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6b900afce0 msgr2=0x7f6b900b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6b900afce0 0x7f6b900b21f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00a7170 tx=0x7f6ba0074a40 comp rx=0 tx=0).stop 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba810d380 msgr2=0x7f6ba8199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba810d380 0x7f6ba8199e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000cad0 tx=0x7f6ba000cf90 comp rx=0 tx=0).stop 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 shutdown_connections 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6b900afce0 0x7f6b900b21f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba810d380 0x7f6ba8199e50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ba8108a20 0x7f6ba8199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 --2- 172.21.15.80:0/998011083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ba8102af0 0x7f6ba81993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 >> 172.21.15.80:0/998011083 conn(0x7f6ba8078100 msgr2=0x7f6ba81040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 shutdown_connections 2024-04-25T11:28:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.518+0000 7f6bad851640 1 -- 172.21.15.80:0/998011083 wait complete. 2024-04-25T11:28:06.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:28:06.520 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:28:06.540 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:06 smithi080 ceph-mon[29126]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:28:06.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 -- 172.21.15.80:0/3048096671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd22810b730 msgr2=0x7fd22810db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/3048096671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd22810b730 0x7fd22810db50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009900 tx=0x7fd21c02a410 comp rx=0 tx=0).stop 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 -- 172.21.15.80:0/3048096671 shutdown_connections 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/3048096671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd22810b730 0x7fd22810db50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/3048096671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22810e090 0x7fd228110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/3048096671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd228104cd0 0x7fd2281050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 -- 172.21.15.80:0/3048096671 >> 172.21.15.80:0/3048096671 conn(0x7fd228078110 msgr2=0x7fd228078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.639+0000 7fd22dfe0640 1 -- 172.21.15.80:0/3048096671 shutdown_connections 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.640+0000 7fd22dfe0640 1 -- 172.21.15.80:0/3048096671 wait complete. 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.640+0000 7fd22dfe0640 1 Processor -- start 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.640+0000 7fd22dfe0640 1 -- start start 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd228104cd0 0x7fd22819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd22810b730 0x7fd22819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22810e090 0x7fd22819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd228113ce0 con 0x7fd228104cd0 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd228113b60 con 0x7fd22810e090 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd228113e60 con 0x7fd22810b730 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd228104cd0 0x7fd22819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd228104cd0 0x7fd22819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48676/0 (socket says 172.21.15.80:48676) 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 -- 172.21.15.80:0/95625288 learned_addr learned my addr 172.21.15.80:0/95625288 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd226ffd640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd22810b730 0x7fd22819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd227fff640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22810e090 0x7fd22819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 -- 172.21.15.80:0/95625288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd22810b730 msgr2=0x7fd22819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd22810b730 0x7fd22819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 -- 172.21.15.80:0/95625288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22810e090 msgr2=0x7fd22819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22810e090 0x7fd22819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 -- 172.21.15.80:0/95625288 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22819f5c0 con 0x7fd228104cd0 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd226ffd640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd22810b730 0x7fd22819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd227fff640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22810e090 0x7fd22819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:06.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd2277fe640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd228104cd0 0x7fd22819a760 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd21800d770 tx=0x7fd21800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd224ff9640 1 -- 172.21.15.80:0/95625288 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218017070 con 0x7fd228104cd0 2024-04-25T11:28:06.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd224ff9640 1 -- 172.21.15.80:0/95625288 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2180054d0 con 0x7fd228104cd0 2024-04-25T11:28:06.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22819f8b0 con 0x7fd228104cd0 2024-04-25T11:28:06.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd224ff9640 1 -- 172.21.15.80:0/95625288 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218004c30 con 0x7fd228104cd0 2024-04-25T11:28:06.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.641+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2281a7230 con 0x7fd228104cd0 2024-04-25T11:28:06.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd224ff9640 1 -- 172.21.15.80:0/95625288 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fd218004e10 con 0x7fd228104cd0 2024-04-25T11:28:06.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 Processor -- start 2024-04-25T11:28:06.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 -- start start 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd23a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd23fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562fcfc89d80 con 0x562fcf95a4d0 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562fcfc438b0 con 0x562fcf9626b0 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd234f68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562fcfc85d40 con 0x562fcf983390 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd2277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd23fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd2277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd23fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48678/0 (socket says 172.21.15.80:48678) 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd2277fe640 1 -- 172.21.15.80:0/550942418 learned_addr learned my addr 172.21.15.80:0/550942418 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd227fff640 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd23a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.644+0000 7fd226ffd640 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd2277fe640 1 -- 172.21.15.80:0/550942418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 msgr2=0x562fcfd23a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd2277fe640 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd23a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd2277fe640 1 -- 172.21.15.80:0/550942418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 msgr2=0x562fcfd308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd2277fe640 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd224ff9640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2100afce0 0x7fd2100b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd2277fe640 1 -- 172.21.15.80:0/550942418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcfc14a40 con 0x562fcf95a4d0 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd226ffd640 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd227fff640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2100afce0 0x7fd2100b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd2277fe640 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd23fa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd2180dc220 tx=0x7fd2180e7690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b903dd4e7568e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd224ff9640 1 -- 172.21.15.80:0/95625288 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd2180deb50 con 0x7fd228104cd0 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd20dffb640 1 -- 172.21.15.80:0/550942418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218020070 con 0x562fcf95a4d0 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd20dffb640 1 -- 172.21.15.80:0/550942418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2180a6810 con 0x562fcf95a4d0 2024-04-25T11:28:06.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.645+0000 7fd20dffb640 1 -- 172.21.15.80:0/550942418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2180a6650 con 0x562fcf95a4d0 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 -- 172.21.15.80:0/550942418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 msgr2=0x562fcfd23fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd227fff640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2100afce0 0x7fd2100b21f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x562fcfd20bd0 tx=0x7fd220009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd23fa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd2180dc220 tx=0x7fd2180e7690 comp rx=0 tx=0).stop 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 -- 172.21.15.80:0/550942418 shutdown_connections 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd23fa0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 --2- 172.21.15.80:0/550942418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd23a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 -- 172.21.15.80:0/550942418 >> 172.21.15.80:0/550942418 conn(0x562fcf9774e0 msgr2=0x562fcfd20210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 -- 172.21.15.80:0/550942418 shutdown_connections 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 -- 172.21.15.80:0/550942418 wait complete. 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.646+0000 7fd234f68740 1 -- start start 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 1 Processor -- start 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf95a4d0 0x562fcfd2e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd2ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf983390 0x562fcfd34440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562fcfd30f80 con 0x562fcf983390 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562fcfc10d10 con 0x562fcf9626b0 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562fcfd31100 con 0x562fcf95a4d0 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd234f68740 10 client.0 _ll_register_callbacks cb 0x562fcfc3d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf983390 0x562fcfd34440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf983390 0x562fcfd34440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48684/0 (socket says 172.21.15.80:48684) 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 -- 172.21.15.80:0/3715509088 learned_addr learned my addr 172.21.15.80:0/3715509088 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd226ffd640 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd2ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd2277fe640 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf95a4d0 0x562fcfd2e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 -- 172.21.15.80:0/3715509088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf95a4d0 msgr2=0x562fcfd2e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf95a4d0 0x562fcfd2e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 -- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 msgr2=0x562fcfd2ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd2ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.647+0000 7fd227fff640 1 -- 172.21.15.80:0/3715509088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fcfa657d0 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd227fff640 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf983390 0x562fcfd34440 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd220010960 tx=0x7fd220004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e088070c84aa3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd206ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd206ffd640 1 -- 172.21.15.80:0/3715509088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22000dce0 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd206ffd640 1 -- 172.21.15.80:0/3715509088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd220027400 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2180a6810 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd206ffd640 1 -- 172.21.15.80:0/3715509088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd220027600 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 10 client.16542 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562fcf99b3f0 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd206ffd640 1 -- 172.21.15.80:0/3715509088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2180a6810 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd206ffd640 1 -- 172.21.15.80:0/3715509088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd2200306d0 con 0x562fcf983390 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 10 client.16542 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 20 client.16542 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf941f60 0x562fcfd40710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 4 client.16542 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.648+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fcfc97990 con 0x562fcf941f60 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.649+0000 7fd2277fe640 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf941f60 0x562fcfd40710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.649+0000 7fd206ffd640 10 client.16542 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.649+0000 7fd2277fe640 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf941f60 0x562fcfd40710 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e66def76dd57af server_cookie=9d1fb8d6a6c3dfdd in_seq=0 out_seq=0 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd206ffd640 1 -- 172.21.15.80:0/3715509088 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562fcfc97990 con 0x562fcf941f60 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd206ffd640 10 client.16542 handle_command_reply: tid=0 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 client.16542 shutdown 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf983390 msgr2=0x562fcfd34440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf983390 0x562fcfd34440 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd220010960 tx=0x7fd220004a40 comp rx=0 tx=0).stop 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 shutdown_connections 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf941f60 0x562fcfd40710 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf983390 0x562fcfd34440 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd2ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd206ffd640 0 client.16542 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 --2- 172.21.15.80:0/3715509088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf95a4d0 0x562fcfd2e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 >> 172.21.15.80:0/3715509088 conn(0x562fcf9774e0 msgr2=0x562fcfd25780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 shutdown_connections 2024-04-25T11:28:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 1 -- 172.21.15.80:0/3715509088 wait complete. 2024-04-25T11:28:06.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.650+0000 7fd234f68740 20 client.16542 trim_cache size 0 max 16384 2024-04-25T11:28:06.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 Processor -- start 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 -- start start 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd2d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd202e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd29690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281b2290 con 0x562fcf95a4d0 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281afb60 con 0x562fcf9626b0 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd234f68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281ad9b0 con 0x562fcf983390 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd2277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd2d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd2277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd2d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48688/0 (socket says 172.21.15.80:48688) 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd2277fe640 1 -- 172.21.15.80:0/526467475 learned_addr learned my addr 172.21.15.80:0/526467475 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.668+0000 7fd227fff640 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd29690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd226ffd640 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd2277fe640 1 -- 172.21.15.80:0/526467475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 msgr2=0x562fcfd29690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd2277fe640 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd29690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd2277fe640 1 -- 172.21.15.80:0/526467475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 msgr2=0x562fcfd202e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd2277fe640 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd202e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd2277fe640 1 -- 172.21.15.80:0/526467475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcf95b0f0 con 0x562fcf95a4d0 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd226ffd640 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd202e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd2277fe640 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd2d3d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd218005c20 tx=0x7fd2180e26a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bab58316daa99e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd20d7fa640 1 -- 172.21.15.80:0/526467475 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218020040 con 0x562fcf95a4d0 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd20d7fa640 1 -- 172.21.15.80:0/526467475 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2180e24f0 con 0x562fcf95a4d0 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.669+0000 7fd20d7fa640 1 -- 172.21.15.80:0/526467475 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2180a6470 con 0x562fcf95a4d0 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 -- 172.21.15.80:0/526467475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 msgr2=0x562fcfd2d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd2d3d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd218005c20 tx=0x7fd2180e26a0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 -- 172.21.15.80:0/526467475 shutdown_connections 2024-04-25T11:28:06.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd29690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf9626b0 0x562fcfd202e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 --2- 172.21.15.80:0/526467475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf95a4d0 0x562fcfd2d3d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 -- 172.21.15.80:0/526467475 >> 172.21.15.80:0/526467475 conn(0x562fcf9774e0 msgr2=0x562fcfd1fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 -- 172.21.15.80:0/526467475 shutdown_connections 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 -- 172.21.15.80:0/526467475 wait complete. 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 -- start start 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.670+0000 7fd234f68740 1 Processor -- start 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf95a4d0 0x562fcfd3ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf9626b0 0x562fcfd35fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd36500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281ae020 con 0x562fcf9626b0 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281af490 con 0x562fcf95a4d0 2024-04-25T11:28:06.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281ae6f0 con 0x562fcf983390 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 10 client.0 _ll_register_callbacks cb 0x7fd220009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf9626b0 0x562fcfd35fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf9626b0 0x562fcfd35fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48704/0 (socket says 172.21.15.80:48704) 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 -- 172.21.15.80:0/632549891 learned_addr learned my addr 172.21.15.80:0/632549891 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd2277fe640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf95a4d0 0x562fcfd3ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd227fff640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd36500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 -- 172.21.15.80:0/632549891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 msgr2=0x562fcfd36500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd36500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 -- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf95a4d0 msgr2=0x562fcfd3ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf95a4d0 0x562fcfd3ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 -- 172.21.15.80:0/632549891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fcfc4a4b0 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd2277fe640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf95a4d0 0x562fcfd3ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd226ffd640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf9626b0 0x562fcfd35fc0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd21c005ab0 tx=0x7fd21c0318a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21733c65a375557 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd206ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd206ffd640 1 -- 172.21.15.80:0/632549891 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c035040 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd206ffd640 1 -- 172.21.15.80:0/632549891 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd21c031b10 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.671+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2180e24f0 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd206ffd640 1 -- 172.21.15.80:0/632549891 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd21c005030 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 10 client.16548 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562fcfda84c0 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd206ffd640 1 -- 172.21.15.80:0/632549891 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2180e24f0 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd206ffd640 1 -- 172.21.15.80:0/632549891 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd21c004c20 con 0x562fcf9626b0 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 10 client.16548 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 10 client.16548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:06.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 20 client.16548 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf9173a0 0x562fcfdaacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 4 client.16548 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562fcfc91800 con 0x562fcf9173a0 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.672+0000 7fd2277fe640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf9173a0 0x562fcfdaacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd206ffd640 10 client.16548 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd2277fe640 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf9173a0 0x562fcfdaacb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1eac32e6fc404a server_cookie=8b01415e52d2594c in_seq=0 out_seq=0 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd206ffd640 1 -- 172.21.15.80:0/632549891 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562fcfc91800 con 0x562fcf9173a0 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd206ffd640 10 client.16548 handle_command_reply: tid=0 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 client.16548 shutdown 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf9626b0 msgr2=0x562fcfd35fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf9626b0 0x562fcfd35fc0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd21c005ab0 tx=0x7fd21c0318a0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 shutdown_connections 2024-04-25T11:28:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562fcf9173a0 0x562fcfdaacb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562fcf9626b0 0x562fcfd35fc0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562fcf983390 0x562fcfd36500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd206ffd640 0 client.16548 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 --2- 172.21.15.80:0/632549891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fcf95a4d0 0x562fcfd3ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 >> 172.21.15.80:0/632549891 conn(0x562fcf9774e0 msgr2=0x562fcfd25660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 shutdown_connections 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 1 -- 172.21.15.80:0/632549891 wait complete. 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.673+0000 7fd234f68740 20 client.16548 trim_cache size 0 max 16384 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:28:06.673 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout: "7a19d760-1d49-4716-912b-5e74f50144f7": { 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "7a19d760-1d49-4716-912b-5e74f50144f7", 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:28:06.674 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:28:06.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2100afce0 msgr2=0x7fd2100b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2100afce0 0x7fd2100b21f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x562fcfd20bd0 tx=0x7fd220009500 comp rx=0 tx=0).stop 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd228104cd0 msgr2=0x7fd22819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd228104cd0 0x7fd22819a760 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd21800d770 tx=0x7fd21800dc30 comp rx=0 tx=0).stop 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 shutdown_connections 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd2100afce0 0x7fd2100b21f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22810e090 0x7fd22819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd22810b730 0x7fd22819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 --2- 172.21.15.80:0/95625288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd228104cd0 0x7fd22819a760 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 >> 172.21.15.80:0/95625288 conn(0x7fd228078110 msgr2=0x7fd228101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 shutdown_connections 2024-04-25T11:28:06.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:06.674+0000 7fd22dfe0640 1 -- 172.21.15.80:0/95625288 wait complete. 2024-04-25T11:28:06.677 INFO:tasks.cephfs.filesystem:scrub status for tag:7a19d760-1d49-4716-912b-5e74f50144f7 - {'path': '/', 'tag': '7a19d760-1d49-4716-912b-5e74f50144f7', 'options': 'recursive,force'} 2024-04-25T11:28:06.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:06 smithi196 ceph-mon[32659]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:28:06.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:06 smithi082 ceph-mon[32440]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:28:07.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:07 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:28:07.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:07 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:07.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:07 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:28:07.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:07 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:07.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:07 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:28:07.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:07 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:07.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:07 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:28:07.688 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:07 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:07.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:07 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:28:07.755 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:07 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:07.755 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:07 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:28:07.755 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:07 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:08.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:08 smithi080 ceph-mon[29126]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:28:08.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:08 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:28:08.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:08 smithi196 ceph-mon[32659]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:28:08.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:08 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:28:08.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:08 smithi082 ceph-mon[32440]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:28:08.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:08 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:28:10.543 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:10 smithi082 ceph-mon[32440]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:28:10.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:10 smithi080 ceph-mon[29126]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:28:10.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:10 smithi196 ceph-mon[32659]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:28:12.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:12 smithi080 ceph-mon[29126]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-25T11:28:12.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:12 smithi196 ceph-mon[32659]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-25T11:28:12.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:12 smithi082 ceph-mon[32440]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-25T11:28:14.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:14 smithi080 ceph-mon[29126]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:28:14.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:14 smithi196 ceph-mon[32659]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:28:14.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:14 smithi082 ceph-mon[32440]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:28:16.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:16 smithi080 ceph-mon[29126]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:28:16.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:16 smithi196 ceph-mon[32659]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:28:16.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:16 smithi082 ceph-mon[32440]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:28:18.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:18 smithi080 ceph-mon[29126]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T11:28:18.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:18 smithi196 ceph-mon[32659]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T11:28:18.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:18 smithi082 ceph-mon[32440]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T11:28:20.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:20 smithi080 ceph-mon[29126]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:28:20.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:20 smithi196 ceph-mon[32659]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:28:20.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:20 smithi082 ceph-mon[32440]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:28:22.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:22 smithi080 ceph-mon[29126]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:28:22.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:22 smithi196 ceph-mon[32659]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:28:22.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:22 smithi082 ceph-mon[32440]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:28:24.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:24 smithi080 ceph-mon[29126]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:24.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:24 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:28:24.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:24 smithi196 ceph-mon[32659]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:24.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:24 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:28:24.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:24 smithi082 ceph-mon[32440]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:24.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:24 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:28:25.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:25 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:28:25.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:25 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:28:25.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:25 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:28:25.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:25 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:28:25.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:25 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:28:25.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:25 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:28:25.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:25 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:28:25.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:25 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:28:25.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:25 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:28:26.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:26 smithi082 ceph-mon[32440]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:26.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:26 smithi080 ceph-mon[29126]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:26.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:26 smithi196 ceph-mon[32659]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:28.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:28 smithi082 ceph-mon[32440]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:28.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:28 smithi080 ceph-mon[29126]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:28.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:28 smithi196 ceph-mon[32659]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:30.741 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:30 smithi082 ceph-mon[32440]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:30.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:30 smithi080 ceph-mon[29126]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:30.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:30 smithi196 ceph-mon[32659]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:32.876 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:32 smithi080 ceph-mon[29126]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:32.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:32 smithi196 ceph-mon[32659]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:32.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:32 smithi082 ceph-mon[32440]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:34.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:34 smithi080 ceph-mon[29126]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:34.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:34 smithi196 ceph-mon[32659]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:34.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:34 smithi082 ceph-mon[32440]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:36.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:28:36.678 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 -- 172.21.15.80:0/2240540049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 msgr2=0x7f6238101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2240540049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f6238101c30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6228009900 tx=0x7f622802a410 comp rx=0 tx=0).stop 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 -- 172.21.15.80:0/2240540049 shutdown_connections 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2240540049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62381027e0 0x7f6238110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2240540049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6238109fe0 0x7f6238102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2240540049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f6238101c30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 -- 172.21.15.80:0/2240540049 >> 172.21.15.80:0/2240540049 conn(0x7f6238077920 msgr2=0x7f6238077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 -- 172.21.15.80:0/2240540049 shutdown_connections 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 -- 172.21.15.80:0/2240540049 wait complete. 2024-04-25T11:28:36.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.814+0000 7f623dcc6640 1 Processor -- start 2024-04-25T11:28:36.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f623dcc6640 1 -- start start 2024-04-25T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f623dcc6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62381027e0 0x7f623819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f623dcc6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f623819ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f623dcc6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6238109fe0 0x7f623819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f623dcc6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6238113d30 con 0x7f6238109b40 2024-04-25T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f623dcc6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6238113bb0 con 0x7f62381027e0 2024-04-25T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f623dcc6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6238113eb0 con 0x7f6238109fe0 2024-04-25T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f623819ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f623819ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33666/0 (socket says 172.21.15.80:33666) 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 -- 172.21.15.80:0/2371487441 learned_addr learned my addr 172.21.15.80:0/2371487441 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f62377fe640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62381027e0 0x7f623819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6237fff640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6238109fe0 0x7f623819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 -- 172.21.15.80:0/2371487441 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6238109fe0 msgr2=0x7f623819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6238109fe0 0x7f623819eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 -- 172.21.15.80:0/2371487441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62381027e0 msgr2=0x7f623819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62381027e0 0x7f623819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f6236ffd640 1 -- 172.21.15.80:0/2371487441 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623819f630 con 0x7f6238109b40 2024-04-25T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.815+0000 7f62377fe640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62381027e0 0x7f623819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.816+0000 7f6236ffd640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f623819ad30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f622c005d00 tx=0x7f622c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.816+0000 7f6234ff9640 1 -- 172.21.15.80:0/2371487441 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c017070 con 0x7f6238109b40 2024-04-25T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.816+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623819f920 con 0x7f6238109b40 2024-04-25T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.816+0000 7f6234ff9640 1 -- 172.21.15.80:0/2371487441 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f622c009c30 con 0x7f6238109b40 2024-04-25T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.816+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62381a72a0 con 0x7f6238109b40 2024-04-25T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.816+0000 7f6234ff9640 1 -- 172.21.15.80:0/2371487441 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c00f620 con 0x7f6238109b40 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.818+0000 7f6234ff9640 1 -- 172.21.15.80:0/2371487441 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f622c01a070 con 0x7f6238109b40 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.818+0000 7f6244b76740 1 Processor -- start 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.818+0000 7f6244b76740 1 -- start start 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6244b76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c1ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6244b76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6244b76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c298f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6244b76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560811b82d80 con 0x56081187c390 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6244b76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560811b3c8b0 con 0x56081185b6b0 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6244b76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560811b7ed40 con 0x5608118534d0 2024-04-25T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c1ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c1ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33682/0 (socket says 172.21.15.80:33682) 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 -- 172.21.15.80:0/3648810790 learned_addr learned my addr 172.21.15.80:0/3648810790 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6234ff9640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f62200afc60 0x7f62200b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f62377fe640 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6236ffd640 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 -- 172.21.15.80:0/3648810790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 msgr2=0x560811c1cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 -- 172.21.15.80:0/3648810790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 msgr2=0x560811c298f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c298f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 -- 172.21.15.80:0/3648810790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560811b0da40 con 0x56081187c390 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6234ff9640 1 -- 172.21.15.80:0/2371487441 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f622c0deb80 con 0x7f6238109b40 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f62200afc60 0x7f62200b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f6237fff640 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c1ca60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f623000e2f0 tx=0x7f623000e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b99373bc1966f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.819+0000 7f621dffb640 1 -- 172.21.15.80:0/3648810790 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230020070 con 0x56081187c390 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f621dffb640 1 -- 172.21.15.80:0/3648810790 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623001adb0 con 0x56081187c390 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f621dffb640 1 -- 172.21.15.80:0/3648810790 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230019ae0 con 0x56081187c390 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 -- 172.21.15.80:0/3648810790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 msgr2=0x560811c1ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6237fff640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f62200afc60 0x7f62200b2170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f623001d000 tx=0x7f623001e000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c1ca60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f623000e2f0 tx=0x7f623000e7b0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 -- 172.21.15.80:0/3648810790 shutdown_connections 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c298f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 --2- 172.21.15.80:0/3648810790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c1ca60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 -- 172.21.15.80:0/3648810790 >> 172.21.15.80:0/3648810790 conn(0x5608118704e0 msgr2=0x560811c19210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:36.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.820+0000 7f6244b76740 1 -- 172.21.15.80:0/3648810790 shutdown_connections 2024-04-25T11:28:36.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 -- 172.21.15.80:0/3648810790 wait complete. 2024-04-25T11:28:36.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 -- start start 2024-04-25T11:28:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 Processor -- start 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c27620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081185b6b0 0x560811c27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081187c390 0x560811c2d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560811c29fe0 con 0x56081185b6b0 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560811b09d10 con 0x56081187c390 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560811c2a160 con 0x5608118534d0 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.821+0000 7f6244b76740 10 client.0 _ll_register_callbacks cb 0x560811b36210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081185b6b0 0x560811c27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081185b6b0 0x560811c27b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33688/0 (socket says 172.21.15.80:33688) 2024-04-25T11:28:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 -- 172.21.15.80:0/2732853101 learned_addr learned my addr 172.21.15.80:0/2732853101 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6237fff640 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081187c390 0x560811c2d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f62377fe640 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c27620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 -- 172.21.15.80:0/2732853101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 msgr2=0x560811c27620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c27620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 -- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081187c390 msgr2=0x560811c2d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081187c390 0x560811c2d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 -- 172.21.15.80:0/2732853101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081195e7d0 con 0x56081185b6b0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6236ffd640 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081185b6b0 0x560811c27b60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f622c0a2d50 tx=0x7f622c0a6570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a328db1f1206e92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6216ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6216ffd640 1 -- 172.21.15.80:0/2732853101 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c021030 con 0x56081185b6b0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6216ffd640 1 -- 172.21.15.80:0/2732853101 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f622c0a6130 con 0x56081185b6b0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f623001adb0 con 0x56081185b6b0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6216ffd640 1 -- 172.21.15.80:0/2732853101 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f622c0dc710 con 0x56081185b6b0 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6244b76740 10 client.16560 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.822+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5608118943f0 con 0x56081185b6b0 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6216ffd640 1 -- 172.21.15.80:0/2732853101 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f623001adb0 con 0x56081185b6b0 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6216ffd640 1 -- 172.21.15.80:0/2732853101 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f622c0a59a0 con 0x56081185b6b0 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6244b76740 10 client.16560 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6244b76740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6244b76740 20 client.16560 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6244b76740 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56081183af60 0x560811c39630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6244b76740 4 client.16560 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560811b90990 con 0x56081183af60 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.823+0000 7f62377fe640 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56081183af60 0x560811c39630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6216ffd640 10 client.16560 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f62377fe640 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56081183af60 0x560811c39630 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aa1f1d9b192e466 server_cookie=f0180e7c36616c41 in_seq=0 out_seq=0 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6216ffd640 1 -- 172.21.15.80:0/2732853101 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560811b90990 con 0x56081183af60 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6216ffd640 10 client.16560 handle_command_reply: tid=0 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 client.16560 shutdown 2024-04-25T11:28:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081185b6b0 msgr2=0x560811c27b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081185b6b0 0x560811c27b60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f622c0a2d50 tx=0x7f622c0a6570 comp rx=0 tx=0).stop 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 shutdown_connections 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56081183af60 0x560811c39630 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081185b6b0 0x560811c27b60 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6216ffd640 0 client.16560 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081187c390 0x560811c2d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.824+0000 7f6244b76740 1 --2- 172.21.15.80:0/2732853101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c27620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.825+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 >> 172.21.15.80:0/2732853101 conn(0x5608118704e0 msgr2=0x560811c1e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.825+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 shutdown_connections 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.825+0000 7f6244b76740 1 -- 172.21.15.80:0/2732853101 wait complete. 2024-04-25T11:28:36.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.825+0000 7f6244b76740 20 client.16560 trim_cache size 0 max 16384 2024-04-25T11:28:36.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 Processor -- start 2024-04-25T11:28:36.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 -- start start 2024-04-25T11:28:36.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c1ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c2d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62381b23e0 con 0x56081187c390 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62381afcb0 con 0x56081185b6b0 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6244b76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f62381adb00 con 0x5608118534d0 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6237fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c2d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6237fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c2d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33690/0 (socket says 172.21.15.80:33690) 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6237fff640 1 -- 172.21.15.80:0/771309016 learned_addr learned my addr 172.21.15.80:0/771309016 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6236ffd640 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c1ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f62377fe640 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6237fff640 1 -- 172.21.15.80:0/771309016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 msgr2=0x560811c1ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6237fff640 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.843+0000 7f6237fff640 1 -- 172.21.15.80:0/771309016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 msgr2=0x560811c1ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.844+0000 7f6237fff640 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c1ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.844+0000 7f6237fff640 1 -- 172.21.15.80:0/771309016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608118540f0 con 0x56081187c390 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.844+0000 7f6237fff640 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c2d420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x560811c1db60 tx=0x7f6230024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e3896411159ef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.844+0000 7f621d7fa640 1 -- 172.21.15.80:0/771309016 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230034070 con 0x56081187c390 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.844+0000 7f621d7fa640 1 -- 172.21.15.80:0/771309016 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6230019d90 con 0x56081187c390 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.844+0000 7f621d7fa640 1 -- 172.21.15.80:0/771309016 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230020040 con 0x56081187c390 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 -- 172.21.15.80:0/771309016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 msgr2=0x560811c2d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c2d420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x560811c1db60 tx=0x7f6230024000 comp rx=0 tx=0).stop 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 -- 172.21.15.80:0/771309016 shutdown_connections 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c2d420 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56081185b6b0 0x560811c1ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 --2- 172.21.15.80:0/771309016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5608118534d0 0x560811c1ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 -- 172.21.15.80:0/771309016 >> 172.21.15.80:0/771309016 conn(0x5608118704e0 msgr2=0x560811c1e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 -- 172.21.15.80:0/771309016 shutdown_connections 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 -- 172.21.15.80:0/771309016 wait complete. 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 -- start start 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.845+0000 7f6244b76740 1 Processor -- start 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608118534d0 0x560811c2ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56081185b6b0 0x560811c2ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c9f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62381ae170 con 0x56081187c390 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62381af5e0 con 0x5608118534d0 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f62381ae840 con 0x56081185b6b0 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 10 client.0 _ll_register_callbacks cb 0x7f622c005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c9f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c9f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33692/0 (socket says 172.21.15.80:33692) 2024-04-25T11:28:36.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 -- 172.21.15.80:0/76028220 learned_addr learned my addr 172.21.15.80:0/76028220 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f62377fe640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608118534d0 0x560811c2ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6236ffd640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56081185b6b0 0x560811c2ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 -- 172.21.15.80:0/76028220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56081185b6b0 msgr2=0x560811c2ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56081185b6b0 0x560811c2ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 -- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608118534d0 msgr2=0x560811c2ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608118534d0 0x560811c2ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 -- 172.21.15.80:0/76028220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560811b434b0 con 0x56081187c390 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f62377fe640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608118534d0 0x560811c2ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6236ffd640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56081185b6b0 0x560811c2ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6237fff640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c9f940 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6230005c90 tx=0x7f6230019f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ea4e655bda08fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6216ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6216ffd640 1 -- 172.21.15.80:0/76028220 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230020070 con 0x56081187c390 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6216ffd640 1 -- 172.21.15.80:0/76028220 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6230012730 con 0x56081187c390 2024-04-25T11:28:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.846+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6230019d90 con 0x56081187c390 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6216ffd640 1 -- 172.21.15.80:0/76028220 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6230034040 con 0x56081187c390 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 10 client.16566 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560811ca0d20 con 0x56081187c390 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6216ffd640 1 -- 172.21.15.80:0/76028220 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6230019d90 con 0x56081187c390 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6216ffd640 1 -- 172.21.15.80:0/76028220 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6230037070 con 0x56081187c390 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 10 client.16566 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 10 client.16566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 20 client.16566 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5608118103a0 0x560811ca3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 4 client.16566 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560811b8a800 con 0x5608118103a0 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.847+0000 7f62377fe640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5608118103a0 0x560811ca3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6216ffd640 10 client.16566 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f62377fe640 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5608118103a0 0x560811ca3150 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e52cf2ad3f306a38 server_cookie=52205f414e1b6846 in_seq=0 out_seq=0 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6216ffd640 1 -- 172.21.15.80:0/76028220 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560811b8a800 con 0x5608118103a0 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6216ffd640 10 client.16566 handle_command_reply: tid=0 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 client.16566 shutdown 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 msgr2=0x560811c9f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c9f940 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6230005c90 tx=0x7f6230019f40 comp rx=0 tx=0).stop 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 shutdown_connections 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5608118103a0 0x560811ca3150 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56081187c390 0x560811c9f940 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56081185b6b0 0x560811c2ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6216ffd640 0 client.16566 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 --2- 172.21.15.80:0/76028220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608118534d0 0x560811c2ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 >> 172.21.15.80:0/76028220 conn(0x5608118704e0 msgr2=0x560811c276a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.848+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 shutdown_connections 2024-04-25T11:28:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f6244b76740 1 -- 172.21.15.80:0/76028220 wait complete. 2024-04-25T11:28:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f6244b76740 20 client.16566 trim_cache size 0 max 16384 2024-04-25T11:28:36.849 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:28:36.849 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:28:36.849 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:28:36.849 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:28:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f62200afc60 msgr2=0x7f62200b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f62200afc60 0x7f62200b2170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f623001d000 tx=0x7f623001e000 comp rx=0 tx=0).stop 2024-04-25T11:28:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 msgr2=0x7f623819ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f623819ad30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f622c005d00 tx=0x7f622c00dde0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 shutdown_connections 2024-04-25T11:28:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f62200afc60 0x7f62200b2170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6238109b40 0x7f623819ad30 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6238109fe0 0x7f623819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 --2- 172.21.15.80:0/2371487441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62381027e0 0x7f623819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 >> 172.21.15.80:0/2371487441 conn(0x7f6238077920 msgr2=0x7f6238105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 shutdown_connections 2024-04-25T11:28:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.849+0000 7f623dcc6640 1 -- 172.21.15.80:0/2371487441 wait complete. 2024-04-25T11:28:36.852 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:36 smithi080 ceph-mon[29126]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:36.852 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:28:36.853 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:28:36.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:36 smithi196 ceph-mon[32659]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 -- 172.21.15.80:0/4018063046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac102b00 msgr2=0x7f56ac102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 --2- 172.21.15.80:0/4018063046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac102b00 0x7f56ac102f10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009900 tx=0x7f56a802a410 comp rx=0 tx=0).stop 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 -- 172.21.15.80:0/4018063046 shutdown_connections 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 --2- 172.21.15.80:0/4018063046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac102b00 0x7f56ac102f10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 --2- 172.21.15.80:0/4018063046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56ac10d390 0x7f56ac10f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 --2- 172.21.15.80:0/4018063046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56ac108a30 0x7f56ac1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 -- 172.21.15.80:0/4018063046 >> 172.21.15.80:0/4018063046 conn(0x7f56ac0fe080 msgr2=0x7f56ac1004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 -- 172.21.15.80:0/4018063046 shutdown_connections 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.968+0000 7f56b3db2640 1 -- 172.21.15.80:0/4018063046 wait complete. 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 Processor -- start 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 -- start start 2024-04-25T11:28:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56ac102b00 0x7f56ac19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56ac108a30 0x7f56ac19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac10d390 0x7f56ac19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac112bf0 con 0x7f56ac10d390 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac112a70 con 0x7f56ac108a30 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b3db2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac112d70 con 0x7f56ac102b00 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac10d390 0x7f56ac19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac10d390 0x7f56ac19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33708/0 (socket says 172.21.15.80:33708) 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 -- 172.21.15.80:0/1661802857 learned_addr learned my addr 172.21.15.80:0/1661802857 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b1b4e640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56ac102b00 0x7f56ac19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b134d640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56ac108a30 0x7f56ac19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 -- 172.21.15.80:0/1661802857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56ac102b00 msgr2=0x7f56ac19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56ac102b00 0x7f56ac19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 -- 172.21.15.80:0/1661802857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56ac108a30 msgr2=0x7f56ac19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:36.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56ac108a30 0x7f56ac19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 -- 172.21.15.80:0/1661802857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac19f580 con 0x7f56ac10d390 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b134d640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56ac108a30 0x7f56ac19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b1b4e640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56ac102b00 0x7f56ac19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.969+0000 7f56b234f640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac10d390 0x7f56ac19ef40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f56a400eb10 tx=0x7f56a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.970+0000 7f56a2ffd640 1 -- 172.21.15.80:0/1661802857 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4004b20 con 0x7f56ac10d390 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.970+0000 7f56a2ffd640 1 -- 172.21.15.80:0/1661802857 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a4004cc0 con 0x7f56ac10d390 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.970+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac19f870 con 0x7f56ac10d390 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.970+0000 7f56a2ffd640 1 -- 172.21.15.80:0/1661802857 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4010670 con 0x7f56ac10d390 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.970+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac19fd70 con 0x7f56ac10d390 2024-04-25T11:28:36.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.971+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac06a190 con 0x7f56ac10d390 2024-04-25T11:28:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.972+0000 7f56a2ffd640 1 -- 172.21.15.80:0/1661802857 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f56a4005000 con 0x7f56ac10d390 2024-04-25T11:28:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.973+0000 7f56a2ffd640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56980afc60 0x7f56980b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.973+0000 7f56b1b4e640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56980afc60 0x7f56980b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.973+0000 7f56a2ffd640 1 -- 172.21.15.80:0/1661802857 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f56a40df920 con 0x7f56ac10d390 2024-04-25T11:28:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.973+0000 7f56b1b4e640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56980afc60 0x7f56980b2170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56ac103a30 tx=0x7f569c005e50 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:36.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:36.976+0000 7f56a2ffd640 1 -- 172.21.15.80:0/1661802857 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f56a4053ff0 con 0x7f56ac10d390 2024-04-25T11:28:36.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:36 smithi082 ceph-mon[32440]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:37.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.192+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56ac19ba70 con 0x7f56ac10d390 2024-04-25T11:28:37.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.193+0000 7f56a2ffd640 1 -- 172.21.15.80:0/1661802857 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f56ac19fd70 con 0x7f56ac10d390 2024-04-25T11:28:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:28:37.185 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:28:37.185 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:28:37.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56980afc60 msgr2=0x7f56980b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56980afc60 0x7f56980b2170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56ac103a30 tx=0x7f569c005e50 comp rx=0 tx=0).stop 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac10d390 msgr2=0x7f56ac19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac10d390 0x7f56ac19ef40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f56a400eb10 tx=0x7f56a400c2d0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 shutdown_connections 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56980afc60 0x7f56980b2170 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56ac10d390 0x7f56ac19ef40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56ac108a30 0x7f56ac19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 --2- 172.21.15.80:0/1661802857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56ac102b00 0x7f56ac19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 >> 172.21.15.80:0/1661802857 conn(0x7f56ac0fe080 msgr2=0x7f56ac10e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 shutdown_connections 2024-04-25T11:28:37.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.195+0000 7f56b3db2640 1 -- 172.21.15.80:0/1661802857 wait complete. 2024-04-25T11:28:37.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:28:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 -- 172.21.15.80:0/1074169774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 msgr2=0x7f1d4c1036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/1074169774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1036b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009900 tx=0x7f1d3c02a410 comp rx=0 tx=0).stop 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 -- 172.21.15.80:0/1074169774 shutdown_connections 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/1074169774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c104260 0x7f1d4c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/1074169774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d4c109fb0 0x7f1d4c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/1074169774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1036b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 -- 172.21.15.80:0/1074169774 >> 172.21.15.80:0/1074169774 conn(0x7f1d4c0ff230 msgr2=0x7f1d4c101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 -- 172.21.15.80:0/1074169774 shutdown_connections 2024-04-25T11:28:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.317+0000 7f1d50ff3640 1 -- 172.21.15.80:0/1074169774 wait complete. 2024-04-25T11:28:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 Processor -- start 2024-04-25T11:28:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 -- start start 2024-04-25T11:28:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c104260 0x7f1d4c1a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d4c109fb0 0x7f1d4c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c113d00 con 0x7f1d4c109b10 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c113b80 con 0x7f1d4c104260 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d50ff3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c113e80 con 0x7f1d4c109fb0 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33734/0 (socket says 172.21.15.80:33734) 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 -- 172.21.15.80:0/3525747456 learned_addr learned my addr 172.21.15.80:0/3525747456 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c104260 0x7f1d4c1a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d4c109fb0 0x7f1d4c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 -- 172.21.15.80:0/3525747456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d4c109fb0 msgr2=0x7f1d4c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d4c109fb0 0x7f1d4c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 -- 172.21.15.80:0/3525747456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c104260 msgr2=0x7f1d4c1a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c104260 0x7f1d4c1a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.318+0000 7f1d49d9b640 1 -- 172.21.15.80:0/3525747456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c19add0 con 0x7f1d4c109b10 2024-04-25T11:28:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.319+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1a0a10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005d00 tx=0x7f1d4000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.319+0000 7f1d3b7fe640 1 -- 172.21.15.80:0/3525747456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40017070 con 0x7f1d4c109b10 2024-04-25T11:28:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.319+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c19b0c0 con 0x7f1d4c109b10 2024-04-25T11:28:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.319+0000 7f1d3b7fe640 1 -- 172.21.15.80:0/3525747456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d40009c30 con 0x7f1d4c109b10 2024-04-25T11:28:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.319+0000 7f1d3b7fe640 1 -- 172.21.15.80:0/3525747456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000f620 con 0x7f1d4c109b10 2024-04-25T11:28:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.319+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c1a72c0 con 0x7f1d4c109b10 2024-04-25T11:28:37.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.321+0000 7f1d3b7fe640 1 -- 172.21.15.80:0/3525747456 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1d4001a070 con 0x7f1d4c109b10 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 Processor -- start 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 -- start start 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166fde6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fdec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fefab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562166f43d80 con 0x562166c3d390 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562166efda20 con 0x562166c144d0 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562166f3fd40 con 0x562166c1c6b0 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d3b7fe640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1d340afc60 0x7f1d340b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d4ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166fde6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d4ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166fde6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33744/0 (socket says 172.21.15.80:33744) 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/1873097678 learned_addr learned my addr 172.21.15.80:0/1873097678 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1d340afc60 0x7f1d340b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fefab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fdec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.322+0000 7f1d3b7fe640 1 -- 172.21.15.80:0/3525747456 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1d400de9a0 con 0x7f1d4c109b10 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/1873097678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 msgr2=0x562166fefab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fefab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/1873097678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 msgr2=0x562166fdec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fdec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/1873097678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562166f08c30 con 0x562166c3d390 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166fde6c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1d44012d80 tx=0x7f1d44010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649ff55a70cbeb1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1d340afc60 0x7f1d340b2170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d44010c40 tx=0x7f1d4400c000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d38ff9640 1 -- 172.21.15.80:0/1873097678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44024070 con 0x562166c3d390 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d38ff9640 1 -- 172.21.15.80:0/1873097678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d440125a0 con 0x562166c3d390 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.323+0000 7f1d38ff9640 1 -- 172.21.15.80:0/1873097678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44005220 con 0x562166c3d390 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 -- 172.21.15.80:0/1873097678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 msgr2=0x562166fde6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166fde6c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1d44012d80 tx=0x7f1d44010740 comp rx=0 tx=0).stop 2024-04-25T11:28:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 -- 172.21.15.80:0/1873097678 shutdown_connections 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fefab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fdec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/1873097678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166fde6c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 -- 172.21.15.80:0/1873097678 >> 172.21.15.80:0/1873097678 conn(0x562166c314e0 msgr2=0x562166fdafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 -- 172.21.15.80:0/1873097678 shutdown_connections 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 -- 172.21.15.80:0/1873097678 wait complete. 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 -- start start 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.324+0000 7f1d57f7b740 1 Processor -- start 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fedbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166ff9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562166ff0140 con 0x562166c3d390 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562166ecadc0 con 0x562166c144d0 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562166ff02c0 con 0x562166c1c6b0 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 10 client.0 _ll_register_callbacks cb 0x562166ee6600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166ff9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166ff9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33748/0 (socket says 172.21.15.80:33748) 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/2097550271 learned_addr learned my addr 172.21.15.80:0/2097550271 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fedbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/2097550271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 msgr2=0x562166fedbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fedbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 msgr2=0x562166fed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 -- 172.21.15.80:0/2097550271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562166c553f0 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166ff9680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009dc0 tx=0x7f1d4400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561f43cee4bde5c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2097550271 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44024050 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d440125a0 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.325+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2097550271 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1d44005210 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2097550271 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1d4400cc70 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 10 client.16584 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562166d1f7d0 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2097550271 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d440125a0 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2097550271 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1d4400f040 con 0x562166c3d390 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 10 client.16584 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 10 client.16584 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:28:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 20 client.16584 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bfbf60 0x562166fffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 4 client.16584 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562166f51990 con 0x562166bfbf60 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.326+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bfbf60 0x562166fffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.327+0000 7f1d31ffb640 10 client.16584 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.327+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bfbf60 0x562166fffa50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54e842966537a0b2 server_cookie=2b5e6815d88e8b8 in_seq=0 out_seq=0 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.327+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2097550271 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562166f51990 con 0x562166bfbf60 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.327+0000 7f1d31ffb640 10 client.16584 handle_command_reply: tid=0 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.327+0000 7f1d57f7b740 1 client.16584 shutdown 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.327+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 msgr2=0x562166ff9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.327+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166ff9680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009dc0 tx=0x7f1d4400cf50 comp rx=0 tx=0).stop 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 shutdown_connections 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bfbf60 0x562166fffa50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c3d390 0x562166ff9680 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c1c6b0 0x562166fedbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2097550271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c144d0 0x562166fed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d31ffb640 0 client.16584 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 >> 172.21.15.80:0/2097550271 conn(0x562166c314e0 msgr2=0x562166fe04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 shutdown_connections 2024-04-25T11:28:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2097550271 wait complete. 2024-04-25T11:28:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.328+0000 7f1d57f7b740 20 client.16584 trim_cache size 0 max 16384 2024-04-25T11:28:37.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 Processor -- start 2024-04-25T11:28:37.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 -- start start 2024-04-25T11:28:37.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c144d0 0x562166ff95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c1c6b0 0x562166fdb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c3d390 0x562167002a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c1b00b0 con 0x562166c144d0 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c1ad980 con 0x562166c1c6b0 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c1ab7d0 con 0x562166c3d390 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d4a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c144d0 0x562166ff95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d4a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c144d0 0x562166ff95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33756/0 (socket says 172.21.15.80:33756) 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d4a59c640 1 -- 172.21.15.80:0/107367757 learned_addr learned my addr 172.21.15.80:0/107367757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c3d390 0x562167002a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.341+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c1c6b0 0x562166fdb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d4a59c640 1 -- 172.21.15.80:0/107367757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c3d390 msgr2=0x562167002a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c3d390 0x562167002a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d4a59c640 1 -- 172.21.15.80:0/107367757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c1c6b0 msgr2=0x562166fdb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c1c6b0 0x562166fdb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d4a59c640 1 -- 172.21.15.80:0/107367757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562166fe9060 con 0x562166c144d0 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c1c6b0 0x562166fdb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c144d0 0x562166ff95f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009230 tx=0x7f1d3c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e543eb58072ba61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d33fff640 1 -- 172.21.15.80:0/107367757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c04a070 con 0x562166c144d0 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d33fff640 1 -- 172.21.15.80:0/107367757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d3c0054f0 con 0x562166c144d0 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.342+0000 7f1d33fff640 1 -- 172.21.15.80:0/107367757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c035040 con 0x562166c144d0 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- 172.21.15.80:0/107367757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c144d0 msgr2=0x562166ff95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c144d0 0x562166ff95f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009230 tx=0x7f1d3c031400 comp rx=0 tx=0).stop 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- 172.21.15.80:0/107367757 shutdown_connections 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c3d390 0x562167002a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c1c6b0 0x562166fdb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/107367757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c144d0 0x562166ff95f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- 172.21.15.80:0/107367757 >> 172.21.15.80:0/107367757 conn(0x562166c314e0 msgr2=0x562166fda9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- 172.21.15.80:0/107367757 shutdown_connections 2024-04-25T11:28:37.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- 172.21.15.80:0/107367757 wait complete. 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- start start 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 Processor -- start 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c144d0 0x562167002f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c1c6b0 0x562167000270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c3d390 0x5621670007b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c1abe40 con 0x562166c1c6b0 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c1ad2b0 con 0x562166c3d390 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c1ac510 con 0x562166c144d0 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d57f7b740 10 client.0 _ll_register_callbacks cb 0x7f1d3c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d49d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c1c6b0 0x562167000270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.343+0000 7f1d49d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c1c6b0 0x562167000270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33770/0 (socket says 172.21.15.80:33770) 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d49d9b640 1 -- 172.21.15.80:0/2335841805 learned_addr learned my addr 172.21.15.80:0/2335841805 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c144d0 0x562167002f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c3d390 0x5621670007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d49d9b640 1 -- 172.21.15.80:0/2335841805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c144d0 msgr2=0x562167002f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c144d0 0x562167002f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d49d9b640 1 -- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c3d390 msgr2=0x5621670007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c3d390 0x5621670007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d49d9b640 1 -- 172.21.15.80:0/2335841805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562167000df0 con 0x562166c1c6b0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c144d0 0x562167002f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d4ad9d640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c3d390 0x5621670007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d49d9b640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c1c6b0 0x562167000270 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009610 tx=0x7f1d40021e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb23ca1208c9aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2335841805 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40021040 con 0x562166c1c6b0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2335841805 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1d400a31f0 con 0x562166c1c6b0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d3c0054f0 con 0x562166c1c6b0 2024-04-25T11:28:37.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2335841805 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1d400a6550 con 0x562166c1c6b0 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d57f7b740 10 client.16590 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562167067940 con 0x562166c1c6b0 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2335841805 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d3c0054f0 con 0x562166c1c6b0 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.344+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2335841805 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1d400a5e60 con 0x562166c1c6b0 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d57f7b740 10 client.16590 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d57f7b740 10 client.16590 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d57f7b740 20 client.16590 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bd13a0 0x56216706a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d57f7b740 4 client.16590 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:28:37.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562166f4b800 con 0x562166bd13a0 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bd13a0 0x56216706a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d31ffb640 10 client.16590 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d4a59c640 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bd13a0 0x56216706a100 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8724a69ed211ebd server_cookie=1bae365e262e70dd in_seq=0 out_seq=0 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d31ffb640 1 -- 172.21.15.80:0/2335841805 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562166f4b800 con 0x562166bd13a0 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d31ffb640 10 client.16590 handle_command_reply: tid=0 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.345+0000 7f1d57f7b740 1 client.16590 shutdown 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c1c6b0 msgr2=0x562167000270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c1c6b0 0x562167000270 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009610 tx=0x7f1d40021e90 comp rx=0 tx=0).stop 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 shutdown_connections 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x562166bd13a0 0x56216706a100 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562166c1c6b0 0x562167000270 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166c3d390 0x5621670007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d31ffb640 0 client.16590 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:28:37.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 --2- 172.21.15.80:0/2335841805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562166c144d0 0x562167002f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 >> 172.21.15.80:0/2335841805 conn(0x562166c314e0 msgr2=0x562166febd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 shutdown_connections 2024-04-25T11:28:37.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 1 -- 172.21.15.80:0/2335841805 wait complete. 2024-04-25T11:28:37.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d57f7b740 20 client.16590 trim_cache size 0 max 16384 2024-04-25T11:28:37.348 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1d340afc60 msgr2=0x7f1d340b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1d340afc60 0x7f1d340b2170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d44010c40 tx=0x7f1d4400c000 comp rx=0 tx=0).stop 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 msgr2=0x7f1d4c1a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1a0a10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005d00 tx=0x7f1d4000dde0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 shutdown_connections 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1d340afc60 0x7f1d340b2170 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4c109b10 0x7f1d4c1a0a10 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d4c109fb0 0x7f1d4c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 --2- 172.21.15.80:0/3525747456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c104260 0x7f1d4c1a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 >> 172.21.15.80:0/3525747456 conn(0x7f1d4c0ff230 msgr2=0x7f1d4c0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 shutdown_connections 2024-04-25T11:28:37.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.346+0000 7f1d50ff3640 1 -- 172.21.15.80:0/3525747456 wait complete. 2024-04-25T11:28:37.351 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 -- 172.21.15.80:0/2238838047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc1031c0 msgr2=0x7f1bfc10f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 --2- 172.21.15.80:0/2238838047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc1031c0 0x7f1bfc10f4a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009ca0 tx=0x7f1bf402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 -- 172.21.15.80:0/2238838047 shutdown_connections 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 --2- 172.21.15.80:0/2238838047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc1031c0 0x7f1bfc10f4a0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 --2- 172.21.15.80:0/2238838047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc108eb0 0x7f1bfc102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 --2- 172.21.15.80:0/2238838047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc108a10 0x7f1bfc102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 -- 172.21.15.80:0/2238838047 >> 172.21.15.80:0/2238838047 conn(0x7f1bfc0781b0 msgr2=0x7f1bfc0785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 -- 172.21.15.80:0/2238838047 shutdown_connections 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.471+0000 7f1c01338640 1 -- 172.21.15.80:0/2238838047 wait complete. 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 Processor -- start 2024-04-25T11:28:37.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 -- start start 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc1031c0 0x7f1bfc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc108a10 0x7f1bfc199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc108eb0 0x7f1bfc19ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc112c30 con 0x7f1bfc108a10 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc112ab0 con 0x7f1bfc108eb0 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1c01338640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc112db0 con 0x7f1bfc1031c0 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1bfa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc108a10 0x7f1bfc199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1bfa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc108a10 0x7f1bfc199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33780/0 (socket says 172.21.15.80:33780) 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/3391130043 learned_addr learned my addr 172.21.15.80:0/3391130043 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc1031c0 0x7f1bfc1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.472+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc108eb0 0x7f1bfc19ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/3391130043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc1031c0 msgr2=0x7f1bfc1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc1031c0 0x7f1bfc1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/3391130043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc108eb0 msgr2=0x7f1bfc19ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc108eb0 0x7f1bfc19ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/3391130043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc19e390 con 0x7f1bfc108a10 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc108a10 0x7f1bfc199b10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d770 tx=0x7f1bec00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1be3fff640 1 -- 172.21.15.80:0/3391130043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec017070 con 0x7f1bfc108a10 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1be3fff640 1 -- 172.21.15.80:0/3391130043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bec009cd0 con 0x7f1bfc108a10 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc19e680 con 0x7f1bfc108a10 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1be3fff640 1 -- 172.21.15.80:0/3391130043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec003b50 con 0x7f1bfc108a10 2024-04-25T11:28:37.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.473+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc19ebd0 con 0x7f1bfc108a10 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.475+0000 7f1c081eb740 1 Processor -- start 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.475+0000 7f1c081eb740 1 -- start start 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553262810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552e984d0 0x55b553262d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55326f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1c081eb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b5531c7d80 con 0x55b552ea06b0 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1c081eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b553181a20 con 0x55b552e984d0 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1c081eb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b5531c3d40 con 0x55b552ec1390 2024-04-25T11:28:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553262810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552e984d0 0x55b553262d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552e984d0 0x55b553262d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:49596/0 (socket says 172.21.15.80:49596) 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 -- 172.21.15.80:0/282611452 learned_addr learned my addr 172.21.15.80:0/282611452 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1be3fff640 1 -- 172.21.15.80:0/3391130043 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1bec004220 con 0x7f1bfc108a10 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55326f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 -- 172.21.15.80:0/282611452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 msgr2=0x55b553262810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553262810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 -- 172.21.15.80:0/282611452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 msgr2=0x55b55326f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55326f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 -- 172.21.15.80:0/282611452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b55318cc30 con 0x55b552e984d0 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553262810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55326f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.476+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552e984d0 0x55b553262d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000ac70 tx=0x7f1bf000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f1e7fb17a33929 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.477+0000 7f1be17fa640 1 -- 172.21.15.80:0/282611452 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf001d070 con 0x55b552e984d0 2024-04-25T11:28:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.477+0000 7f1be3fff640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1be40afc60 0x7f1be40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.477+0000 7f1be17fa640 1 -- 172.21.15.80:0/282611452 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bf0018af0 con 0x55b552e984d0 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.477+0000 7f1be17fa640 1 -- 172.21.15.80:0/282611452 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0010b20 con 0x55b552e984d0 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.477+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1be40afc60 0x7f1be40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.477+0000 7f1be3fff640 1 -- 172.21.15.80:0/3391130043 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1bec0de970 con 0x7f1bfc108a10 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- 172.21.15.80:0/282611452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552e984d0 msgr2=0x55b553262d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1be40afc60 0x7f1be40b2170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55b55325f980 tx=0x7f1bf4005c30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552e984d0 0x55b553262d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000ac70 tx=0x7f1bf000f790 comp rx=0 tx=0).stop 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- 172.21.15.80:0/282611452 shutdown_connections 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55326f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552e984d0 0x55b553262d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 --2- 172.21.15.80:0/282611452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553262810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- 172.21.15.80:0/282611452 >> 172.21.15.80:0/282611452 conn(0x55b552eb54e0 msgr2=0x55b55325efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- 172.21.15.80:0/282611452 shutdown_connections 2024-04-25T11:28:37.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- 172.21.15.80:0/282611452 wait complete. 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- start start 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 Processor -- start 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b55326d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553279210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b55326fd90 con 0x55b552e984d0 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b55314edc0 con 0x55b552ea06b0 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b55326ff10 con 0x55b552ec1390 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1c081eb740 10 client.0 _ll_register_callbacks cb 0x55b55316a600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.478+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b55326d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b55326d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33810/0 (socket says 172.21.15.80:33810) 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1001671333 learned_addr learned my addr 172.21.15.80:0/1001671333 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553279210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 msgr2=0x55b553279210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553279210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1001671333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 msgr2=0x55b55326d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1001671333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b552ed93f0 con 0x55b552e984d0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b55326d290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0000c00 tx=0x7f1bf0010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280995737a3ffa41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bdeff5640 1 -- 172.21.15.80:0/1001671333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0027020 con 0x55b552e984d0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bf0018af0 con 0x55b552e984d0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bdeff5640 1 -- 172.21.15.80:0/1001671333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1bf0018780 con 0x55b552e984d0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1bdeff5640 1 -- 172.21.15.80:0/1001671333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bf0032050 con 0x55b552e984d0 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1c081eb740 10 client.16599 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:37.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.479+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b552fa37d0 con 0x55b552e984d0 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1bdeff5640 1 -- 172.21.15.80:0/1001671333 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bf0018af0 con 0x55b552e984d0 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1bdeff5640 1 -- 172.21.15.80:0/1001671333 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1bf00046c0 con 0x55b552e984d0 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1c081eb740 10 client.16599 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1c081eb740 10 client.16599 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1c081eb740 20 client.16599 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e7ff60 0x55b55327f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1c081eb740 4 client.16599 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5531d5990 con 0x55b552e7ff60 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.480+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e7ff60 0x55b55327f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e7ff60 0x55b55327f520 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34acadc416d63ffc server_cookie=726b2ced6afa42c3 in_seq=0 out_seq=0 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1bdeff5640 10 client.16599 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1bdeff5640 1 -- 172.21.15.80:0/1001671333 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b5531d5990 con 0x55b552e7ff60 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1bdeff5640 10 client.16599 handle_command_reply: tid=0 2024-04-25T11:28:37.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1c081eb740 1 client.16599 shutdown 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 msgr2=0x55b55326d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b55326d290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0000c00 tx=0x7f1bf0010660 comp rx=0 tx=0).stop 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 shutdown_connections 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.481+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e7ff60 0x55b55327f520 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553279210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1001671333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b55326d290 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1bdeff5640 0 client.16599 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 >> 172.21.15.80:0/1001671333 conn(0x55b552eb54e0 msgr2=0x55b553264530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 shutdown_connections 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1c081eb740 1 -- 172.21.15.80:0/1001671333 wait complete. 2024-04-25T11:28:37.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.482+0000 7f1c081eb740 20 client.16599 trim_cache size 0 max 16384 2024-04-25T11:28:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 Processor -- start 2024-04-25T11:28:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 -- start start 2024-04-25T11:28:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b553279200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553267430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1b1190 con 0x55b552e984d0 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1aea60 con 0x55b552ea06b0 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1c081eb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1ac8b0 con 0x55b552ec1390 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b553279200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1bfaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b553279200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33818/0 (socket says 172.21.15.80:33818) 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1035353903 learned_addr learned my addr 172.21.15.80:0/1035353903 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.495+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553267430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1035353903 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 msgr2=0x55b553267430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553267430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1035353903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 msgr2=0x55b55326eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfaffd640 1 -- 172.21.15.80:0/1035353903 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b55326fc70 con 0x55b552e984d0 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b553279200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0004b10 tx=0x7f1bf000a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78413593a145fc61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1be0ff9640 1 -- 172.21.15.80:0/1035353903 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf003b070 con 0x55b552e984d0 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1be0ff9640 1 -- 172.21.15.80:0/1035353903 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bf0004d00 con 0x55b552e984d0 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.496+0000 7f1be0ff9640 1 -- 172.21.15.80:0/1035353903 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0027070 con 0x55b552e984d0 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- 172.21.15.80:0/1035353903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 msgr2=0x55b553279200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b553279200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0004b10 tx=0x7f1bf000a510 comp rx=0 tx=0).stop 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- 172.21.15.80:0/1035353903 shutdown_connections 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552ec1390 0x55b553267430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ea06b0 0x55b55326eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 --2- 172.21.15.80:0/1035353903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552e984d0 0x55b553279200 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- 172.21.15.80:0/1035353903 >> 172.21.15.80:0/1035353903 conn(0x55b552eb54e0 msgr2=0x55b55326e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- 172.21.15.80:0/1035353903 shutdown_connections 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- 172.21.15.80:0/1035353903 wait complete. 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- start start 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 Processor -- start 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552e984d0 0x55b5532829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55327fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ec1390 0x55b553280290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1acf20 con 0x55b552ea06b0 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1ae390 con 0x55b552ec1390 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1ad5f0 con 0x55b552e984d0 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1c081eb740 10 client.0 _ll_register_callbacks cb 0x7f1bf001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.497+0000 7f1bfa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55327fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55327fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33834/0 (socket says 172.21.15.80:33834) 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/2567068063 learned_addr learned my addr 172.21.15.80:0/2567068063 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ec1390 0x55b553280290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552e984d0 0x55b5532829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552e984d0 msgr2=0x55b5532829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552e984d0 0x55b5532829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/2567068063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ec1390 msgr2=0x55b553280290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ec1390 0x55b553280290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 -- 172.21.15.80:0/2567068063 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5532625a0 con 0x55b552ea06b0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfb7fe640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ec1390 0x55b553280290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bfa7fc640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55327fd50 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0a6820 tx=0x7f1bec0c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d081c070ab21ba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bdeff5640 1 -- 172.21.15.80:0/2567068063 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0a7220 con 0x55b552ea06b0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bdeff5640 1 -- 172.21.15.80:0/2567068063 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1bec0a2db0 con 0x55b552ea06b0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bf0004d00 con 0x55b552ea06b0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bdeff5640 1 -- 172.21.15.80:0/2567068063 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bec0a6b20 con 0x55b552ea06b0 2024-04-25T11:28:37.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1c081eb740 10 client.16605 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5532600f0 con 0x55b552ea06b0 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.498+0000 7f1bdeff5640 1 -- 172.21.15.80:0/2567068063 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bf0004d00 con 0x55b552ea06b0 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1bdeff5640 1 -- 172.21.15.80:0/2567068063 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1bec023060 con 0x55b552ea06b0 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1c081eb740 10 client.16605 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1c081eb740 10 client.16605 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1c081eb740 20 client.16605 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1c081eb740 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e553a0 0x55b5532e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1c081eb740 4 client.16605 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5531cf800 con 0x55b552e553a0 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e553a0 0x55b5532e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1bdeff5640 10 client.16605 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1bfaffd640 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e553a0 0x55b5532e9800 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b57793cea5402cd server_cookie=b50ee8db777a68dc in_seq=0 out_seq=0 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1bdeff5640 1 -- 172.21.15.80:0/2567068063 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5531cf800 con 0x55b552e553a0 2024-04-25T11:28:37.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1bdeff5640 10 client.16605 handle_command_reply: tid=0 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.499+0000 7f1c081eb740 1 client.16605 shutdown 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 msgr2=0x55b55327fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55327fd50 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0a6820 tx=0x7f1bec0c9040 comp rx=0 tx=0).stop 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 shutdown_connections 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b552ea06b0 0x55b55327fd50 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b552e553a0 0x55b5532e9800 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b552ec1390 0x55b553280290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1bdeff5640 0 client.16605 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 --2- 172.21.15.80:0/2567068063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b552e984d0 0x55b5532829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 >> 172.21.15.80:0/2567068063 conn(0x55b552eb54e0 msgr2=0x55b55325edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 shutdown_connections 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 1 -- 172.21.15.80:0/2567068063 wait complete. 2024-04-25T11:28:37.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c081eb740 20 client.16605 trim_cache size 0 max 16384 2024-04-25T11:28:37.499 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1be40afc60 msgr2=0x7f1be40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1be40afc60 0x7f1be40b2170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55b55325f980 tx=0x7f1bf4005c30 comp rx=0 tx=0).stop 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc108a10 msgr2=0x7f1bfc199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc108a10 0x7f1bfc199b10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d770 tx=0x7f1bec00db70 comp rx=0 tx=0).stop 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 shutdown_connections 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1be40afc60 0x7f1be40b2170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bfc108a10 0x7f1bfc199b10 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc108eb0 0x7f1bfc19ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 --2- 172.21.15.80:0/3391130043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc1031c0 0x7f1bfc1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 >> 172.21.15.80:0/3391130043 conn(0x7f1bfc0781b0 msgr2=0x7f1bfc100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 shutdown_connections 2024-04-25T11:28:37.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.500+0000 7f1c01338640 1 -- 172.21.15.80:0/3391130043 wait complete. 2024-04-25T11:28:37.503 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:28:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 -- 172.21.15.80:0/1709579000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 msgr2=0x7f35f8101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1709579000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8101b10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009ca0 tx=0x7f35f402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 -- 172.21.15.80:0/1709579000 shutdown_connections 2024-04-25T11:28:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1709579000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f810e550 0x7f35f8110970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1709579000 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35f8102050 0x7f35f8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1709579000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8101b10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 -- 172.21.15.80:0/1709579000 >> 172.21.15.80:0/1709579000 conn(0x7f35f8077880 msgr2=0x7f35f8077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 -- 172.21.15.80:0/1709579000 shutdown_connections 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.622+0000 7f35ff77a640 1 -- 172.21.15.80:0/1709579000 wait complete. 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 Processor -- start 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 -- start start 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f8102050 0x7f35f8102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35f810e550 0x7f35f8103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8113d10 con 0x7f35f8109ba0 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8113b90 con 0x7f35f8102050 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35ff77a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8113e90 con 0x7f35f810e550 2024-04-25T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8103230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33850/0 (socket says 172.21.15.80:33850) 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 -- 172.21.15.80:0/1720572845 learned_addr learned my addr 172.21.15.80:0/1720572845 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fd516640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f8102050 0x7f35f8102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fdd17640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35f810e550 0x7f35f8103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 -- 172.21.15.80:0/1720572845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35f810e550 msgr2=0x7f35f8103770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35f810e550 0x7f35f8103770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 -- 172.21.15.80:0/1720572845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f8102050 msgr2=0x7f35f8102cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f8102050 0x7f35f8102cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fcd15640 1 -- 172.21.15.80:0/1720572845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f81a8ad0 con 0x7f35f8109ba0 2024-04-25T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.623+0000 7f35fdd17640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35f810e550 0x7f35f8103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.624+0000 7f35fcd15640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8103230 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f35e800d740 tx=0x7f35e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.624+0000 7f35ee7fc640 1 -- 172.21.15.80:0/1720572845 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8017070 con 0x7f35f8109ba0 2024-04-25T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.624+0000 7f35ee7fc640 1 -- 172.21.15.80:0/1720572845 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e800de50 con 0x7f35f8109ba0 2024-04-25T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.624+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f81a8dc0 con 0x7f35f8109ba0 2024-04-25T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.624+0000 7f35ee7fc640 1 -- 172.21.15.80:0/1720572845 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8004ce0 con 0x7f35f8109ba0 2024-04-25T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.624+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f81a9230 con 0x7f35f8109ba0 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.626+0000 7f3606621740 1 Processor -- start 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f3606621740 1 -- start start 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f3606621740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa51e390 0x55a6fa8bf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f3606621740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8bfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f3606621740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35ee7fc640 1 -- 172.21.15.80:0/1720572845 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f35e8004e80 con 0x7f35f8109ba0 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f3606621740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa824d80 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f3606621740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa7dea20 con 0x55a6fa4f54d0 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f3606621740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa820d40 con 0x55a6fa51e390 2024-04-25T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33858/0 (socket says 172.21.15.80:33858) 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 -- 172.21.15.80:0/4259010397 learned_addr learned my addr 172.21.15.80:0/4259010397 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fdd17640 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa51e390 0x55a6fa8bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fd516640 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8bfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 -- 172.21.15.80:0/4259010397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa51e390 msgr2=0x55a6fa8bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa51e390 0x55a6fa8bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 -- 172.21.15.80:0/4259010397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4f54d0 msgr2=0x55a6fa8bfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8bfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35fcd15640 1 -- 172.21.15.80:0/4259010397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa7e9c30 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.627+0000 7f35ee7fc640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f35e40afc60 0x7f35e40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.628+0000 7f35fcd15640 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cc6a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f35e80dc160 tx=0x7f35e80e75d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d94a0bb1b38d5e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.628+0000 7f35fdd17640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f35e40afc60 0x7f35e40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.628+0000 7f35e37fe640 1 -- 172.21.15.80:0/4259010397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80a2b00 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.628+0000 7f35ee7fc640 1 -- 172.21.15.80:0/1720572845 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f35e80dea90 con 0x7f35f8109ba0 2024-04-25T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.628+0000 7f35e37fe640 1 -- 172.21.15.80:0/4259010397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e80e6040 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.628+0000 7f35e37fe640 1 -- 172.21.15.80:0/4259010397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80a63b0 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 -- 172.21.15.80:0/4259010397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 msgr2=0x55a6fa8cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cc6a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f35e80dc160 tx=0x7f35e80e75d0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f35fdd17640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f35e40afc60 0x7f35e40b2170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55a6fa8bc980 tx=0x7f35f00093d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 -- 172.21.15.80:0/4259010397 shutdown_connections 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cc6a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8bfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 --2- 172.21.15.80:0/4259010397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa51e390 0x55a6fa8bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 -- 172.21.15.80:0/4259010397 >> 172.21.15.80:0/4259010397 conn(0x55a6fa5124e0 msgr2=0x55a6fa8bbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 -- 172.21.15.80:0/4259010397 shutdown_connections 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 -- 172.21.15.80:0/4259010397 wait complete. 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 -- start start 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.629+0000 7f3606621740 1 Processor -- start 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8d6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa8ccd90 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa7abdc0 con 0x55a6fa51e390 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a6fa8ccf10 con 0x55a6fa4f54d0 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 10 client.0 _ll_register_callbacks cb 0x55a6fa7c7600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33874/0 (socket says 172.21.15.80:33874) 2024-04-25T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 -- 172.21.15.80:0/1267069957 learned_addr learned my addr 172.21.15.80:0/1267069957 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fdd17640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8d6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fd516640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 -- 172.21.15.80:0/1267069957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 msgr2=0x55a6fa8ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 -- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 msgr2=0x55a6fa8d6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8d6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 -- 172.21.15.80:0/1267069957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fa5363f0 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fdd17640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8d6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35fcd15640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8ca6d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f35e80dc2a0 tx=0x7f35e80e2160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fb2ead378009f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35e0ff9640 1 -- 172.21.15.80:0/1267069957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8020040 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f35e0ff9640 1 -- 172.21.15.80:0/1267069957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f35e80a2ed0 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.630+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35e80e6040 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f35e0ff9640 1 -- 172.21.15.80:0/1267069957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f35e80a6590 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 10 client.16617 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a6fa6007d0 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f35e0ff9640 1 -- 172.21.15.80:0/1267069957 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e80e6040 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f35e0ff9640 1 -- 172.21.15.80:0/1267069957 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f35e80e2710 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 10 client.16617 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 20 client.16617 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4dcf60 0x55a6fa8dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 4 client.16617 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6fa832990 con 0x55a6fa4dcf60 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.631+0000 7f35fd516640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4dcf60 0x55a6fa8dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.632+0000 7f35e0ff9640 10 client.16617 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.632+0000 7f35fd516640 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4dcf60 0x55a6fa8dc460 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e6c9ae6beb4532 server_cookie=4c0bad8ff535441 in_seq=0 out_seq=0 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.632+0000 7f35e0ff9640 1 -- 172.21.15.80:0/1267069957 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a6fa832990 con 0x55a6fa4dcf60 2024-04-25T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.632+0000 7f35e0ff9640 10 client.16617 handle_command_reply: tid=0 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.632+0000 7f3606621740 1 client.16617 shutdown 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 msgr2=0x55a6fa8ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8ca6d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f35e80dc2a0 tx=0x7f35e80e2160 comp rx=0 tx=0).stop 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 shutdown_connections 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4dcf60 0x55a6fa8dc460 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8ca6d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8d6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f35e0ff9640 0 client.16617 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 --2- 172.21.15.80:0/1267069957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 >> 172.21.15.80:0/1267069957 conn(0x55a6fa5124e0 msgr2=0x55a6fa8c1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 shutdown_connections 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 1 -- 172.21.15.80:0/1267069957 wait complete. 2024-04-25T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.633+0000 7f3606621740 20 client.16617 trim_cache size 0 max 16384 2024-04-25T11:28:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.646+0000 7f3606621740 1 Processor -- start 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.646+0000 7f3606621740 1 -- start start 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.646+0000 7f3606621740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.646+0000 7f3606621740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8d5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f3606621740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f3606621740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81b4570 con 0x55a6fa4f54d0 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f3606621740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81b1e40 con 0x55a6fa51e390 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f3606621740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81afc90 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33884/0 (socket says 172.21.15.80:33884) 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 -- 172.21.15.80:0/1173768780 learned_addr learned my addr 172.21.15.80:0/1173768780 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 -- 172.21.15.80:0/1173768780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4fd6b0 msgr2=0x55a6fa8d5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 --2- 172.21.15.80:0/1173768780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8d5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 -- 172.21.15.80:0/1173768780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 msgr2=0x55a6fa8c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 --2- 172.21.15.80:0/1173768780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 -- 172.21.15.80:0/1173768780 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fa8c0070 con 0x55a6fa4f54d0 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35fd516640 1 --2- 172.21.15.80:0/1173768780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8c8f60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f35f8069bf0 tx=0x7f35f4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711eb0f1676c7696 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35e2ffd640 1 -- 172.21.15.80:0/1173768780 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4031450 con 0x55a6fa4f54d0 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35e2ffd640 1 -- 172.21.15.80:0/1173768780 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f4036040 con 0x55a6fa4f54d0 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.647+0000 7f35e2ffd640 1 -- 172.21.15.80:0/1173768780 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4047760 con 0x55a6fa4f54d0 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 -- 172.21.15.80:0/1173768780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4f54d0 msgr2=0x55a6fa8c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 --2- 172.21.15.80:0/1173768780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8c8f60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f35f8069bf0 tx=0x7f35f4009360 comp rx=0 tx=0).stop 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 -- 172.21.15.80:0/1173768780 shutdown_connections 2024-04-25T11:28:37.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 --2- 172.21.15.80:0/1173768780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa51e390 0x55a6fa8c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 --2- 172.21.15.80:0/1173768780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8d5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 --2- 172.21.15.80:0/1173768780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8c8f60 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 -- 172.21.15.80:0/1173768780 >> 172.21.15.80:0/1173768780 conn(0x55a6fa5124e0 msgr2=0x55a6fa8c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 -- 172.21.15.80:0/1173768780 shutdown_connections 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 -- 172.21.15.80:0/1173768780 wait complete. 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 -- start start 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.648+0000 7f3606621740 1 Processor -- start 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f3606621740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f3606621740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f3606621740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa51e390 0x55a6fa8cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f3606621740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81b0300 con 0x55a6fa51e390 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f3606621740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81b1770 con 0x55a6fa4fd6b0 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f3606621740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81b09d0 con 0x55a6fa4f54d0 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f3606621740 10 client.0 _ll_register_callbacks cb 0x7f35f4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:37.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa51e390 0x55a6fa8cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa51e390 0x55a6fa8cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33892/0 (socket says 172.21.15.80:33892) 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 -- 172.21.15.80:0/3470111446 learned_addr learned my addr 172.21.15.80:0/3470111446 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fd516640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fcd15640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 -- 172.21.15.80:0/3470111446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 msgr2=0x55a6fa8cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 -- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4fd6b0 msgr2=0x55a6fa8cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 -- 172.21.15.80:0/3470111446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fa942670 con 0x55a6fa51e390 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fcd15640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:37.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fd516640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35fdd17640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa51e390 0x55a6fa8cdc30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009fd0 tx=0x7f35f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d9f0e52b45cf6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.649+0000 7f35e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f35e0ff9640 1 -- 172.21.15.80:0/3470111446 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f001f830 con 0x55a6fa51e390 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f35e0ff9640 1 -- 172.21.15.80:0/3470111446 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f35f001f9d0 con 0x55a6fa51e390 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f4036040 con 0x55a6fa51e390 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f35e0ff9640 1 -- 172.21.15.80:0/3470111446 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f35f0012e20 con 0x55a6fa51e390 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 10 client.16623 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a6fa943950 con 0x55a6fa51e390 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f35e0ff9640 1 -- 172.21.15.80:0/3470111446 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f4036040 con 0x55a6fa51e390 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f35e0ff9640 1 -- 172.21.15.80:0/3470111446 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f35f000f040 con 0x55a6fa51e390 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 10 client.16623 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 20 client.16623 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:37.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4b23a0 0x55a6fa946170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 4 client.16623 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6fa82c800 con 0x55a6fa4b23a0 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.650+0000 7f35fd516640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4b23a0 0x55a6fa946170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f35e0ff9640 10 client.16623 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f35fd516640 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4b23a0 0x55a6fa946170 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5cd4626d83fa812 server_cookie=e9fa626fc2c344de in_seq=0 out_seq=0 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f35e0ff9640 1 -- 172.21.15.80:0/3470111446 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6fa82c800 con 0x55a6fa4b23a0 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f35e0ff9640 10 client.16623 handle_command_reply: tid=0 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 client.16623 shutdown 2024-04-25T11:28:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa51e390 msgr2=0x55a6fa8cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa51e390 0x55a6fa8cdc30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009fd0 tx=0x7f35f0004730 comp rx=0 tx=0).stop 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 shutdown_connections 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a6fa4b23a0 0x55a6fa946170 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6fa51e390 0x55a6fa8cdc30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6fa4fd6b0 0x55a6fa8cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f35e0ff9640 0 client.16623 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 --2- 172.21.15.80:0/3470111446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a6fa4f54d0 0x55a6fa8cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 >> 172.21.15.80:0/3470111446 conn(0x55a6fa5124e0 msgr2=0x55a6fa8bbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 shutdown_connections 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 1 -- 172.21.15.80:0/3470111446 wait complete. 2024-04-25T11:28:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.651+0000 7f3606621740 20 client.16623 trim_cache size 0 max 16384 2024-04-25T11:28:37.652 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:28:37.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f35e40afc60 msgr2=0x7f35e40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f35e40afc60 0x7f35e40b2170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55a6fa8bc980 tx=0x7f35f00093d0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 msgr2=0x7f35f8103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8103230 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f35e800d740 tx=0x7f35e800dc00 comp rx=0 tx=0).stop 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 shutdown_connections 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f35e40afc60 0x7f35e40b2170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35f8109ba0 0x7f35f8103230 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35f810e550 0x7f35f8103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 --2- 172.21.15.80:0/1720572845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f8102050 0x7f35f8102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 >> 172.21.15.80:0/1720572845 conn(0x7f35f8077880 msgr2=0x7f35f810a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 shutdown_connections 2024-04-25T11:28:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:37.652+0000 7f35ff77a640 1 -- 172.21.15.80:0/1720572845 wait complete. 2024-04-25T11:28:37.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:37 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1661802857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:28:37.938 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:37 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1661802857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:28:37.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:37 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1661802857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:28:38.655 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:28:38.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:28:38.656 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:28:38.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 -- 172.21.15.80:0/3093506216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 msgr2=0x7f7fc8102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 --2- 172.21.15.80:0/3093506216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc8102460 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009900 tx=0x7f7fbc02a410 comp rx=0 tx=0).stop 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 -- 172.21.15.80:0/3093506216 shutdown_connections 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 --2- 172.21.15.80:0/3093506216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc8102460 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 --2- 172.21.15.80:0/3093506216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7fc810e550 0x7f7fc8110970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 --2- 172.21.15.80:0/3093506216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc8109ba0 0x7f7fc8101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 -- 172.21.15.80:0/3093506216 >> 172.21.15.80:0/3093506216 conn(0x7f7fc8077880 msgr2=0x7f7fc8077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 -- 172.21.15.80:0/3093506216 shutdown_connections 2024-04-25T11:28:38.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.795+0000 7f7fcca27640 1 -- 172.21.15.80:0/3093506216 wait complete. 2024-04-25T11:28:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 Processor -- start 2024-04-25T11:28:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 -- start start 2024-04-25T11:28:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7fc8109ba0 0x7f7fc819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc810e550 0x7f7fc819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8113d10 con 0x7f7fc8102050 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8113b90 con 0x7f7fc810e550 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fcca27640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8113e90 con 0x7f7fc8109ba0 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fc659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fc659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33908/0 (socket says 172.21.15.80:33908) 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fc659c640 1 -- 172.21.15.80:0/1163522556 learned_addr learned my addr 172.21.15.80:0/1163522556 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc810e550 0x7f7fc819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.796+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7fc8109ba0 0x7f7fc819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fc659c640 1 -- 172.21.15.80:0/1163522556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7fc8109ba0 msgr2=0x7f7fc819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7fc8109ba0 0x7f7fc819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fc659c640 1 -- 172.21.15.80:0/1163522556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc810e550 msgr2=0x7f7fc819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc810e550 0x7f7fc819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fc659c640 1 -- 172.21.15.80:0/1163522556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc819f590 con 0x7f7fc8102050 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7fc8109ba0 0x7f7fc819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc819a730 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800eb90 tx=0x7f7fb800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fb77fe640 1 -- 172.21.15.80:0/1163522556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8003b70 con 0x7f7fc8102050 2024-04-25T11:28:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc819f880 con 0x7f7fc8102050 2024-04-25T11:28:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fb77fe640 1 -- 172.21.15.80:0/1163522556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb800ee90 con 0x7f7fc8102050 2024-04-25T11:28:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fb77fe640 1 -- 172.21.15.80:0/1163522556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80197b0 con 0x7f7fc8102050 2024-04-25T11:28:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.797+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc81a7200 con 0x7f7fc8102050 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 Processor -- start 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fb77fe640 1 -- 172.21.15.80:0/1163522556 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f7fb8004030 con 0x7f7fc8102050 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 -- start start 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8e8410 0x55c98cc88620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8bf550 0x55c98cc88b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c98cbeeb00 con 0x55c98c8bf550 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c98cb8a920 con 0x55c98c8e8410 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c98cbeaac0 con 0x55c98c8c7730 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fc659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8bf550 0x55c98cc88b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fc659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8bf550 0x55c98cc88b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33924/0 (socket says 172.21.15.80:33924) 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fc659c640 1 -- 172.21.15.80:0/3009269181 learned_addr learned my addr 172.21.15.80:0/3009269181 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8e8410 0x55c98cc88620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.800+0000 7f7fb77fe640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7fb00afc60 0x7f7fb00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7fb00afc60 0x7f7fb00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc659c640 1 -- 172.21.15.80:0/3009269181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 msgr2=0x55c98cc890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc659c640 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc890a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc659c640 1 -- 172.21.15.80:0/3009269181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8e8410 msgr2=0x55c98cc88620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc659c640 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8e8410 0x55c98cc88620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc659c640 1 -- 172.21.15.80:0/3009269181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c98c9c87e0 con 0x55c98c8bf550 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fb77fe640 1 -- 172.21.15.80:0/1163522556 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7fb80df960 con 0x7f7fc8102050 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc659c640 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8bf550 0x55c98cc88b60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80dd030 tx=0x7f7fb8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e034b6f9cb4520 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7fb00afc60 0x7f7fb00b2170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c98cc85790 tx=0x7f7fc0004730 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fb4ff9640 1 -- 172.21.15.80:0/3009269181 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80a7460 con 0x55c98c8bf550 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fb4ff9640 1 -- 172.21.15.80:0/3009269181 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb80a7620 con 0x55c98c8bf550 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.801+0000 7f7fb4ff9640 1 -- 172.21.15.80:0/3009269181 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80a7280 con 0x55c98c8bf550 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3009269181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8bf550 msgr2=0x55c98cc88b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8bf550 0x55c98cc88b60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80dd030 tx=0x7f7fb8021000 comp rx=0 tx=0).stop 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3009269181 shutdown_connections 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8bf550 0x55c98cc88b60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3009269181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8e8410 0x55c98cc88620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3009269181 >> 172.21.15.80:0/3009269181 conn(0x55c98c8dc560 msgr2=0x55c98cc84dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3009269181 shutdown_connections 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.802+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3009269181 wait complete. 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 -- start start 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 Processor -- start 2024-04-25T11:28:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 0x55c98cc92b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc93080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8e8410 0x55c98cc9edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c98cc95910 con 0x55c98c8c7730 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c98cb885d0 con 0x55c98c8bf550 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c98cc95a90 con 0x55c98c8e8410 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fd39ba740 10 client.0 _ll_register_callbacks cb 0x55c98cb76080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc93080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33930/0 (socket says 172.21.15.80:33930) 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/3371287589 learned_addr learned my addr 172.21.15.80:0/3371287589 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc659c640 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 0x55c98cc92b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8e8410 0x55c98cc9edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/3371287589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8e8410 msgr2=0x55c98cc9edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8e8410 0x55c98cc9edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 msgr2=0x55c98cc92b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 0x55c98cc92b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.803+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/3371287589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c98ca28f70 con 0x55c98c8c7730 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc93080 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc005940 tx=0x7f7fbc031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6077b3e727799b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fadffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fadffb640 1 -- 172.21.15.80:0/3371287589 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc035040 con 0x55c98c8c7730 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fadffb640 1 -- 172.21.15.80:0/3371287589 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7fbc004240 con 0x55c98c8c7730 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb80a7620 con 0x55c98c8c7730 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fadffb640 1 -- 172.21.15.80:0/3371287589 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fbc004440 con 0x55c98c8c7730 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 10 client.16635 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c98c8c0170 con 0x55c98c8c7730 2024-04-25T11:28:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fadffb640 1 -- 172.21.15.80:0/3371287589 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb80a7620 con 0x55c98c8c7730 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fadffb640 1 -- 172.21.15.80:0/3371287589 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7fbc004bc0 con 0x55c98c8c7730 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 10 client.16635 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 20 client.16635 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8a71f0 0x55c98cca4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 4 client.16635 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.804+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c98cbfc710 con 0x55c98c8a71f0 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.805+0000 7f7fc659c640 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8a71f0 0x55c98cca4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.805+0000 7f7fc659c640 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8a71f0 0x55c98cca4e80 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76cff97cc4cad740 server_cookie=f69487fcc8899533 in_seq=0 out_seq=0 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.805+0000 7f7fadffb640 10 client.16635 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fadffb640 1 -- 172.21.15.80:0/3371287589 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c98cbfc710 con 0x55c98c8a71f0 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fadffb640 10 client.16635 handle_command_reply: tid=0 2024-04-25T11:28:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 client.16635 shutdown 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 msgr2=0x55c98cc93080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc93080 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc005940 tx=0x7f7fbc031740 comp rx=0 tx=0).stop 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 shutdown_connections 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8a71f0 0x55c98cca4e80 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc93080 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8e8410 0x55c98cc9edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fadffb640 0 client.16635 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/3371287589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 0x55c98cc92b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 >> 172.21.15.80:0/3371287589 conn(0x55c98c8dc560 msgr2=0x55c98cc885c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 shutdown_connections 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 1 -- 172.21.15.80:0/3371287589 wait complete. 2024-04-25T11:28:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.806+0000 7f7fd39ba740 20 client.16635 trim_cache size 0 max 16384 2024-04-25T11:28:38.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.824+0000 7f7fd39ba740 1 Processor -- start 2024-04-25T11:28:38.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.824+0000 7f7fd39ba740 1 -- start start 2024-04-25T11:28:38.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.824+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8dc560 0x55c98cc83ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.824+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 0x55c98cc88ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.824+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc89000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81b2330 con 0x55c98c8dc560 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81afc00 con 0x55c98c8bf550 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81ada50 con 0x55c98c8c7730 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8dc560 0x55c98cc83ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8dc560 0x55c98cc83ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33938/0 (socket says 172.21.15.80:33938) 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 -- 172.21.15.80:0/1881282585 learned_addr learned my addr 172.21.15.80:0/1881282585 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc89000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 -- 172.21.15.80:0/1881282585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 msgr2=0x55c98cc89000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc89000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 -- 172.21.15.80:0/1881282585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 msgr2=0x55c98cc88ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 0x55c98cc88ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 -- 172.21.15.80:0/1881282585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c98cc85f20 con 0x55c98c8dc560 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc89000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8dc560 0x55c98cc83ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80dd6c0 tx=0x7f7fb80ca040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f259ff341de1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7faffff640 1 -- 172.21.15.80:0/1881282585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80a7280 con 0x55c98c8dc560 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7faffff640 1 -- 172.21.15.80:0/1881282585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb80a7620 con 0x55c98c8dc560 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.825+0000 7f7faffff640 1 -- 172.21.15.80:0/1881282585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80a7460 con 0x55c98c8dc560 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1881282585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8dc560 msgr2=0x55c98cc83ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8dc560 0x55c98cc83ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80dd6c0 tx=0x7f7fb80ca040 comp rx=0 tx=0).stop 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1881282585 shutdown_connections 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8c7730 0x55c98cc89000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8bf550 0x55c98cc88ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1881282585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8dc560 0x55c98cc83ef0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1881282585 >> 172.21.15.80:0/1881282585 conn(0x55c98cc84f60 msgr2=0x55c98cc883b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1881282585 shutdown_connections 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1881282585 wait complete. 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 -- start start 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.826+0000 7f7fd39ba740 1 Processor -- start 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8bf550 0x55c98cc96ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc96ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8dc560 0x55c98cc97530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81ae0c0 con 0x55c98c8c7730 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81af530 con 0x55c98c8dc560 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81ae790 con 0x55c98c8bf550 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 10 client.0 _ll_register_callbacks cb 0x7f7fbc005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc96ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc96ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33950/0 (socket says 172.21.15.80:33950) 2024-04-25T11:28:38.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/1051392392 learned_addr learned my addr 172.21.15.80:0/1051392392 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8bf550 0x55c98cc96ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc6d9d640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8dc560 0x55c98cc97530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/1051392392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8bf550 msgr2=0x55c98cc96ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8bf550 0x55c98cc96ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8dc560 msgr2=0x55c98cc97530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8dc560 0x55c98cc97530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 -- 172.21.15.80:0/1051392392 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c98cd0c350 con 0x55c98c8c7730 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8bf550 0x55c98cc96ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fc5d9b640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc96ff0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009900 tx=0x7f7fbc031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973a3398ff3c9be4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fadffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fadffb640 1 -- 172.21.15.80:0/1051392392 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc052070 con 0x55c98c8c7730 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fadffb640 1 -- 172.21.15.80:0/1051392392 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7fbc004ad0 con 0x55c98c8c7730 2024-04-25T11:28:38.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb80a7620 con 0x55c98c8c7730 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fadffb640 1 -- 172.21.15.80:0/1051392392 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fbc035040 con 0x55c98c8c7730 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 10 client.16641 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.827+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c98cd0d540 con 0x55c98c8c7730 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fadffb640 1 -- 172.21.15.80:0/1051392392 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb80a7620 con 0x55c98c8c7730 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fadffb640 1 -- 172.21.15.80:0/1051392392 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7fbc003bb0 con 0x55c98c8c7730 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fd39ba740 10 client.16641 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fd39ba740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fd39ba740 20 client.16641 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8e8410 0x55c98cd0fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fd39ba740 4 client.16641 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c98cbf6580 con 0x55c98c8e8410 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8e8410 0x55c98cd0fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fc659c640 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8e8410 0x55c98cd0fc50 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ab32877c96bf server_cookie=3363b3745fa73530 in_seq=0 out_seq=0 2024-04-25T11:28:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.828+0000 7f7fadffb640 10 client.16641 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fadffb640 1 -- 172.21.15.80:0/1051392392 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c98cbf6580 con 0x55c98c8e8410 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fadffb640 10 client.16641 handle_command_reply: tid=0 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 client.16641 shutdown 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 msgr2=0x55c98cc96ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc96ff0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009900 tx=0x7f7fbc031400 comp rx=0 tx=0).stop 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 shutdown_connections 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c98c8e8410 0x55c98cd0fc50 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c98c8c7730 0x55c98cc96ff0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c98c8dc560 0x55c98cc97530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fadffb640 0 client.16641 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 --2- 172.21.15.80:0/1051392392 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c98c8bf550 0x55c98cc96ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 >> 172.21.15.80:0/1051392392 conn(0x55c98cc84f60 msgr2=0x55c98cc88de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 shutdown_connections 2024-04-25T11:28:38.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 1 -- 172.21.15.80:0/1051392392 wait complete. 2024-04-25T11:28:38.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fd39ba740 20 client.16641 trim_cache size 0 max 16384 2024-04-25T11:28:38.828 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:28:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:28:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "f934ef26-505a-470b-addb-76b6fe5ffaf4", 2024-04-25T11:28:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:28:38.828 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:28:38.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7fb00afc60 msgr2=0x7f7fb00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fcca27640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7fb00afc60 0x7f7fb00b2170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c98cc85790 tx=0x7f7fc0004730 comp rx=0 tx=0).stop 2024-04-25T11:28:38.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 msgr2=0x7f7fc819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.830+0000 7f7fcca27640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc819a730 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800eb90 tx=0x7f7fb800c6a0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 shutdown_connections 2024-04-25T11:28:38.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7fb00afc60 0x7f7fb00b2170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc810e550 0x7f7fc819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7fc8109ba0 0x7f7fc819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 --2- 172.21.15.80:0/1163522556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc8102050 0x7f7fc819a730 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 >> 172.21.15.80:0/1163522556 conn(0x7f7fc8077880 msgr2=0x7f7fc810a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 shutdown_connections 2024-04-25T11:28:38.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.831+0000 7f7fcca27640 1 -- 172.21.15.80:0/1163522556 wait complete. 2024-04-25T11:28:38.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:38 smithi080 ceph-mon[29126]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:38.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:28:38.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:28:38.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:38 smithi196 ceph-mon[32659]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 -- 172.21.15.80:0/3665420262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 msgr2=0x7fe16010ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 --2- 172.21.15.80:0/3665420262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16010ebe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe14800aa10 tx=0x7fe14802b720 comp rx=0 tx=0).stop 2024-04-25T11:28:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 -- 172.21.15.80:0/3665420262 shutdown_connections 2024-04-25T11:28:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 --2- 172.21.15.80:0/3665420262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16010ebe0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 --2- 172.21.15.80:0/3665420262 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe160106980 0x7fe160106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 --2- 172.21.15.80:0/3665420262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe160102440 0x7fe160102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 -- 172.21.15.80:0/3665420262 >> 172.21.15.80:0/3665420262 conn(0x7fe160077880 msgr2=0x7fe160077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 -- 172.21.15.80:0/3665420262 shutdown_connections 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.952+0000 7fe166f27640 1 -- 172.21.15.80:0/3665420262 wait complete. 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 Processor -- start 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 -- start start 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe160102440 0x7fe160198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe160106980 0x7fe160198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe160111ad0 con 0x7fe160107440 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe160111950 con 0x7fe160106980 2024-04-25T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe166f27640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe160111c50 con 0x7fe160102440 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33960/0 (socket says 172.21.15.80:33960) 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 -- 172.21.15.80:0/4255129848 learned_addr learned my addr 172.21.15.80:0/4255129848 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe164cc3640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe160102440 0x7fe160198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe15ffff640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe160106980 0x7fe160198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 -- 172.21.15.80:0/4255129848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe160102440 msgr2=0x7fe160198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe160102440 0x7fe160198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 -- 172.21.15.80:0/4255129848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe160106980 msgr2=0x7fe160198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe160106980 0x7fe160198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.953+0000 7fe1654c4640 1 -- 172.21.15.80:0/4255129848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16019d310 con 0x7fe160107440 2024-04-25T11:28:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.954+0000 7fe1654c4640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16019cd50 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe14800ab30 tx=0x7fe148004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.954+0000 7fe15dffb640 1 -- 172.21.15.80:0/4255129848 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148040070 con 0x7fe160107440 2024-04-25T11:28:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.954+0000 7fe15dffb640 1 -- 172.21.15.80:0/4255129848 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe148003ca0 con 0x7fe160107440 2024-04-25T11:28:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.954+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16019d5a0 con 0x7fe160107440 2024-04-25T11:28:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.954+0000 7fe15dffb640 1 -- 172.21.15.80:0/4255129848 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148036030 con 0x7fe160107440 2024-04-25T11:28:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.954+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16019da90 con 0x7fe160107440 2024-04-25T11:28:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.956+0000 7fe15dffb640 1 -- 172.21.15.80:0/4255129848 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fe148043070 con 0x7fe160107440 2024-04-25T11:28:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 Processor -- start 2024-04-25T11:28:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 -- start start 2024-04-25T11:28:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe15dffb640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe14c0afc60 0x7fe14c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f25a639d80 con 0x55f25a30a4d0 2024-04-25T11:28:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f25a5f38b0 con 0x55f25a333390 2024-04-25T11:28:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f25a635d40 con 0x55f25a3126b0 2024-04-25T11:28:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe15ffff640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe14c0afc60 0x7fe14c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe164cc3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6d3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33964/0 (socket says 172.21.15.80:33964) 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe15ffff640 1 -- 172.21.15.80:0/3932657743 learned_addr learned my addr 172.21.15.80:0/3932657743 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe1654c4640 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.957+0000 7fe15dffb640 1 -- 172.21.15.80:0/4255129848 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe148100d70 con 0x7fe160107440 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe15ffff640 1 -- 172.21.15.80:0/3932657743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 msgr2=0x55f25a6e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe15ffff640 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe15ffff640 1 -- 172.21.15.80:0/3932657743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 msgr2=0x55f25a6d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe15ffff640 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6d3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe15ffff640 1 -- 172.21.15.80:0/3932657743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25a5c4a40 con 0x55f25a30a4d0 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe1654c4640 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:28:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe15ffff640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe14c0afc60 0x7fe14c0b2170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1500128c0 tx=0x7fe15000bad0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe15ffff640 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6d3fa0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe150005bb0 tx=0x7fe15001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c175bdb72c43b31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe156ffd640 1 -- 172.21.15.80:0/3932657743 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150024070 con 0x55f25a30a4d0 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe156ffd640 1 -- 172.21.15.80:0/3932657743 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe150010e00 con 0x55f25a30a4d0 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.958+0000 7fe156ffd640 1 -- 172.21.15.80:0/3932657743 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150004dd0 con 0x55f25a30a4d0 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3932657743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 msgr2=0x55f25a6d3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6d3fa0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe150005bb0 tx=0x7fe15001c000 comp rx=0 tx=0).stop 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3932657743 shutdown_connections 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6d3fa0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3932657743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3932657743 >> 172.21.15.80:0/3932657743 conn(0x55f25a3274e0 msgr2=0x55f25a6d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3932657743 shutdown_connections 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3932657743 wait complete. 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 -- start start 2024-04-25T11:28:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.959+0000 7fe16ddd7740 1 Processor -- start 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6dec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6e4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f25a6e0f80 con 0x55f25a30a4d0 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f25a5c0d10 con 0x55f25a333390 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f25a6e1100 con 0x55f25a3126b0 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe16ddd7740 10 client.0 _ll_register_callbacks cb 0x55f25a5ed210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6de6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33978/0 (socket says 172.21.15.80:33978) 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 -- 172.21.15.80:0/3587690625 learned_addr learned my addr 172.21.15.80:0/3587690625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe1654c4640 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 -- 172.21.15.80:0/3587690625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 msgr2=0x55f25a6dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 -- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 msgr2=0x55f25a6e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6e4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 -- 172.21.15.80:0/3587690625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25a4157d0 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe164cc3640 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6de6a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe158010c30 tx=0x7fe15800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f16047440a755e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe13ffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe13ffff640 1 -- 172.21.15.80:0/3587690625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15800e5c0 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.960+0000 7fe13ffff640 1 -- 172.21.15.80:0/3587690625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe15800e760 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe150010e00 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe13ffff640 1 -- 172.21.15.80:0/3587690625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe15800e960 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 10 client.16653 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f25a34b3f0 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe13ffff640 1 -- 172.21.15.80:0/3587690625 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe150010e00 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe13ffff640 1 -- 172.21.15.80:0/3587690625 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe15801ac00 con 0x55f25a30a4d0 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 10 client.16653 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 20 client.16653 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a2f1f60 0x55f25a6f0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 4 client.16653 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f25a647990 con 0x55f25a2f1f60 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.961+0000 7fe15ffff640 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a2f1f60 0x55f25a6f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.962+0000 7fe13ffff640 10 client.16653 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.962+0000 7fe15ffff640 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a2f1f60 0x55f25a6f0880 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72dae2d235590668 server_cookie=8be9151d37304c70 in_seq=0 out_seq=0 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.962+0000 7fe13ffff640 1 -- 172.21.15.80:0/3587690625 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f25a647990 con 0x55f25a2f1f60 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.962+0000 7fe13ffff640 10 client.16653 handle_command_reply: tid=0 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.962+0000 7fe16ddd7740 1 client.16653 shutdown 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.962+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 msgr2=0x55f25a6de6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.962+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6de6a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe158010c30 tx=0x7fe15800f7f0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 shutdown_connections 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a2f1f60 0x55f25a6f0880 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a333390 0x55f25a6e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a3126b0 0x55f25a6dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe13ffff640 0 client.16653 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3587690625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a30a4d0 0x55f25a6de6a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 >> 172.21.15.80:0/3587690625 conn(0x55f25a3274e0 msgr2=0x55f25a6d5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 shutdown_connections 2024-04-25T11:28:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3587690625 wait complete. 2024-04-25T11:28:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.963+0000 7fe16ddd7740 20 client.16653 trim_cache size 0 max 16384 2024-04-25T11:28:38.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 Processor -- start 2024-04-25T11:28:38.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 -- start start 2024-04-25T11:28:38.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a2f1f60 0x55f25a6d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a30a4d0 0x55f25a6f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6f6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe1601b0030 con 0x55f25a3126b0 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe1601ad900 con 0x55f25a30a4d0 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe1601ab750 con 0x55f25a2f1f60 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6f6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33986/0 (socket says 172.21.15.80:33986) 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 -- 172.21.15.80:0/2374243322 learned_addr learned my addr 172.21.15.80:0/2374243322 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe15ffff640 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a30a4d0 0x55f25a6f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe164cc3640 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a2f1f60 0x55f25a6d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 -- 172.21.15.80:0/2374243322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a2f1f60 msgr2=0x55f25a6d5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a2f1f60 0x55f25a6d5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 -- 172.21.15.80:0/2374243322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a30a4d0 msgr2=0x55f25a6f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a30a4d0 0x55f25a6f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 -- 172.21.15.80:0/2374243322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25a30b0f0 con 0x55f25a3126b0 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe15ffff640 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a30a4d0 0x55f25a6f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.981+0000 7fe1654c4640 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6f6580 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe148030bf0 tx=0x7fe14803c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7247e69dd781d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe1567fc640 1 -- 172.21.15.80:0/2374243322 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14804a070 con 0x55f25a3126b0 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe1567fc640 1 -- 172.21.15.80:0/2374243322 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1480cd2d0 con 0x55f25a3126b0 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe1567fc640 1 -- 172.21.15.80:0/2374243322 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1480c9230 con 0x55f25a3126b0 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 -- 172.21.15.80:0/2374243322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 msgr2=0x55f25a6f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6f6580 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe148030bf0 tx=0x7fe14803c840 comp rx=0 tx=0).stop 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 -- 172.21.15.80:0/2374243322 shutdown_connections 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6f6580 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a30a4d0 0x55f25a6f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/2374243322 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a2f1f60 0x55f25a6d5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 -- 172.21.15.80:0/2374243322 >> 172.21.15.80:0/2374243322 conn(0x55f25a3274e0 msgr2=0x55f25a6d5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 -- 172.21.15.80:0/2374243322 shutdown_connections 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.982+0000 7fe16ddd7740 1 -- 172.21.15.80:0/2374243322 wait complete. 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 -- start start 2024-04-25T11:28:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 Processor -- start 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a2f1f60 0x55f25a6e55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a30a4d0 0x55f25a6e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6e6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe1601abdc0 con 0x55f25a3126b0 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe1601ad230 con 0x55f25a2f1f60 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe1601ac490 con 0x55f25a30a4d0 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe16ddd7740 10 client.0 _ll_register_callbacks cb 0x7fe158007b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe1654c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe1654c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33994/0 (socket says 172.21.15.80:33994) 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.983+0000 7fe1654c4640 1 -- 172.21.15.80:0/3721938784 learned_addr learned my addr 172.21.15.80:0/3721938784 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe164cc3640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a2f1f60 0x55f25a6e55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe15ffff640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a30a4d0 0x55f25a6e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe1654c4640 1 -- 172.21.15.80:0/3721938784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a30a4d0 msgr2=0x55f25a6e5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe1654c4640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a30a4d0 0x55f25a6e5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe1654c4640 1 -- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a2f1f60 msgr2=0x55f25a6e55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe1654c4640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a2f1f60 0x55f25a6e55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe1654c4640 1 -- 172.21.15.80:0/3721938784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25a5fa4b0 con 0x55f25a3126b0 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe164cc3640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a2f1f60 0x55f25a6e55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe1654c4640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6e6030 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe148030550 tx=0x7fe1480c5490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599fd33eb14dafbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe13ffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe13ffff640 1 -- 172.21.15.80:0/3721938784 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1480e3020 con 0x55f25a3126b0 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe13ffff640 1 -- 172.21.15.80:0/3721938784 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe1480c9440 con 0x55f25a3126b0 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1480cd2d0 con 0x55f25a3126b0 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe13ffff640 1 -- 172.21.15.80:0/3721938784 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe14804a040 con 0x55f25a3126b0 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 10 client.16659 fetch_fsmap learned FSMap version 24 2024-04-25T11:28:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f25a757c90 con 0x55f25a3126b0 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe13ffff640 1 -- 172.21.15.80:0/3721938784 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1480cd2d0 con 0x55f25a3126b0 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe13ffff640 1 -- 172.21.15.80:0/3721938784 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe1480cc070 con 0x55f25a3126b0 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 10 client.16659 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 20 client.16659 populate_metadata read hostname 'smithi080' 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a333390 0x55f25a75a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 4 client.16659 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.984+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f25a641800 con 0x55f25a333390 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.985+0000 7fe164cc3640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a333390 0x55f25a75a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.985+0000 7fe13ffff640 10 client.16659 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.985+0000 7fe164cc3640 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a333390 0x55f25a75a360 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ea7355dcca5de73 server_cookie=26b7d28f41e2b559 in_seq=0 out_seq=0 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.985+0000 7fe13ffff640 1 -- 172.21.15.80:0/3721938784 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f25a641800 con 0x55f25a333390 2024-04-25T11:28:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.985+0000 7fe13ffff640 10 client.16659 handle_command_reply: tid=0 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.985+0000 7fe16ddd7740 1 client.16659 shutdown 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 msgr2=0x55f25a6e6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6e6030 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe148030550 tx=0x7fe1480c5490 comp rx=0 tx=0).stop 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 shutdown_connections 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f25a333390 0x55f25a75a360 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f25a3126b0 0x55f25a6e6030 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe13ffff640 0 client.16659 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f25a30a4d0 0x55f25a6e5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 --2- 172.21.15.80:0/3721938784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f25a2f1f60 0x55f25a6e55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 >> 172.21.15.80:0/3721938784 conn(0x55f25a3274e0 msgr2=0x55f25a6ddd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 shutdown_connections 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 1 -- 172.21.15.80:0/3721938784 wait complete. 2024-04-25T11:28:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe16ddd7740 20 client.16659 trim_cache size 0 max 16384 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "f934ef26-505a-470b-addb-76b6fe5ffaf4": { 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "f934ef26-505a-470b-addb-76b6fe5ffaf4", 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:28:38.985 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:28:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe14c0afc60 msgr2=0x7fe14c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe14c0afc60 0x7fe14c0b2170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1500128c0 tx=0x7fe15000bad0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 msgr2=0x7fe16019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:28:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16019cd50 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe14800ab30 tx=0x7fe148004270 comp rx=0 tx=0).stop 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 shutdown_connections 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe14c0afc60 0x7fe14c0b2170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe160107440 0x7fe16019cd50 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe160106980 0x7fe160198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 --2- 172.21.15.80:0/4255129848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe160102440 0x7fe160198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 >> 172.21.15.80:0/4255129848 conn(0x7fe160077880 msgr2=0x7fe1600ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 shutdown_connections 2024-04-25T11:28:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:28:38.986+0000 7fe166f27640 1 -- 172.21.15.80:0/4255129848 wait complete. 2024-04-25T11:28:38.989 INFO:tasks.cephfs.filesystem:scrub status for tag:f934ef26-505a-470b-addb-76b6fe5ffaf4 - {'path': '/', 'tag': 'f934ef26-505a-470b-addb-76b6fe5ffaf4', 'options': 'recursive,force'} 2024-04-25T11:28:38.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:38 smithi082 ceph-mon[32440]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:39.876 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:39 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:28:39.876 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:39 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:39.876 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:39 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:28:39.876 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:39 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:39.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:39 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:28:39.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:39 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:39.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:39 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:28:39.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:39 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:39.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:39 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:28:39.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:39 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:39.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:39 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:28:39.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:39 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:28:40.838 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:40 smithi196 ceph-mon[32659]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:40.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:40 smithi080 ceph-mon[29126]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:40.892 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:40 smithi082 ceph-mon[32440]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:42.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:42 smithi080 ceph-mon[29126]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:42.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:42 smithi196 ceph-mon[32659]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:42.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:42 smithi082 ceph-mon[32440]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:43.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:43 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:28:43.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:43 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:28:43.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:43 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:28:44.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:44 smithi080 ceph-mon[29126]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:44.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:44 smithi196 ceph-mon[32659]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:44.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:44 smithi082 ceph-mon[32440]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:46.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:46 smithi080 ceph-mon[29126]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:46.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:46 smithi196 ceph-mon[32659]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:46.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:46 smithi082 ceph-mon[32440]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:48.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:48 smithi080 ceph-mon[29126]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:48.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:48 smithi196 ceph-mon[32659]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:48.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:48 smithi082 ceph-mon[32440]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:50.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:50 smithi080 ceph-mon[29126]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:50.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:50 smithi196 ceph-mon[32659]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:50.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:50 smithi082 ceph-mon[32440]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:28:52.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:52 smithi080 ceph-mon[29126]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:52.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:52 smithi196 ceph-mon[32659]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:52.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:52 smithi082 ceph-mon[32440]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:28:54.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:54 smithi080 ceph-mon[29126]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:54.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:54 smithi196 ceph-mon[32659]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:54.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:54 smithi082 ceph-mon[32440]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:56.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:56 smithi080 ceph-mon[29126]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:56.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:56 smithi196 ceph-mon[32659]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:56.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:56 smithi082 ceph-mon[32440]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:28:58.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:28:58 smithi080 ceph-mon[29126]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:58.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:28:58 smithi196 ceph-mon[32659]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:28:58.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:28:58 smithi082 ceph-mon[32440]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:00.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:00 smithi080 ceph-mon[29126]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:00.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:00 smithi196 ceph-mon[32659]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:00.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:00 smithi082 ceph-mon[32440]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:02.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:02 smithi080 ceph-mon[29126]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:02.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:02 smithi196 ceph-mon[32659]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:02.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:02 smithi082 ceph-mon[32440]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:04.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:04 smithi080 ceph-mon[29126]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:29:04.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:04 smithi196 ceph-mon[32659]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:29:04.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:04 smithi082 ceph-mon[32440]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:29:06.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:06 smithi080 ceph-mon[29126]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:29:06.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:06 smithi196 ceph-mon[32659]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:29:06.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:06 smithi082 ceph-mon[32440]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T11:29:08.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:08 smithi080 ceph-mon[29126]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:08.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:08 smithi196 ceph-mon[32659]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:08.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:29:08.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:29:08.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:08 smithi082 ceph-mon[32440]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:09.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 -- 172.21.15.80:0/770667128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e0107940 msgr2=0x7f70e0102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 --2- 172.21.15.80:0/770667128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e0107940 0x7f70e0102d30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009cd0 tx=0x7f70d002a8e0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 -- 172.21.15.80:0/770667128 shutdown_connections 2024-04-25T11:29:09.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 --2- 172.21.15.80:0/770667128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70e010d3e0 0x7f70e010f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 --2- 172.21.15.80:0/770667128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e0103270 0x7f70e0103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 --2- 172.21.15.80:0/770667128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e0107940 0x7f70e0102d30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 -- 172.21.15.80:0/770667128 >> 172.21.15.80:0/770667128 conn(0x7f70e00fd850 msgr2=0x7f70e00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 -- 172.21.15.80:0/770667128 shutdown_connections 2024-04-25T11:29:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 -- 172.21.15.80:0/770667128 wait complete. 2024-04-25T11:29:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.125+0000 7f70e54f2640 1 Processor -- start 2024-04-25T11:29:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70e54f2640 1 -- start start 2024-04-25T11:29:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70e54f2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70e0103270 0x7f70e019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70e54f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e0107940 0x7f70e019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70e54f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e010d3e0 0x7f70e01a6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70e54f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0112c50 con 0x7f70e010d3e0 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70e54f2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0112ad0 con 0x7f70e0107940 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70e54f2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0112dd0 con 0x7f70e0103270 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e010d3e0 0x7f70e01a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e010d3e0 0x7f70e01a6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34564/0 (socket says 172.21.15.80:34564) 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 -- 172.21.15.80:0/3821520825 learned_addr learned my addr 172.21.15.80:0/3821520825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70deffd640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70e0103270 0x7f70e019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70de7fc640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e0107940 0x7f70e019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 -- 172.21.15.80:0/3821520825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70e0103270 msgr2=0x7f70e019b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70e0103270 0x7f70e019b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 -- 172.21.15.80:0/3821520825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e0107940 msgr2=0x7f70e019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e0107940 0x7f70e019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 -- 172.21.15.80:0/3821520825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e019c2d0 con 0x7f70e010d3e0 2024-04-25T11:29:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.126+0000 7f70df7fe640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e010d3e0 0x7f70e01a6590 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e970 tx=0x7f70d800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.127+0000 7f70c7fff640 1 -- 172.21.15.80:0/3821520825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d800ccc0 con 0x7f70e010d3e0 2024-04-25T11:29:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.127+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e01a6b90 con 0x7f70e010d3e0 2024-04-25T11:29:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.127+0000 7f70c7fff640 1 -- 172.21.15.80:0/3821520825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d80054d0 con 0x7f70e010d3e0 2024-04-25T11:29:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.127+0000 7f70c7fff640 1 -- 172.21.15.80:0/3821520825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8010430 con 0x7f70e010d3e0 2024-04-25T11:29:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.127+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e01a70e0 con 0x7f70e010d3e0 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70c7fff640 1 -- 172.21.15.80:0/3821520825 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f70d8005020 con 0x7f70e010d3e0 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 Processor -- start 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 -- start start 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729731a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x558729731fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558729697d80 con 0x5587293684d0 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5587296518b0 con 0x558729391390 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.129+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558729693d40 con 0x5587293706b0 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x558729731fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x558729731fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34568/0 (socket says 172.21.15.80:34568) 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 -- 172.21.15.80:0/723247655 learned_addr learned my addr 172.21.15.80:0/723247655 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70c7fff640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f70c80afc60 0x7f70c80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70de7fc640 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729731a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70de7fc640 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 -- 172.21.15.80:0/723247655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 msgr2=0x55872973e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70df7fe640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f70c80afc60 0x7f70c80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 -- 172.21.15.80:0/723247655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 msgr2=0x558729731a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729731a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 -- 172.21.15.80:0/723247655 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558729622a40 con 0x5587293684d0 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70c7fff640 1 -- 172.21.15.80:0/3821520825 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f70d80df410 con 0x7f70e010d3e0 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70deffd640 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x558729731fa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009cd0 tx=0x7f70d0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242e0c8605b95c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70c57fa640 1 -- 172.21.15.80:0/723247655 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0031850 con 0x5587293684d0 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70c57fa640 1 -- 172.21.15.80:0/723247655 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d0036040 con 0x5587293684d0 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70c57fa640 1 -- 172.21.15.80:0/723247655 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0004460 con 0x5587293684d0 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.130+0000 7f70df7fe640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f70c80afc60 0x7f70c80b2170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70d80dcc20 tx=0x7f70d80760c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 -- 172.21.15.80:0/723247655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 msgr2=0x558729731fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x558729731fa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009cd0 tx=0x7f70d0009a20 comp rx=0 tx=0).stop 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 -- 172.21.15.80:0/723247655 shutdown_connections 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x558729731fa0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/723247655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729731a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 -- 172.21.15.80:0/723247655 >> 172.21.15.80:0/723247655 conn(0x5587293854e0 msgr2=0x55872972e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 -- 172.21.15.80:0/723247655 shutdown_connections 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.131+0000 7f70ec3a2740 1 -- 172.21.15.80:0/723247655 wait complete. 2024-04-25T11:29:09.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 -- start start 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 Processor -- start 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729742410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55872973ef80 con 0x5587293684d0 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55872961ed10 con 0x558729391390 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55872973f100 con 0x5587293706b0 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70ec3a2740 10 client.0 _ll_register_callbacks cb 0x55872964b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34570/0 (socket says 172.21.15.80:34570) 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 -- 172.21.15.80:0/3875354846 learned_addr learned my addr 172.21.15.80:0/3875354846 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729742410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70deffd640 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 -- 172.21.15.80:0/3875354846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 msgr2=0x55872973cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 -- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 msgr2=0x558729742410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729742410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.132+0000 7f70de7fc640 1 -- 172.21.15.80:0/3875354846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587294737d0 con 0x5587293684d0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70de7fc640 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973c630 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f70d4014ac0 tx=0x7f70d400c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccbc9b51b23a1f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70c2ff5640 1 -- 172.21.15.80:0/3875354846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d40142d0 con 0x5587293684d0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70c2ff5640 1 -- 172.21.15.80:0/3875354846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f70d4011c50 con 0x5587293684d0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d0036040 con 0x5587293684d0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70c2ff5640 1 -- 172.21.15.80:0/3875354846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f70d4026050 con 0x5587293684d0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 10 client.16671 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5587293a93f0 con 0x5587293684d0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70c2ff5640 1 -- 172.21.15.80:0/3875354846 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d0036040 con 0x5587293684d0 2024-04-25T11:29:09.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70c2ff5640 1 -- 172.21.15.80:0/3875354846 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f70d401e020 con 0x5587293684d0 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 10 client.16671 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 20 client.16671 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55872934ff60 0x55872974e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 4 client.16671 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.133+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587296a5990 con 0x55872934ff60 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.134+0000 7f70deffd640 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55872934ff60 0x55872974e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.134+0000 7f70c2ff5640 10 client.16671 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.134+0000 7f70deffd640 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55872934ff60 0x55872974e790 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3a618ddccead5d server_cookie=b57ba90e3d44110a in_seq=0 out_seq=0 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70c2ff5640 1 -- 172.21.15.80:0/3875354846 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5587296a5990 con 0x55872934ff60 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70c2ff5640 10 client.16671 handle_command_reply: tid=0 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 client.16671 shutdown 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 msgr2=0x55872973c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973c630 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f70d4014ac0 tx=0x7f70d400c610 comp rx=0 tx=0).stop 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 shutdown_connections 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55872934ff60 0x55872974e790 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558729391390 0x558729742410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x55872973cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70c2ff5640 0 client.16671 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/3875354846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973c630 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 >> 172.21.15.80:0/3875354846 conn(0x5587293854e0 msgr2=0x558729733780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 shutdown_connections 2024-04-25T11:29:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 1 -- 172.21.15.80:0/3875354846 wait complete. 2024-04-25T11:29:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.135+0000 7f70ec3a2740 20 client.16671 trim_cache size 0 max 16384 2024-04-25T11:29:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 Processor -- start 2024-04-25T11:29:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 -- start start 2024-04-25T11:29:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293706b0 0x55872973e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558729391390 0x55872973e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70e01b2370 con 0x5587293684d0 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70e01afc40 con 0x5587293706b0 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70e01ada90 con 0x558729391390 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34582/0 (socket says 172.21.15.80:34582) 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 -- 172.21.15.80:0/4267202053 learned_addr learned my addr 172.21.15.80:0/4267202053 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 -- 172.21.15.80:0/4267202053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558729391390 msgr2=0x55872973e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 --2- 172.21.15.80:0/4267202053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558729391390 0x55872973e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 -- 172.21.15.80:0/4267202053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293706b0 msgr2=0x55872973e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 --2- 172.21.15.80:0/4267202053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293706b0 0x55872973e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.153+0000 7f70de7fc640 1 -- 172.21.15.80:0/4267202053 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587293690f0 con 0x5587293684d0 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.154+0000 7f70de7fc640 1 --2- 172.21.15.80:0/4267202053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973b360 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c3b0 tx=0x7f70d400c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b5d1bff8e7514e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.154+0000 7f70c4ff9640 1 -- 172.21.15.80:0/4267202053 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d40142d0 con 0x5587293684d0 2024-04-25T11:29:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.154+0000 7f70c4ff9640 1 -- 172.21.15.80:0/4267202053 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d402f070 con 0x5587293684d0 2024-04-25T11:29:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.154+0000 7f70c4ff9640 1 -- 172.21.15.80:0/4267202053 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d40048e0 con 0x5587293684d0 2024-04-25T11:29:09.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- 172.21.15.80:0/4267202053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 msgr2=0x55872973b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/4267202053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973b360 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c3b0 tx=0x7f70d400c3e0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- 172.21.15.80:0/4267202053 shutdown_connections 2024-04-25T11:29:09.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/4267202053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558729391390 0x55872973e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/4267202053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293706b0 0x55872973e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/4267202053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5587293684d0 0x55872973b360 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- 172.21.15.80:0/4267202053 >> 172.21.15.80:0/4267202053 conn(0x5587293854e0 msgr2=0x55872973db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- 172.21.15.80:0/4267202053 shutdown_connections 2024-04-25T11:29:09.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- 172.21.15.80:0/4267202053 wait complete. 2024-04-25T11:29:09.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- start start 2024-04-25T11:29:09.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 Processor -- start 2024-04-25T11:29:09.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293684d0 0x5587297433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x558729743930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558729391390 0x5587297b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70e01ae100 con 0x558729391390 2024-04-25T11:29:09.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70e01af570 con 0x5587293684d0 2024-04-25T11:29:09.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.155+0000 7f70ec3a2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70e01ae7d0 con 0x5587293706b0 2024-04-25T11:29:09.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70ec3a2740 10 client.0 _ll_register_callbacks cb 0x7f70d4014680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:09.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558729391390 0x5587297b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558729391390 0x5587297b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34598/0 (socket says 172.21.15.80:34598) 2024-04-25T11:29:09.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 -- 172.21.15.80:0/2278712916 learned_addr learned my addr 172.21.15.80:0/2278712916 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70deffd640 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x558729743930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293684d0 0x5587297433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 -- 172.21.15.80:0/2278712916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 msgr2=0x558729743930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x558729743930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 -- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293684d0 msgr2=0x5587297433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293684d0 0x5587297433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 -- 172.21.15.80:0/2278712916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587296584b0 con 0x558729391390 2024-04-25T11:29:09.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70de7fc640 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558729391390 0x5587297b4b30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f70d4014650 tx=0x7f70d4005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcac7ad40cc9566 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:09.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70c2ff5640 1 -- 172.21.15.80:0/2278712916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4005310 con 0x558729391390 2024-04-25T11:29:09.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70c2ff5640 1 -- 172.21.15.80:0/2278712916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f70d40054b0 con 0x558729391390 2024-04-25T11:29:09.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d402f070 con 0x558729391390 2024-04-25T11:29:09.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70c2ff5640 1 -- 172.21.15.80:0/2278712916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f70d4004680 con 0x558729391390 2024-04-25T11:29:09.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70ec3a2740 10 client.16677 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:09.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5587297b6030 con 0x558729391390 2024-04-25T11:29:09.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.156+0000 7f70c2ff5640 1 -- 172.21.15.80:0/2278712916 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d402f070 con 0x558729391390 2024-04-25T11:29:09.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70c2ff5640 1 -- 172.21.15.80:0/2278712916 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f70d401e050 con 0x558729391390 2024-04-25T11:29:09.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70ec3a2740 10 client.16677 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:09.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70ec3a2740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:09.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70ec3a2740 20 client.16677 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:09.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5587293253a0 0x5587297b8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70ec3a2740 4 client.16677 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:29:09.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55872969f800 con 0x5587293253a0 2024-04-25T11:29:09.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70deffd640 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5587293253a0 0x5587297b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70c2ff5640 10 client.16677 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:09.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.157+0000 7f70deffd640 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5587293253a0 0x5587297b8620 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc5834181468f93 server_cookie=c0c56954bdfa0626 in_seq=0 out_seq=0 2024-04-25T11:29:09.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70c2ff5640 1 -- 172.21.15.80:0/2278712916 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55872969f800 con 0x5587293253a0 2024-04-25T11:29:09.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70c2ff5640 10 client.16677 handle_command_reply: tid=0 2024-04-25T11:29:09.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 client.16677 shutdown 2024-04-25T11:29:09.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558729391390 msgr2=0x5587297b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558729391390 0x5587297b4b30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f70d4014650 tx=0x7f70d4005970 comp rx=0 tx=0).stop 2024-04-25T11:29:09.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 shutdown_connections 2024-04-25T11:29:09.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5587293253a0 0x5587297b8620 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558729391390 0x5587297b4b30 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5587293706b0 0x558729743930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70c2ff5640 0 client.16677 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:09.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 --2- 172.21.15.80:0/2278712916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5587293684d0 0x5587297433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 >> 172.21.15.80:0/2278712916 conn(0x5587293854e0 msgr2=0x55872973e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 shutdown_connections 2024-04-25T11:29:09.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 1 -- 172.21.15.80:0/2278712916 wait complete. 2024-04-25T11:29:09.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70ec3a2740 20 client.16677 trim_cache size 0 max 16384 2024-04-25T11:29:09.201 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:29:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:29:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:29:09.201 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:29:09.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f70c80afc60 msgr2=0x7f70c80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f70c80afc60 0x7f70c80b2170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70d80dcc20 tx=0x7f70d80760c0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e010d3e0 msgr2=0x7f70e01a6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e010d3e0 0x7f70e01a6590 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e970 tx=0x7f70d800ee30 comp rx=0 tx=0).stop 2024-04-25T11:29:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 shutdown_connections 2024-04-25T11:29:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f70c80afc60 0x7f70c80b2170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70e010d3e0 0x7f70e01a6590 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70e0107940 0x7f70e019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 --2- 172.21.15.80:0/3821520825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70e0103270 0x7f70e019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.158+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 >> 172.21.15.80:0/3821520825 conn(0x7f70e00fd850 msgr2=0x7f70e010e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.159+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 shutdown_connections 2024-04-25T11:29:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.159+0000 7f70e54f2640 1 -- 172.21.15.80:0/3821520825 wait complete. 2024-04-25T11:29:09.206 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:29:09.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:29:09.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.324+0000 7fa79af6c640 1 -- 172.21.15.80:0/1861041069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79410e560 msgr2=0x7fa794110980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.324+0000 7fa79af6c640 1 --2- 172.21.15.80:0/1861041069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79410e560 0x7fa794110980 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009ca0 tx=0x7fa78c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 -- 172.21.15.80:0/1861041069 shutdown_connections 2024-04-25T11:29:09.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 --2- 172.21.15.80:0/1861041069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79410e560 0x7fa794110980 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 --2- 172.21.15.80:0/1861041069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794102060 0x7fa794102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 --2- 172.21.15.80:0/1861041069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa794109bb0 0x7fa794101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 -- 172.21.15.80:0/1861041069 >> 172.21.15.80:0/1861041069 conn(0x7fa7940fd850 msgr2=0x7fa7940ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 -- 172.21.15.80:0/1861041069 shutdown_connections 2024-04-25T11:29:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 -- 172.21.15.80:0/1861041069 wait complete. 2024-04-25T11:29:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 Processor -- start 2024-04-25T11:29:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.325+0000 7fa79af6c640 1 -- start start 2024-04-25T11:29:09.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa79af6c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794102060 0x7fa79419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa79af6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa794109bb0 0x7fa79419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa79af6c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79410e560 0x7fa79419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa79af6c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa794113d20 con 0x7fa794109bb0 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa79af6c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa794113ba0 con 0x7fa79410e560 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa79af6c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa794113ea0 con 0x7fa794102060 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa794109bb0 0x7fa79419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa794109bb0 0x7fa79419ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34620/0 (socket says 172.21.15.80:34620) 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 -- 172.21.15.80:0/533167623 learned_addr learned my addr 172.21.15.80:0/533167623 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa798d08640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794102060 0x7fa79419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa799509640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79410e560 0x7fa79419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 -- 172.21.15.80:0/533167623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794102060 msgr2=0x7fa79419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794102060 0x7fa79419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 -- 172.21.15.80:0/533167623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79410e560 msgr2=0x7fa79419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79410e560 0x7fa79419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 -- 172.21.15.80:0/533167623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79419f4c0 con 0x7fa794109bb0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa799509640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79410e560 0x7fa79419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa78bfff640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa794109bb0 0x7fa79419ac40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa78400d770 tx=0x7fa78400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa789ffb640 1 -- 172.21.15.80:0/533167623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784017070 con 0x7fa794109bb0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79419f7b0 con 0x7fa794109bb0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa789ffb640 1 -- 172.21.15.80:0/533167623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa78400de80 con 0x7fa794109bb0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.326+0000 7fa789ffb640 1 -- 172.21.15.80:0/533167623 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784004ce0 con 0x7fa794109bb0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.327+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79419fcb0 con 0x7fa794109bb0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.328+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79406a190 con 0x7fa794109bb0 2024-04-25T11:29:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.329+0000 7fa789ffb640 1 -- 172.21.15.80:0/533167623 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fa784004e80 con 0x7fa794109bb0 2024-04-25T11:29:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.329+0000 7fa789ffb640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa77c0afc60 0x7fa77c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.329+0000 7fa798d08640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa77c0afc60 0x7fa77c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.329+0000 7fa789ffb640 1 -- 172.21.15.80:0/533167623 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fa7840deab0 con 0x7fa794109bb0 2024-04-25T11:29:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.330+0000 7fa798d08640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa77c0afc60 0x7fa77c0b2170 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa7900058c0 tx=0x7fa790005850 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.334+0000 7fa789ffb640 1 -- 172.21.15.80:0/533167623 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa7840a7360 con 0x7fa794109bb0 2024-04-25T11:29:09.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.551+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7941a7240 con 0x7fa794109bb0 2024-04-25T11:29:09.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.551+0000 7fa789ffb640 1 -- 172.21.15.80:0/533167623 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7fa7840a6c60 con 0x7fa794109bb0 2024-04-25T11:29:09.543 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:29:09.543 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:29:09.543 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.553+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa77c0afc60 msgr2=0x7fa77c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.553+0000 7fa79af6c640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa77c0afc60 0x7fa77c0b2170 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa7900058c0 tx=0x7fa790005850 comp rx=0 tx=0).stop 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.553+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa794109bb0 msgr2=0x7fa79419ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.553+0000 7fa79af6c640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa794109bb0 0x7fa79419ac40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa78400d770 tx=0x7fa78400dc30 comp rx=0 tx=0).stop 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 shutdown_connections 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa77c0afc60 0x7fa77c0b2170 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa794109bb0 0x7fa79419ac40 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79410e560 0x7fa79419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 --2- 172.21.15.80:0/533167623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794102060 0x7fa79419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 >> 172.21.15.80:0/533167623 conn(0x7fa7940fd850 msgr2=0x7fa7940ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 shutdown_connections 2024-04-25T11:29:09.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.554+0000 7fa79af6c640 1 -- 172.21.15.80:0/533167623 wait complete. 2024-04-25T11:29:09.557 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:29:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 -- 172.21.15.80:0/3583076418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109fb0 msgr2=0x7f88f8103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 --2- 172.21.15.80:0/3583076418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109fb0 0x7f88f8103bf0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009900 tx=0x7f88ec02a410 comp rx=0 tx=0).stop 2024-04-25T11:29:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 -- 172.21.15.80:0/3583076418 shutdown_connections 2024-04-25T11:29:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 --2- 172.21.15.80:0/3583076418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109fb0 0x7f88f8103bf0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 --2- 172.21.15.80:0/3583076418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f8104260 0x7f88f8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 --2- 172.21.15.80:0/3583076418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88f8109b10 0x7f88f81036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 -- 172.21.15.80:0/3583076418 >> 172.21.15.80:0/3583076418 conn(0x7f88f80ff210 msgr2=0x7f88f8101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 -- 172.21.15.80:0/3583076418 shutdown_connections 2024-04-25T11:29:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.676+0000 7f88fea51640 1 -- 172.21.15.80:0/3583076418 wait complete. 2024-04-25T11:29:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 Processor -- start 2024-04-25T11:29:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 -- start start 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88f8104260 0x7f88f819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109b10 0x7f88f819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f8109fb0 0x7f88f819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88f8113d00 con 0x7f88f8109b10 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88f8113b80 con 0x7f88f8109fb0 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.677+0000 7f88fea51640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88f8113e80 con 0x7f88f8104260 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109b10 0x7f88f819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109b10 0x7f88f819aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34636/0 (socket says 172.21.15.80:34636) 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 -- 172.21.15.80:0/832043131 learned_addr learned my addr 172.21.15.80:0/832043131 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88fcfee640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f8109fb0 0x7f88f819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f7fff640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88f8104260 0x7f88f819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 -- 172.21.15.80:0/832043131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88f8104260 msgr2=0x7f88f819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88f8104260 0x7f88f819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 -- 172.21.15.80:0/832043131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f8109fb0 msgr2=0x7f88f819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f8109fb0 0x7f88f819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 -- 172.21.15.80:0/832043131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f819f5a0 con 0x7f88f8109b10 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f7fff640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88f8104260 0x7f88f819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f77fe640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109b10 0x7f88f819aca0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f88ec02a930 tx=0x7f88ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f57fa640 1 -- 172.21.15.80:0/832043131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec03f030 con 0x7f88f8109b10 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f819f830 con 0x7f88f8109b10 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f57fa640 1 -- 172.21.15.80:0/832043131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88ec003aa0 con 0x7f88f8109b10 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88f57fa640 1 -- 172.21.15.80:0/832043131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec035070 con 0x7f88f8109b10 2024-04-25T11:29:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.678+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f819fd20 con 0x7f88f8109b10 2024-04-25T11:29:09.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 Processor -- start 2024-04-25T11:29:09.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f88f57fa640 1 -- 172.21.15.80:0/832043131 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f88ec042030 con 0x7f88f8109b10 2024-04-25T11:29:09.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 -- start start 2024-04-25T11:29:09.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b43b390 0x560b9b7dc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560b9b741d80 con 0x560b9b43b390 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b9b6fba20 con 0x560b9b4124d0 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f89059e2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560b9b73dd40 con 0x560b9b41a6b0 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f88fcfee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b43b390 0x560b9b7dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f88fcfee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b43b390 0x560b9b7dc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34648/0 (socket says 172.21.15.80:34648) 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.681+0000 7f88fcfee640 1 -- 172.21.15.80:0/2565780223 learned_addr learned my addr 172.21.15.80:0/2565780223 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88f57fa640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88e00afc60 0x7f88e00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88f7fff640 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88f77fe640 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88fcfee640 1 -- 172.21.15.80:0/2565780223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 msgr2=0x560b9b7e96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88fcfee640 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7e96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88fcfee640 1 -- 172.21.15.80:0/2565780223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 msgr2=0x560b9b7dcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88fcfee640 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7dcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88fcfee640 1 -- 172.21.15.80:0/2565780223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9b706c30 con 0x560b9b43b390 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88fcfee640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88e00afc60 0x7f88e00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88f57fa640 1 -- 172.21.15.80:0/832043131 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f88ec0ff840 con 0x7f88f8109b10 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88fcfee640 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b43b390 0x560b9b7dc810 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f88f00103f0 tx=0x7f88f00108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1051a12afd11e9d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88de7fc640 1 -- 172.21.15.80:0/2565780223 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0021070 con 0x560b9b43b390 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88de7fc640 1 -- 172.21.15.80:0/2565780223 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f0013bc0 con 0x560b9b43b390 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.682+0000 7f88de7fc640 1 -- 172.21.15.80:0/2565780223 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f001b730 con 0x560b9b43b390 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 -- 172.21.15.80:0/2565780223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b43b390 msgr2=0x560b9b7dc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b43b390 0x560b9b7dc810 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f88f00103f0 tx=0x7f88f00108b0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f88fcfee640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88e00afc60 0x7f88e00b2170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88f001e000 tx=0x7f88f001be60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 -- 172.21.15.80:0/2565780223 shutdown_connections 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7e96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 --2- 172.21.15.80:0/2565780223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b43b390 0x560b9b7dc810 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 -- 172.21.15.80:0/2565780223 >> 172.21.15.80:0/2565780223 conn(0x560b9b42f4e0 msgr2=0x560b9b7d8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 -- 172.21.15.80:0/2565780223 shutdown_connections 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.683+0000 7f89059e2740 1 -- 172.21.15.80:0/2565780223 wait complete. 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 -- start start 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 Processor -- start 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b4124d0 0x560b9b7e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b41a6b0 0x560b9b7e7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b43b390 0x560b9b7f3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560b9b7e9d90 con 0x560b9b4124d0 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b9b6c8dc0 con 0x560b9b41a6b0 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560b9b7e9f10 con 0x560b9b43b390 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f89059e2740 10 client.0 _ll_register_callbacks cb 0x560b9b6e4600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b4124d0 0x560b9b7e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b4124d0 0x560b9b7e72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34656/0 (socket says 172.21.15.80:34656) 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88f7fff640 1 -- 172.21.15.80:0/3227849808 learned_addr learned my addr 172.21.15.80:0/3227849808 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88f77fe640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b41a6b0 0x560b9b7e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88fcfee640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b43b390 0x560b9b7f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88f7fff640 1 -- 172.21.15.80:0/3227849808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b43b390 msgr2=0x560b9b7f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88f7fff640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b43b390 0x560b9b7f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.684+0000 7f88f7fff640 1 -- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b41a6b0 msgr2=0x560b9b7e7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88f7fff640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b41a6b0 0x560b9b7e7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88f7fff640 1 -- 172.21.15.80:0/3227849808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b9b4533f0 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88fcfee640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b43b390 0x560b9b7f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88f7fff640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b4124d0 0x560b9b7e72e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f88e8010670 tx=0x7f88e8010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79db2cbc616dc81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88d77fe640 1 -- 172.21.15.80:0/3227849808 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8004220 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88d77fe640 1 -- 172.21.15.80:0/3227849808 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f88e80043c0 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f0013bc0 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88d77fe640 1 -- 172.21.15.80:0/3227849808 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f88e8010e70 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 10 client.16695 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560b9b51d7d0 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88d77fe640 1 -- 172.21.15.80:0/3227849808 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f0013bc0 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f88d77fe640 1 -- 172.21.15.80:0/3227849808 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f88e800f040 con 0x560b9b4124d0 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 10 client.16695 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 10 client.16695 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 20 client.16695 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b3f9f60 0x560b9b7f9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 4 client.16695 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.685+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b9b74f990 con 0x560b9b3f9f60 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.686+0000 7f88f77fe640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b3f9f60 0x560b9b7f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.686+0000 7f88d77fe640 10 client.16695 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.686+0000 7f88f77fe640 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b3f9f60 0x560b9b7f9700 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a216fa859cd96e8b server_cookie=d6074bba99dfbf70 in_seq=0 out_seq=0 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f88d77fe640 1 -- 172.21.15.80:0/3227849808 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560b9b74f990 con 0x560b9b3f9f60 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f88d77fe640 10 client.16695 handle_command_reply: tid=0 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 client.16695 shutdown 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b4124d0 msgr2=0x560b9b7e72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b4124d0 0x560b9b7e72e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f88e8010670 tx=0x7f88e8010b30 comp rx=0 tx=0).stop 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 shutdown_connections 2024-04-25T11:29:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b3f9f60 0x560b9b7f9700 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b43b390 0x560b9b7f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f88d77fe640 0 client.16695 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b41a6b0 0x560b9b7e7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 --2- 172.21.15.80:0/3227849808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b4124d0 0x560b9b7e72e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 >> 172.21.15.80:0/3227849808 conn(0x560b9b42f4e0 msgr2=0x560b9b7de530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 shutdown_connections 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 1 -- 172.21.15.80:0/3227849808 wait complete. 2024-04-25T11:29:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.687+0000 7f89059e2740 20 client.16695 trim_cache size 0 max 16384 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 Processor -- start 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 -- start start 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b3f9f60 0x560b9b7d8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7feec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81b22b0 con 0x560b9b3f9f60 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81afb80 con 0x560b9b4124d0 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f89059e2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ad9d0 con 0x560b9b41a6b0 2024-04-25T11:29:09.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b3f9f60 0x560b9b7d8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b3f9f60 0x560b9b7d8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34660/0 (socket says 172.21.15.80:34660) 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 -- 172.21.15.80:0/1845456389 learned_addr learned my addr 172.21.15.80:0/1845456389 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88fcfee640 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f77fe640 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 -- 172.21.15.80:0/1845456389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 msgr2=0x560b9b7feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 -- 172.21.15.80:0/1845456389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 msgr2=0x560b9b7f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7f2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.701+0000 7f88f7fff640 1 -- 172.21.15.80:0/1845456389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9b7e8040 con 0x560b9b3f9f60 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.702+0000 7f88f7fff640 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b3f9f60 0x560b9b7d8f70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000c00 tx=0x7f88e8009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568d26d6bfae9e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.702+0000 7f88ddffb640 1 -- 172.21.15.80:0/1845456389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8033070 con 0x560b9b3f9f60 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.702+0000 7f88ddffb640 1 -- 172.21.15.80:0/1845456389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88e800e8d0 con 0x560b9b3f9f60 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.702+0000 7f88ddffb640 1 -- 172.21.15.80:0/1845456389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8004130 con 0x560b9b3f9f60 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- 172.21.15.80:0/1845456389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b3f9f60 msgr2=0x560b9b7d8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b3f9f60 0x560b9b7d8f70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000c00 tx=0x7f88e8009f80 comp rx=0 tx=0).stop 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- 172.21.15.80:0/1845456389 shutdown_connections 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b41a6b0 0x560b9b7feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 --2- 172.21.15.80:0/1845456389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b3f9f60 0x560b9b7d8f70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- 172.21.15.80:0/1845456389 >> 172.21.15.80:0/1845456389 conn(0x560b9b42f4e0 msgr2=0x560b9b7d8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- 172.21.15.80:0/1845456389 shutdown_connections 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- 172.21.15.80:0/1845456389 wait complete. 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- start start 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 Processor -- start 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b3f9f60 0x560b9b7ef640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7ea990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b41a6b0 0x560b9b7eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ae040 con 0x560b9b41a6b0 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81af4b0 con 0x560b9b4124d0 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.703+0000 7f89059e2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ae710 con 0x560b9b3f9f60 2024-04-25T11:29:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f89059e2740 10 client.0 _ll_register_callbacks cb 0x7f88e8009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b41a6b0 0x560b9b7eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b41a6b0 0x560b9b7eaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34672/0 (socket says 172.21.15.80:34672) 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 -- 172.21.15.80:0/2449015290 learned_addr learned my addr 172.21.15.80:0/2449015290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88f7fff640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b3f9f60 0x560b9b7ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 -- 172.21.15.80:0/2449015290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b3f9f60 msgr2=0x560b9b7ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88f77fe640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b3f9f60 0x560b9b7ef640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 -- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 msgr2=0x560b9b7ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7ea990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 -- 172.21.15.80:0/2449015290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b9b7e2c90 con 0x560b9b41a6b0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88f7fff640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b3f9f60 0x560b9b7ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88fcfee640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b41a6b0 0x560b9b7eaed0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f88f00103f0 tx=0x7f88f000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9caff331558d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88d77fe640 1 -- 172.21.15.80:0/2449015290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0021040 con 0x560b9b41a6b0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88d77fe640 1 -- 172.21.15.80:0/2449015290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f88f000cdd0 con 0x560b9b41a6b0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88e800e8d0 con 0x560b9b41a6b0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88d77fe640 1 -- 172.21.15.80:0/2449015290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f88f003d050 con 0x560b9b41a6b0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f89059e2740 10 client.16701 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560b9b861650 con 0x560b9b41a6b0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.704+0000 7f88d77fe640 1 -- 172.21.15.80:0/2449015290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88e800e8d0 con 0x560b9b41a6b0 2024-04-25T11:29:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f88d77fe640 1 -- 172.21.15.80:0/2449015290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f88f002e070 con 0x560b9b41a6b0 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f89059e2740 10 client.16701 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f89059e2740 10 client.16701 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f89059e2740 20 client.16701 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f89059e2740 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b43b390 0x560b9b863c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f89059e2740 4 client.16701 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b9b749800 con 0x560b9b43b390 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.705+0000 7f88f7fff640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b43b390 0x560b9b863c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f88f7fff640 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b43b390 0x560b9b863c90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a44c9c14b20b308 server_cookie=2ab0f795e5da0273 in_seq=0 out_seq=0 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f88d77fe640 10 client.16701 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f88d77fe640 1 -- 172.21.15.80:0/2449015290 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b9b749800 con 0x560b9b43b390 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f88d77fe640 10 client.16701 handle_command_reply: tid=0 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 client.16701 shutdown 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b41a6b0 msgr2=0x560b9b7eaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b41a6b0 0x560b9b7eaed0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f88f00103f0 tx=0x7f88f000c000 comp rx=0 tx=0).stop 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 shutdown_connections 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x560b9b43b390 0x560b9b863c90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560b9b41a6b0 0x560b9b7eaed0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f88d77fe640 0 client.16701 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b9b4124d0 0x560b9b7ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 --2- 172.21.15.80:0/2449015290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560b9b3f9f60 0x560b9b7ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 >> 172.21.15.80:0/2449015290 conn(0x560b9b42f4e0 msgr2=0x560b9b7d7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 shutdown_connections 2024-04-25T11:29:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 1 -- 172.21.15.80:0/2449015290 wait complete. 2024-04-25T11:29:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.706+0000 7f89059e2740 20 client.16701 trim_cache size 0 max 16384 2024-04-25T11:29:09.706 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88e00afc60 msgr2=0x7f88e00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88e00afc60 0x7f88e00b2170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88f001e000 tx=0x7f88f001be60 comp rx=0 tx=0).stop 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109b10 msgr2=0x7f88f819aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109b10 0x7f88f819aca0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f88ec02a930 tx=0x7f88ec004270 comp rx=0 tx=0).stop 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 shutdown_connections 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88e00afc60 0x7f88e00b2170 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88f8109b10 0x7f88f819aca0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f8109fb0 0x7f88f819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 --2- 172.21.15.80:0/832043131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88f8104260 0x7f88f819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 >> 172.21.15.80:0/832043131 conn(0x7f88f80ff210 msgr2=0x7f88f810f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 shutdown_connections 2024-04-25T11:29:09.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.707+0000 7f88fea51640 1 -- 172.21.15.80:0/832043131 wait complete. 2024-04-25T11:29:09.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:29:09.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 -- 172.21.15.80:0/1797158545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c109980 msgr2=0x7fd95c103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 --2- 172.21.15.80:0/1797158545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c109980 0x7fd95c103560 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd958009ca0 tx=0x7fd95802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 -- 172.21.15.80:0/1797158545 shutdown_connections 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 --2- 172.21.15.80:0/1797158545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c10e2e0 0x7fd95c110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 --2- 172.21.15.80:0/1797158545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95c103aa0 0x7fd95c103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 --2- 172.21.15.80:0/1797158545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c109980 0x7fd95c103560 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 -- 172.21.15.80:0/1797158545 >> 172.21.15.80:0/1797158545 conn(0x7fd95c0ff1a0 msgr2=0x7fd95c1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 -- 172.21.15.80:0/1797158545 shutdown_connections 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.828+0000 7fd96219d640 1 -- 172.21.15.80:0/1797158545 wait complete. 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 Processor -- start 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 -- start start 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c103aa0 0x7fd95c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c109980 0x7fd95c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95c10e2e0 0x7fd95c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c113b40 con 0x7fd95c103aa0 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1139c0 con 0x7fd95c109980 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96219d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c113cc0 con 0x7fd95c10e2e0 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c103aa0 0x7fd95c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c103aa0 0x7fd95c19a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34690/0 (socket says 172.21.15.80:34690) 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 -- 172.21.15.80:0/302891556 learned_addr learned my addr 172.21.15.80:0/302891556 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96099a640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c109980 0x7fd95c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 -- 172.21.15.80:0/302891556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95c10e2e0 msgr2=0x7fd95c19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96199c640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95c10e2e0 0x7fd95c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95c10e2e0 0x7fd95c19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 -- 172.21.15.80:0/302891556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c109980 msgr2=0x7fd95c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c109980 0x7fd95c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 -- 172.21.15.80:0/302891556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c19f3e0 con 0x7fd95c103aa0 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96099a640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c109980 0x7fd95c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96199c640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95c10e2e0 0x7fd95c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.829+0000 7fd96119b640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c103aa0 0x7fd95c19a580 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd958006010 tx=0x7fd9580319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.830+0000 7fd9527fc640 1 -- 172.21.15.80:0/302891556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958003bf0 con 0x7fd95c103aa0 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.830+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c19f670 con 0x7fd95c103aa0 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.830+0000 7fd9527fc640 1 -- 172.21.15.80:0/302891556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd958003d90 con 0x7fd95c103aa0 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.830+0000 7fd9527fc640 1 -- 172.21.15.80:0/302891556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95802fb60 con 0x7fd95c103aa0 2024-04-25T11:29:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.830+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c1a7050 con 0x7fd95c103aa0 2024-04-25T11:29:09.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 Processor -- start 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd9527fc640 1 -- 172.21.15.80:0/302891556 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fd95802fd00 con 0x7fd95c103aa0 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 -- start start 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca622f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2606b0 0x55ddca62f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55ddca587d80 con 0x55ddca2584d0 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ddca541a20 con 0x55ddca2606b0 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.832+0000 7fd96a38c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ddca583d40 con 0x55ddca281390 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca622f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca622f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34706/0 (socket says 172.21.15.80:34706) 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 -- 172.21.15.80:0/768320442 learned_addr learned my addr 172.21.15.80:0/768320442 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96199c640 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96099a640 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2606b0 0x55ddca62f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd9527fc640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd9480afc50 0x7fd9480b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 -- 172.21.15.80:0/768320442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 msgr2=0x55ddca6229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 -- 172.21.15.80:0/768320442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2606b0 msgr2=0x55ddca62f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2606b0 0x55ddca62f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 -- 172.21.15.80:0/768320442 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddca54cc30 con 0x55ddca2584d0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96199c640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd9480afc50 0x7fd9480b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd9527fc640 1 -- 172.21.15.80:0/302891556 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd9581005a0 con 0x7fd95c103aa0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96119b640 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca622f20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd9580fdd80 tx=0x7fd95808ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fc7506e0dfe465 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd96199c640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd9480afc50 0x7fd9480b2160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55ddca61fb50 tx=0x7fd9540046c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.833+0000 7fd9477fe640 1 -- 172.21.15.80:0/768320442 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580c8630 con 0x55ddca2584d0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd9477fe640 1 -- 172.21.15.80:0/768320442 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9580c8370 con 0x55ddca2584d0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd9477fe640 1 -- 172.21.15.80:0/768320442 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580c7fd0 con 0x55ddca2584d0 2024-04-25T11:29:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 -- 172.21.15.80:0/768320442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 msgr2=0x55ddca622f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca622f20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd9580fdd80 tx=0x7fd95808ec80 comp rx=0 tx=0).stop 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 -- 172.21.15.80:0/768320442 shutdown_connections 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca622f20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2606b0 0x55ddca62f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 --2- 172.21.15.80:0/768320442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 -- 172.21.15.80:0/768320442 >> 172.21.15.80:0/768320442 conn(0x55ddca2754e0 msgr2=0x55ddca61f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 -- 172.21.15.80:0/768320442 shutdown_connections 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.834+0000 7fd96a38c740 1 -- 172.21.15.80:0/768320442 wait complete. 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 -- start start 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 Processor -- start 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2584d0 0x55ddca62d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca62d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca6390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55ddca587d80 con 0x55ddca2606b0 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ddca50edc0 con 0x55ddca281390 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ddca62fdb0 con 0x55ddca2584d0 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96a38c740 10 client.0 _ll_register_callbacks cb 0x55ddca52a600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96099a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca62d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96099a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca62d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34710/0 (socket says 172.21.15.80:34710) 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.835+0000 7fd96099a640 1 -- 172.21.15.80:0/3468679366 learned_addr learned my addr 172.21.15.80:0/3468679366 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96199c640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca6390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96119b640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2584d0 0x55ddca62d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96099a640 1 -- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2584d0 msgr2=0x55ddca62d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96099a640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2584d0 0x55ddca62d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96099a640 1 -- 172.21.15.80:0/3468679366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 msgr2=0x55ddca6390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96099a640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca6390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96099a640 1 -- 172.21.15.80:0/3468679366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddca2993f0 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96119b640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2584d0 0x55ddca62d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96199c640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca6390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96099a640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca62d9d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009f80 tx=0x7fd94c011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f93370675b7a403 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd944ff9640 1 -- 172.21.15.80:0/3468679366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c005220 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd944ff9640 1 -- 172.21.15.80:0/3468679366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd94c0053c0 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9580c8370 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd944ff9640 1 -- 172.21.15.80:0/3468679366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd94c0055c0 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96a38c740 10 client.16713 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ddca3637d0 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.836+0000 7fd944ff9640 1 -- 172.21.15.80:0/3468679366 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9580c8370 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd944ff9640 1 -- 172.21.15.80:0/3468679366 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd94c00f040 con 0x55ddca2606b0 2024-04-25T11:29:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96a38c740 10 client.16713 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96a38c740 10 client.16713 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96a38c740 20 client.16713 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96a38c740 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca23ff60 0x55ddca63f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96a38c740 4 client.16713 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddca595990 con 0x55ddca23ff60 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96119b640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca23ff60 0x55ddca63f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd944ff9640 10 client.16713 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.837+0000 7fd96119b640 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca23ff60 0x55ddca63f730 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=112a1334fdfdff94 server_cookie=4ead0de94c25d94c in_seq=0 out_seq=0 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd944ff9640 1 -- 172.21.15.80:0/3468679366 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ddca595990 con 0x55ddca23ff60 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd944ff9640 10 client.16713 handle_command_reply: tid=0 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 client.16713 shutdown 2024-04-25T11:29:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 msgr2=0x55ddca62d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca62d9d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009f80 tx=0x7fd94c011870 comp rx=0 tx=0).stop 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 shutdown_connections 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca62d9d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca23ff60 0x55ddca63f730 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca6390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd944ff9640 0 client.16713 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 --2- 172.21.15.80:0/3468679366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2584d0 0x55ddca62d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.838+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 >> 172.21.15.80:0/3468679366 conn(0x55ddca2754e0 msgr2=0x55ddca61d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.839+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 shutdown_connections 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.839+0000 7fd96a38c740 1 -- 172.21.15.80:0/3468679366 wait complete. 2024-04-25T11:29:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.839+0000 7fd96a38c740 20 client.16713 trim_cache size 0 max 16384 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 Processor -- start 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 -- start start 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca61f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2606b0 0x55ddca638d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca644ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1b2150 con 0x55ddca2584d0 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1afa20 con 0x55ddca281390 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96a38c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1ad870 con 0x55ddca2606b0 2024-04-25T11:29:09.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca61f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca61f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34716/0 (socket says 172.21.15.80:34716) 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 -- 172.21.15.80:0/4219251839 learned_addr learned my addr 172.21.15.80:0/4219251839 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96199c640 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca644ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 -- 172.21.15.80:0/4219251839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2606b0 msgr2=0x55ddca638d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2606b0 0x55ddca638d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 -- 172.21.15.80:0/4219251839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 msgr2=0x55ddca644ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca644ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.852+0000 7fd96119b640 1 -- 172.21.15.80:0/4219251839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddca628e40 con 0x55ddca2584d0 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd96119b640 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca61f150 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd9580c87f0 tx=0x7fd958106550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714d45814ae91866 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd946ffd640 1 -- 172.21.15.80:0/4219251839 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580c81b0 con 0x55ddca2584d0 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd946ffd640 1 -- 172.21.15.80:0/4219251839 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd958036070 con 0x55ddca2584d0 2024-04-25T11:29:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd946ffd640 1 -- 172.21.15.80:0/4219251839 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580c8370 con 0x55ddca2584d0 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd96a38c740 1 -- 172.21.15.80:0/4219251839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 msgr2=0x55ddca61f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca61f150 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd9580c87f0 tx=0x7fd958106550 comp rx=0 tx=0).stop 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd96a38c740 1 -- 172.21.15.80:0/4219251839 shutdown_connections 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca281390 0x55ddca644ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca2606b0 0x55ddca638d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.853+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4219251839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2584d0 0x55ddca61f150 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 -- 172.21.15.80:0/4219251839 >> 172.21.15.80:0/4219251839 conn(0x55ddca2754e0 msgr2=0x55ddca61ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 -- 172.21.15.80:0/4219251839 shutdown_connections 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 -- 172.21.15.80:0/4219251839 wait complete. 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 -- start start 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 Processor -- start 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2584d0 0x55ddca635220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca635780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1adee0 con 0x55ddca2606b0 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1af350 con 0x55ddca2584d0 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1ae5b0 con 0x55ddca281390 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96a38c740 10 client.0 _ll_register_callbacks cb 0x7fd94c0097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.854+0000 7fd96099a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca635780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca635780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34726/0 (socket says 172.21.15.80:34726) 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 -- 172.21.15.80:0/4118708102 learned_addr learned my addr 172.21.15.80:0/4118708102 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96119b640 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2584d0 0x55ddca635220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96199c640 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 -- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 msgr2=0x55ddca6307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 -- 172.21.15.80:0/4118708102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2584d0 msgr2=0x55ddca635220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2584d0 0x55ddca635220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 -- 172.21.15.80:0/4118708102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddca630f30 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96099a640 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca635780 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd94c004ef0 tx=0x7fd94c009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15008defdacb2e92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd944ff9640 1 -- 172.21.15.80:0/4118708102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c02f060 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd944ff9640 1 -- 172.21.15.80:0/4118708102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd94c004f70 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd958036070 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd944ff9640 1 -- 172.21.15.80:0/4118708102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd94c005170 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96a38c740 10 client.16719 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ddca6a75c0 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.855+0000 7fd944ff9640 1 -- 172.21.15.80:0/4118708102 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd958036070 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd944ff9640 1 -- 172.21.15.80:0/4118708102 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd94c01a8c0 con 0x55ddca2606b0 2024-04-25T11:29:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96a38c740 10 client.16719 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96a38c740 10 client.16719 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96a38c740 20 client.16719 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca2153a0 0x55ddca6a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96a38c740 4 client.16719 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddca58f800 con 0x55ddca2153a0 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96119b640 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca2153a0 0x55ddca6a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd944ff9640 10 client.16719 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd96119b640 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca2153a0 0x55ddca6a9d50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb77af976f7615c7 server_cookie=f4d636b0e3ec2f71 in_seq=0 out_seq=0 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd944ff9640 1 -- 172.21.15.80:0/4118708102 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddca58f800 con 0x55ddca2153a0 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.856+0000 7fd944ff9640 10 client.16719 handle_command_reply: tid=0 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 client.16719 shutdown 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 msgr2=0x55ddca635780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca635780 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd94c004ef0 tx=0x7fd94c009890 comp rx=0 tx=0).stop 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 shutdown_connections 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ddca2606b0 0x55ddca635780 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55ddca2153a0 0x55ddca6a9d50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ddca281390 0x55ddca6307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 --2- 172.21.15.80:0/4118708102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddca2584d0 0x55ddca635220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 >> 172.21.15.80:0/4118708102 conn(0x55ddca2754e0 msgr2=0x55ddca6245e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd944ff9640 0 client.16719 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 shutdown_connections 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 1 -- 172.21.15.80:0/4118708102 wait complete. 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96a38c740 20 client.16719 trim_cache size 0 max 16384 2024-04-25T11:29:09.856 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:29:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd9480afc50 msgr2=0x7fd9480b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd9480afc50 0x7fd9480b2160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55ddca61fb50 tx=0x7fd9540046c0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c103aa0 msgr2=0x7fd95c19a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c103aa0 0x7fd95c19a580 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd958006010 tx=0x7fd9580319f0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 shutdown_connections 2024-04-25T11:29:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd9480afc50 0x7fd9480b2160 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95c10e2e0 0x7fd95c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c109980 0x7fd95c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 --2- 172.21.15.80:0/302891556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95c103aa0 0x7fd95c19a580 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.857+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 >> 172.21.15.80:0/302891556 conn(0x7fd95c0ff1a0 msgr2=0x7fd95c0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.858+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 shutdown_connections 2024-04-25T11:29:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.858+0000 7fd96219d640 1 -- 172.21.15.80:0/302891556 wait complete. 2024-04-25T11:29:09.858 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:09 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/533167623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:29:09.859 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:29:09.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:09 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/533167623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:29:09.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 -- 172.21.15.80:0/2690825670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241031d0 msgr2=0x7f592410f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 --2- 172.21.15.80:0/2690825670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241031d0 0x7f592410f4b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f591c009ca0 tx=0x7f591c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 -- 172.21.15.80:0/2690825670 shutdown_connections 2024-04-25T11:29:09.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 --2- 172.21.15.80:0/2690825670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59241031d0 0x7f592410f4b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 --2- 172.21.15.80:0/2690825670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924108ec0 0x7f5924102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 --2- 172.21.15.80:0/2690825670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5924108a20 0x7f5924102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 -- 172.21.15.80:0/2690825670 >> 172.21.15.80:0/2690825670 conn(0x7f5924078180 msgr2=0x7f59240785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 -- 172.21.15.80:0/2690825670 shutdown_connections 2024-04-25T11:29:09.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.978+0000 7f592c2ca640 1 -- 172.21.15.80:0/2690825670 wait complete. 2024-04-25T11:29:09.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 Processor -- start 2024-04-25T11:29:09.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 -- start start 2024-04-25T11:29:09.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59241031d0 0x7f59241995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924108a20 0x7f5924199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924108ec0 0x7f592419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5924112c60 con 0x7f5924108ec0 2024-04-25T11:29:09.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5924112ae0 con 0x7f59241031d0 2024-04-25T11:29:09.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592c2ca640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5924112de0 con 0x7f5924108a20 2024-04-25T11:29:09.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.979+0000 7f592a867640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924108ec0 0x7f592419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924108ec0 0x7f592419de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34736/0 (socket says 172.21.15.80:34736) 2024-04-25T11:29:09.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 -- 172.21.15.80:0/3854653550 learned_addr learned my addr 172.21.15.80:0/3854653550 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f5929865640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924108a20 0x7f5924199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a066640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59241031d0 0x7f59241995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 -- 172.21.15.80:0/3854653550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924108a20 msgr2=0x7f5924199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924108a20 0x7f5924199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 -- 172.21.15.80:0/3854653550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59241031d0 msgr2=0x7f59241995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59241031d0 0x7f59241995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 -- 172.21.15.80:0/3854653550 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592419e440 con 0x7f5924108ec0 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592a867640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924108ec0 0x7f592419de00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f591c0098d0 tx=0x7f591c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f591b7fe640 1 -- 172.21.15.80:0/3854653550 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c003b70 con 0x7f5924108ec0 2024-04-25T11:29:09.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f591b7fe640 1 -- 172.21.15.80:0/3854653550 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f591c003d10 con 0x7f5924108ec0 2024-04-25T11:29:09.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592419e6d0 con 0x7f5924108ec0 2024-04-25T11:29:09.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f591b7fe640 1 -- 172.21.15.80:0/3854653550 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c02fa20 con 0x7f5924108ec0 2024-04-25T11:29:09.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.980+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592419ec20 con 0x7f5924108ec0 2024-04-25T11:29:09.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f591b7fe640 1 -- 172.21.15.80:0/3854653550 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f591c02fc40 con 0x7f5924108ec0 2024-04-25T11:29:09.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 Processor -- start 2024-04-25T11:29:09.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 -- start start 2024-04-25T11:29:09.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bf9390 0x560be1f9a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1f9ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560be1effd80 con 0x560be1bd04d0 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560be1eb9a20 con 0x560be1bd86b0 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.983+0000 7f5933179740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560be1efbd40 con 0x560be1bf9390 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1f9ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f591b7fe640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f59100afc60 0x7f59100b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1f9ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34744/0 (socket says 172.21.15.80:34744) 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 -- 172.21.15.80:0/2999326120 learned_addr learned my addr 172.21.15.80:0/2999326120 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f5929865640 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a867640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f59100afc60 0x7f59100b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f5929865640 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bf9390 0x560be1f9a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f591b7fe640 1 -- 172.21.15.80:0/3854653550 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f591c1003d0 con 0x7f5924108ec0 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 -- 172.21.15.80:0/2999326120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bf9390 msgr2=0x560be1f9a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bf9390 0x560be1f9a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 -- 172.21.15.80:0/2999326120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 msgr2=0x560be1fa98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 -- 172.21.15.80:0/2999326120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be1ec4c30 con 0x560be1bd04d0 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a066640 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1f9ac40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5920009c60 tx=0x7f5920011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7877b2ba9310dd39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f592a867640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f59100afc60 0x7f59100b2170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f591c0fdcf0 tx=0x7f591c095ef0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f5918bfe640 1 -- 172.21.15.80:0/2999326120 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920004230 con 0x560be1bd04d0 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f5918bfe640 1 -- 172.21.15.80:0/2999326120 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59200043d0 con 0x560be1bd04d0 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.984+0000 7f5918bfe640 1 -- 172.21.15.80:0/2999326120 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920004d20 con 0x560be1bd04d0 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 -- 172.21.15.80:0/2999326120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 msgr2=0x560be1f9ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1f9ac40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5920009c60 tx=0x7f5920011810 comp rx=0 tx=0).stop 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 -- 172.21.15.80:0/2999326120 shutdown_connections 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1f9ac40 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 --2- 172.21.15.80:0/2999326120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bf9390 0x560be1f9a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 -- 172.21.15.80:0/2999326120 >> 172.21.15.80:0/2999326120 conn(0x560be1bed4e0 msgr2=0x560be1f96fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 -- 172.21.15.80:0/2999326120 shutdown_connections 2024-04-25T11:29:09.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.985+0000 7f5933179740 1 -- 172.21.15.80:0/2999326120 wait complete. 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 -- start start 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 Processor -- start 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 0x560be1fa7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bf9390 0x560be1fb34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560be1fa9fa0 con 0x560be1bf9390 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560be1e86dc0 con 0x560be1bd86b0 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560be1faa120 con 0x560be1bd04d0 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5933179740 10 client.0 _ll_register_callbacks cb 0x560be1ea2600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bf9390 0x560be1fb34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bf9390 0x560be1fb34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34756/0 (socket says 172.21.15.80:34756) 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 -- 172.21.15.80:0/4158600067 learned_addr learned my addr 172.21.15.80:0/4158600067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:09.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f592a066640 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 -- 172.21.15.80:0/4158600067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 msgr2=0x560be1fa7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 0x560be1fa7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 -- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 msgr2=0x560be1fa7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.986+0000 7f5929865640 1 -- 172.21.15.80:0/4158600067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be1c113f0 con 0x560be1bf9390 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5929865640 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bf9390 0x560be1fb34e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f59241092f0 tx=0x7f5914012b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d61bea182f205d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f590dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f590dffb640 1 -- 172.21.15.80:0/4158600067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914005220 con 0x560be1bf9390 2024-04-25T11:29:09.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59200043d0 con 0x560be1bf9390 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f590dffb640 1 -- 172.21.15.80:0/4158600067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f59140053c0 con 0x560be1bf9390 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f590dffb640 1 -- 172.21.15.80:0/4158600067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f59140055c0 con 0x560be1bf9390 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 10 client.16731 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560be1cdb7d0 con 0x560be1bf9390 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f590dffb640 1 -- 172.21.15.80:0/4158600067 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59200043d0 con 0x560be1bf9390 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f590dffb640 1 -- 172.21.15.80:0/4158600067 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f591401c030 con 0x560be1bf9390 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 10 client.16731 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 20 client.16731 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1bb7f60 0x560be1fb9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 4 client.16731 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.987+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560be1f0d990 con 0x560be1bb7f60 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.988+0000 7f592a066640 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1bb7f60 0x560be1fb9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.988+0000 7f590dffb640 10 client.16731 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:09.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.988+0000 7f592a066640 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1bb7f60 0x560be1fb9930 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49af220f6b0f1929 server_cookie=97d1a845abb8dd82 in_seq=0 out_seq=0 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f590dffb640 1 -- 172.21.15.80:0/4158600067 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560be1f0d990 con 0x560be1bb7f60 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f590dffb640 10 client.16731 handle_command_reply: tid=0 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 client.16731 shutdown 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bf9390 msgr2=0x560be1fb34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bf9390 0x560be1fb34e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f59241092f0 tx=0x7f5914012b40 comp rx=0 tx=0).stop 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 shutdown_connections 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1bb7f60 0x560be1fb9930 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bf9390 0x560be1fb34e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bd86b0 0x560be1fa7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f590dffb640 0 client.16731 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 --2- 172.21.15.80:0/4158600067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 0x560be1fa7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 >> 172.21.15.80:0/4158600067 conn(0x560be1bed4e0 msgr2=0x560be1f9c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 shutdown_connections 2024-04-25T11:29:09.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 1 -- 172.21.15.80:0/4158600067 wait complete. 2024-04-25T11:29:09.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:09.989+0000 7f5933179740 20 client.16731 trim_cache size 0 max 16384 2024-04-25T11:29:09.993 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:09 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/533167623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:29:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.002+0000 7f5933179740 1 Processor -- start 2024-04-25T11:29:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.002+0000 7f5933179740 1 -- start start 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5933179740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1fa7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5933179740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd86b0 0x560be1fb30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5933179740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be1fbf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5933179740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59241afff0 con 0x560be1bd04d0 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5933179740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59241ad8c0 con 0x560be1bf9390 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5933179740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f59241ab710 con 0x560be1bd86b0 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1fa7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1fa7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34760/0 (socket says 172.21.15.80:34760) 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 -- 172.21.15.80:0/1038094633 learned_addr learned my addr 172.21.15.80:0/1038094633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 -- 172.21.15.80:0/1038094633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd86b0 msgr2=0x560be1fb30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 --2- 172.21.15.80:0/1038094633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd86b0 0x560be1fb30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 -- 172.21.15.80:0/1038094633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 msgr2=0x560be1fbf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 --2- 172.21.15.80:0/1038094633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be1fbf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 -- 172.21.15.80:0/1038094633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be1f97b90 con 0x560be1bd04d0 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f5929865640 1 --2- 172.21.15.80:0/1038094633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1fa7b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5914004c00 tx=0x7f5914004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f602bd12838eed54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f590ffff640 1 -- 172.21.15.80:0/1038094633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914004730 con 0x560be1bd04d0 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f590ffff640 1 -- 172.21.15.80:0/1038094633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5914016030 con 0x560be1bd04d0 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.003+0000 7f590ffff640 1 -- 172.21.15.80:0/1038094633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914026450 con 0x560be1bd04d0 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 -- 172.21.15.80:0/1038094633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 msgr2=0x560be1fa7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 --2- 172.21.15.80:0/1038094633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1fa7b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5914004c00 tx=0x7f5914004e70 comp rx=0 tx=0).stop 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 -- 172.21.15.80:0/1038094633 shutdown_connections 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 --2- 172.21.15.80:0/1038094633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be1fbf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 --2- 172.21.15.80:0/1038094633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd86b0 0x560be1fb30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 --2- 172.21.15.80:0/1038094633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd04d0 0x560be1fa7b10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 -- 172.21.15.80:0/1038094633 >> 172.21.15.80:0/1038094633 conn(0x560be1bed4e0 msgr2=0x560be1fa7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 -- 172.21.15.80:0/1038094633 shutdown_connections 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 -- 172.21.15.80:0/1038094633 wait complete. 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.004+0000 7f5933179740 1 -- start start 2024-04-25T11:29:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 1 Processor -- start 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 0x560be1faa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd86b0 0x560be1faabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be201fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59241abd80 con 0x560be1bd86b0 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59241ad1f0 con 0x560be1bf9390 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f59241ac450 con 0x560be1bd04d0 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5933179740 10 client.0 _ll_register_callbacks cb 0x7f591400bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd86b0 0x560be1faabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd86b0 0x560be1faabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34772/0 (socket says 172.21.15.80:34772) 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 -- 172.21.15.80:0/4177238372 learned_addr learned my addr 172.21.15.80:0/4177238372 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5929865640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be201fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5929865640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 0x560be1faa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 -- 172.21.15.80:0/4177238372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 msgr2=0x560be1faa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 0x560be1faa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 -- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 msgr2=0x560be201fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be201fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 -- 172.21.15.80:0/4177238372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be20201d0 con 0x560be1bd86b0 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f5929865640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be201fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f592a066640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd86b0 0x560be1faabf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5920011d10 tx=0x7f5920009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa60c63f656f9fd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.005+0000 7f590dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f590dffb640 1 -- 172.21.15.80:0/4177238372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592001e040 con 0x560be1bd86b0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f590dffb640 1 -- 172.21.15.80:0/4177238372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f5920005530 con 0x560be1bd86b0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5914016030 con 0x560be1bd86b0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f590dffb640 1 -- 172.21.15.80:0/4177238372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f592002b2e0 con 0x560be1bd86b0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 10 client.16737 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560be2021380 con 0x560be1bd86b0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f590dffb640 1 -- 172.21.15.80:0/4177238372 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5914016030 con 0x560be1bd86b0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f590dffb640 1 -- 172.21.15.80:0/4177238372 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5920018070 con 0x560be1bd86b0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 10 client.16737 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 20 client.16737 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1b8d3a0 0x560be2023a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 4 client.16737 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560be1f07800 con 0x560be1b8d3a0 2024-04-25T11:29:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.006+0000 7f5929865640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1b8d3a0 0x560be2023a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f590dffb640 10 client.16737 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5929865640 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1b8d3a0 0x560be2023a00 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5697b440a94c8a4 server_cookie=1d0aa146559a1152 in_seq=0 out_seq=0 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f590dffb640 1 -- 172.21.15.80:0/4177238372 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560be1f07800 con 0x560be1b8d3a0 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f590dffb640 10 client.16737 handle_command_reply: tid=0 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 client.16737 shutdown 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd86b0 msgr2=0x560be1faabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd86b0 0x560be1faabf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5920011d10 tx=0x7f5920009830 comp rx=0 tx=0).stop 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 shutdown_connections 2024-04-25T11:29:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560be1b8d3a0 0x560be2023a00 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560be1bd86b0 0x560be1faabf0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f590dffb640 0 client.16737 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560be1bf9390 0x560be201fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 --2- 172.21.15.80:0/4177238372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560be1bd04d0 0x560be1faa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 >> 172.21.15.80:0/4177238372 conn(0x560be1bed4e0 msgr2=0x560be1f96680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 shutdown_connections 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 1 -- 172.21.15.80:0/4177238372 wait complete. 2024-04-25T11:29:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.007+0000 7f5933179740 20 client.16737 trim_cache size 0 max 16384 2024-04-25T11:29:10.007 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:29:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f59100afc60 msgr2=0x7f59100b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f59100afc60 0x7f59100b2170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f591c0fdcf0 tx=0x7f591c095ef0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924108ec0 msgr2=0x7f592419de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924108ec0 0x7f592419de00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f591c0098d0 tx=0x7f591c0317b0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 shutdown_connections 2024-04-25T11:29:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f59100afc60 0x7f59100b2170 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5924108ec0 0x7f592419de00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5924108a20 0x7f5924199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 --2- 172.21.15.80:0/3854653550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59241031d0 0x7f59241995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 >> 172.21.15.80:0/3854653550 conn(0x7f5924078180 msgr2=0x7f5924100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 shutdown_connections 2024-04-25T11:29:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:10.008+0000 7f592c2ca640 1 -- 172.21.15.80:0/3854653550 wait complete. 2024-04-25T11:29:10.838 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:10 smithi196 ceph-mon[32659]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:29:10.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:10 smithi080 ceph-mon[29126]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:29:10.892 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:10 smithi082 ceph-mon[32440]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:29:11.012 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:29:11.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:29:11.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:29:11.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 -- 172.21.15.80:0/305396090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10b6e0 msgr2=0x7f03bc10db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/305396090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10b6e0 0x7f03bc10db00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009900 tx=0x7f03a802a480 comp rx=0 tx=0).stop 2024-04-25T11:29:11.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 -- 172.21.15.80:0/305396090 shutdown_connections 2024-04-25T11:29:11.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/305396090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10b6e0 0x7f03bc10db00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/305396090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03bc10e090 0x7f03bc110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/305396090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03bc104c80 0x7f03bc105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 -- 172.21.15.80:0/305396090 >> 172.21.15.80:0/305396090 conn(0x7f03bc078180 msgr2=0x7f03bc0785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 -- 172.21.15.80:0/305396090 shutdown_connections 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.147+0000 7f03c2f0d640 1 -- 172.21.15.80:0/305396090 wait complete. 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 Processor -- start 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 -- start start 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03bc104c80 0x7f03bc19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03bc10b6e0 0x7f03bc19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10e090 0x7f03bc19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc113cf0 con 0x7f03bc10e090 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc113b70 con 0x7f03bc104c80 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.148+0000 7f03c2f0d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc113e70 con 0x7f03bc10b6e0 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10e090 0x7f03bc19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10e090 0x7f03bc19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34794/0 (socket says 172.21.15.80:34794) 2024-04-25T11:29:11.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 -- 172.21.15.80:0/1010053311 learned_addr learned my addr 172.21.15.80:0/1010053311 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03bbfff640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03bc10b6e0 0x7f03bc19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03bc104c80 0x7f03bc19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 -- 172.21.15.80:0/1010053311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03bc10b6e0 msgr2=0x7f03bc19acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03bc10b6e0 0x7f03bc19acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 -- 172.21.15.80:0/1010053311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03bc104c80 msgr2=0x7f03bc19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03bc104c80 0x7f03bc19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 -- 172.21.15.80:0/1010053311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc19f5b0 con 0x7f03bc10e090 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10e090 0x7f03bc19ef70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f03b400eaa0 tx=0x7f03b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03b9ffb640 1 -- 172.21.15.80:0/1010053311 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b400cdb0 con 0x7f03bc10e090 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03bc19f8a0 con 0x7f03bc10e090 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03b9ffb640 1 -- 172.21.15.80:0/1010053311 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b4005020 con 0x7f03bc10e090 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03b9ffb640 1 -- 172.21.15.80:0/1010053311 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40116d0 con 0x7f03bc10e090 2024-04-25T11:29:11.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.149+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03bc19fd70 con 0x7f03bc10e090 2024-04-25T11:29:11.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.151+0000 7f03b9ffb640 1 -- 172.21.15.80:0/1010053311 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f03b40051d0 con 0x7f03bc10e090 2024-04-25T11:29:11.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 Processor -- start 2024-04-25T11:29:11.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 -- start start 2024-04-25T11:29:11.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03b9ffb640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03ac0afc60 0x7f03ac0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a22410 0x5560c7dc2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c79f9550 0x5560c7dc2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03b9ffb640 1 -- 172.21.15.80:0/1010053311 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f03b40df0e0 con 0x7f03bc10e090 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5560c7d28b00 con 0x5560c79f9550 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5560c7cc4920 con 0x5560c7a22410 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5560c7d24ac0 con 0x5560c7a01730 2024-04-25T11:29:11.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03bbfff640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03ac0afc60 0x7f03ac0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.152+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c79f9550 0x5560c7dc2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c0ca9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a22410 0x5560c7dc2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c79f9550 0x5560c7dc2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34802/0 (socket says 172.21.15.80:34802) 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03bbfff640 1 -- 172.21.15.80:0/2277373753 learned_addr learned my addr 172.21.15.80:0/2277373753 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c14aa640 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c0ca9640 1 -- 172.21.15.80:0/2277373753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 msgr2=0x5560c7dc30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c0ca9640 1 -- 172.21.15.80:0/2277373753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c79f9550 msgr2=0x5560c7dc2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c79f9550 0x5560c7dc2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c0ca9640 1 -- 172.21.15.80:0/2277373753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c7b027e0 con 0x5560c7a22410 2024-04-25T11:29:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03bbfff640 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c79f9550 0x5560c7dc2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03bbfff640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03ac0afc60 0x7f03ac0b2170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03a802a9a0 tx=0x7f03a8032b20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a22410 0x5560c7dc2620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009b70 tx=0x7f03b00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4249589131871781 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03a6ffd640 1 -- 172.21.15.80:0/2277373753 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0009e60 con 0x5560c7a22410 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03a6ffd640 1 -- 172.21.15.80:0/2277373753 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b0012900 con 0x5560c7a22410 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.153+0000 7f03a6ffd640 1 -- 172.21.15.80:0/2277373753 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b000f9b0 con 0x5560c7a22410 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 -- 172.21.15.80:0/2277373753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a22410 msgr2=0x5560c7dc2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a22410 0x5560c7dc2620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009b70 tx=0x7f03b00117b0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 -- 172.21.15.80:0/2277373753 shutdown_connections 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c79f9550 0x5560c7dc2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/2277373753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a22410 0x5560c7dc2620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 -- 172.21.15.80:0/2277373753 >> 172.21.15.80:0/2277373753 conn(0x5560c7a16560 msgr2=0x5560c7dbedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 -- 172.21.15.80:0/2277373753 shutdown_connections 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.154+0000 7f03c9dc2740 1 -- 172.21.15.80:0/2277373753 wait complete. 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 -- start start 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 Processor -- start 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c79f9550 0x5560c7dccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a01730 0x5560c7dcd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dd8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5560c7dcf970 con 0x5560c7a22410 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5560c7cc25d0 con 0x5560c7a01730 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5560c7dcfaf0 con 0x5560c79f9550 2024-04-25T11:29:11.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c9dc2740 10 client.0 _ll_register_callbacks cb 0x5560c7cb0080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dd8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dd8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34806/0 (socket says 172.21.15.80:34806) 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c14aa640 1 -- 172.21.15.80:0/4043424755 learned_addr learned my addr 172.21.15.80:0/4043424755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03bbfff640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a01730 0x5560c7dcd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.155+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c79f9550 0x5560c7dccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c14aa640 1 -- 172.21.15.80:0/4043424755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c79f9550 msgr2=0x5560c7dccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c14aa640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c79f9550 0x5560c7dccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c14aa640 1 -- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a01730 msgr2=0x5560c7dcd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c14aa640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a01730 0x5560c7dcd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c14aa640 1 -- 172.21.15.80:0/4043424755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c7b62f70 con 0x5560c7a22410 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c79f9550 0x5560c7dccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c14aa640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dd8e50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f03b40092f0 tx=0x7f03b40a6f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62b0fdd9194acc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f039bfff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:11.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f039bfff640 1 -- 172.21.15.80:0/4043424755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40c1060 con 0x5560c7a22410 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f039bfff640 1 -- 172.21.15.80:0/4043424755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f03b40a67a0 con 0x5560c7a22410 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b0012900 con 0x5560c7a22410 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f039bfff640 1 -- 172.21.15.80:0/4043424755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f03b401f070 con 0x5560c7a22410 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c9dc2740 10 client.16749 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5560c79fa170 con 0x5560c7a22410 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f039bfff640 1 -- 172.21.15.80:0/4043424755 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b0012900 con 0x5560c7a22410 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f039bfff640 1 -- 172.21.15.80:0/4043424755 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f03b400f040 con 0x5560c7a22410 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c9dc2740 10 client.16749 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c9dc2740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.156+0000 7f03c9dc2740 20 client.16749 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.157+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79e11f0 0x5560c7ddefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.157+0000 7f03c9dc2740 4 client.16749 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.157+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560c7d36710 con 0x5560c79e11f0 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.157+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79e11f0 0x5560c7ddefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.157+0000 7f039bfff640 10 client.16749 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.157+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79e11f0 0x5560c7ddefb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad9f9684da2eee7 server_cookie=2110e8e536122d1 in_seq=0 out_seq=0 2024-04-25T11:29:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f039bfff640 1 -- 172.21.15.80:0/4043424755 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5560c7d36710 con 0x5560c79e11f0 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f039bfff640 10 client.16749 handle_command_reply: tid=0 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 client.16749 shutdown 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 msgr2=0x5560c7dd8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dd8e50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f03b40092f0 tx=0x7f03b40a6f20 comp rx=0 tx=0).stop 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 shutdown_connections 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79e11f0 0x5560c7ddefb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dd8e50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c7a01730 0x5560c7dcd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/4043424755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c79f9550 0x5560c7dccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f039bfff640 0 client.16749 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 >> 172.21.15.80:0/4043424755 conn(0x5560c7a16560 msgr2=0x5560c7dc2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 shutdown_connections 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 1 -- 172.21.15.80:0/4043424755 wait complete. 2024-04-25T11:29:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.158+0000 7f03c9dc2740 20 client.16749 trim_cache size 0 max 16384 2024-04-25T11:29:11.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.176+0000 7f03c9dc2740 1 Processor -- start 2024-04-25T11:29:11.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.176+0000 7f03c9dc2740 1 -- start start 2024-04-25T11:29:11.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dcbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dbdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1b2270 con 0x5560c7a22410 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1afb40 con 0x5560c79f9550 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1ad990 con 0x5560c7a01730 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dbdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dbdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34808/0 (socket says 172.21.15.80:34808) 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 -- 172.21.15.80:0/1039191037 learned_addr learned my addr 172.21.15.80:0/1039191037 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dcbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03bbfff640 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 -- 172.21.15.80:0/1039191037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 msgr2=0x5560c7dc70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 -- 172.21.15.80:0/1039191037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 msgr2=0x5560c7dcbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dcbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 -- 172.21.15.80:0/1039191037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c7dbf9a0 con 0x5560c7a22410 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03bbfff640 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dbdbd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f03b40a7030 tx=0x7f03b40a6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369887e855a3fe02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03a67fc640 1 -- 172.21.15.80:0/1039191037 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40c1070 con 0x5560c7a22410 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03a67fc640 1 -- 172.21.15.80:0/1039191037 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b40ab6e0 con 0x5560c7a22410 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.177+0000 7f03a67fc640 1 -- 172.21.15.80:0/1039191037 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40a1ac0 con 0x5560c7a22410 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1039191037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 msgr2=0x5560c7dbdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dbdbd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f03b40a7030 tx=0x7f03b40a6db0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1039191037 shutdown_connections 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7dbdbd0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dc70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1039191037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dcbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1039191037 >> 172.21.15.80:0/1039191037 conn(0x5560c7a16560 msgr2=0x5560c7dbd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1039191037 shutdown_connections 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1039191037 wait complete. 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.178+0000 7f03c9dc2740 1 -- start start 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 1 Processor -- start 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dd03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dd0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7e3f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1ae000 con 0x5560c7a22410 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1af470 con 0x5560c79f9550 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc1ae6d0 con 0x5560c7a01730 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c9dc2740 10 client.0 _ll_register_callbacks cb 0x7f03b40a37f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7e3f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7e3f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34812/0 (socket says 172.21.15.80:34812) 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 -- 172.21.15.80:0/1720013633 learned_addr learned my addr 172.21.15.80:0/1720013633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dd03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03bbfff640 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dd0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 -- 172.21.15.80:0/1720013633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 msgr2=0x5560c7dd0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dd0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 -- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 msgr2=0x5560c7dd03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dd03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.179+0000 7f03c14aa640 1 -- 172.21.15.80:0/1720013633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c7e3f8a0 con 0x5560c7a22410 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c14aa640 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7e3f2e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f03b40a33b0 tx=0x7f03b40a1cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0544f97dd1d301f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f039bfff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f039bfff640 1 -- 172.21.15.80:0/1720013633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40c1070 con 0x5560c7a22410 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f039bfff640 1 -- 172.21.15.80:0/1720013633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f03b40a3920 con 0x5560c7a22410 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b40ab6e0 con 0x5560c7a22410 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f039bfff640 1 -- 172.21.15.80:0/1720013633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f03b40a1e60 con 0x5560c7a22410 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 10 client.16755 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5560c7e3f8a0 con 0x5560c7a22410 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f039bfff640 1 -- 172.21.15.80:0/1720013633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b40ab6e0 con 0x5560c7a22410 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f039bfff640 1 -- 172.21.15.80:0/1720013633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f03b40a6210 con 0x5560c7a22410 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 10 client.16755 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 20 client.16755 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79b6630 0x5560c7e48d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 4 client.16755 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.180+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5560c7d30580 con 0x5560c79b6630 2024-04-25T11:29:11.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.181+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79b6630 0x5560c7e48d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.181+0000 7f039bfff640 10 client.16755 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.181+0000 7f03c0ca9640 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79b6630 0x5560c7e48d60 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd49d449ff34b71 server_cookie=8faa56de31b31514 in_seq=0 out_seq=0 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f039bfff640 1 -- 172.21.15.80:0/1720013633 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5560c7d30580 con 0x5560c79b6630 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f039bfff640 10 client.16755 handle_command_reply: tid=0 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 client.16755 shutdown 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 msgr2=0x5560c7e3f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7e3f2e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f03b40a33b0 tx=0x7f03b40a1cf0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 shutdown_connections 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5560c79b6630 0x5560c7e48d60 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f039bfff640 0 client.16755 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560c7a22410 0x5560c7e3f2e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560c7a01730 0x5560c7dd0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 --2- 172.21.15.80:0/1720013633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c79f9550 0x5560c7dd03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 >> 172.21.15.80:0/1720013633 conn(0x5560c7a16560 msgr2=0x5560c7dcb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.182+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 shutdown_connections 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c9dc2740 1 -- 172.21.15.80:0/1720013633 wait complete. 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c9dc2740 20 client.16755 trim_cache size 0 max 16384 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "b832857b-1808-422c-a186-b755ebdb9904", 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:29:11.181 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:29:11.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03ac0afc60 msgr2=0x7f03ac0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03ac0afc60 0x7f03ac0b2170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03a802a9a0 tx=0x7f03a8032b20 comp rx=0 tx=0).stop 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10e090 msgr2=0x7f03bc19ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10e090 0x7f03bc19ef70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f03b400eaa0 tx=0x7f03b400ef60 comp rx=0 tx=0).stop 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 shutdown_connections 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03ac0afc60 0x7f03ac0b2170 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03bc10e090 0x7f03bc19ef70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03bc10b6e0 0x7f03bc19acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 --2- 172.21.15.80:0/1010053311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03bc104c80 0x7f03bc19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 >> 172.21.15.80:0/1010053311 conn(0x7f03bc078180 msgr2=0x7f03bc1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 shutdown_connections 2024-04-25T11:29:11.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.183+0000 7f03c2f0d640 1 -- 172.21.15.80:0/1010053311 wait complete. 2024-04-25T11:29:11.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:29:11.186 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 -- 172.21.15.80:0/3507431816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 msgr2=0x7fe9cc1036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 --2- 172.21.15.80:0/3507431816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1036b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009900 tx=0x7fe9bc02a410 comp rx=0 tx=0).stop 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 -- 172.21.15.80:0/3507431816 shutdown_connections 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 --2- 172.21.15.80:0/3507431816 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9cc104260 0x7fe9cc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 --2- 172.21.15.80:0/3507431816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9cc109fb0 0x7fe9cc103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 --2- 172.21.15.80:0/3507431816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1036b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 -- 172.21.15.80:0/3507431816 >> 172.21.15.80:0/3507431816 conn(0x7fe9cc0ff1d0 msgr2=0x7fe9cc101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 -- 172.21.15.80:0/3507431816 shutdown_connections 2024-04-25T11:29:11.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.304+0000 7fe9d1827640 1 -- 172.21.15.80:0/3507431816 wait complete. 2024-04-25T11:29:11.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 Processor -- start 2024-04-25T11:29:11.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 -- start start 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9cc104260 0x7fe9cc1a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9cc109fb0 0x7fe9cc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc113d50 con 0x7fe9cc109b10 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc113bd0 con 0x7fe9cc104260 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.305+0000 7fe9d1827640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc113ed0 con 0x7fe9cc109fb0 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34832/0 (socket says 172.21.15.80:34832) 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/2445929187 learned_addr learned my addr 172.21.15.80:0/2445929187 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9caffd640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9cc104260 0x7fe9cc1a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9cb7fe640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9cc109fb0 0x7fe9cc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/2445929187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9cc109fb0 msgr2=0x7fe9cc19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9cc109fb0 0x7fe9cc19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/2445929187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9cc104260 msgr2=0x7fe9cc1a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9cc104260 0x7fe9cc1a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/2445929187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc19ad80 con 0x7fe9cc109b10 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1a0a10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e9f0 tx=0x7fe9c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9d0825640 1 -- 172.21.15.80:0/2445929187 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000ccc0 con 0x7fe9cc109b10 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9d0825640 1 -- 172.21.15.80:0/2445929187 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9c00035f0 con 0x7fe9cc109b10 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc19b010 con 0x7fe9cc109b10 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9d0825640 1 -- 172.21.15.80:0/2445929187 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000ce60 con 0x7fe9cc109b10 2024-04-25T11:29:11.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.306+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc1a7270 con 0x7fe9cc109b10 2024-04-25T11:29:11.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 Processor -- start 2024-04-25T11:29:11.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 -- start start 2024-04-25T11:29:11.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739bafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d373920d80 con 0x55d3735f96b0 2024-04-25T11:29:11.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d3738da8b0 con 0x55d37361a390 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d37391cd40 con 0x55d3735f14d0 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9d0825640 1 -- 172.21.15.80:0/2445929187 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fe9c0003aa0 con 0x7fe9cc109b10 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739bafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9ca7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739bafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:52250/0 (socket says 172.21.15.80:52250) 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9caffd640 1 -- 172.21.15.80:0/2054463207 learned_addr learned my addr 172.21.15.80:0/2054463207 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.309+0000 7fe9cb7fe640 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/2054463207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 msgr2=0x55d3739bafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739bafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/2054463207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 msgr2=0x55d3739baa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739baa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/2054463207 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3738aba40 con 0x55d3735f96b0 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9caffd640 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739bafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:29:11.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c78f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00dcab0 tx=0x7fe9c00e7490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9201bb97197f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9d0825640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe9b40afc60 0x7fe9b40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9b1ffb640 1 -- 172.21.15.80:0/2054463207 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00f3070 con 0x55d3735f96b0 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9cb7fe640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe9b40afc60 0x7fe9b40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9b1ffb640 1 -- 172.21.15.80:0/2054463207 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9c00a7010 con 0x55d3735f96b0 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9b1ffb640 1 -- 172.21.15.80:0/2054463207 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c008a240 con 0x55d3735f96b0 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.310+0000 7fe9d0825640 1 -- 172.21.15.80:0/2445929187 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe9c00df350 con 0x7fe9cc109b10 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2054463207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 msgr2=0x55d3739c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9cb7fe640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe9b40afc60 0x7fe9b40b2170 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d3739b7bd0 tx=0x7fe9c40097e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c78f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00dcab0 tx=0x7fe9c00e7490 comp rx=0 tx=0).stop 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2054463207 shutdown_connections 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c78f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739bafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2054463207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739baa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2054463207 >> 172.21.15.80:0/2054463207 conn(0x55d37360e4e0 msgr2=0x55d3739b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2054463207 shutdown_connections 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.311+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2054463207 wait complete. 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 -- start start 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 Processor -- start 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d3739c7fe0 con 0x55d3735f96b0 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d3738a7d10 con 0x55d37361a390 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d3739c8160 con 0x55d3735f14d0 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9d87bb740 10 client.0 _ll_register_callbacks cb 0x55d3738d4210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34844/0 (socket says 172.21.15.80:34844) 2024-04-25T11:29:11.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/325167038 learned_addr learned my addr 172.21.15.80:0/325167038 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9cb7fe640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9caffd640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/325167038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 msgr2=0x55d3739c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 msgr2=0x55d3739d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9ca7fc640 1 -- 172.21.15.80:0/325167038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3736fc7d0 con 0x55d3735f96b0 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.312+0000 7fe9caffd640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c5ad0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00a7200 tx=0x7fe9c0003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf35b145bf69f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9aaffd640 1 -- 172.21.15.80:0/325167038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c008e730 con 0x55d3735f96b0 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9aaffd640 1 -- 172.21.15.80:0/325167038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe9c0091360 con 0x55d3735f96b0 2024-04-25T11:29:11.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9c00a7010 con 0x55d3735f96b0 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9aaffd640 1 -- 172.21.15.80:0/325167038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe9c008cc90 con 0x55d3735f96b0 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 10 client.16767 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d3736323f0 con 0x55d3735f96b0 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9aaffd640 1 -- 172.21.15.80:0/325167038 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9c00a7010 con 0x55d3735f96b0 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9aaffd640 1 -- 172.21.15.80:0/325167038 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe9c00a3790 con 0x55d3735f96b0 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 10 client.16767 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 10 client.16767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 20 client.16767 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d3735d8f60 0x55d3739d7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 4 client.16767 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.313+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d37392e990 con 0x55d3735d8f60 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.314+0000 7fe9caffd640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d3735d8f60 0x55d3739d7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.314+0000 7fe9aaffd640 10 client.16767 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.314+0000 7fe9caffd640 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d3735d8f60 0x55d3739d7540 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8a74677796d563c server_cookie=91838fd362a32e71 in_seq=0 out_seq=0 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9aaffd640 1 -- 172.21.15.80:0/325167038 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d37392e990 con 0x55d3735d8f60 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9aaffd640 10 client.16767 handle_command_reply: tid=0 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 client.16767 shutdown 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 msgr2=0x55d3739c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c5ad0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00a7200 tx=0x7fe9c0003e70 comp rx=0 tx=0).stop 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 shutdown_connections 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d3735d8f60 0x55d3739d7540 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735f96b0 0x55d3739c5ad0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9aaffd640 0 client.16767 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d37361a390 0x55d3739d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/325167038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 >> 172.21.15.80:0/325167038 conn(0x55d37360e4e0 msgr2=0x55d3739bc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 shutdown_connections 2024-04-25T11:29:11.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 1 -- 172.21.15.80:0/325167038 wait complete. 2024-04-25T11:29:11.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.315+0000 7fe9d87bb740 20 client.16767 trim_cache size 0 max 16384 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 Processor -- start 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 -- start start 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739bae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f14d0 0x55d3739c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f96b0 0x55d3739bce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1b2370 con 0x55d3735d8f60 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1afc40 con 0x55d3735f14d0 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1ada90 con 0x55d3735f96b0 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739bae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34850/0 (socket says 172.21.15.80:34850) 2024-04-25T11:29:11.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 -- 172.21.15.80:0/1583056243 learned_addr learned my addr 172.21.15.80:0/1583056243 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 -- 172.21.15.80:0/1583056243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f96b0 msgr2=0x55d3739bce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f96b0 0x55d3739bce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 -- 172.21.15.80:0/1583056243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f14d0 msgr2=0x55d3739c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f14d0 0x55d3739c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f14d0 0x55d3739c0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 -- 172.21.15.80:0/1583056243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3735f20f0 con 0x55d3735d8f60 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.333+0000 7fe9caffd640 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739bae60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc1047f0 tx=0x7fe9bc005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e156be8e86b35ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9b17fa640 1 -- 172.21.15.80:0/1583056243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc048020 con 0x55d3735d8f60 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9b17fa640 1 -- 172.21.15.80:0/1583056243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9bc0054f0 con 0x55d3735d8f60 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9b17fa640 1 -- 172.21.15.80:0/1583056243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc035040 con 0x55d3735d8f60 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 -- 172.21.15.80:0/1583056243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 msgr2=0x55d3739bae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739bae60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc1047f0 tx=0x7fe9bc005a20 comp rx=0 tx=0).stop 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 -- 172.21.15.80:0/1583056243 shutdown_connections 2024-04-25T11:29:11.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f96b0 0x55d3739bce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f14d0 0x55d3739c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/1583056243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739bae60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 -- 172.21.15.80:0/1583056243 >> 172.21.15.80:0/1583056243 conn(0x55d37360e4e0 msgr2=0x55d3739bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 -- 172.21.15.80:0/1583056243 shutdown_connections 2024-04-25T11:29:11.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.334+0000 7fe9d87bb740 1 -- 172.21.15.80:0/1583056243 wait complete. 2024-04-25T11:29:11.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 -- start start 2024-04-25T11:29:11.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 Processor -- start 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739daae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739d7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f96b0 0x55d3739d8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1ae100 con 0x55d3735d8f60 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1af570 con 0x55d3735f96b0 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1ae7d0 con 0x55d3735f14d0 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9d87bb740 10 client.0 _ll_register_callbacks cb 0x7fe9c00f1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739daae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739daae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34854/0 (socket says 172.21.15.80:34854) 2024-04-25T11:29:11.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.335+0000 7fe9caffd640 1 -- 172.21.15.80:0/2075326706 learned_addr learned my addr 172.21.15.80:0/2075326706 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9cb7fe640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f96b0 0x55d3739d8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739d7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9caffd640 1 -- 172.21.15.80:0/2075326706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 msgr2=0x55d3739d7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9caffd640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739d7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9caffd640 1 -- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f96b0 msgr2=0x55d3739d8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9caffd640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f96b0 0x55d3739d8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9caffd640 1 -- 172.21.15.80:0/2075326706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3738e14b0 con 0x55d3735d8f60 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9cb7fe640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f96b0 0x55d3739d8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9caffd640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739daae0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc005ab0 tx=0x7fe9bc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c34b1745e22839 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9aaffd640 1 -- 172.21.15.80:0/2075326706 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc048030 con 0x55d3735d8f60 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9aaffd640 1 -- 172.21.15.80:0/2075326706 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fe9bc0050a0 con 0x55d3735d8f60 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9bc0054f0 con 0x55d3735d8f60 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9aaffd640 1 -- 172.21.15.80:0/2075326706 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe9bc035040 con 0x55d3735d8f60 2024-04-25T11:29:11.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9d87bb740 10 client.16773 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d373a3f390 con 0x55d3735d8f60 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.336+0000 7fe9aaffd640 1 -- 172.21.15.80:0/2075326706 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9bc0054f0 con 0x55d3735d8f60 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9aaffd640 1 -- 172.21.15.80:0/2075326706 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe9bc044ce0 con 0x55d3735d8f60 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9d87bb740 10 client.16773 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9d87bb740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9d87bb740 20 client.16773 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d37361a390 0x55d373a41b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9d87bb740 4 client.16773 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d373928800 con 0x55d37361a390 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d37361a390 0x55d373a41b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9aaffd640 10 client.16773 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.337+0000 7fe9ca7fc640 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d37361a390 0x55d373a41b20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af0465cc575fd354 server_cookie=1dcddbb774f0c9c4 in_seq=0 out_seq=0 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9aaffd640 1 -- 172.21.15.80:0/2075326706 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d373928800 con 0x55d37361a390 2024-04-25T11:29:11.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9aaffd640 10 client.16773 handle_command_reply: tid=0 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 client.16773 shutdown 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 msgr2=0x55d3739daae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739daae0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc005ab0 tx=0x7fe9bc0047e0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 shutdown_connections 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d37361a390 0x55d373a41b20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3735f96b0 0x55d3739d8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d3735f14d0 0x55d3739d7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9aaffd640 0 client.16773 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 --2- 172.21.15.80:0/2075326706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d3735d8f60 0x55d3739daae0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 >> 172.21.15.80:0/2075326706 conn(0x55d37360e4e0 msgr2=0x55d3739c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 shutdown_connections 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 1 -- 172.21.15.80:0/2075326706 wait complete. 2024-04-25T11:29:11.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d87bb740 20 client.16773 trim_cache size 0 max 16384 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: "b832857b-1808-422c-a186-b755ebdb9904": { 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "b832857b-1808-422c-a186-b755ebdb9904", 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:29:11.336 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:29:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe9b40afc60 msgr2=0x7fe9b40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe9b40afc60 0x7fe9b40b2170 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d3739b7bd0 tx=0x7fe9c40097e0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 msgr2=0x7fe9cc1a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:11.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1a0a10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e9f0 tx=0x7fe9c000eeb0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 shutdown_connections 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe9b40afc60 0x7fe9b40b2170 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9cc109b10 0x7fe9cc1a0a10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9cc109fb0 0x7fe9cc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.338+0000 7fe9d1827640 1 --2- 172.21.15.80:0/2445929187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9cc104260 0x7fe9cc1a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.339+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 >> 172.21.15.80:0/2445929187 conn(0x7fe9cc0ff1d0 msgr2=0x7fe9cc0ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.339+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 shutdown_connections 2024-04-25T11:29:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:11.339+0000 7fe9d1827640 1 -- 172.21.15.80:0/2445929187 wait complete. 2024-04-25T11:29:11.341 INFO:tasks.cephfs.filesystem:scrub status for tag:b832857b-1808-422c-a186-b755ebdb9904 - {'path': '/', 'tag': 'b832857b-1808-422c-a186-b755ebdb9904', 'options': 'recursive,force'} 2024-04-25T11:29:12.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:12 smithi080 ceph-mon[29126]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:12.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:12 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:29:12.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:12 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:12.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:12 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:29:12.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:12 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:12.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:12 smithi196 ceph-mon[32659]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:12.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:12 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:29:12.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:12 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:12.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:12 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:29:12.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:12 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:12.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:12 smithi082 ceph-mon[32440]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:29:12.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:12 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:29:12.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:12 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:12.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:12 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:29:12.991 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:12 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:13.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:13 smithi080 ceph-mon[29126]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:29:13.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:13 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:29:13.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:13 smithi196 ceph-mon[32659]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:29:13.937 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:13 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:29:13.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:13 smithi082 ceph-mon[32440]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:29:13.990 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:13 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:29:16.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:15 smithi196 ceph-mon[32659]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:29:16.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:15 smithi082 ceph-mon[32440]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:29:16.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:15 smithi080 ceph-mon[29126]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T11:29:18.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:17 smithi196 ceph-mon[32659]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T11:29:18.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:17 smithi082 ceph-mon[32440]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T11:29:18.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:17 smithi080 ceph-mon[29126]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T11:29:20.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:19 smithi196 ceph-mon[32659]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:29:20.241 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:19 smithi082 ceph-mon[32440]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:29:20.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:19 smithi080 ceph-mon[29126]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:29:22.186 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:21 smithi196 ceph-mon[32659]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:29:22.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:21 smithi082 ceph-mon[32440]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:29:22.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:21 smithi080 ceph-mon[29126]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:29:24.177 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:23 smithi080 ceph-mon[29126]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:24.186 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:23 smithi196 ceph-mon[32659]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:24.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:23 smithi082 ceph-mon[32440]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:25.186 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:24 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:29:25.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:24 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:29:25.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:24 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:29:26.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:25 smithi196 ceph-mon[32659]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:26.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:25 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:29:26.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:25 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:29:26.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:25 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:29:26.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:25 smithi082 ceph-mon[32440]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:26.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:25 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:29:26.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:25 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:29:26.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:25 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:29:26.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:25 smithi080 ceph-mon[29126]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:26.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:25 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:29:26.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:25 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:29:26.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:25 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:29:28.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:27 smithi196 ceph-mon[32659]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:28.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:27 smithi082 ceph-mon[32440]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:28.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:27 smithi080 ceph-mon[29126]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:30.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:29 smithi196 ceph-mon[32659]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:30.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:29 smithi082 ceph-mon[32440]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:30.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:29 smithi080 ceph-mon[29126]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:32.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:31 smithi196 ceph-mon[32659]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:32.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:31 smithi082 ceph-mon[32440]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:32.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:31 smithi080 ceph-mon[29126]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:34.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:33 smithi196 ceph-mon[32659]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:34.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:33 smithi082 ceph-mon[32440]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:34.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:33 smithi080 ceph-mon[29126]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:36.187 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:35 smithi196 ceph-mon[32659]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:36.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:35 smithi082 ceph-mon[32440]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:36.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:35 smithi080 ceph-mon[29126]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:38.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:37 smithi082 ceph-mon[32440]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:38.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:37 smithi080 ceph-mon[29126]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:38.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:37 smithi196 ceph-mon[32659]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:40.238 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:39 smithi196 ceph-mon[32659]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:40.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:39 smithi082 ceph-mon[32440]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:40.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:39 smithi080 ceph-mon[29126]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:41.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:29:41.342 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:29:41.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 -- 172.21.15.80:0/2261584919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a8107d00 msgr2=0x7f05a810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 --2- 172.21.15.80:0/2261584919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a8107d00 0x7f05a810f530 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009ca0 tx=0x7f05a002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 -- 172.21.15.80:0/2261584919 shutdown_connections 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 --2- 172.21.15.80:0/2261584919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a8107d00 0x7f05a810f530 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 --2- 172.21.15.80:0/2261584919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a8107280 0x7f05a8107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 --2- 172.21.15.80:0/2261584919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a81033c0 0x7f05a81037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 -- 172.21.15.80:0/2261584919 >> 172.21.15.80:0/2261584919 conn(0x7f05a8077920 msgr2=0x7f05a8077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 -- 172.21.15.80:0/2261584919 shutdown_connections 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 -- 172.21.15.80:0/2261584919 wait complete. 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 Processor -- start 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.480+0000 7f05af7be640 1 -- start start 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a81033c0 0x7f05a819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a8107280 0x7f05a819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a8107d00 0x7f05a819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8112c20 con 0x7f05a81033c0 2024-04-25T11:29:41.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8112aa0 con 0x7f05a8107d00 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8112da0 con 0x7f05a8107280 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a81033c0 0x7f05a819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a81033c0 0x7f05a819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57622/0 (socket says 172.21.15.80:57622) 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 -- 172.21.15.80:0/2731708889 learned_addr learned my addr 172.21.15.80:0/2731708889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05acd59640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a8107280 0x7f05a819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05add5b640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a8107d00 0x7f05a819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 -- 172.21.15.80:0/2731708889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a8107280 msgr2=0x7f05a819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a8107280 0x7f05a819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 -- 172.21.15.80:0/2731708889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a8107d00 msgr2=0x7f05a819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a8107d00 0x7f05a819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 -- 172.21.15.80:0/2731708889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a819f530 con 0x7f05a81033c0 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05add5b640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a8107d00 0x7f05a819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:41.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a81033c0 0x7f05a819a6d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f05a400d770 tx=0x7f05a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f059e7fc640 1 -- 172.21.15.80:0/2731708889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4017070 con 0x7f05a81033c0 2024-04-25T11:29:41.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f059e7fc640 1 -- 172.21.15.80:0/2731708889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05a4009c30 con 0x7f05a81033c0 2024-04-25T11:29:41.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a819f820 con 0x7f05a81033c0 2024-04-25T11:29:41.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f059e7fc640 1 -- 172.21.15.80:0/2731708889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a400f620 con 0x7f05a81033c0 2024-04-25T11:29:41.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.481+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a81a71a0 con 0x7f05a81033c0 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 Processor -- start 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 -- start start 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f059e7fc640 1 -- 172.21.15.80:0/2731708889 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f05a401a070 con 0x7f05a81033c0 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55816379a390 0x558163b3aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b3afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637796b0 0x558163b478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558163aa0d80 con 0x5581637714d0 2024-04-25T11:29:41.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558163a5a8b0 con 0x5581637796b0 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.484+0000 7f05b6672740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558163a9cd40 con 0x55816379a390 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b3afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b3afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57634/0 (socket says 172.21.15.80:57634) 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 -- 172.21.15.80:0/2633061874 learned_addr learned my addr 172.21.15.80:0/2633061874 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05add5b640 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55816379a390 0x558163b3aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05acd59640 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637796b0 0x558163b478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 -- 172.21.15.80:0/2633061874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55816379a390 msgr2=0x558163b3aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55816379a390 0x558163b3aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 -- 172.21.15.80:0/2633061874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637796b0 msgr2=0x558163b478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637796b0 0x558163b478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 -- 172.21.15.80:0/2633061874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558163a2ba40 con 0x5581637714d0 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f059e7fc640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05940afc60 0x7f05940b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b3afa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f05a40dc330 tx=0x7f05a40e77a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790e0b142dbc75d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05add5b640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05940afc60 0x7f05940b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05937fe640 1 -- 172.21.15.80:0/2633061874 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a40a2cd0 con 0x5581637714d0 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f059e7fc640 1 -- 172.21.15.80:0/2731708889 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f05a40dec60 con 0x7f05a81033c0 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05937fe640 1 -- 172.21.15.80:0/2633061874 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05a40ec070 con 0x5581637714d0 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.485+0000 7f05937fe640 1 -- 172.21.15.80:0/2633061874 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a40a6580 con 0x5581637714d0 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 -- 172.21.15.80:0/2633061874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 msgr2=0x558163b3afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05add5b640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05940afc60 0x7f05940b2170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x558163b37bd0 tx=0x7f05a0005d80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b3afa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f05a40dc330 tx=0x7f05a40e77a0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 -- 172.21.15.80:0/2633061874 shutdown_connections 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b3afa0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637796b0 0x558163b478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 --2- 172.21.15.80:0/2633061874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55816379a390 0x558163b3aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 -- 172.21.15.80:0/2633061874 >> 172.21.15.80:0/2633061874 conn(0x55816378e4e0 msgr2=0x558163b37210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 -- 172.21.15.80:0/2633061874 shutdown_connections 2024-04-25T11:29:41.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.486+0000 7f05b6672740 1 -- 172.21.15.80:0/2633061874 wait complete. 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 -- start start 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 Processor -- start 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b45590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 0x558163b45ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55816379a390 0x558163b51460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558163b47fe0 con 0x5581637714d0 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558163a27d10 con 0x55816379a390 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558163b48160 con 0x5581637796b0 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05ad55a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b45590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05b6672740 10 client.0 _ll_register_callbacks cb 0x558163a54210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05ad55a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b45590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57646/0 (socket says 172.21.15.80:57646) 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.487+0000 7f05ad55a640 1 -- 172.21.15.80:0/3895180674 learned_addr learned my addr 172.21.15.80:0/3895180674 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05add5b640 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55816379a390 0x558163b51460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05acd59640 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 0x558163b45ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05ad55a640 1 -- 172.21.15.80:0/3895180674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 msgr2=0x558163b45ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05ad55a640 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 0x558163b45ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05ad55a640 1 -- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55816379a390 msgr2=0x558163b51460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05ad55a640 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55816379a390 0x558163b51460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05ad55a640 1 -- 172.21.15.80:0/3895180674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55816387c7d0 con 0x5581637714d0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05ad55a640 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b45590 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f05a40dc470 tx=0x7f05a4010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e47de478786801f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f0590ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f0590ff9640 1 -- 172.21.15.80:0/3895180674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a40e1070 con 0x5581637714d0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f0590ff9640 1 -- 172.21.15.80:0/3895180674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f05a40c1460 con 0x5581637714d0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05a40ec070 con 0x5581637714d0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f0590ff9640 1 -- 172.21.15.80:0/3895180674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f05a4021070 con 0x5581637714d0 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05b6672740 10 client.16785 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:41.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5581637b23f0 con 0x5581637714d0 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.488+0000 7f0590ff9640 1 -- 172.21.15.80:0/3895180674 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05a40ec070 con 0x5581637714d0 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f0590ff9640 1 -- 172.21.15.80:0/3895180674 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f05a40dc640 con 0x5581637714d0 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05b6672740 10 client.16785 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05b6672740 10 client.16785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05b6672740 20 client.16785 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05b6672740 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558163758f60 0x558163b57480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05b6672740 4 client.16785 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558163aae990 con 0x558163758f60 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05acd59640 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558163758f60 0x558163b57480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f0590ff9640 10 client.16785 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.489+0000 7f05acd59640 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558163758f60 0x558163b57480 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5787f7a5e108e85e server_cookie=ba2c084bd8fc1620 in_seq=0 out_seq=0 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f0590ff9640 1 -- 172.21.15.80:0/3895180674 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558163aae990 con 0x558163758f60 2024-04-25T11:29:41.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f0590ff9640 10 client.16785 handle_command_reply: tid=0 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 client.16785 shutdown 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 msgr2=0x558163b45590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b45590 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f05a40dc470 tx=0x7f05a4010c00 comp rx=0 tx=0).stop 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 shutdown_connections 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558163758f60 0x558163b57480 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55816379a390 0x558163b51460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 0x558163b45ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f0590ff9640 0 client.16785 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 --2- 172.21.15.80:0/3895180674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b45590 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 >> 172.21.15.80:0/3895180674 conn(0x55816378e4e0 msgr2=0x558163b3c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 shutdown_connections 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 1 -- 172.21.15.80:0/3895180674 wait complete. 2024-04-25T11:29:41.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.490+0000 7f05b6672740 20 client.16785 trim_cache size 0 max 16384 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 Processor -- start 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 -- start start 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558163758f60 0x558163b44230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b369d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 0x558163b36f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81b2230 con 0x5581637714d0 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81afb00 con 0x558163758f60 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05b6672740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81ad950 con 0x5581637796b0 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.508+0000 7f05acd59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b369d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57648/0 (socket says 172.21.15.80:57648) 2024-04-25T11:29:41.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 -- 172.21.15.80:0/665611720 learned_addr learned my addr 172.21.15.80:0/665611720 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 -- 172.21.15.80:0/665611720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 msgr2=0x558163b36f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 --2- 172.21.15.80:0/665611720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 0x558163b36f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 -- 172.21.15.80:0/665611720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558163758f60 msgr2=0x558163b44230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 --2- 172.21.15.80:0/665611720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558163758f60 0x558163b44230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 -- 172.21.15.80:0/665611720 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581637720f0 con 0x5581637714d0 2024-04-25T11:29:41.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f05acd59640 1 --2- 172.21.15.80:0/665611720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b369d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0598000c00 tx=0x7f0598005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac38f9637018bf1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f0592ffd640 1 -- 172.21.15.80:0/665611720 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059801f630 con 0x5581637714d0 2024-04-25T11:29:41.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f0592ffd640 1 -- 172.21.15.80:0/665611720 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0598023070 con 0x5581637714d0 2024-04-25T11:29:41.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.509+0000 7f0592ffd640 1 -- 172.21.15.80:0/665611720 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598011e20 con 0x5581637714d0 2024-04-25T11:29:41.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 -- 172.21.15.80:0/665611720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 msgr2=0x558163b369d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 --2- 172.21.15.80:0/665611720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b369d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0598000c00 tx=0x7f0598005f90 comp rx=0 tx=0).stop 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 -- 172.21.15.80:0/665611720 shutdown_connections 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 --2- 172.21.15.80:0/665611720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637714d0 0x558163b369d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 --2- 172.21.15.80:0/665611720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5581637796b0 0x558163b36f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 --2- 172.21.15.80:0/665611720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558163758f60 0x558163b44230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 -- 172.21.15.80:0/665611720 >> 172.21.15.80:0/665611720 conn(0x55816378e4e0 msgr2=0x558163b43b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 -- 172.21.15.80:0/665611720 shutdown_connections 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 -- 172.21.15.80:0/665611720 wait complete. 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 -- start start 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.510+0000 7f05b6672740 1 Processor -- start 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05b6672740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558163758f60 0x558163b5a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05b6672740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637714d0 0x558163b57a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05b6672740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637796b0 0x558163b57f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05b6672740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81adfc0 con 0x5581637796b0 2024-04-25T11:29:41.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05b6672740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81af430 con 0x5581637714d0 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05b6672740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81ae690 con 0x558163758f60 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05b6672740 10 client.0 _ll_register_callbacks cb 0x7f0598009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637796b0 0x558163b57f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637796b0 0x558163b57f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57654/0 (socket says 172.21.15.80:57654) 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 -- 172.21.15.80:0/2940686006 learned_addr learned my addr 172.21.15.80:0/2940686006 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05acd59640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637714d0 0x558163b57a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558163758f60 0x558163b5a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 -- 172.21.15.80:0/2940686006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558163758f60 msgr2=0x558163b5a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558163758f60 0x558163b5a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 -- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637714d0 msgr2=0x558163b57a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637714d0 0x558163b57a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 -- 172.21.15.80:0/2940686006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558163a614b0 con 0x5581637796b0 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558163758f60 0x558163b5a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05acd59640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637714d0 0x558163b57a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:41.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f05add5b640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637796b0 0x558163b57f70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009ca0 tx=0x7f05a002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976cc6876f0b2089 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f0590ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f0590ff9640 1 -- 172.21.15.80:0/2940686006 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0058060 con 0x5581637796b0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.511+0000 7f0590ff9640 1 -- 172.21.15.80:0/2940686006 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f05a0004250 con 0x5581637796b0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0598023070 con 0x5581637796b0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f0590ff9640 1 -- 172.21.15.80:0/2940686006 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f05a00318e0 con 0x5581637796b0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 10 client.16791 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558163bbef90 con 0x5581637796b0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f0590ff9640 1 -- 172.21.15.80:0/2940686006 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0598023070 con 0x5581637796b0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f0590ff9640 1 -- 172.21.15.80:0/2940686006 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f05a002fcf0 con 0x5581637796b0 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 10 client.16791 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 20 client.16791 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55816379a390 0x558163bc17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 4 client.16791 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558163aa8800 con 0x55816379a390 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.512+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55816379a390 0x558163bc17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05ad55a640 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55816379a390 0x558163bc17b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2268558155ea60e1 server_cookie=22c4f866d80ce817 in_seq=0 out_seq=0 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f0590ff9640 10 client.16791 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f0590ff9640 1 -- 172.21.15.80:0/2940686006 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558163aa8800 con 0x55816379a390 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f0590ff9640 10 client.16791 handle_command_reply: tid=0 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 client.16791 shutdown 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637796b0 msgr2=0x558163b57f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637796b0 0x558163b57f70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009ca0 tx=0x7f05a002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 shutdown_connections 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55816379a390 0x558163bc17b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5581637796b0 0x558163b57f70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581637714d0 0x558163b57a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f0590ff9640 0 client.16791 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 --2- 172.21.15.80:0/2940686006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558163758f60 0x558163b5a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 >> 172.21.15.80:0/2940686006 conn(0x55816378e4e0 msgr2=0x558163b47150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 shutdown_connections 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 1 -- 172.21.15.80:0/2940686006 wait complete. 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.513+0000 7f05b6672740 20 client.16791 trim_cache size 0 max 16384 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:29:41.511 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:29:41.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05940afc60 msgr2=0x7f05940b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05940afc60 0x7f05940b2170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x558163b37bd0 tx=0x7f05a0005d80 comp rx=0 tx=0).stop 2024-04-25T11:29:41.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a81033c0 msgr2=0x7f05a819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a81033c0 0x7f05a819a6d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f05a400d770 tx=0x7f05a400dc30 comp rx=0 tx=0).stop 2024-04-25T11:29:41.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 shutdown_connections 2024-04-25T11:29:41.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05940afc60 0x7f05940b2170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a8107d00 0x7f05a819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a8107280 0x7f05a819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 --2- 172.21.15.80:0/2731708889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a81033c0 0x7f05a819a6d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 >> 172.21.15.80:0/2731708889 conn(0x7f05a8077920 msgr2=0x7f05a8101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 shutdown_connections 2024-04-25T11:29:41.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.514+0000 7f05af7be640 1 -- 172.21.15.80:0/2731708889 wait complete. 2024-04-25T11:29:41.515 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:29:41.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:29:41.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 -- 172.21.15.80:0/2011003422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4102b60 msgr2=0x7fa4d4102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2011003422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4102b60 0x7fa4d4102f70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009900 tx=0x7fa4c802a410 comp rx=0 tx=0).stop 2024-04-25T11:29:41.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 -- 172.21.15.80:0/2011003422 shutdown_connections 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2011003422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4102b60 0x7fa4d4102f70 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2011003422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d410d3a0 0x7fa4d410f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2011003422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d4108a40 0x7fa4d4102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 -- 172.21.15.80:0/2011003422 >> 172.21.15.80:0/2011003422 conn(0x7fa4d40fe260 msgr2=0x7fa4d4100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 -- 172.21.15.80:0/2011003422 shutdown_connections 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.632+0000 7fa4d9746640 1 -- 172.21.15.80:0/2011003422 wait complete. 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 Processor -- start 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 -- start start 2024-04-25T11:29:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d4102b60 0x7fa4d419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4108a40 0x7fa4d419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d410d3a0 0x7fa4d419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4112c00 con 0x7fa4d4108a40 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4112a80 con 0x7fa4d410d3a0 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d9746640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4112d80 con 0x7fa4d4102b60 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d27fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4108a40 0x7fa4d419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d27fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4108a40 0x7fa4d419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57678/0 (socket says 172.21.15.80:57678) 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d27fc640 1 -- 172.21.15.80:0/2371710420 learned_addr learned my addr 172.21.15.80:0/2371710420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d2ffd640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d4102b60 0x7fa4d419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d37fe640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d410d3a0 0x7fa4d419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d27fc640 1 -- 172.21.15.80:0/2371710420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d4102b60 msgr2=0x7fa4d419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d27fc640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d4102b60 0x7fa4d419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d27fc640 1 -- 172.21.15.80:0/2371710420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d410d3a0 msgr2=0x7fa4d419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.633+0000 7fa4d27fc640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d410d3a0 0x7fa4d419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.634+0000 7fa4d27fc640 1 -- 172.21.15.80:0/2371710420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d419f570 con 0x7fa4d4108a40 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.634+0000 7fa4d27fc640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4108a40 0x7fa4d419ac70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa4c802a930 tx=0x7fa4c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.634+0000 7fa4bbfff640 1 -- 172.21.15.80:0/2371710420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c803f030 con 0x7fa4d4108a40 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.634+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d419f800 con 0x7fa4d4108a40 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.634+0000 7fa4bbfff640 1 -- 172.21.15.80:0/2371710420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c8003aa0 con 0x7fa4d4108a40 2024-04-25T11:29:41.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.634+0000 7fa4bbfff640 1 -- 172.21.15.80:0/2371710420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8035070 con 0x7fa4d4108a40 2024-04-25T11:29:41.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.634+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d419fd40 con 0x7fa4d4108a40 2024-04-25T11:29:41.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.635+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d406a190 con 0x7fa4d4108a40 2024-04-25T11:29:41.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.636+0000 7fa4bbfff640 1 -- 172.21.15.80:0/2371710420 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fa4c8042030 con 0x7fa4d4108a40 2024-04-25T11:29:41.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.637+0000 7fa4bbfff640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa4bc0afc60 0x7fa4bc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.637+0000 7fa4d2ffd640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa4bc0afc60 0x7fa4bc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.637+0000 7fa4bbfff640 1 -- 172.21.15.80:0/2371710420 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fa4c80ffa40 con 0x7fa4d4108a40 2024-04-25T11:29:41.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.638+0000 7fa4d2ffd640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa4bc0afc60 0x7fa4bc0b2170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc005c40 tx=0x7fa4cc00a570 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.641+0000 7fa4bbfff640 1 -- 172.21.15.80:0/2371710420 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa4c80c7ca0 con 0x7fa4d4108a40 2024-04-25T11:29:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.854+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4d41a7240 con 0x7fa4d4108a40 2024-04-25T11:29:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.855+0000 7fa4bbfff640 1 -- 172.21.15.80:0/2371710420 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7fa4c80cbfa0 con 0x7fa4d4108a40 2024-04-25T11:29:41.845 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:29:41.845 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:29:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:29:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa4bc0afc60 msgr2=0x7fa4bc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa4bc0afc60 0x7fa4bc0b2170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc005c40 tx=0x7fa4cc00a570 comp rx=0 tx=0).stop 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4108a40 msgr2=0x7fa4d419ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4108a40 0x7fa4d419ac70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa4c802a930 tx=0x7fa4c8004270 comp rx=0 tx=0).stop 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 shutdown_connections 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa4bc0afc60 0x7fa4bc0b2170 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d4108a40 0x7fa4d419ac70 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d410d3a0 0x7fa4d419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 --2- 172.21.15.80:0/2371710420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d4102b60 0x7fa4d419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.857+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 >> 172.21.15.80:0/2371710420 conn(0x7fa4d40fe260 msgr2=0x7fa4d4074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.858+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 shutdown_connections 2024-04-25T11:29:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.858+0000 7fa4d9746640 1 -- 172.21.15.80:0/2371710420 wait complete. 2024-04-25T11:29:41.859 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 -- 172.21.15.80:0/3785428445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010b6d0 msgr2=0x7f510010daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 --2- 172.21.15.80:0/3785428445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010b6d0 0x7f510010daf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009900 tx=0x7f50e802a410 comp rx=0 tx=0).stop 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 -- 172.21.15.80:0/3785428445 shutdown_connections 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 --2- 172.21.15.80:0/3785428445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010b6d0 0x7f510010daf0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 --2- 172.21.15.80:0/3785428445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510010e0c0 0x7f51001105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 --2- 172.21.15.80:0/3785428445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5100104c70 0x7f5100105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 -- 172.21.15.80:0/3785428445 >> 172.21.15.80:0/3785428445 conn(0x7f5100078110 msgr2=0x7f5100078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 -- 172.21.15.80:0/3785428445 shutdown_connections 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 -- 172.21.15.80:0/3785428445 wait complete. 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 Processor -- start 2024-04-25T11:29:41.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.980+0000 7f5105d14640 1 -- start start 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f5105d14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5100104c70 0x7f510019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f5105d14640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f510010b6d0 0x7f510019ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f5105d14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010e0c0 0x7f510019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f5105d14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5100113ce0 con 0x7f510010e0c0 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f5105d14640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5100113b60 con 0x7f5100104c70 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f5105d14640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5100113e60 con 0x7f510010b6d0 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010e0c0 0x7f510019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010e0c0 0x7f510019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57710/0 (socket says 172.21.15.80:57710) 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 -- 172.21.15.80:0/2303358752 learned_addr learned my addr 172.21.15.80:0/2303358752 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5100104c70 0x7f510019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f510010b6d0 0x7f510019ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 -- 172.21.15.80:0/2303358752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f510010b6d0 msgr2=0x7f510019ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f510010b6d0 0x7f510019ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 -- 172.21.15.80:0/2303358752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5100104c70 msgr2=0x7f510019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5100104c70 0x7f510019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 -- 172.21.15.80:0/2303358752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510019f600 con 0x7f510010e0c0 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fffff640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010e0c0 0x7f510019efc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009fd0 tx=0x7f50f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.981+0000 7f50fd7fa640 1 -- 172.21.15.80:0/2303358752 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8017070 con 0x7f510010e0c0 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.982+0000 7f50fd7fa640 1 -- 172.21.15.80:0/2303358752 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f8003e20 con 0x7f510010e0c0 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.982+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510019f8f0 con 0x7f510010e0c0 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.982+0000 7f50fd7fa640 1 -- 172.21.15.80:0/2303358752 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8010460 con 0x7f510010e0c0 2024-04-25T11:29:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.982+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510019fdc0 con 0x7f510010e0c0 2024-04-25T11:29:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 Processor -- start 2024-04-25T11:29:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f50fd7fa640 1 -- 172.21.15.80:0/2303358752 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f50f8003970 con 0x7f510010e0c0 2024-04-25T11:29:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 -- start start 2024-04-25T11:29:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd45a390 0x555ecd7fb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd7fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd8086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555ecd760d80 con 0x555ecd4314d0 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ecd71aa20 con 0x555ecd4396b0 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f510cbc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555ecd75cd40 con 0x555ecd45a390 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f50ff7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd7fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f50ff7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd7fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57720/0 (socket says 172.21.15.80:57720) 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f50ff7fe640 1 -- 172.21.15.80:0/3375387667 learned_addr learned my addr 172.21.15.80:0/3375387667 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f50f7fff640 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd8086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.984+0000 7f50fd7fa640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f50ec0afc60 0x7f50ec0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50f7fff640 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd45a390 0x555ecd7fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50fffff640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f50ec0afc60 0x7f50ec0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50ff7fe640 1 -- 172.21.15.80:0/3375387667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd45a390 msgr2=0x555ecd7fb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd45a390 0x555ecd7fb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50ff7fe640 1 -- 172.21.15.80:0/3375387667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 msgr2=0x555ecd8086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd8086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50ff7fe640 1 -- 172.21.15.80:0/3375387667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ecd725c30 con 0x555ecd4314d0 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50fd7fa640 1 -- 172.21.15.80:0/2303358752 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f50f80dedf0 con 0x7f510010e0c0 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd7fbd50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009c90 tx=0x7f50f00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a989177c28cdecf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50fffff640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f50ec0afc60 0x7f50ec0b2170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50f80dcb50 tx=0x7f50f809b890 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50f5ffb640 1 -- 172.21.15.80:0/3375387667 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0012450 con 0x555ecd4314d0 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50f5ffb640 1 -- 172.21.15.80:0/3375387667 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f0012aa0 con 0x555ecd4314d0 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.985+0000 7f50f5ffb640 1 -- 172.21.15.80:0/3375387667 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f000fa40 con 0x555ecd4314d0 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 -- 172.21.15.80:0/3375387667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 msgr2=0x555ecd7fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd7fbd50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009c90 tx=0x7f50f00117b0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 -- 172.21.15.80:0/3375387667 shutdown_connections 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd7fbd50 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd8086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 --2- 172.21.15.80:0/3375387667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd45a390 0x555ecd7fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 -- 172.21.15.80:0/3375387667 >> 172.21.15.80:0/3375387667 conn(0x555ecd44e4e0 msgr2=0x555ecd7f7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 -- 172.21.15.80:0/3375387667 shutdown_connections 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 -- 172.21.15.80:0/3375387667 wait complete. 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.986+0000 7f510cbc8740 1 -- start start 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 1 Processor -- start 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd806240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4396b0 0x555ecd806780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd45a390 0x555ecd812210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555ecd808d90 con 0x555ecd4314d0 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ecd6e7dc0 con 0x555ecd45a390 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555ecd808f10 con 0x555ecd4396b0 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f510cbc8740 10 client.0 _ll_register_callbacks cb 0x555ecd703600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd806240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd806240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57728/0 (socket says 172.21.15.80:57728) 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 -- 172.21.15.80:0/2936553474 learned_addr learned my addr 172.21.15.80:0/2936553474 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 -- 172.21.15.80:0/2936553474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4396b0 msgr2=0x555ecd806780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4396b0 0x555ecd806780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 -- 172.21.15.80:0/2936553474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd45a390 msgr2=0x555ecd812210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd45a390 0x555ecd812210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 -- 172.21.15.80:0/2936553474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ecd4723f0 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd806240 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f510006c590 tx=0x7f50e8032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec99ccc798430cff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.987+0000 7f50deffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f50deffd640 1 -- 172.21.15.80:0/2936553474 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8035040 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f50deffd640 1 -- 172.21.15.80:0/2936553474 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f50e8004100 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50f0012aa0 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f50deffd640 1 -- 172.21.15.80:0/2936553474 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f50e8004300 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 10 client.16809 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ecd53c7d0 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f50deffd640 1 -- 172.21.15.80:0/2936553474 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f0012aa0 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f50deffd640 1 -- 172.21.15.80:0/2936553474 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f50e803a040 con 0x555ecd4314d0 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 10 client.16809 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 10 client.16809 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:29:41.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 20 client.16809 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd418f60 0x555ecd818690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 4 client.16809 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ecd76e990 con 0x555ecd418f60 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.988+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd418f60 0x555ecd818690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.989+0000 7f50deffd640 10 client.16809 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.989+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd418f60 0x555ecd818690 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=112b0faf7f79aa7e server_cookie=8580442539f4f62d in_seq=0 out_seq=0 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f50deffd640 1 -- 172.21.15.80:0/2936553474 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555ecd76e990 con 0x555ecd418f60 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f50deffd640 10 client.16809 handle_command_reply: tid=0 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 client.16809 shutdown 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 msgr2=0x555ecd806240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd806240 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f510006c590 tx=0x7f50e8032bb0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 shutdown_connections 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd418f60 0x555ecd818690 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd45a390 0x555ecd812210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4396b0 0x555ecd806780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f50deffd640 0 client.16809 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2936553474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd4314d0 0x555ecd806240 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 >> 172.21.15.80:0/2936553474 conn(0x555ecd44e4e0 msgr2=0x555ecd7fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 shutdown_connections 2024-04-25T11:29:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 1 -- 172.21.15.80:0/2936553474 wait complete. 2024-04-25T11:29:41.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:41.990+0000 7f510cbc8740 20 client.16809 trim_cache size 0 max 16384 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.003+0000 7f510cbc8740 1 Processor -- start 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f510cbc8740 1 -- start start 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd811e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd7fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd81de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f510cbc8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f51001b22d0 con 0x555ecd45a390 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f510cbc8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51001afba0 con 0x555ecd4396b0 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f510cbc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f51001ad9f0 con 0x555ecd4314d0 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd81de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd81de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57730/0 (socket says 172.21.15.80:57730) 2024-04-25T11:29:41.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 -- 172.21.15.80:0/1235827186 learned_addr learned my addr 172.21.15.80:0/1235827186 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd811e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 -- 172.21.15.80:0/1235827186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 msgr2=0x555ecd811e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd811e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 -- 172.21.15.80:0/1235827186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 msgr2=0x555ecd7fdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd7fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd7fdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 -- 172.21.15.80:0/1235827186 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ecd7fd040 con 0x555ecd45a390 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd7fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd81de50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x555ecd7fb340 tx=0x7f50e8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acc1ba0b123bcae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.004+0000 7f50f57fa640 1 -- 172.21.15.80:0/1235827186 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8035070 con 0x555ecd45a390 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f50f57fa640 1 -- 172.21.15.80:0/1235827186 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e803d7d0 con 0x555ecd45a390 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f50f57fa640 1 -- 172.21.15.80:0/1235827186 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8003d00 con 0x555ecd45a390 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 -- 172.21.15.80:0/1235827186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 msgr2=0x555ecd81de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd81de50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x555ecd7fb340 tx=0x7f50e8031400 comp rx=0 tx=0).stop 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 -- 172.21.15.80:0/1235827186 shutdown_connections 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd81de50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd7fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 --2- 172.21.15.80:0/1235827186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd811e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 -- 172.21.15.80:0/1235827186 >> 172.21.15.80:0/1235827186 conn(0x555ecd44e4e0 msgr2=0x555ecd7fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 -- 172.21.15.80:0/1235827186 shutdown_connections 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.005+0000 7f510cbc8740 1 -- 172.21.15.80:0/1235827186 wait complete. 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 -- start start 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 Processor -- start 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd80e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd809aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd809fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f51001ae060 con 0x555ecd45a390 2024-04-25T11:29:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51001af4d0 con 0x555ecd4396b0 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f51001ae730 con 0x555ecd4314d0 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f510cbc8740 10 client.0 _ll_register_callbacks cb 0x7f50e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd809fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd809fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57734/0 (socket says 172.21.15.80:57734) 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 -- 172.21.15.80:0/2026441598 learned_addr learned my addr 172.21.15.80:0/2026441598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd80e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd809aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 -- 172.21.15.80:0/2026441598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 msgr2=0x555ecd80e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd80e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 -- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 msgr2=0x555ecd809aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd809aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.006+0000 7f50f7fff640 1 -- 172.21.15.80:0/2026441598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ecd80a6f0 con 0x555ecd45a390 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f50f7fff640 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd809fe0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f50e8003940 tx=0x7f50e80039a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a432957d59768a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f50deffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f50deffd640 1 -- 172.21.15.80:0/2026441598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8035030 con 0x555ecd45a390 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f50deffd640 1 -- 172.21.15.80:0/2026441598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f50e8031cc0 con 0x555ecd45a390 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e803d7d0 con 0x555ecd45a390 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f50deffd640 1 -- 172.21.15.80:0/2026441598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f50e8003dd0 con 0x555ecd45a390 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 10 client.16815 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ecd880830 con 0x555ecd45a390 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f50deffd640 1 -- 172.21.15.80:0/2026441598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e803d7d0 con 0x555ecd45a390 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f50deffd640 1 -- 172.21.15.80:0/2026441598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f50e80594a0 con 0x555ecd45a390 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 10 client.16815 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 10 client.16815 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 20 client.16815 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd3ee3a0 0x555ecd882f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 4 client.16815 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.007+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ecd768800 con 0x555ecd3ee3a0 2024-04-25T11:29:42.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd3ee3a0 0x555ecd882f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f50deffd640 10 client.16815 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f50ff7fe640 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd3ee3a0 0x555ecd882f20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3fd37ab1aaeb5239 server_cookie=6558411874d40ac8 in_seq=0 out_seq=0 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f50deffd640 1 -- 172.21.15.80:0/2026441598 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ecd768800 con 0x555ecd3ee3a0 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f50deffd640 10 client.16815 handle_command_reply: tid=0 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 client.16815 shutdown 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 msgr2=0x555ecd809fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd809fe0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f50e8003940 tx=0x7f50e80039a0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 shutdown_connections 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x555ecd3ee3a0 0x555ecd882f20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555ecd45a390 0x555ecd809fe0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ecd4396b0 0x555ecd809aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f50deffd640 0 client.16815 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 --2- 172.21.15.80:0/2026441598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555ecd4314d0 0x555ecd80e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.008+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 >> 172.21.15.80:0/2026441598 conn(0x555ecd44e4e0 msgr2=0x555ecd7fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 shutdown_connections 2024-04-25T11:29:42.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f510cbc8740 1 -- 172.21.15.80:0/2026441598 wait complete. 2024-04-25T11:29:42.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f510cbc8740 20 client.16815 trim_cache size 0 max 16384 2024-04-25T11:29:42.005 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f50ec0afc60 msgr2=0x7f50ec0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f50ec0afc60 0x7f50ec0b2170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50f80dcb50 tx=0x7f50f809b890 comp rx=0 tx=0).stop 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010e0c0 msgr2=0x7f510019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010e0c0 0x7f510019efc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009fd0 tx=0x7f50f800b260 comp rx=0 tx=0).stop 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 shutdown_connections 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f50ec0afc60 0x7f50ec0b2170 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f510010e0c0 0x7f510019efc0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f510010b6d0 0x7f510019ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 --2- 172.21.15.80:0/2303358752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5100104c70 0x7f510019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 >> 172.21.15.80:0/2303358752 conn(0x7f5100078110 msgr2=0x7f5100101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 shutdown_connections 2024-04-25T11:29:42.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.009+0000 7f5105d14640 1 -- 172.21.15.80:0/2303358752 wait complete. 2024-04-25T11:29:42.010 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 -- 172.21.15.80:0/4239909218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 msgr2=0x7fd85410dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 --2- 172.21.15.80:0/4239909218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85410dab0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd848009900 tx=0x7fd84802a410 comp rx=0 tx=0).stop 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 -- 172.21.15.80:0/4239909218 shutdown_connections 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 --2- 172.21.15.80:0/4239909218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85410dab0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 --2- 172.21.15.80:0/4239909218 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd85410e080 0x7fd854110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 --2- 172.21.15.80:0/4239909218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd854104c30 0x7fd854105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 -- 172.21.15.80:0/4239909218 >> 172.21.15.80:0/4239909218 conn(0x7fd854078110 msgr2=0x7fd854078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 -- 172.21.15.80:0/4239909218 shutdown_connections 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.130+0000 7fd859796640 1 -- 172.21.15.80:0/4239909218 wait complete. 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.131+0000 7fd859796640 1 Processor -- start 2024-04-25T11:29:42.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.131+0000 7fd859796640 1 -- start start 2024-04-25T11:29:42.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd854104c30 0x7fd85419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85419acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd85410e080 0x7fd85419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd854113ce0 con 0x7fd85410b690 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd854113b60 con 0x7fd854104c30 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd854113e60 con 0x7fd85410e080 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85419acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85419acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57750/0 (socket says 172.21.15.80:57750) 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 -- 172.21.15.80:0/3553862575 learned_addr learned my addr 172.21.15.80:0/3553862575 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd852ffd640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd854104c30 0x7fd85419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8537fe640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd85410e080 0x7fd85419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 -- 172.21.15.80:0/3553862575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd85410e080 msgr2=0x7fd85419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd85410e080 0x7fd85419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 -- 172.21.15.80:0/3553862575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd854104c30 msgr2=0x7fd85419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd854104c30 0x7fd85419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 -- 172.21.15.80:0/3553862575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85419f5c0 con 0x7fd85410b690 2024-04-25T11:29:42.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd8527fc640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85419acc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd848005940 tx=0x7fd8480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd83bfff640 1 -- 172.21.15.80:0/3553862575 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84803f030 con 0x7fd85410b690 2024-04-25T11:29:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd83bfff640 1 -- 172.21.15.80:0/3553862575 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd848003cb0 con 0x7fd85410b690 2024-04-25T11:29:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85419f850 con 0x7fd85410b690 2024-04-25T11:29:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd83bfff640 1 -- 172.21.15.80:0/3553862575 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848035070 con 0x7fd85410b690 2024-04-25T11:29:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.132+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85419fd40 con 0x7fd85410b690 2024-04-25T11:29:42.125 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:41 smithi080 ceph-mon[29126]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:42.125 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:41 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2371710420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.135+0000 7fd860649740 1 Processor -- start 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.135+0000 7fd83bfff640 1 -- 172.21.15.80:0/3553862575 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fd848042030 con 0x7fd85410b690 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.135+0000 7fd860649740 1 -- start start 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd860649740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd860649740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd860649740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd860649740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x563dacad3d80 con 0x563dac7a44d0 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd860649740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563daca8da20 con 0x563dac7ac6b0 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd860649740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563dacacfd40 con 0x563dac7cd390 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb6ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57766/0 (socket says 172.21.15.80:57766) 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 -- 172.21.15.80:0/1372174848 learned_addr learned my addr 172.21.15.80:0/1372174848 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd8527fc640 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd8537fe640 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd83bfff640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd83c0afc60 0x7fd83c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 -- 172.21.15.80:0/1372174848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 msgr2=0x563dacb6e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 -- 172.21.15.80:0/1372174848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 msgr2=0x563dacb7b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 -- 172.21.15.80:0/1372174848 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563daca98c30 con 0x563dac7a44d0 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd8537fe640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd83c0afc60 0x7fd83c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd8527fc640 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd83bfff640 1 -- 172.21.15.80:0/3553862575 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd8480ff580 con 0x7fd85410b690 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.136+0000 7fd852ffd640 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb6ed50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8440039f0 tx=0x7fd844003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecd913e18bf58d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.137+0000 7fd8397fa640 1 -- 172.21.15.80:0/1372174848 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844004b20 con 0x563dac7a44d0 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.137+0000 7fd8397fa640 1 -- 172.21.15.80:0/1372174848 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd844004cc0 con 0x563dac7a44d0 2024-04-25T11:29:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.137+0000 7fd8397fa640 1 -- 172.21.15.80:0/1372174848 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8440126b0 con 0x563dac7a44d0 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.137+0000 7fd8537fe640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd83c0afc60 0x7fd83c0b2170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd84c005fd0 tx=0x7fd84c0046c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- 172.21.15.80:0/1372174848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 msgr2=0x563dacb6ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb6ed50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8440039f0 tx=0x7fd844003eb0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- 172.21.15.80:0/1372174848 shutdown_connections 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb6ed50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 --2- 172.21.15.80:0/1372174848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- 172.21.15.80:0/1372174848 >> 172.21.15.80:0/1372174848 conn(0x563dac7c14e0 msgr2=0x563dacb6afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- 172.21.15.80:0/1372174848 shutdown_connections 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- 172.21.15.80:0/1372174848 wait complete. 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- start start 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 Processor -- start 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb79270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb797b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb85210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x563dacb7bd90 con 0x563dac7a44d0 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563daca5adc0 con 0x563dac7ac6b0 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563dacb7bf10 con 0x563dac7cd390 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd860649740 10 client.0 _ll_register_callbacks cb 0x563daca76600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb79270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb79270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57768/0 (socket says 172.21.15.80:57768) 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.138+0000 7fd852ffd640 1 -- 172.21.15.80:0/1282753858 learned_addr learned my addr 172.21.15.80:0/1282753858 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd8537fe640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb85210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd8527fc640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb797b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd852ffd640 1 -- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 msgr2=0x563dacb85210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd852ffd640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb85210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd852ffd640 1 -- 172.21.15.80:0/1282753858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 msgr2=0x563dacb797b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd852ffd640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb797b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd852ffd640 1 -- 172.21.15.80:0/1282753858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dac7e53f0 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd8537fe640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb85210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd8527fc640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb797b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd852ffd640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb79270 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd844005b40 tx=0x7fd844005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f081bd3f695bfbb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd836ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd836ff5640 1 -- 172.21.15.80:0/1282753858 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844005280 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd836ff5640 1 -- 172.21.15.80:0/1282753858 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd844005420 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd844004cc0 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd836ff5640 1 -- 172.21.15.80:0/1282753858 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd844005620 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd860649740 10 client.16827 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563dac8af7d0 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd836ff5640 1 -- 172.21.15.80:0/1282753858 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd844004cc0 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.139+0000 7fd836ff5640 1 -- 172.21.15.80:0/1282753858 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd84400f040 con 0x563dac7a44d0 2024-04-25T11:29:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd860649740 10 client.16827 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd860649740 10 client.16827 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd860649740 20 client.16827 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd860649740 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac78bf60 0x563dacb8b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd860649740 4 client.16827 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dacae1990 con 0x563dac78bf60 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd8527fc640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac78bf60 0x563dacb8b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd836ff5640 10 client.16827 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.140+0000 7fd8527fc640 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac78bf60 0x563dacb8b590 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f043b8a41b1876a server_cookie=3bcc7c9c6ce0db60 in_seq=0 out_seq=0 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd836ff5640 1 -- 172.21.15.80:0/1282753858 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563dacae1990 con 0x563dac78bf60 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd836ff5640 10 client.16827 handle_command_reply: tid=0 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 client.16827 shutdown 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 msgr2=0x563dacb79270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb79270 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd844005b40 tx=0x7fd844005bd0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 shutdown_connections 2024-04-25T11:29:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac78bf60 0x563dacb8b590 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb85210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd836ff5640 0 client.16827 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb797b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 --2- 172.21.15.80:0/1282753858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7a44d0 0x563dacb79270 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 >> 172.21.15.80:0/1282753858 conn(0x563dac7c14e0 msgr2=0x563dacb70530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 shutdown_connections 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 1 -- 172.21.15.80:0/1282753858 wait complete. 2024-04-25T11:29:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.141+0000 7fd860649740 20 client.16827 trim_cache size 0 max 16384 2024-04-25T11:29:42.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 Processor -- start 2024-04-25T11:29:42.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 -- start start 2024-04-25T11:29:42.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7a44d0 0x563dacb84e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7ac6b0 0x563dacb69d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541b2310 con 0x563dac7ac6b0 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541afbe0 con 0x563dac7a44d0 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd860649740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541ada30 con 0x563dac7cd390 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd8527fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7ac6b0 0x563dacb69d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd8527fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7ac6b0 0x563dacb69d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57778/0 (socket says 172.21.15.80:57778) 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd8527fc640 1 -- 172.21.15.80:0/4089229641 learned_addr learned my addr 172.21.15.80:0/4089229641 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd852ffd640 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7a44d0 0x563dacb84e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd8537fe640 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd8527fc640 1 -- 172.21.15.80:0/4089229641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 msgr2=0x563dacb6a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.155+0000 7fd8527fc640 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd8527fc640 1 -- 172.21.15.80:0/4089229641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7a44d0 msgr2=0x563dacb84e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd8527fc640 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7a44d0 0x563dacb84e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd8527fc640 1 -- 172.21.15.80:0/4089229641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dacb6e5a0 con 0x563dac7ac6b0 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd8527fc640 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7ac6b0 0x563dacb69d20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd8480c49a0 tx=0x7fd848101b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18cf022d1a2caf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd838ff9640 1 -- 172.21.15.80:0/4089229641 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848049050 con 0x563dac7ac6b0 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd838ff9640 1 -- 172.21.15.80:0/4089229641 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8480c7240 con 0x563dac7ac6b0 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd838ff9640 1 -- 172.21.15.80:0/4089229641 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8480cee60 con 0x563dac7ac6b0 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd860649740 1 -- 172.21.15.80:0/4089229641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7ac6b0 msgr2=0x563dacb69d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd860649740 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7ac6b0 0x563dacb69d20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd8480c49a0 tx=0x7fd848101b00 comp rx=0 tx=0).stop 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd860649740 1 -- 172.21.15.80:0/4089229641 shutdown_connections 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd860649740 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7ac6b0 0x563dacb69d20 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd860649740 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7cd390 0x563dacb6a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd860649740 1 --2- 172.21.15.80:0/4089229641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7a44d0 0x563dacb84e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.156+0000 7fd860649740 1 -- 172.21.15.80:0/4089229641 >> 172.21.15.80:0/4089229641 conn(0x563dac7c14e0 msgr2=0x563dacb69610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 -- 172.21.15.80:0/4089229641 shutdown_connections 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 -- 172.21.15.80:0/4089229641 wait complete. 2024-04-25T11:29:42.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 -- start start 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 Processor -- start 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7a44d0 0x563dacb7c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7cd390 0x563dacb7cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541ae0a0 con 0x563dac7cd390 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541af510 con 0x563dac7ac6b0 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541ae770 con 0x563dac7a44d0 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd860649740 10 client.0 _ll_register_callbacks cb 0x7fd848105060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7cd390 0x563dacb7cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7cd390 0x563dacb7cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57788/0 (socket says 172.21.15.80:57788) 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd8537fe640 1 -- 172.21.15.80:0/751664790 learned_addr learned my addr 172.21.15.80:0/751664790 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd852ffd640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7a44d0 0x563dacb7c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.157+0000 7fd8527fc640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd8537fe640 1 -- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7a44d0 msgr2=0x563dacb7c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd8537fe640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7a44d0 0x563dacb7c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd8537fe640 1 -- 172.21.15.80:0/751664790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 msgr2=0x563dacb7c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd8537fe640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd8537fe640 1 -- 172.21.15.80:0/751664790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dacbf1920 con 0x563dac7cd390 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd8527fc640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd8537fe640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7cd390 0x563dacb7cc30 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd84c01e400 tx=0x7fd84c005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f7a7d8d67e0907 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd836ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd836ff5640 1 -- 172.21.15.80:0/751664790 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c01b650 con 0x563dac7cd390 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd836ff5640 1 -- 172.21.15.80:0/751664790 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fd84c01b7f0 con 0x563dac7cd390 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8480c7240 con 0x563dac7cd390 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd836ff5640 1 -- 172.21.15.80:0/751664790 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd84c01b9f0 con 0x563dac7cd390 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd860649740 10 client.16833 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563dacbf2c00 con 0x563dac7cd390 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd836ff5640 1 -- 172.21.15.80:0/751664790 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8480c7240 con 0x563dac7cd390 2024-04-25T11:29:42.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.158+0000 7fd836ff5640 1 -- 172.21.15.80:0/751664790 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd84c0303f0 con 0x563dac7cd390 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd860649740 10 client.16833 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd860649740 10 client.16833 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd860649740 20 client.16833 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd860649740 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac7613a0 0x563dacbf5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd860649740 4 client.16833 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563dacadb800 con 0x563dac7613a0 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd852ffd640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac7613a0 0x563dacbf5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd836ff5640 10 client.16833 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd852ffd640 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac7613a0 0x563dacbf5440 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=105fbd8439a7a69a server_cookie=e5d5200aff04a211 in_seq=0 out_seq=0 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd836ff5640 1 -- 172.21.15.80:0/751664790 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563dacadb800 con 0x563dac7613a0 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd836ff5640 10 client.16833 handle_command_reply: tid=0 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.159+0000 7fd860649740 1 client.16833 shutdown 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7cd390 msgr2=0x563dacb7cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7cd390 0x563dacb7cc30 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd84c01e400 tx=0x7fd84c005f00 comp rx=0 tx=0).stop 2024-04-25T11:29:42.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 shutdown_connections 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563dac7cd390 0x563dacb7cc30 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x563dac7613a0 0x563dacbf5440 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dac7ac6b0 0x563dacb7c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 --2- 172.21.15.80:0/751664790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dac7a44d0 0x563dacb7c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd836ff5640 0 client.16833 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 >> 172.21.15.80:0/751664790 conn(0x563dac7c14e0 msgr2=0x563dacb6a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 shutdown_connections 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 1 -- 172.21.15.80:0/751664790 wait complete. 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd860649740 20 client.16833 trim_cache size 0 max 16384 2024-04-25T11:29:42.156 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:29:42.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd83c0afc60 msgr2=0x7fd83c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd83c0afc60 0x7fd83c0b2170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd84c005fd0 tx=0x7fd84c0046c0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 msgr2=0x7fd85419acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85419acc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd848005940 tx=0x7fd8480042f0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 shutdown_connections 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd83c0afc60 0x7fd83c0b2170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd85410b690 0x7fd85419acc0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd85410e080 0x7fd85419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 --2- 172.21.15.80:0/3553862575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd854104c30 0x7fd85419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 >> 172.21.15.80:0/3553862575 conn(0x7fd854078110 msgr2=0x7fd854101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 shutdown_connections 2024-04-25T11:29:42.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.160+0000 7fd859796640 1 -- 172.21.15.80:0/3553862575 wait complete. 2024-04-25T11:29:42.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:29:42.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:41 smithi082 ceph-mon[32440]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:42.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:41 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2371710420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.280+0000 7f2bd9a96640 1 -- 172.21.15.80:0/4170478542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd41027c0 msgr2=0x7f2bd4110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.280+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/4170478542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd41027c0 0x7f2bd4110610 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009ca0 tx=0x7f2bcc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.280+0000 7f2bd9a96640 1 -- 172.21.15.80:0/4170478542 shutdown_connections 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.280+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/4170478542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd41027c0 0x7f2bd4110610 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.280+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/4170478542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bd4109fc0 0x7f2bd4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.280+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/4170478542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bd4109b20 0x7f2bd4101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.280+0000 7f2bd9a96640 1 -- 172.21.15.80:0/4170478542 >> 172.21.15.80:0/4170478542 conn(0x7f2bd4077880 msgr2=0x7f2bd4077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.281+0000 7f2bd9a96640 1 -- 172.21.15.80:0/4170478542 shutdown_connections 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.281+0000 7f2bd9a96640 1 -- 172.21.15.80:0/4170478542 wait complete. 2024-04-25T11:29:42.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.281+0000 7f2bd9a96640 1 Processor -- start 2024-04-25T11:29:42.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.281+0000 7f2bd9a96640 1 -- start start 2024-04-25T11:29:42.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd9a96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bd41027c0 0x7f2bd419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd9a96640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bd4109b20 0x7f2bd419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd9a96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd4109fc0 0x7f2bd419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd9a96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4113ce0 con 0x7f2bd4109fc0 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd9a96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4113b60 con 0x7f2bd41027c0 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd9a96640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4113e60 con 0x7f2bd4109b20 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd4109fc0 0x7f2bd419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd4109fc0 0x7f2bd419ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57810/0 (socket says 172.21.15.80:57810) 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 -- 172.21.15.80:0/742379209 learned_addr learned my addr 172.21.15.80:0/742379209 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bd41027c0 0x7f2bd419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bd4109b20 0x7f2bd419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 -- 172.21.15.80:0/742379209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bd4109b20 msgr2=0x7f2bd419aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bd4109b20 0x7f2bd419aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 -- 172.21.15.80:0/742379209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bd41027c0 msgr2=0x7f2bd419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bd41027c0 0x7f2bd419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 -- 172.21.15.80:0/742379209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd419f5a0 con 0x7f2bd4109fc0 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bd4109b20 0x7f2bd419aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd3fff640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd4109fc0 0x7f2bd419ef60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009430 tx=0x7f2bcc0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd0ff9640 1 -- 172.21.15.80:0/742379209 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc003b70 con 0x7f2bd4109fc0 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd0ff9640 1 -- 172.21.15.80:0/742379209 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bcc003d10 con 0x7f2bd4109fc0 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd0ff9640 1 -- 172.21.15.80:0/742379209 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc02fb20 con 0x7f2bd4109fc0 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.282+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd419f830 con 0x7f2bd4109fc0 2024-04-25T11:29:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.283+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd419fd80 con 0x7f2bd4109fc0 2024-04-25T11:29:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.285+0000 7f2be0a26740 1 Processor -- start 2024-04-25T11:29:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd0ff9640 1 -- 172.21.15.80:0/742379209 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f2bcc004580 con 0x7f2bd4109fc0 2024-04-25T11:29:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2be0a26740 1 -- start start 2024-04-25T11:29:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c54f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c54f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c55066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2be0a26740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3c545ed80 con 0x55c3c51376b0 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2be0a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3c5418a20 con 0x55c3c512f4d0 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2be0a26740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c3c545ad40 con 0x55c3c5158390 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c55066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c55066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57814/0 (socket says 172.21.15.80:57814) 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/788235083 learned_addr learned my addr 172.21.15.80:0/788235083 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c54f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c54f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd0ff9640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2bbc0afc60 0x7f2bbc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/788235083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 msgr2=0x55c3c54f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c54f9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/788235083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 msgr2=0x55c3c54f9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c54f9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/788235083 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c5423c30 con 0x55c3c51376b0 2024-04-25T11:29:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c54f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.286+0000 7f2bd3fff640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2bbc0afc60 0x7f2bbc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.287+0000 7f2bd0ff9640 1 -- 172.21.15.80:0/742379209 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f2bcc100370 con 0x7f2bd4109fc0 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.287+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c55066a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8013960 tx=0x7f2bc800c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d20d6e7599c347 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.287+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/788235083 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8004220 con 0x55c3c51376b0 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.287+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/788235083 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bc80043c0 con 0x55c3c51376b0 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.287+0000 7f2bb9ffb640 1 -- 172.21.15.80:0/788235083 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8003a20 con 0x55c3c51376b0 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 -- 172.21.15.80:0/788235083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 msgr2=0x55c3c55066a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2bd3fff640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2bbc0afc60 0x7f2bbc0b2170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0fdc90 tx=0x7f2bcc02a8c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c55066a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8013960 tx=0x7f2bc800c6b0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 -- 172.21.15.80:0/788235083 shutdown_connections 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c55066a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c54f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 --2- 172.21.15.80:0/788235083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c54f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 -- 172.21.15.80:0/788235083 >> 172.21.15.80:0/788235083 conn(0x55c3c514c4e0 msgr2=0x55c3c54f5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 -- 172.21.15.80:0/788235083 shutdown_connections 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 -- 172.21.15.80:0/788235083 wait complete. 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 -- start start 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.288+0000 7f2be0a26740 1 Processor -- start 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c55042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c55047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c5510210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3c5506d90 con 0x55c3c512f4d0 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3c53e5dc0 con 0x55c3c51376b0 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c3c5506f10 con 0x55c3c5158390 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 10 client.0 _ll_register_callbacks cb 0x55c3c5401600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c55042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c55042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57830/0 (socket says 172.21.15.80:57830) 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/3315683013 learned_addr learned my addr 172.21.15.80:0/3315683013 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c5510210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c55047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/3315683013 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 msgr2=0x55c3c5510210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c5510210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 msgr2=0x55c3c55047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c55047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/3315683013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3c51703f0 con 0x55c3c512f4d0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c55042b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8005890 tx=0x7f2bc8003720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bec0498d898dce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/3315683013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8003800 con 0x55c3c512f4d0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/3315683013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f2bc80039a0 con 0x55c3c512f4d0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.289+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bc80043c0 con 0x55c3c512f4d0 2024-04-25T11:29:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/3315683013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2bc8034050 con 0x55c3c512f4d0 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 10 client.16845 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c3c523a7d0 con 0x55c3c512f4d0 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/3315683013 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bc80043c0 con 0x55c3c512f4d0 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/3315683013 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2bc802c020 con 0x55c3c512f4d0 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 10 client.16845 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 20 client.16845 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c5116f60 0x55c3c5516590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 4 client.16845 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3c546c990 con 0x55c3c5116f60 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.290+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c5116f60 0x55c3c5516590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.291+0000 7f2bb2ffd640 10 client.16845 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.291+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c5116f60 0x55c3c5516590 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=200625e2e72a7f1e server_cookie=51edc6435b3134a6 in_seq=0 out_seq=0 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.291+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/3315683013 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c3c546c990 con 0x55c3c5116f60 2024-04-25T11:29:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.291+0000 7f2bb2ffd640 10 client.16845 handle_command_reply: tid=0 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.291+0000 7f2be0a26740 1 client.16845 shutdown 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 msgr2=0x55c3c55042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c55042b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8005890 tx=0x7f2bc8003720 comp rx=0 tx=0).stop 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 shutdown_connections 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c5116f60 0x55c3c5516590 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c5510210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c55047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2bb2ffd640 0 client.16845 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 --2- 172.21.15.80:0/3315683013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c55042b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 >> 172.21.15.80:0/3315683013 conn(0x55c3c514c4e0 msgr2=0x55c3c54fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 shutdown_connections 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 1 -- 172.21.15.80:0/3315683013 wait complete. 2024-04-25T11:29:42.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.292+0000 7f2be0a26740 20 client.16845 trim_cache size 0 max 16384 2024-04-25T11:29:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 Processor -- start 2024-04-25T11:29:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 -- start start 2024-04-25T11:29:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c5503320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c550fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c54fe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41b2240 con 0x55c3c512f4d0 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41afb10 con 0x55c3c51376b0 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2be0a26740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41ad960 con 0x55c3c5158390 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c5503320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c5503320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57844/0 (socket says 172.21.15.80:57844) 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/2148307667 learned_addr learned my addr 172.21.15.80:0/2148307667 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/2148307667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 msgr2=0x55c3c54fe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c54fe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/2148307667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 msgr2=0x55c3c550fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c550fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c550fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 -- 172.21.15.80:0/2148307667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c54f95a0 con 0x55c3c512f4d0 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.306+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c5503320 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80058c0 tx=0x7f2bc800c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2458cadbf5500a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2bb97fa640 1 -- 172.21.15.80:0/2148307667 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8005500 con 0x55c3c512f4d0 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2bb97fa640 1 -- 172.21.15.80:0/2148307667 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bc8029040 con 0x55c3c512f4d0 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2bb97fa640 1 -- 172.21.15.80:0/2148307667 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80048b0 con 0x55c3c512f4d0 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 -- 172.21.15.80:0/2148307667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 msgr2=0x55c3c5503320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c5503320 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80058c0 tx=0x7f2bc800c500 comp rx=0 tx=0).stop 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 -- 172.21.15.80:0/2148307667 shutdown_connections 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c54fe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c51376b0 0x55c3c550fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2148307667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c512f4d0 0x55c3c5503320 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 -- 172.21.15.80:0/2148307667 >> 172.21.15.80:0/2148307667 conn(0x55c3c514c4e0 msgr2=0x55c3c54f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 -- 172.21.15.80:0/2148307667 shutdown_connections 2024-04-25T11:29:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.307+0000 7f2be0a26740 1 -- 172.21.15.80:0/2148307667 wait complete. 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 -- start start 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 Processor -- start 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c550c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c550c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c55002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41adfd0 con 0x55c3c51376b0 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41af440 con 0x55c3c512f4d0 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41ae6a0 con 0x55c3c5158390 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2be0a26740 10 client.0 _ll_register_callbacks cb 0x7f2bc800ce20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2bd37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c550c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2bd37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c550c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57852/0 (socket says 172.21.15.80:57852) 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.308+0000 7f2bd37fe640 1 -- 172.21.15.80:0/2929088713 learned_addr learned my addr 172.21.15.80:0/2929088713 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c550c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c55002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd37fe640 1 -- 172.21.15.80:0/2929088713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 msgr2=0x55c3c55002d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c55002d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd37fe640 1 -- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 msgr2=0x55c3c550c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c550c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd37fe640 1 -- 172.21.15.80:0/2929088713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3c55020c0 con 0x55c3c51376b0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c55002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bd37fe640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c550c730 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x55c3c5516b60 tx=0x7f2bc4012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6964054ea91d48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/2929088713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4004250 con 0x55c3c51376b0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/2929088713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f2bc40043f0 con 0x55c3c51376b0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bc8029040 con 0x55c3c51376b0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/2929088713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2bc402f050 con 0x55c3c51376b0 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 10 client.16851 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:42.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c3c557ddc0 con 0x55c3c51376b0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/2929088713 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bc8029040 con 0x55c3c51376b0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/2929088713 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2bc4020250 con 0x55c3c51376b0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 10 client.16851 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 20 client.16851 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c50ec3a0 0x55c3c5580600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 4 client.16851 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.309+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3c5466800 con 0x55c3c50ec3a0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c50ec3a0 0x55c3c5580600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2bb2ffd640 10 client.16851 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2bd2ffd640 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c50ec3a0 0x55c3c5580600 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5f4fc2af5deb3db server_cookie=bd5a282c5ea131c8 in_seq=0 out_seq=0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2bb2ffd640 1 -- 172.21.15.80:0/2929088713 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3c5466800 con 0x55c3c50ec3a0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2bb2ffd640 10 client.16851 handle_command_reply: tid=0 2024-04-25T11:29:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2be0a26740 1 client.16851 shutdown 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 msgr2=0x55c3c550c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.310+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c550c730 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x55c3c5516b60 tx=0x7f2bc4012820 comp rx=0 tx=0).stop 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 shutdown_connections 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55c3c50ec3a0 0x55c3c5580600 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3c51376b0 0x55c3c550c730 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c3c5158390 0x55c3c55002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 --2- 172.21.15.80:0/2929088713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3c512f4d0 0x55c3c550c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bb2ffd640 0 client.16851 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 >> 172.21.15.80:0/2929088713 conn(0x55c3c514c4e0 msgr2=0x55c3c5503900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 shutdown_connections 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 1 -- 172.21.15.80:0/2929088713 wait complete. 2024-04-25T11:29:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2be0a26740 20 client.16851 trim_cache size 0 max 16384 2024-04-25T11:29:42.308 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:29:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2bbc0afc60 msgr2=0x7f2bbc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2bbc0afc60 0x7f2bbc0b2170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0fdc90 tx=0x7f2bcc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd4109fc0 msgr2=0x7f2bd419ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd4109fc0 0x7f2bd419ef60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009430 tx=0x7f2bcc0316f0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 shutdown_connections 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2bbc0afc60 0x7f2bbc0b2170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bd4109fc0 0x7f2bd419ef60 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bd4109b20 0x7f2bd419aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 --2- 172.21.15.80:0/742379209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bd41027c0 0x7f2bd419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 >> 172.21.15.80:0/742379209 conn(0x7f2bd4077880 msgr2=0x7f2bd4100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 shutdown_connections 2024-04-25T11:29:42.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:42.311+0000 7f2bd9a96640 1 -- 172.21.15.80:0/742379209 wait complete. 2024-04-25T11:29:42.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:41 smithi196 ceph-mon[32659]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:29:42.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:41 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2371710420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:29:43.313 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:29:43.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:29:43.313 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:29:43.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 -- 172.21.15.80:0/947676234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748109b10 msgr2=0x7ff7481036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/947676234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748109b10 0x7ff7481036b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff738009900 tx=0x7ff73802a410 comp rx=0 tx=0).stop 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 -- 172.21.15.80:0/947676234 shutdown_connections 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/947676234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff748104260 0x7ff748110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/947676234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff748109fb0 0x7ff748103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/947676234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748109b10 0x7ff7481036b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 -- 172.21.15.80:0/947676234 >> 172.21.15.80:0/947676234 conn(0x7ff7480ff210 msgr2=0x7ff748101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 -- 172.21.15.80:0/947676234 shutdown_connections 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.444+0000 7ff74e4bd640 1 -- 172.21.15.80:0/947676234 wait complete. 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 Processor -- start 2024-04-25T11:29:43.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 -- start start 2024-04-25T11:29:43.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748104260 0x7ff74819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff748109b10 0x7ff74819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff748109fb0 0x7ff74819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff748113d00 con 0x7ff748104260 2024-04-25T11:29:43.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff748113b80 con 0x7ff748109fb0 2024-04-25T11:29:43.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff74e4bd640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff748113e80 con 0x7ff748109b10 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff747fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748104260 0x7ff74819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.445+0000 7ff747fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748104260 0x7ff74819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57862/0 (socket says 172.21.15.80:57862) 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff747fff640 1 -- 172.21.15.80:0/800024389 learned_addr learned my addr 172.21.15.80:0/800024389 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff748109fb0 0x7ff74819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff7477fe640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff748109b10 0x7ff74819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff747fff640 1 -- 172.21.15.80:0/800024389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff748109b10 msgr2=0x7ff74819ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff747fff640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff748109b10 0x7ff74819ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff747fff640 1 -- 172.21.15.80:0/800024389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff748109fb0 msgr2=0x7ff74819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff747fff640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff748109fb0 0x7ff74819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff747fff640 1 -- 172.21.15.80:0/800024389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74819f600 con 0x7ff748104260 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff747fff640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748104260 0x7ff74819a7a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff738006010 tx=0x7ff738004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff7457fa640 1 -- 172.21.15.80:0/800024389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73803f030 con 0x7ff748104260 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff7457fa640 1 -- 172.21.15.80:0/800024389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff738003aa0 con 0x7ff748104260 2024-04-25T11:29:43.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74819f890 con 0x7ff748104260 2024-04-25T11:29:43.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff7457fa640 1 -- 172.21.15.80:0/800024389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738035070 con 0x7ff748104260 2024-04-25T11:29:43.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.446+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74819fd80 con 0x7ff748104260 2024-04-25T11:29:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff7457fa640 1 -- 172.21.15.80:0/800024389 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff738042030 con 0x7ff748104260 2024-04-25T11:29:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 Processor -- start 2024-04-25T11:29:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 -- start start 2024-04-25T11:29:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d3b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d3bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5599f8ca1b00 con 0x5599f899b410 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599f8c3d920 con 0x5599f897a730 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff755375740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5599f8c9dac0 con 0x5599f8972550 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d3b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d3b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57864/0 (socket says 172.21.15.80:57864) 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 -- 172.21.15.80:0/2671248211 learned_addr learned my addr 172.21.15.80:0/2671248211 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff7457fa640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff7300afc60 0x7ff7300b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff7477fe640 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff747fff640 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d3bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 -- 172.21.15.80:0/2671248211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 msgr2=0x5599f8d3bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d3bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 -- 172.21.15.80:0/2671248211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 msgr2=0x5599f8d3c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d3c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.449+0000 7ff74ca5a640 1 -- 172.21.15.80:0/2671248211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f8a7b7e0 con 0x5599f899b410 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.450+0000 7ff7477fe640 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d3c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.450+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff7300afc60 0x7ff7300b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.450+0000 7ff7457fa640 1 -- 172.21.15.80:0/800024389 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff7380ff3e0 con 0x7ff748104260 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.450+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d3b620 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff740003b10 tx=0x7ff740009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5f7a2c4f1fde2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.450+0000 7ff72e7fc640 1 -- 172.21.15.80:0/2671248211 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740024070 con 0x5599f899b410 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.450+0000 7ff72e7fc640 1 -- 172.21.15.80:0/2671248211 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff740010cb0 con 0x5599f899b410 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.450+0000 7ff72e7fc640 1 -- 172.21.15.80:0/2671248211 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74001ed30 con 0x5599f899b410 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 -- 172.21.15.80:0/2671248211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 msgr2=0x5599f8d3b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff7300afc60 0x7ff7300b2170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff740021000 tx=0x7ff74001e000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d3b620 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff740003b10 tx=0x7ff740009f90 comp rx=0 tx=0).stop 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 -- 172.21.15.80:0/2671248211 shutdown_connections 2024-04-25T11:29:43.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d3c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d3bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 --2- 172.21.15.80:0/2671248211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d3b620 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 -- 172.21.15.80:0/2671248211 >> 172.21.15.80:0/2671248211 conn(0x5599f898f560 msgr2=0x5599f8d37dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 -- 172.21.15.80:0/2671248211 shutdown_connections 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 -- 172.21.15.80:0/2671248211 wait complete. 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.451+0000 7ff755375740 1 -- start start 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 1 Processor -- start 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d45bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d46130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d51e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5599f8d48970 con 0x5599f899b410 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599f8c3b5d0 con 0x5599f897a730 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5599f8d48af0 con 0x5599f8972550 2024-04-25T11:29:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff755375740 10 client.0 _ll_register_callbacks cb 0x5599f8c29080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d51e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d51e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57868/0 (socket says 172.21.15.80:57868) 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3868651567 learned_addr learned my addr 172.21.15.80:0/3868651567 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff7477fe640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d46130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff747fff640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d45bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3868651567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 msgr2=0x5599f8d45bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d45bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 msgr2=0x5599f8d46130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d46130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3868651567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599f8adbf70 con 0x5599f899b410 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff747fff640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d45bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff7477fe640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d46130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d51e20 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff74001e9b0 tx=0x7ff74001e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f906807e4ff9cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.452+0000 7ff7277fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:43.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff7277fe640 1 -- 172.21.15.80:0/3868651567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740024070 con 0x5599f899b410 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff7277fe640 1 -- 172.21.15.80:0/3868651567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff74001eaf0 con 0x5599f899b410 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff740010cb0 con 0x5599f899b410 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff7277fe640 1 -- 172.21.15.80:0/3868651567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff740039050 con 0x5599f899b410 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 10 client.16863 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5599f8973170 con 0x5599f899b410 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff7277fe640 1 -- 172.21.15.80:0/3868651567 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff740010cb0 con 0x5599f899b410 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff7277fe640 1 -- 172.21.15.80:0/3868651567 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff740010800 con 0x5599f899b410 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 10 client.16863 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 20 client.16863 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f895a1f0 0x5599f8d57e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 4 client.16863 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.453+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599f8caf710 con 0x5599f895a1f0 2024-04-25T11:29:43.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.454+0000 7ff747fff640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f895a1f0 0x5599f8d57e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.454+0000 7ff7277fe640 10 client.16863 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.454+0000 7ff747fff640 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f895a1f0 0x5599f8d57e30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6676c9186a954e server_cookie=ce2b7bd2d8f227f6 in_seq=0 out_seq=0 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff7277fe640 1 -- 172.21.15.80:0/3868651567 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5599f8caf710 con 0x5599f895a1f0 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff7277fe640 10 client.16863 handle_command_reply: tid=0 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 client.16863 shutdown 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 msgr2=0x5599f8d51e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d51e20 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff74001e9b0 tx=0x7ff74001e6b0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 shutdown_connections 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f895a1f0 0x5599f8d57e30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f899b410 0x5599f8d51e20 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff7277fe640 0 client.16863 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f897a730 0x5599f8d46130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 --2- 172.21.15.80:0/3868651567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f8972550 0x5599f8d45bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 >> 172.21.15.80:0/3868651567 conn(0x5599f898f560 msgr2=0x5599f8d3b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 shutdown_connections 2024-04-25T11:29:43.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 1 -- 172.21.15.80:0/3868651567 wait complete. 2024-04-25T11:29:43.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.455+0000 7ff755375740 20 client.16863 trim_cache size 0 max 16384 2024-04-25T11:29:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 Processor -- start 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 -- start start 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f895a1f0 0x5599f8d36ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d3bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f897a730 0x5599f8d3c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481b2350 con 0x5599f895a1f0 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481afc20 con 0x5599f8972550 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff755375740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ada70 con 0x5599f897a730 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff747fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f895a1f0 0x5599f8d36ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff747fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f895a1f0 0x5599f8d36ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57870/0 (socket says 172.21.15.80:57870) 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.473+0000 7ff747fff640 1 -- 172.21.15.80:0/3170843814 learned_addr learned my addr 172.21.15.80:0/3170843814 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff747fff640 1 -- 172.21.15.80:0/3170843814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f897a730 msgr2=0x5599f8d3c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f897a730 0x5599f8d3c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff7477fe640 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d3bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff747fff640 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f897a730 0x5599f8d3c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff747fff640 1 -- 172.21.15.80:0/3170843814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 msgr2=0x5599f8d3bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff747fff640 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d3bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff747fff640 1 -- 172.21.15.80:0/3170843814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f8d489c0 con 0x5599f895a1f0 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f897a730 0x5599f8d3c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff7477fe640 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d3bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff747fff640 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f895a1f0 0x5599f8d36ef0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff7380c75d0 tx=0x7ff7381018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3db47c5b35b970 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff72dffb640 1 -- 172.21.15.80:0/3170843814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738049040 con 0x5599f895a1f0 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff72dffb640 1 -- 172.21.15.80:0/3170843814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7380c7640 con 0x5599f895a1f0 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.474+0000 7ff72dffb640 1 -- 172.21.15.80:0/3170843814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380c38d0 con 0x5599f895a1f0 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 -- 172.21.15.80:0/3170843814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f895a1f0 msgr2=0x5599f8d36ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f895a1f0 0x5599f8d36ef0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff7380c75d0 tx=0x7ff7381018f0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 -- 172.21.15.80:0/3170843814 shutdown_connections 2024-04-25T11:29:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f897a730 0x5599f8d3c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d3bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 --2- 172.21.15.80:0/3170843814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f895a1f0 0x5599f8d36ef0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 -- 172.21.15.80:0/3170843814 >> 172.21.15.80:0/3170843814 conn(0x5599f898f560 msgr2=0x5599f8d3b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 -- 172.21.15.80:0/3170843814 shutdown_connections 2024-04-25T11:29:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 -- 172.21.15.80:0/3170843814 wait complete. 2024-04-25T11:29:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 -- start start 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.475+0000 7ff755375740 1 Processor -- start 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f895a1f0 0x5599f8d58b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d59050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f897a730 0x5599f8d59590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ae0e0 con 0x5599f897a730 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481af550 con 0x5599f8972550 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ae7b0 con 0x5599f895a1f0 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 10 client.0 _ll_register_callbacks cb 0x7ff740009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:43.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f897a730 0x5599f8d59590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f897a730 0x5599f8d59590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57882/0 (socket says 172.21.15.80:57882) 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3522590757 learned_addr learned my addr 172.21.15.80:0/3522590757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff7477fe640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d59050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff747fff640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f895a1f0 0x5599f8d58b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3522590757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f895a1f0 msgr2=0x5599f8d58b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f895a1f0 0x5599f8d58b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 msgr2=0x5599f8d59050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d59050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 -- 172.21.15.80:0/3522590757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599f8dbefb0 con 0x5599f897a730 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff7477fe640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d59050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff74ca5a640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f897a730 0x5599f8d59590 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff740013770 tx=0x7ff740009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283f5c9c8eb58752 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff7277fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff7277fe640 1 -- 172.21.15.80:0/3522590757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740024040 con 0x5599f897a730 2024-04-25T11:29:43.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff7277fe640 1 -- 172.21.15.80:0/3522590757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff7400050f0 con 0x5599f897a730 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.476+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7380c7640 con 0x5599f897a730 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff7277fe640 1 -- 172.21.15.80:0/3522590757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff740010c80 con 0x5599f897a730 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 10 client.16869 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5599f8dc0130 con 0x5599f897a730 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff7277fe640 1 -- 172.21.15.80:0/3522590757 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7380c7640 con 0x5599f897a730 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff7277fe640 1 -- 172.21.15.80:0/3522590757 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff740004c50 con 0x5599f897a730 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 10 client.16869 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 20 client.16869 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f899b410 0x5599f8dc2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 4 client.16869 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5599f8ca9580 con 0x5599f899b410 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.477+0000 7ff747fff640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f899b410 0x5599f8dc2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.478+0000 7ff7277fe640 10 client.16869 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.478+0000 7ff747fff640 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f899b410 0x5599f8dc2920 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da5fe471b1a1cf71 server_cookie=5d418f8b81694714 in_seq=0 out_seq=0 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff7277fe640 1 -- 172.21.15.80:0/3522590757 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599f8ca9580 con 0x5599f899b410 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff7277fe640 10 client.16869 handle_command_reply: tid=0 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 client.16869 shutdown 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f897a730 msgr2=0x5599f8d59590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f897a730 0x5599f8d59590 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff740013770 tx=0x7ff740009330 comp rx=0 tx=0).stop 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 shutdown_connections 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5599f899b410 0x5599f8dc2920 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5599f897a730 0x5599f8d59590 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff7277fe640 0 client.16869 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599f8972550 0x5599f8d59050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 --2- 172.21.15.80:0/3522590757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5599f895a1f0 0x5599f8d58b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 >> 172.21.15.80:0/3522590757 conn(0x5599f898f560 msgr2=0x5599f8d3bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 shutdown_connections 2024-04-25T11:29:43.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 1 -- 172.21.15.80:0/3522590757 wait complete. 2024-04-25T11:29:43.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.479+0000 7ff755375740 20 client.16869 trim_cache size 0 max 16384 2024-04-25T11:29:43.476 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:29:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:29:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "ff5e3beb-8f95-4dcc-84c4-5bf34a0c741c", 2024-04-25T11:29:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:29:43.476 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:29:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff7300afc60 msgr2=0x7ff7300b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff7300afc60 0x7ff7300b2170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff740021000 tx=0x7ff74001e000 comp rx=0 tx=0).stop 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748104260 msgr2=0x7ff74819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748104260 0x7ff74819a7a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff738006010 tx=0x7ff738004060 comp rx=0 tx=0).stop 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 shutdown_connections 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff7300afc60 0x7ff7300b2170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff748109fb0 0x7ff74819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff748109b10 0x7ff74819ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 --2- 172.21.15.80:0/800024389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff748104260 0x7ff74819a7a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 >> 172.21.15.80:0/800024389 conn(0x7ff7480ff210 msgr2=0x7ff748101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 shutdown_connections 2024-04-25T11:29:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.480+0000 7ff74e4bd640 1 -- 172.21.15.80:0/800024389 wait complete. 2024-04-25T11:29:43.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:29:43.482 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 -- 172.21.15.80:0/1655356301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150102720 msgr2=0x7f4150110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 --2- 172.21.15.80:0/1655356301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150102720 0x7f4150110570 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4148009ca0 tx=0x7f414802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 -- 172.21.15.80:0/1655356301 shutdown_connections 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 --2- 172.21.15.80:0/1655356301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150102720 0x7f4150110570 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 --2- 172.21.15.80:0/1655356301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4150109f90 0x7f41501020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 --2- 172.21.15.80:0/1655356301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4150109af0 0x7f4150101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 -- 172.21.15.80:0/1655356301 >> 172.21.15.80:0/1655356301 conn(0x7f4150077880 msgr2=0x7f4150077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 -- 172.21.15.80:0/1655356301 shutdown_connections 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.600+0000 7f4155fb2640 1 -- 172.21.15.80:0/1655356301 wait complete. 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 Processor -- start 2024-04-25T11:29:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 -- start start 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4150102720 0x7f415019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150109af0 0x7f415019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4150109f90 0x7f415019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4150113ce0 con 0x7f4150109af0 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4150113b60 con 0x7f4150102720 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f4155fb2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4150113e60 con 0x7f4150109f90 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150109af0 0x7f415019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150109af0 0x7f415019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57906/0 (socket says 172.21.15.80:57906) 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 -- 172.21.15.80:0/3454507024 learned_addr learned my addr 172.21.15.80:0/3454507024 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414f7fe640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4150102720 0x7f415019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414ffff640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4150109f90 0x7f415019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 -- 172.21.15.80:0/3454507024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4150109f90 msgr2=0x7f415019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4150109f90 0x7f415019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 -- 172.21.15.80:0/3454507024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4150102720 msgr2=0x7f415019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4150102720 0x7f415019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414effd640 1 -- 172.21.15.80:0/3454507024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415019f4c0 con 0x7f4150109af0 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.601+0000 7f414ffff640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4150109f90 0x7f415019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.602+0000 7f414effd640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150109af0 0x7f415019abc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f414000d770 tx=0x7f414000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.602+0000 7f414cff9640 1 -- 172.21.15.80:0/3454507024 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140017070 con 0x7f4150109af0 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.602+0000 7f414cff9640 1 -- 172.21.15.80:0/3454507024 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4140009c30 con 0x7f4150109af0 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.602+0000 7f414cff9640 1 -- 172.21.15.80:0/3454507024 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414000f620 con 0x7f4150109af0 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.602+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415019f7b0 con 0x7f4150109af0 2024-04-25T11:29:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.602+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41501a7130 con 0x7f4150109af0 2024-04-25T11:29:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.604+0000 7f415ce63740 1 Processor -- start 2024-04-25T11:29:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.604+0000 7f415ce63740 1 -- start start 2024-04-25T11:29:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.604+0000 7f414cff9640 1 -- 172.21.15.80:0/3454507024 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f414001a070 con 0x7f4150109af0 2024-04-25T11:29:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f415ce63740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6abfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f415ce63740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66f64d0 0x559df6abffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f415ce63740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6acc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f415ce63740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559df6a25d80 con 0x559df66f64d0 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f415ce63740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559df69df8b0 con 0x559df671f390 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f415ce63740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559df6a21d40 con 0x559df66fe6b0 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66f64d0 0x559df6abffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66f64d0 0x559df6abffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57912/0 (socket says 172.21.15.80:57912) 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 -- 172.21.15.80:0/2858830379 learned_addr learned my addr 172.21.15.80:0/2858830379 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414effd640 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6acc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414ffff640 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6abfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 -- 172.21.15.80:0/2858830379 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 msgr2=0x559df6acc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6acc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 -- 172.21.15.80:0/2858830379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 msgr2=0x559df6abfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6abfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 -- 172.21.15.80:0/2858830379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559df69b0a40 con 0x559df66f64d0 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414ffff640 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6abfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414cff9640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41380afc60 0x7f41380b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414ffff640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41380afc60 0x7f41380b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414f7fe640 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66f64d0 0x559df6abffa0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f414400bd50 tx=0x7f41440107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4e01764d4fd655 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f414cff9640 1 -- 172.21.15.80:0/3454507024 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f41400dead0 con 0x7f4150109af0 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.605+0000 7f4135ffb640 1 -- 172.21.15.80:0/2858830379 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4144005220 con 0x559df66f64d0 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f4135ffb640 1 -- 172.21.15.80:0/2858830379 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f414400be40 con 0x559df66f64d0 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f4135ffb640 1 -- 172.21.15.80:0/2858830379 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4144011770 con 0x559df66f64d0 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 -- 172.21.15.80:0/2858830379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66f64d0 msgr2=0x559df6abffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66f64d0 0x559df6abffa0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f414400bd50 tx=0x7f41440107a0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f414ffff640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41380afc60 0x7f41380b2170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x559df6abcbd0 tx=0x7f4148009430 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 -- 172.21.15.80:0/2858830379 shutdown_connections 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66f64d0 0x559df6abffa0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6acc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 --2- 172.21.15.80:0/2858830379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6abfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 -- 172.21.15.80:0/2858830379 >> 172.21.15.80:0/2858830379 conn(0x559df67134e0 msgr2=0x559df6abc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 -- 172.21.15.80:0/2858830379 shutdown_connections 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.606+0000 7f415ce63740 1 -- 172.21.15.80:0/2858830379 wait complete. 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 -- start start 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 Processor -- start 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6aca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66fe6b0 0x559df6acaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6ad04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559df6accfe0 con 0x559df66fe6b0 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559df69acd10 con 0x559df671f390 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559df6acd160 con 0x559df66f64d0 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f415ce63740 10 client.0 _ll_register_callbacks cb 0x559df69d9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.607+0000 7f414effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66fe6b0 0x559df6acaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66fe6b0 0x559df6acaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57922/0 (socket says 172.21.15.80:57922) 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 -- 172.21.15.80:0/769718248 learned_addr learned my addr 172.21.15.80:0/769718248 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414f7fe640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6aca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414ffff640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6ad04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 -- 172.21.15.80:0/769718248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 msgr2=0x559df6aca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6aca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 -- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 msgr2=0x559df6ad04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6ad04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 -- 172.21.15.80:0/769718248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559df68017d0 con 0x559df66fe6b0 2024-04-25T11:29:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414ffff640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6ad04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f414effd640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66fe6b0 0x559df6acaba0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f41400a3ef0 tx=0x7f41400e2210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d31b78a4175ce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f412effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f412effd640 1 -- 172.21.15.80:0/769718248 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140021030 con 0x559df66fe6b0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f412effd640 1 -- 172.21.15.80:0/769718248 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f41400a60f0 con 0x559df66fe6b0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559df6a33990 con 0x559df66fe6b0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f412effd640 1 -- 172.21.15.80:0/769718248 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f41400a2b40 con 0x559df66fe6b0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f415ce63740 10 client.16881 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559df67373f0 con 0x559df66fe6b0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f412effd640 1 -- 172.21.15.80:0/769718248 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559df6a33990 con 0x559df66fe6b0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.608+0000 7f412effd640 1 -- 172.21.15.80:0/769718248 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f41400a5950 con 0x559df66fe6b0 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f415ce63740 10 client.16881 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f415ce63740 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f415ce63740 20 client.16881 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f415ce63740 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66ddf60 0x559df6adc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f415ce63740 4 client.16881 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559df6a2d800 con 0x559df66ddf60 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f414f7fe640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66ddf60 0x559df6adc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f412effd640 10 client.16881 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.609+0000 7f414f7fe640 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66ddf60 0x559df6adc6e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d25a82f11f40051 server_cookie=da33e44fa0d9e96 in_seq=0 out_seq=0 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f412effd640 1 -- 172.21.15.80:0/769718248 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559df6a2d800 con 0x559df66ddf60 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f412effd640 10 client.16881 handle_command_reply: tid=0 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 client.16881 shutdown 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66fe6b0 msgr2=0x559df6acaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66fe6b0 0x559df6acaba0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f41400a3ef0 tx=0x7f41400e2210 comp rx=0 tx=0).stop 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 shutdown_connections 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66ddf60 0x559df6adc6e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df66fe6b0 0x559df6acaba0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df671f390 0x559df6ad04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 --2- 172.21.15.80:0/769718248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6aca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f412effd640 0 client.16881 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 >> 172.21.15.80:0/769718248 conn(0x559df67134e0 msgr2=0x559df6ac1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 shutdown_connections 2024-04-25T11:29:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 1 -- 172.21.15.80:0/769718248 wait complete. 2024-04-25T11:29:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.610+0000 7f415ce63740 20 client.16881 trim_cache size 0 max 16384 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 Processor -- start 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 -- start start 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66f64d0 0x559df6ad0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6ac5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6acc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41501b22a0 con 0x559df671f390 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41501afb70 con 0x559df66f64d0 2024-04-25T11:29:43.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f415ce63740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41501ad9c0 con 0x559df66fe6b0 2024-04-25T11:29:43.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f414ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6acc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f414ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6acc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57932/0 (socket says 172.21.15.80:57932) 2024-04-25T11:29:43.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f414ffff640 1 -- 172.21.15.80:0/2102361991 learned_addr learned my addr 172.21.15.80:0/2102361991 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f414f7fe640 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66f64d0 0x559df6ad0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.628+0000 7f414effd640 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6ac5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f414ffff640 1 -- 172.21.15.80:0/2102361991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 msgr2=0x559df6ac5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f414ffff640 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6ac5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f414ffff640 1 -- 172.21.15.80:0/2102361991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66f64d0 msgr2=0x559df6ad0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f414ffff640 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66f64d0 0x559df6ad0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f414ffff640 1 -- 172.21.15.80:0/2102361991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559df66f70f0 con 0x559df671f390 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f414ffff640 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6acc480 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4148035000 tx=0x7f4148040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9b58e2c364399d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f41357fa640 1 -- 172.21.15.80:0/2102361991 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148003970 con 0x559df671f390 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f41357fa640 1 -- 172.21.15.80:0/2102361991 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4148036040 con 0x559df671f390 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.629+0000 7f41357fa640 1 -- 172.21.15.80:0/2102361991 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414802f660 con 0x559df671f390 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 -- 172.21.15.80:0/2102361991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 msgr2=0x559df6acc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6acc480 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4148035000 tx=0x7f4148040000 comp rx=0 tx=0).stop 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 -- 172.21.15.80:0/2102361991 shutdown_connections 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6acc480 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66fe6b0 0x559df6ac5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 --2- 172.21.15.80:0/2102361991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66f64d0 0x559df6ad0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 -- 172.21.15.80:0/2102361991 >> 172.21.15.80:0/2102361991 conn(0x559df67134e0 msgr2=0x559df6ac1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 -- 172.21.15.80:0/2102361991 shutdown_connections 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 -- 172.21.15.80:0/2102361991 wait complete. 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 -- start start 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.630+0000 7f415ce63740 1 Processor -- start 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6ad1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66fe6b0 0x559df6ad24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6b3ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41501ae030 con 0x559df671f390 2024-04-25T11:29:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41501af4a0 con 0x559df66fe6b0 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41501ae700 con 0x559df66f64d0 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 10 client.0 _ll_register_callbacks cb 0x7f414000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6b3ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6b3ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57934/0 (socket says 172.21.15.80:57934) 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 -- 172.21.15.80:0/672872308 learned_addr learned my addr 172.21.15.80:0/672872308 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414f7fe640 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6ad1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414effd640 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66fe6b0 0x559df6ad24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 -- 172.21.15.80:0/672872308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 msgr2=0x559df6ad1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6ad1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 -- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66fe6b0 msgr2=0x559df6ad24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66fe6b0 0x559df6ad24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 -- 172.21.15.80:0/672872308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559df69e64b0 con 0x559df671f390 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f414ffff640 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6b3ca80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4148006010 tx=0x7f4148009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a7b0583fb7acd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:29:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f412effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f412effd640 1 -- 172.21.15.80:0/672872308 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148059020 con 0x559df671f390 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f412effd640 1 -- 172.21.15.80:0/672872308 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f414802fc20 con 0x559df671f390 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4148036040 con 0x559df671f390 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f412effd640 1 -- 172.21.15.80:0/672872308 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4148064050 con 0x559df671f390 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 10 client.16887 fetch_fsmap learned FSMap version 24 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.631+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559df6b44160 con 0x559df671f390 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f412effd640 1 -- 172.21.15.80:0/672872308 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4148036040 con 0x559df671f390 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f412effd640 1 -- 172.21.15.80:0/672872308 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4148044040 con 0x559df671f390 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f415ce63740 10 client.16887 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f415ce63740 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f415ce63740 20 client.16887 populate_metadata read hostname 'smithi080' 2024-04-25T11:29:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f415ce63740 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66b33a0 0x559df6b468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f415ce63740 4 client.16887 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559df69a84a0 con 0x559df66b33a0 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.632+0000 7f414f7fe640 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66b33a0 0x559df6b468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f414f7fe640 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66b33a0 0x559df6b468b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc7af1fc6561fd9b server_cookie=c6fad2e4de6f4024 in_seq=0 out_seq=0 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f412effd640 10 client.16887 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f412effd640 1 -- 172.21.15.80:0/672872308 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559df69a84a0 con 0x559df66b33a0 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f412effd640 10 client.16887 handle_command_reply: tid=0 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 client.16887 shutdown 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 msgr2=0x559df6b3ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6b3ca80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4148006010 tx=0x7f4148009650 comp rx=0 tx=0).stop 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 shutdown_connections 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559df66b33a0 0x559df6b468b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559df671f390 0x559df6b3ca80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f412effd640 0 client.16887 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:29:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559df66fe6b0 0x559df6ad24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 --2- 172.21.15.80:0/672872308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559df66f64d0 0x559df6ad1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 >> 172.21.15.80:0/672872308 conn(0x559df67134e0 msgr2=0x559df6ac1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 shutdown_connections 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 1 -- 172.21.15.80:0/672872308 wait complete. 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.633+0000 7f415ce63740 20 client.16887 trim_cache size 0 max 16384 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "ff5e3beb-8f95-4dcc-84c4-5bf34a0c741c": { 2024-04-25T11:29:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:29:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "ff5e3beb-8f95-4dcc-84c4-5bf34a0c741c", 2024-04-25T11:29:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:29:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:29:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:29:43.633 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:29:43.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41380afc60 msgr2=0x7f41380b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41380afc60 0x7f41380b2170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x559df6abcbd0 tx=0x7f4148009430 comp rx=0 tx=0).stop 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150109af0 msgr2=0x7f415019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150109af0 0x7f415019abc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f414000d770 tx=0x7f414000dc30 comp rx=0 tx=0).stop 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 shutdown_connections 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f41380afc60 0x7f41380b2170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4150109af0 0x7f415019abc0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4150109f90 0x7f415019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 --2- 172.21.15.80:0/3454507024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4150102720 0x7f415019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 >> 172.21.15.80:0/3454507024 conn(0x7f4150077880 msgr2=0x7f41501006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 shutdown_connections 2024-04-25T11:29:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:29:43.634+0000 7f4155fb2640 1 -- 172.21.15.80:0/3454507024 wait complete. 2024-04-25T11:29:43.636 INFO:tasks.cephfs.filesystem:scrub status for tag:ff5e3beb-8f95-4dcc-84c4-5bf34a0c741c - {'path': '/', 'tag': 'ff5e3beb-8f95-4dcc-84c4-5bf34a0c741c', 'options': 'recursive,force'} 2024-04-25T11:29:44.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:43 smithi082 ceph-mon[32440]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:44.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:43 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:29:44.241 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:43 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:44.241 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:43 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:29:44.241 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:43 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:44.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:43 smithi080 ceph-mon[29126]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:44.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:43 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:29:44.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:43 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:44.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:43 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:29:44.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:43 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:44.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:43 smithi196 ceph-mon[32659]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:44.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:43 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:29:44.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:43 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:44.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:43 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:29:44.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:43 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:29:46.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:45 smithi082 ceph-mon[32440]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:46.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:45 smithi080 ceph-mon[29126]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:46.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:45 smithi196 ceph-mon[32659]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:29:48.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:47 smithi082 ceph-mon[32440]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:48.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:47 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:29:48.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:47 smithi080 ceph-mon[29126]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:48.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:47 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:29:48.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:47 smithi196 ceph-mon[32659]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:48.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:47 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:29:50.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:49 smithi082 ceph-mon[32440]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:50.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:49 smithi080 ceph-mon[29126]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:50.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:49 smithi196 ceph-mon[32659]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:52.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:51 smithi082 ceph-mon[32440]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:52.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:51 smithi080 ceph-mon[29126]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:52.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:51 smithi196 ceph-mon[32659]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:54.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:53 smithi082 ceph-mon[32440]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:54.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:53 smithi080 ceph-mon[29126]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:54.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:53 smithi196 ceph-mon[32659]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:56.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:55 smithi082 ceph-mon[32440]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:56.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:55 smithi080 ceph-mon[29126]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:56.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:55 smithi196 ceph-mon[32659]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:29:58.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:57 smithi082 ceph-mon[32440]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:58.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:57 smithi080 ceph-mon[29126]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:29:58.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:57 smithi196 ceph-mon[32659]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:30:00.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:29:59 smithi082 ceph-mon[32440]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:00.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:29:59 smithi080 ceph-mon[29126]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:00.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:29:59 smithi196 ceph-mon[32659]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:01.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:00 smithi082 ceph-mon[32440]: overall HEALTH_OK 2024-04-25T11:30:01.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:00 smithi080 ceph-mon[29126]: overall HEALTH_OK 2024-04-25T11:30:01.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:00 smithi196 ceph-mon[32659]: overall HEALTH_OK 2024-04-25T11:30:02.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:01 smithi082 ceph-mon[32440]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:30:02.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:01 smithi080 ceph-mon[29126]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:30:02.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:01 smithi196 ceph-mon[32659]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:30:04.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:04 smithi080 ceph-mon[29126]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-25T11:30:04.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:04 smithi196 ceph-mon[32659]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-25T11:30:04.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:04 smithi082 ceph-mon[32440]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-25T11:30:06.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:06 smithi080 ceph-mon[29126]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-25T11:30:06.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:06 smithi196 ceph-mon[32659]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-25T11:30:06.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:06 smithi082 ceph-mon[32440]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-25T11:30:08.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:08 smithi080 ceph-mon[29126]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:30:08.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:08 smithi196 ceph-mon[32659]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:30:08.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:08 smithi082 ceph-mon[32440]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:30:10.292 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:10 smithi082 ceph-mon[32440]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:30:10.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:10 smithi080 ceph-mon[29126]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:30:10.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:10 smithi196 ceph-mon[32659]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T11:30:12.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:12 smithi080 ceph-mon[29126]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:30:12.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:12 smithi196 ceph-mon[32659]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:30:12.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:12 smithi082 ceph-mon[32440]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T11:30:13.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:30:13.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:30:13.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 -- 172.21.15.80:0/523430663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1290104c80 msgr2=0x7f1290105090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 --2- 172.21.15.80:0/523430663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1290104c80 0x7f1290105090 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1280009900 tx=0x7f128002a480 comp rx=0 tx=0).stop 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 -- 172.21.15.80:0/523430663 shutdown_connections 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 --2- 172.21.15.80:0/523430663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129010e090 0x7f1290110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 --2- 172.21.15.80:0/523430663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f129010b6e0 0x7f129010db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 --2- 172.21.15.80:0/523430663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1290104c80 0x7f1290105090 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 -- 172.21.15.80:0/523430663 >> 172.21.15.80:0/523430663 conn(0x7f1290078180 msgr2=0x7f12900785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 -- 172.21.15.80:0/523430663 shutdown_connections 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.777+0000 7f1294aa8640 1 -- 172.21.15.80:0/523430663 wait complete. 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 Processor -- start 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 -- start start 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1290104c80 0x7f129019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f129010b6e0 0x7f129019acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f129010e090 0x7f129019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1290113cf0 con 0x7f129010e090 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1290113b70 con 0x7f1290104c80 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f1294aa8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1290113e70 con 0x7f129010b6e0 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f128ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f129010e090 0x7f129019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f128ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f129010e090 0x7f129019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45918/0 (socket says 172.21.15.80:45918) 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f128e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1290104c80 0x7f129019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f128ed9d640 1 -- 172.21.15.80:0/229193881 learned_addr learned my addr 172.21.15.80:0/229193881 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.778+0000 7f128dd9b640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f129010b6e0 0x7f129019acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f128ed9d640 1 -- 172.21.15.80:0/229193881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f129010b6e0 msgr2=0x7f129019acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f128ed9d640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f129010b6e0 0x7f129019acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f128ed9d640 1 -- 172.21.15.80:0/229193881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1290104c80 msgr2=0x7f129019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f128ed9d640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1290104c80 0x7f129019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f128ed9d640 1 -- 172.21.15.80:0/229193881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129019f5f0 con 0x7f129010e090 2024-04-25T11:30:13.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f128ed9d640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f129010e090 0x7f129019efb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1288009fd0 tx=0x7f128800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f127f7fe640 1 -- 172.21.15.80:0/229193881 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288017070 con 0x7f129010e090 2024-04-25T11:30:13.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129019f8e0 con 0x7f129010e090 2024-04-25T11:30:13.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f127f7fe640 1 -- 172.21.15.80:0/229193881 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1288003e20 con 0x7f129010e090 2024-04-25T11:30:13.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f127f7fe640 1 -- 172.21.15.80:0/229193881 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288010460 con 0x7f129010e090 2024-04-25T11:30:13.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.779+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129019fde0 con 0x7f129010e090 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.782+0000 7f129ba37740 1 Processor -- start 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.782+0000 7f127f7fe640 1 -- 172.21.15.80:0/229193881 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1288003970 con 0x7f129010e090 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.782+0000 7f129ba37740 1 -- start start 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f129ba37740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f129ba37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d313fe4d0 0x555d317c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f129ba37740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d314066b0 0x555d317d48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f129ba37740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555d3172dd80 con 0x555d314066b0 2024-04-25T11:30:13.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f129ba37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d316e78b0 con 0x555d313fe4d0 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f129ba37740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555d31729d40 con 0x555d31427390 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d314066b0 0x555d317d48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d314066b0 0x555d317d48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45924/0 (socket says 172.21.15.80:45924) 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 -- 172.21.15.80:0/2006025353 learned_addr learned my addr 172.21.15.80:0/2006025353 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f127f7fe640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f12780afc60 0x7f12780b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128e59c640 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d313fe4d0 0x555d317c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128ed9d640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f12780afc60 0x7f12780b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 -- 172.21.15.80:0/2006025353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 msgr2=0x555d317c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f127f7fe640 1 -- 172.21.15.80:0/229193881 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f12880decc0 con 0x7f129010e090 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 -- 172.21.15.80:0/2006025353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d313fe4d0 msgr2=0x555d317c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d313fe4d0 0x555d317c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 -- 172.21.15.80:0/2006025353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d316b8a40 con 0x555d314066b0 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128e59c640 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d313fe4d0 0x555d317c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.783+0000 7f128dd9b640 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d314066b0 0x555d317d48f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1284012770 tx=0x7f128400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21778ccfd9d9cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.784+0000 7f128ed9d640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f12780afc60 0x7f12780b2170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12880dca20 tx=0x7f12880154a0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.784+0000 7f127cff9640 1 -- 172.21.15.80:0/2006025353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284012cf0 con 0x555d314066b0 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.784+0000 7f127cff9640 1 -- 172.21.15.80:0/2006025353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1284005020 con 0x555d314066b0 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.784+0000 7f127cff9640 1 -- 172.21.15.80:0/2006025353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12840049c0 con 0x555d314066b0 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 -- 172.21.15.80:0/2006025353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d314066b0 msgr2=0x555d317d48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d314066b0 0x555d317d48f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1284012770 tx=0x7f128400b7c0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 -- 172.21.15.80:0/2006025353 shutdown_connections 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d314066b0 0x555d317d48f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d313fe4d0 0x555d317c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 --2- 172.21.15.80:0/2006025353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 -- 172.21.15.80:0/2006025353 >> 172.21.15.80:0/2006025353 conn(0x555d3141b4e0 msgr2=0x555d317c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 -- 172.21.15.80:0/2006025353 shutdown_connections 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 -- 172.21.15.80:0/2006025353 wait complete. 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 -- start start 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.785+0000 7f129ba37740 1 Processor -- start 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317de460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555d317d4fe0 con 0x555d313fe4d0 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d316b4d10 con 0x555d314066b0 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555d317d5160 con 0x555d31427390 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 10 client.0 _ll_register_callbacks cb 0x555d316e1210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45928/0 (socket says 172.21.15.80:45928) 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 -- 172.21.15.80:0/3498072717 learned_addr learned my addr 172.21.15.80:0/3498072717 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128e59c640 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 -- 172.21.15.80:0/3498072717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 msgr2=0x555d317de460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 -- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 msgr2=0x555d317d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 -- 172.21.15.80:0/3498072717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d315097d0 con 0x555d313fe4d0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f128dd9b640 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d25b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1284005c90 tx=0x7f128400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2abec501faa7a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f1275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f1275ffb640 1 -- 172.21.15.80:0/3498072717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284010970 con 0x555d313fe4d0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1284005020 con 0x555d313fe4d0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.786+0000 7f1275ffb640 1 -- 172.21.15.80:0/3498072717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f1284010b10 con 0x555d313fe4d0 2024-04-25T11:30:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f1275ffb640 1 -- 172.21.15.80:0/3498072717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1284031050 con 0x555d313fe4d0 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 10 client.16899 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d3143f3f0 con 0x555d313fe4d0 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f1275ffb640 1 -- 172.21.15.80:0/3498072717 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1284005020 con 0x555d313fe4d0 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f1275ffb640 1 -- 172.21.15.80:0/3498072717 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f128401f420 con 0x555d313fe4d0 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 10 client.16899 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 20 client.16899 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313e5f60 0x555d317e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 4 client.16899 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d3173b990 con 0x555d313e5f60 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.787+0000 7f128e59c640 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313e5f60 0x555d317e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.788+0000 7f1275ffb640 10 client.16899 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.788+0000 7f128e59c640 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313e5f60 0x555d317e44b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7b75bc7eefcb6b server_cookie=db95cf62a2710d59 in_seq=0 out_seq=0 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.788+0000 7f1275ffb640 1 -- 172.21.15.80:0/3498072717 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555d3173b990 con 0x555d313e5f60 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.788+0000 7f1275ffb640 10 client.16899 handle_command_reply: tid=0 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.788+0000 7f129ba37740 1 client.16899 shutdown 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 msgr2=0x555d317d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d25b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1284005c90 tx=0x7f128400b420 comp rx=0 tx=0).stop 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 shutdown_connections 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313e5f60 0x555d317e44b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317de460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 --2- 172.21.15.80:0/3498072717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d25b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 >> 172.21.15.80:0/3498072717 conn(0x555d3141b4e0 msgr2=0x555d317c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f1275ffb640 0 client.16899 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 shutdown_connections 2024-04-25T11:30:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 1 -- 172.21.15.80:0/3498072717 wait complete. 2024-04-25T11:30:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.789+0000 7f129ba37740 20 client.16899 trim_cache size 0 max 16384 2024-04-25T11:30:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.807+0000 7f129ba37740 1 Processor -- start 2024-04-25T11:30:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.807+0000 7f129ba37740 1 -- start start 2024-04-25T11:30:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.807+0000 7f129ba37740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d313fe4d0 0x555d317d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f129ba37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317e9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f129ba37740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d31427390 0x555d317e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f129ba37740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f12901b2320 con 0x555d31427390 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f129ba37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12901afbf0 con 0x555d314066b0 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f129ba37740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f12901ada40 con 0x555d313fe4d0 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d31427390 0x555d317e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d31427390 0x555d317e9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45936/0 (socket says 172.21.15.80:45936) 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 -- 172.21.15.80:0/3234899390 learned_addr learned my addr 172.21.15.80:0/3234899390 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128e59c640 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317e9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d313fe4d0 0x555d317d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 -- 172.21.15.80:0/3234899390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d313fe4d0 msgr2=0x555d317d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d313fe4d0 0x555d317d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 -- 172.21.15.80:0/3234899390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 msgr2=0x555d317e9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317e9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 -- 172.21.15.80:0/3234899390 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d313ff0f0 con 0x555d31427390 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128e59c640 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f128dd9b640 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d31427390 0x555d317e9ff0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1284000c00 tx=0x7f128400bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98415cc4755fc605 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f1277fff640 1 -- 172.21.15.80:0/3234899390 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128401f420 con 0x555d31427390 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f1277fff640 1 -- 172.21.15.80:0/3234899390 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1284016040 con 0x555d31427390 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.808+0000 7f1277fff640 1 -- 172.21.15.80:0/3234899390 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128402a410 con 0x555d31427390 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 -- 172.21.15.80:0/3234899390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d31427390 msgr2=0x555d317e9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d31427390 0x555d317e9ff0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1284000c00 tx=0x7f128400bba0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 -- 172.21.15.80:0/3234899390 shutdown_connections 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d31427390 0x555d317e9ff0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 --2- 172.21.15.80:0/3234899390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d313fe4d0 0x555d317d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 -- 172.21.15.80:0/3234899390 >> 172.21.15.80:0/3234899390 conn(0x555d3141b4e0 msgr2=0x555d317c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 -- 172.21.15.80:0/3234899390 shutdown_connections 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.809+0000 7f129ba37740 1 -- 172.21.15.80:0/3234899390 wait complete. 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 -- start start 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 Processor -- start 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f12901ae0b0 con 0x555d313fe4d0 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12901af520 con 0x555d314066b0 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f12901ae780 con 0x555d31427390 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f129ba37740 10 client.0 _ll_register_callbacks cb 0x7f128400be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45950/0 (socket says 172.21.15.80:45950) 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 -- 172.21.15.80:0/1154933680 learned_addr learned my addr 172.21.15.80:0/1154933680 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128e59c640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 -- 172.21.15.80:0/1154933680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 msgr2=0x555d317d5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317d5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 -- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 msgr2=0x555d317d5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128dd9b640 1 -- 172.21.15.80:0/1154933680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d316ee4b0 con 0x555d313fe4d0 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.810+0000 7f128e59c640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f128dd9b640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d5400 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1284013f80 tx=0x7f1284005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78be54744c3e4ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f1275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f1275ffb640 1 -- 172.21.15.80:0/1154933680 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12840122d0 con 0x555d313fe4d0 2024-04-25T11:30:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f1275ffb640 1 -- 172.21.15.80:0/1154933680 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f128401f420 con 0x555d313fe4d0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1284016040 con 0x555d313fe4d0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f1275ffb640 1 -- 172.21.15.80:0/1154933680 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f128401f620 con 0x555d313fe4d0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 10 client.16905 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d3184b4c0 con 0x555d313fe4d0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f1275ffb640 1 -- 172.21.15.80:0/1154933680 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1284016040 con 0x555d313fe4d0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f1275ffb640 1 -- 172.21.15.80:0/1154933680 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f128403d070 con 0x555d313fe4d0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 10 client.16905 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 20 client.16905 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313bb3a0 0x555d3184dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 4 client.16905 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555d31735800 con 0x555d313bb3a0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.811+0000 7f128e59c640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313bb3a0 0x555d3184dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f1275ffb640 10 client.16905 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f128e59c640 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313bb3a0 0x555d3184dbb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=189db85fd2f49f7 server_cookie=f29a236400ae31e4 in_seq=0 out_seq=0 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f1275ffb640 1 -- 172.21.15.80:0/1154933680 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555d31735800 con 0x555d313bb3a0 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f1275ffb640 10 client.16905 handle_command_reply: tid=0 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 client.16905 shutdown 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 msgr2=0x555d317d5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d5400 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1284013f80 tx=0x7f1284005c50 comp rx=0 tx=0).stop 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 shutdown_connections 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555d313bb3a0 0x555d3184dbb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555d31427390 0x555d317d5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d314066b0 0x555d317d5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 --2- 172.21.15.80:0/1154933680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555d313fe4d0 0x555d317d5400 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f1275ffb640 0 client.16905 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 >> 172.21.15.80:0/1154933680 conn(0x555d3141b4e0 msgr2=0x555d317d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 shutdown_connections 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 1 -- 172.21.15.80:0/1154933680 wait complete. 2024-04-25T11:30:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.812+0000 7f129ba37740 20 client.16905 trim_cache size 0 max 16384 2024-04-25T11:30:13.814 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:30:13.814 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:30:13.814 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:30:13.814 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f12780afc60 msgr2=0x7f12780b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f12780afc60 0x7f12780b2170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12880dca20 tx=0x7f12880154a0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f129010e090 msgr2=0x7f129019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f129010e090 0x7f129019efb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1288009fd0 tx=0x7f128800b260 comp rx=0 tx=0).stop 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 shutdown_connections 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f12780afc60 0x7f12780b2170 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f129010e090 0x7f129019efb0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f129010b6e0 0x7f129019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 --2- 172.21.15.80:0/229193881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1290104c80 0x7f129019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 >> 172.21.15.80:0/229193881 conn(0x7f1290078180 msgr2=0x7f12901011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 shutdown_connections 2024-04-25T11:30:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.813+0000 7f1294aa8640 1 -- 172.21.15.80:0/229193881 wait complete. 2024-04-25T11:30:13.817 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:30:13.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 -- 172.21.15.80:0/552785214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560109bb0 msgr2=0x7f2560101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 --2- 172.21.15.80:0/552785214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560109bb0 0x7f2560101b20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2550009900 tx=0x7f255002a410 comp rx=0 tx=0).stop 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 -- 172.21.15.80:0/552785214 shutdown_connections 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 --2- 172.21.15.80:0/552785214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f256010e560 0x7f2560110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 --2- 172.21.15.80:0/552785214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2560102060 0x7f2560102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 --2- 172.21.15.80:0/552785214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560109bb0 0x7f2560101b20 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 -- 172.21.15.80:0/552785214 >> 172.21.15.80:0/552785214 conn(0x7f25600fd850 msgr2=0x7f25600ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 -- 172.21.15.80:0/552785214 shutdown_connections 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.935+0000 7f2565c67640 1 -- 172.21.15.80:0/552785214 wait complete. 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 Processor -- start 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 -- start start 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560102060 0x7f256019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2560109bb0 0x7f256019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f256010e560 0x7f256019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113d20 con 0x7f2560102060 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113ba0 con 0x7f256010e560 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2565c67640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113ea0 con 0x7f2560109bb0 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f255f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560102060 0x7f256019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f255f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560102060 0x7f256019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45980/0 (socket says 172.21.15.80:45980) 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f255f7fe640 1 -- 172.21.15.80:0/1994308993 learned_addr learned my addr 172.21.15.80:0/1994308993 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f2557fff640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2560109bb0 0x7f256019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.936+0000 7f255ffff640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f256010e560 0x7f256019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255f7fe640 1 -- 172.21.15.80:0/1994308993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2560109bb0 msgr2=0x7f256019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255f7fe640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2560109bb0 0x7f256019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255f7fe640 1 -- 172.21.15.80:0/1994308993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f256010e560 msgr2=0x7f256019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255f7fe640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f256010e560 0x7f256019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255f7fe640 1 -- 172.21.15.80:0/1994308993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256019f580 con 0x7f2560102060 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f2557fff640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2560109bb0 0x7f256019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255f7fe640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560102060 0x7f256019a720 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f255002a930 tx=0x7f2550004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255d7fa640 1 -- 172.21.15.80:0/1994308993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255003f030 con 0x7f2560102060 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255d7fa640 1 -- 172.21.15.80:0/1994308993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2550003aa0 con 0x7f2560102060 2024-04-25T11:30:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256019f810 con 0x7f2560102060 2024-04-25T11:30:13.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f255d7fa640 1 -- 172.21.15.80:0/1994308993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550035070 con 0x7f2560102060 2024-04-25T11:30:13.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.937+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256019fd50 con 0x7f2560102060 2024-04-25T11:30:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.938+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256006a190 con 0x7f2560102060 2024-04-25T11:30:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.940+0000 7f255d7fa640 1 -- 172.21.15.80:0/1994308993 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f2550042030 con 0x7f2560102060 2024-04-25T11:30:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.940+0000 7f255d7fa640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f254c0afce0 0x7f254c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.941+0000 7f2557fff640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f254c0afce0 0x7f254c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.941+0000 7f255d7fa640 1 -- 172.21.15.80:0/1994308993 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f25500ffae0 con 0x7f2560102060 2024-04-25T11:30:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.941+0000 7f2557fff640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f254c0afce0 0x7f254c0b21f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2548005d00 tx=0x7f2548005c70 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:13.944+0000 7f255d7fa640 1 -- 172.21.15.80:0/1994308993 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f25500c8390 con 0x7f2560102060 2024-04-25T11:30:14.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.162+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f256019ba70 con 0x7f2560102060 2024-04-25T11:30:14.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.162+0000 7f255d7fa640 1 -- 172.21.15.80:0/1994308993 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f25500c7c90 con 0x7f2560102060 2024-04-25T11:30:14.153 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:30:14.153 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:30:14.153 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:30:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f254c0afce0 msgr2=0x7f254c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f254c0afce0 0x7f254c0b21f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2548005d00 tx=0x7f2548005c70 comp rx=0 tx=0).stop 2024-04-25T11:30:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560102060 msgr2=0x7f256019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560102060 0x7f256019a720 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f255002a930 tx=0x7f2550004270 comp rx=0 tx=0).stop 2024-04-25T11:30:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 shutdown_connections 2024-04-25T11:30:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f254c0afce0 0x7f254c0b21f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f256010e560 0x7f256019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2560109bb0 0x7f256019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 --2- 172.21.15.80:0/1994308993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2560102060 0x7f256019a720 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 >> 172.21.15.80:0/1994308993 conn(0x7f25600fd850 msgr2=0x7f25600fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 shutdown_connections 2024-04-25T11:30:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.164+0000 7f2565c67640 1 -- 172.21.15.80:0/1994308993 wait complete. 2024-04-25T11:30:14.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:30:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 -- 172.21.15.80:0/2650543679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 msgr2=0x7f43b0102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2650543679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0102f00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009ca0 tx=0x7f43a402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 -- 172.21.15.80:0/2650543679 shutdown_connections 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2650543679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0102f00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2650543679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43b010d380 0x7f43b010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2650543679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43b0108a20 0x7f43b01025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 -- 172.21.15.80:0/2650543679 >> 172.21.15.80:0/2650543679 conn(0x7f43b0078100 msgr2=0x7f43b0078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 -- 172.21.15.80:0/2650543679 shutdown_connections 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 -- 172.21.15.80:0/2650543679 wait complete. 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.286+0000 7f43b61b2640 1 Processor -- start 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43b61b2640 1 -- start start 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43b61b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43b61b2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43b0108a20 0x7f43b0199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43b61b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43b010d380 0x7f43b019de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43b61b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f43b0112be0 con 0x7f43b0102af0 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43b61b2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43b0112a60 con 0x7f43b010d380 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43b61b2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f43b0112d60 con 0x7f43b0108a20 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45998/0 (socket says 172.21.15.80:45998) 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 -- 172.21.15.80:0/2783112534 learned_addr learned my addr 172.21.15.80:0/2783112534 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43affff640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43b010d380 0x7f43b019de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43aeffd640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43b0108a20 0x7f43b0199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 -- 172.21.15.80:0/2783112534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43b0108a20 msgr2=0x7f43b0199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43b0108a20 0x7f43b0199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 -- 172.21.15.80:0/2783112534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43b010d380 msgr2=0x7f43b019de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43b010d380 0x7f43b019de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 -- 172.21.15.80:0/2783112534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b019e460 con 0x7f43b0102af0 2024-04-25T11:30:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43affff640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43b010d380 0x7f43b019de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:14.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.287+0000 7f43af7fe640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0199600 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f43a000e9c0 tx=0x7f43a000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.288+0000 7f43acff9640 1 -- 172.21.15.80:0/2783112534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a000cd80 con 0x7f43b0102af0 2024-04-25T11:30:14.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.288+0000 7f43acff9640 1 -- 172.21.15.80:0/2783112534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a00054d0 con 0x7f43b0102af0 2024-04-25T11:30:14.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.288+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b019e750 con 0x7f43b0102af0 2024-04-25T11:30:14.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.288+0000 7f43acff9640 1 -- 172.21.15.80:0/2783112534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0010430 con 0x7f43b0102af0 2024-04-25T11:30:14.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.288+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b01a60d0 con 0x7f43b0102af0 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.290+0000 7f43bd063740 1 Processor -- start 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.290+0000 7f43bd063740 1 -- start start 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.290+0000 7f43acff9640 1 -- 172.21.15.80:0/2783112534 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f43a0004fd0 con 0x7f43b0102af0 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43bd063740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df68e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43bd063740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df68ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43bd063740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43bd063740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b8df5f3d80 con 0x55b8df2c44d0 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43bd063740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b8df5ada20 con 0x55b8df2ed390 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43bd063740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b8df5efd40 con 0x55b8df2cc6b0 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df68ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df68ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46010/0 (socket says 172.21.15.80:46010) 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 -- 172.21.15.80:0/3994176232 learned_addr learned my addr 172.21.15.80:0/3994176232 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43aeffd640 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43affff640 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df68e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 -- 172.21.15.80:0/3994176232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 msgr2=0x55b8df68f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 -- 172.21.15.80:0/3994176232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 msgr2=0x55b8df68e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43acff9640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f43980afc60 0x7f43980b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df68e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 -- 172.21.15.80:0/3994176232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8df5b8c30 con 0x55b8df2c44d0 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43aeffd640 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43affff640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f43980afc60 0x7f43980b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43af7fe640 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df68ebe0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f43a00dcc40 tx=0x7f43a00a3e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cbbb3215b10b57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.291+0000 7f43acff9640 1 -- 172.21.15.80:0/2783112534 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f43a00df570 con 0x7f43b0102af0 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f4395ffb640 1 -- 172.21.15.80:0/3994176232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00a74f0 con 0x55b8df2c44d0 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f4395ffb640 1 -- 172.21.15.80:0/3994176232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a00aee50 con 0x55b8df2c44d0 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43affff640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f43980afc60 0x7f43980b2170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009700 tx=0x7f43a80046c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f4395ffb640 1 -- 172.21.15.80:0/3994176232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00a6e90 con 0x55b8df2c44d0 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 -- 172.21.15.80:0/3994176232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 msgr2=0x55b8df68ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df68ebe0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f43a00dcc40 tx=0x7f43a00a3e30 comp rx=0 tx=0).stop 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 -- 172.21.15.80:0/3994176232 shutdown_connections 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df68ebe0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 --2- 172.21.15.80:0/3994176232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df68e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 -- 172.21.15.80:0/3994176232 >> 172.21.15.80:0/3994176232 conn(0x55b8df2e14e0 msgr2=0x55b8df68afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.292+0000 7f43bd063740 1 -- 172.21.15.80:0/3994176232 shutdown_connections 2024-04-25T11:30:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 -- 172.21.15.80:0/3994176232 wait complete. 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 -- start start 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 Processor -- start 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2c44d0 0x55b8df69d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df69d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2ed390 0x55b8df6a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b8df6a0190 con 0x55b8df2ed390 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b8df57adc0 con 0x55b8df2c44d0 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b8df6a0310 con 0x55b8df2cc6b0 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.293+0000 7f43bd063740 10 client.0 _ll_register_callbacks cb 0x55b8df596600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2ed390 0x55b8df6a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2ed390 0x55b8df6a9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46020/0 (socket says 172.21.15.80:46020) 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 -- 172.21.15.80:0/2995453064 learned_addr learned my addr 172.21.15.80:0/2995453064 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43aeffd640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df69d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43af7fe640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2c44d0 0x55b8df69d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 -- 172.21.15.80:0/2995453064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 msgr2=0x55b8df69d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df69d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 -- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2c44d0 msgr2=0x55b8df69d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2c44d0 0x55b8df69d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 -- 172.21.15.80:0/2995453064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8df3053f0 con 0x55b8df2ed390 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43af7fe640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2c44d0 0x55b8df69d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43affff640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2ed390 0x55b8df6a9640 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f43a8003e70 tx=0x7f43a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13934d780964fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f438effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f438effd640 1 -- 172.21.15.80:0/2995453064 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8020430 con 0x55b8df2ed390 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f438effd640 1 -- 172.21.15.80:0/2995453064 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f43a80205d0 con 0x55b8df2ed390 2024-04-25T11:30:14.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a00aee50 con 0x55b8df2ed390 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f438effd640 1 -- 172.21.15.80:0/2995453064 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43a8024020 con 0x55b8df2ed390 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43bd063740 10 client.16923 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8df3cf7d0 con 0x55b8df2ed390 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.294+0000 7f438effd640 1 -- 172.21.15.80:0/2995453064 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a00aee50 con 0x55b8df2ed390 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f438effd640 1 -- 172.21.15.80:0/2995453064 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f43a800f040 con 0x55b8df2ed390 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43bd063740 10 client.16923 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43bd063740 10 client.16923 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43bd063740 20 client.16923 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43bd063740 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2abf60 0x55b8df6afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43bd063740 4 client.16923 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8df601990 con 0x55b8df2abf60 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43af7fe640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2abf60 0x55b8df6afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f438effd640 10 client.16923 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.295+0000 7f43af7fe640 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2abf60 0x55b8df6afb30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ad6aa19db19392b server_cookie=6a6df1bc067cc9c2 in_seq=0 out_seq=0 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f438effd640 1 -- 172.21.15.80:0/2995453064 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b8df601990 con 0x55b8df2abf60 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f438effd640 10 client.16923 handle_command_reply: tid=0 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 client.16923 shutdown 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2ed390 msgr2=0x55b8df6a9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2ed390 0x55b8df6a9640 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f43a8003e70 tx=0x7f43a8004730 comp rx=0 tx=0).stop 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 shutdown_connections 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2abf60 0x55b8df6afb30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2ed390 0x55b8df6a9640 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f438effd640 0 client.16923 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df69d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 --2- 172.21.15.80:0/2995453064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2c44d0 0x55b8df69d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 >> 172.21.15.80:0/2995453064 conn(0x55b8df2e14e0 msgr2=0x55b8df689610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 shutdown_connections 2024-04-25T11:30:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.296+0000 7f43bd063740 1 -- 172.21.15.80:0/2995453064 wait complete. 2024-04-25T11:30:14.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.297+0000 7f43bd063740 20 client.16923 trim_cache size 0 max 16384 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 Processor -- start 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 -- start start 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df692d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f43b01b0160 con 0x55b8df2c44d0 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43b01ada30 con 0x55b8df2ed390 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43bd063740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f43b01ab880 con 0x55b8df2cc6b0 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df692d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df692d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46024/0 (socket says 172.21.15.80:46024) 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 -- 172.21.15.80:0/594860542 learned_addr learned my addr 172.21.15.80:0/594860542 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43affff640 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43aeffd640 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 -- 172.21.15.80:0/594860542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 msgr2=0x55b8df68e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 -- 172.21.15.80:0/594860542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 msgr2=0x55b8df6b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43af7fe640 1 -- 172.21.15.80:0/594860542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8df68fe00 con 0x55b8df2c44d0 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.310+0000 7f43aeffd640 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43af7fe640 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df692d80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f43a00dd2d0 tx=0x7f43a00a3ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c213fee9553c41ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43957fa640 1 -- 172.21.15.80:0/594860542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00a7070 con 0x55b8df2c44d0 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43957fa640 1 -- 172.21.15.80:0/594860542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a00aee50 con 0x55b8df2c44d0 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43957fa640 1 -- 172.21.15.80:0/594860542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a00a7230 con 0x55b8df2c44d0 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 -- 172.21.15.80:0/594860542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 msgr2=0x55b8df692d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df692d80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f43a00dd2d0 tx=0x7f43a00a3ea0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 -- 172.21.15.80:0/594860542 shutdown_connections 2024-04-25T11:30:14.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2cc6b0 0x55b8df68e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 --2- 172.21.15.80:0/594860542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2c44d0 0x55b8df692d80 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 -- 172.21.15.80:0/594860542 >> 172.21.15.80:0/594860542 conn(0x55b8df2e14e0 msgr2=0x55b8df69e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 -- 172.21.15.80:0/594860542 shutdown_connections 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.311+0000 7f43bd063740 1 -- 172.21.15.80:0/594860542 wait complete. 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 -- start start 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 Processor -- start 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2c44d0 0x55b8df6a3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2cc6b0 0x55b8df6a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f43b01abef0 con 0x55b8df2cc6b0 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43b01ad360 con 0x55b8df2ed390 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f43b01ac5c0 con 0x55b8df2c44d0 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43bd063740 10 client.0 _ll_register_callbacks cb 0x7f43a80044d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43aeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2cc6b0 0x55b8df6a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43aeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2cc6b0 0x55b8df6a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46032/0 (socket says 172.21.15.80:46032) 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43aeffd640 1 -- 172.21.15.80:0/4124344539 learned_addr learned my addr 172.21.15.80:0/4124344539 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43affff640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.312+0000 7f43af7fe640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2c44d0 0x55b8df6a3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43aeffd640 1 -- 172.21.15.80:0/4124344539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2c44d0 msgr2=0x55b8df6a3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43aeffd640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2c44d0 0x55b8df6a3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43aeffd640 1 -- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 msgr2=0x55b8df6a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43aeffd640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43aeffd640 1 -- 172.21.15.80:0/4124344539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8df6a6030 con 0x55b8df2cc6b0 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43affff640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43aeffd640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2cc6b0 0x55b8df6a3580 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f43a4005e30 tx=0x7f43a40093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8962719e969b4bc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f438effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:14.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f438effd640 1 -- 172.21.15.80:0/4124344539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4031450 con 0x55b8df2cc6b0 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f438effd640 1 -- 172.21.15.80:0/4124344539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f43a40315f0 con 0x55b8df2cc6b0 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a00aee50 con 0x55b8df2cc6b0 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f438effd640 1 -- 172.21.15.80:0/4124344539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43a4031810 con 0x55b8df2cc6b0 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 10 client.16929 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8df717eb0 con 0x55b8df2cc6b0 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f438effd640 1 -- 172.21.15.80:0/4124344539 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a00aee50 con 0x55b8df2cc6b0 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f438effd640 1 -- 172.21.15.80:0/4124344539 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f43a4004610 con 0x55b8df2cc6b0 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 10 client.16929 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 10 client.16929 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 20 client.16929 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2813a0 0x55b8df71a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 4 client.16929 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:30:14.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.313+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8df5fb800 con 0x55b8df2813a0 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43af7fe640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2813a0 0x55b8df71a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f438effd640 10 client.16929 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43af7fe640 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2813a0 0x55b8df71a6c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41027d9990ff2427 server_cookie=a53696acb0e48a05 in_seq=0 out_seq=0 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f438effd640 1 -- 172.21.15.80:0/4124344539 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8df5fb800 con 0x55b8df2813a0 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f438effd640 10 client.16929 handle_command_reply: tid=0 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 client.16929 shutdown 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2cc6b0 msgr2=0x55b8df6a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2cc6b0 0x55b8df6a3580 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f43a4005e30 tx=0x7f43a40093f0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 shutdown_connections 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55b8df2813a0 0x55b8df71a6c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b8df2cc6b0 0x55b8df6a3580 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8df2ed390 0x55b8df6a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f438effd640 0 client.16929 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:14.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 --2- 172.21.15.80:0/4124344539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b8df2c44d0 0x55b8df6a3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.314+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 >> 172.21.15.80:0/4124344539 conn(0x55b8df2e14e0 msgr2=0x55b8df692ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 shutdown_connections 2024-04-25T11:30:14.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43bd063740 1 -- 172.21.15.80:0/4124344539 wait complete. 2024-04-25T11:30:14.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43bd063740 20 client.16929 trim_cache size 0 max 16384 2024-04-25T11:30:14.313 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:30:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f43980afc60 msgr2=0x7f43980b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f43980afc60 0x7f43980b2170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009700 tx=0x7f43a80046c0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 msgr2=0x7f43b0199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0199600 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f43a000e9c0 tx=0x7f43a000ee80 comp rx=0 tx=0).stop 2024-04-25T11:30:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 shutdown_connections 2024-04-25T11:30:14.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f43980afc60 0x7f43980b2170 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43b010d380 0x7f43b019de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43b0108a20 0x7f43b0199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 --2- 172.21.15.80:0/2783112534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f43b0102af0 0x7f43b0199600 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 >> 172.21.15.80:0/2783112534 conn(0x7f43b0078100 msgr2=0x7f43b01040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 shutdown_connections 2024-04-25T11:30:14.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.315+0000 7f43b61b2640 1 -- 172.21.15.80:0/2783112534 wait complete. 2024-04-25T11:30:14.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:14 smithi080 ceph-mon[29126]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:30:14.317 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:30:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 -- 172.21.15.80:0/2007537571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b660 msgr2=0x7efca810da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 --2- 172.21.15.80:0/2007537571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b660 0x7efca810da80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efc90009900 tx=0x7efc9002a410 comp rx=0 tx=0).stop 2024-04-25T11:30:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 -- 172.21.15.80:0/2007537571 shutdown_connections 2024-04-25T11:30:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 --2- 172.21.15.80:0/2007537571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b660 0x7efca810da80 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 --2- 172.21.15.80:0/2007537571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca810e050 0x7efca8110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 --2- 172.21.15.80:0/2007537571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efca8104c00 0x7efca8105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 -- 172.21.15.80:0/2007537571 >> 172.21.15.80:0/2007537571 conn(0x7efca80fe260 msgr2=0x7efca8100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 -- 172.21.15.80:0/2007537571 shutdown_connections 2024-04-25T11:30:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.438+0000 7efcacfee640 1 -- 172.21.15.80:0/2007537571 wait complete. 2024-04-25T11:30:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.439+0000 7efcacfee640 1 Processor -- start 2024-04-25T11:30:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.439+0000 7efcacfee640 1 -- start start 2024-04-25T11:30:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.439+0000 7efcacfee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca8104c00 0x7efca819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efcacfee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efca810b660 0x7efca819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efcacfee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810e050 0x7efca819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efcacfee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efca8113cd0 con 0x7efca810e050 2024-04-25T11:30:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efcacfee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efca8113b50 con 0x7efca8104c00 2024-04-25T11:30:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efcacfee640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efca8113e50 con 0x7efca810b660 2024-04-25T11:30:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810e050 0x7efca819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810e050 0x7efca819efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46042/0 (socket says 172.21.15.80:46042) 2024-04-25T11:30:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 -- 172.21.15.80:0/3528055258 learned_addr learned my addr 172.21.15.80:0/3528055258 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca659c640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca8104c00 0x7efca819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efc9ffff640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efca810b660 0x7efca819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 -- 172.21.15.80:0/3528055258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efca810b660 msgr2=0x7efca819ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efca810b660 0x7efca819ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 -- 172.21.15.80:0/3528055258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca8104c00 msgr2=0x7efca819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca8104c00 0x7efca819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 -- 172.21.15.80:0/3528055258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca819f610 con 0x7efca810e050 2024-04-25T11:30:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca659c640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca8104c00 0x7efca819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efca6d9d640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810e050 0x7efca819efd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efca000eb10 tx=0x7efca000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efc9f7fe640 1 -- 172.21.15.80:0/3528055258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0004b20 con 0x7efca810e050 2024-04-25T11:30:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efc9f7fe640 1 -- 172.21.15.80:0/3528055258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efca0004cc0 con 0x7efca810e050 2024-04-25T11:30:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca819f900 con 0x7efca810e050 2024-04-25T11:30:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efc9f7fe640 1 -- 172.21.15.80:0/3528055258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0010670 con 0x7efca810e050 2024-04-25T11:30:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.440+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca819fe00 con 0x7efca810e050 2024-04-25T11:30:14.440 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:14 smithi196 ceph-mon[32659]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:30:14.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.443+0000 7efcb3f73740 1 Processor -- start 2024-04-25T11:30:14.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.443+0000 7efc9f7fe640 1 -- 172.21.15.80:0/3528055258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7efca0005020 con 0x7efca810e050 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.443+0000 7efcb3f73740 1 -- start start 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.443+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2da810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.443+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f104d0 0x56546a2dad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f186b0 0x56546a2e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efcb3f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56546a23fd80 con 0x565469f39390 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efcb3f73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56546a1f9a20 con 0x565469f186b0 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efcb3f73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56546a23bd40 con 0x565469f104d0 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2da810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46058/0 (socket says 172.21.15.80:46058) 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 -- 172.21.15.80:0/726345458 learned_addr learned my addr 172.21.15.80:0/726345458 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9f7fe640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc940afc60 0x7efc940b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efca659c640 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f104d0 0x56546a2dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f186b0 0x56546a2e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efca6d9d640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc940afc60 0x7efc940b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 -- 172.21.15.80:0/726345458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f104d0 msgr2=0x56546a2dad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f104d0 0x56546a2dad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 -- 172.21.15.80:0/726345458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f186b0 msgr2=0x56546a2e76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f186b0 0x56546a2e76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 -- 172.21.15.80:0/726345458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546a204c30 con 0x565469f39390 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9f7fe640 1 -- 172.21.15.80:0/3528055258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7efca00df6c0 con 0x7efca810e050 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9ffff640 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2da810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efc9002a930 tx=0x7efc90005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e4b25ba9621cfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efca6d9d640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc940afc60 0x7efc940b2170 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efca00a7570 tx=0x7efca00d5fc0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.444+0000 7efc9cff9640 1 -- 172.21.15.80:0/726345458 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90035050 con 0x565469f39390 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efc9cff9640 1 -- 172.21.15.80:0/726345458 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc900316a0 con 0x565469f39390 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efc9cff9640 1 -- 172.21.15.80:0/726345458 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc900046c0 con 0x565469f39390 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 -- 172.21.15.80:0/726345458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 msgr2=0x56546a2da810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2da810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efc9002a930 tx=0x7efc90005a20 comp rx=0 tx=0).stop 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 -- 172.21.15.80:0/726345458 shutdown_connections 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f186b0 0x56546a2e76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f104d0 0x56546a2dad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 --2- 172.21.15.80:0/726345458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2da810 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 -- 172.21.15.80:0/726345458 >> 172.21.15.80:0/726345458 conn(0x565469f2d4e0 msgr2=0x56546a2d6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.445+0000 7efcb3f73740 1 -- 172.21.15.80:0/726345458 shutdown_connections 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 -- 172.21.15.80:0/726345458 wait complete. 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 -- start start 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 Processor -- start 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56546a2e7d30 con 0x565469f39390 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56546a1c6dc0 con 0x565469f104d0 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56546a2e7eb0 con 0x565469f186b0 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efcb3f73740 10 client.0 _ll_register_callbacks cb 0x56546a1e2600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2f11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46072/0 (socket says 172.21.15.80:46072) 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efc9ffff640 1 -- 172.21.15.80:0/2659689568 learned_addr learned my addr 172.21.15.80:0/2659689568 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.446+0000 7efc9ffff640 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efca659c640 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc9ffff640 1 -- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 msgr2=0x56546a2e5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc9ffff640 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc9ffff640 1 -- 172.21.15.80:0/2659689568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 msgr2=0x56546a2e5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc9ffff640 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc9ffff640 1 -- 172.21.15.80:0/2659689568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565469f513f0 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc9ffff640 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2f11b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efc90000c00 tx=0x7efc90041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1131f6278cb7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc8dffb640 1 -- 172.21.15.80:0/2659689568 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9004e020 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc8dffb640 1 -- 172.21.15.80:0/2659689568 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7efc90004440 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc900316a0 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc8dffb640 1 -- 172.21.15.80:0/2659689568 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc9005a050 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 10 client.16941 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56546a01b7d0 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc8dffb640 1 -- 172.21.15.80:0/2659689568 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc900316a0 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efc8dffb640 1 -- 172.21.15.80:0/2659689568 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7efc90055030 con 0x565469f39390 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 10 client.16941 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 10 client.16941 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:30:14.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 20 client.16941 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ef7f60 0x56546a2f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 4 client.16941 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.447+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56546a24d990 con 0x565469ef7f60 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.448+0000 7efca659c640 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ef7f60 0x56546a2f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.448+0000 7efc8dffb640 10 client.16941 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.448+0000 7efca659c640 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ef7f60 0x56546a2f74f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0a5ce27686e904e server_cookie=8ca869155676bc8a in_seq=0 out_seq=0 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efc8dffb640 1 -- 172.21.15.80:0/2659689568 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56546a24d990 con 0x565469ef7f60 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efc8dffb640 10 client.16941 handle_command_reply: tid=0 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 client.16941 shutdown 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 msgr2=0x56546a2f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2f11b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efc90000c00 tx=0x7efc90041040 comp rx=0 tx=0).stop 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 shutdown_connections 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2f11b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ef7f60 0x56546a2f74f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efc8dffb640 0 client.16941 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 --2- 172.21.15.80:0/2659689568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 >> 172.21.15.80:0/2659689568 conn(0x565469f2d4e0 msgr2=0x56546a2dc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 shutdown_connections 2024-04-25T11:30:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 1 -- 172.21.15.80:0/2659689568 wait complete. 2024-04-25T11:30:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.449+0000 7efcb3f73740 20 client.16941 trim_cache size 0 max 16384 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 Processor -- start 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 -- start start 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efca81b21f0 con 0x565469f39390 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efca81afac0 con 0x565469f104d0 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efcb3f73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efca81ad910 con 0x565469f186b0 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2df4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2df4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46084/0 (socket says 172.21.15.80:46084) 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 -- 172.21.15.80:0/883379245 learned_addr learned my addr 172.21.15.80:0/883379245 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efca659c640 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 -- 172.21.15.80:0/883379245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 msgr2=0x56546a2e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 -- 172.21.15.80:0/883379245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 msgr2=0x56546a2e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.463+0000 7efc9ffff640 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.464+0000 7efc9ffff640 1 -- 172.21.15.80:0/883379245 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546a2d2710 con 0x565469f39390 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.464+0000 7efc9ffff640 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2df4f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efc90001eb0 tx=0x7efc90032ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b737a3bceee1d4c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.464+0000 7efc8ffff640 1 -- 172.21.15.80:0/883379245 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90063070 con 0x565469f39390 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.464+0000 7efc8ffff640 1 -- 172.21.15.80:0/883379245 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc9004f040 con 0x565469f39390 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.464+0000 7efc8ffff640 1 -- 172.21.15.80:0/883379245 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9004e030 con 0x565469f39390 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- 172.21.15.80:0/883379245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 msgr2=0x56546a2df4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2df4f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efc90001eb0 tx=0x7efc90032ad0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- 172.21.15.80:0/883379245 shutdown_connections 2024-04-25T11:30:14.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f39390 0x56546a2df4f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 --2- 172.21.15.80:0/883379245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f104d0 0x56546a2e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- 172.21.15.80:0/883379245 >> 172.21.15.80:0/883379245 conn(0x565469f2d4e0 msgr2=0x56546a2e6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- 172.21.15.80:0/883379245 shutdown_connections 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- 172.21.15.80:0/883379245 wait complete. 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- start start 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 Processor -- start 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f104d0 0x56546a2f7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f39390 0x56546a35d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efca81adf80 con 0x565469f104d0 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efca81af3f0 con 0x565469f39390 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efca81ae650 con 0x565469f186b0 2024-04-25T11:30:14.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efcb3f73740 10 client.0 _ll_register_callbacks cb 0x7efc980095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.465+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f104d0 0x56546a2f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f104d0 0x56546a2f7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46088/0 (socket says 172.21.15.80:46088) 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 -- 172.21.15.80:0/3756581079 learned_addr learned my addr 172.21.15.80:0/3756581079 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efca659c640 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f39390 0x56546a35d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 -- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 msgr2=0x56546a2f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 -- 172.21.15.80:0/3756581079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f39390 msgr2=0x56546a35d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f39390 0x56546a35d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 -- 172.21.15.80:0/3756581079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56546a35db50 con 0x565469f104d0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc9ffff640 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f104d0 0x56546a2f7780 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efc90009900 tx=0x7efc90005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8e445c6c1c80da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc8dffb640 1 -- 172.21.15.80:0/3756581079 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9004e070 con 0x565469f104d0 2024-04-25T11:30:14.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc8dffb640 1 -- 172.21.15.80:0/3756581079 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7efc90004440 con 0x565469f104d0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc9004f040 con 0x565469f104d0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc8dffb640 1 -- 172.21.15.80:0/3756581079 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc90063070 con 0x565469f104d0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efcb3f73740 10 client.16947 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56546a35ec70 con 0x565469f104d0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.466+0000 7efc8dffb640 1 -- 172.21.15.80:0/3756581079 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc9004f040 con 0x565469f104d0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efc8dffb640 1 -- 172.21.15.80:0/3756581079 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7efc90055070 con 0x565469f104d0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efcb3f73740 10 client.16947 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efcb3f73740 10 client.16947 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efcb3f73740 20 client.16947 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efcb3f73740 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ecd3a0 0x56546a361340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efcb3f73740 4 client.16947 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56546a247800 con 0x565469ecd3a0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efca659c640 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ecd3a0 0x56546a361340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efc8dffb640 10 client.16947 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.467+0000 7efca659c640 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ecd3a0 0x56546a361340 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4887462030290b3 server_cookie=4c8507b931693b90 in_seq=0 out_seq=0 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efc8dffb640 1 -- 172.21.15.80:0/3756581079 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56546a247800 con 0x565469ecd3a0 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efc8dffb640 10 client.16947 handle_command_reply: tid=0 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 client.16947 shutdown 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f104d0 msgr2=0x56546a2f7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f104d0 0x56546a2f7780 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efc90009900 tx=0x7efc90005820 comp rx=0 tx=0).stop 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 shutdown_connections 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x565469ecd3a0 0x56546a361340 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565469f39390 0x56546a35d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x565469f186b0 0x56546a2f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 --2- 172.21.15.80:0/3756581079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565469f104d0 0x56546a2f7780 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efc8dffb640 0 client.16947 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 >> 172.21.15.80:0/3756581079 conn(0x565469f2d4e0 msgr2=0x56546a2e6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 shutdown_connections 2024-04-25T11:30:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 1 -- 172.21.15.80:0/3756581079 wait complete. 2024-04-25T11:30:14.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcb3f73740 20 client.16947 trim_cache size 0 max 16384 2024-04-25T11:30:14.466 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc940afc60 msgr2=0x7efc940b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcacfee640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc940afc60 0x7efc940b2170 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efca00a7570 tx=0x7efca00d5fc0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810e050 msgr2=0x7efca819efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.468+0000 7efcacfee640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810e050 0x7efca819efd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efca000eb10 tx=0x7efca000c2d0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 shutdown_connections 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7efc940afc60 0x7efc940b2170 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810e050 0x7efca819efd0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efca810b660 0x7efca819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 --2- 172.21.15.80:0/3528055258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca8104c00 0x7efca819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 >> 172.21.15.80:0/3528055258 conn(0x7efca80fe260 msgr2=0x7efca810e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 shutdown_connections 2024-04-25T11:30:14.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.469+0000 7efcacfee640 1 -- 172.21.15.80:0/3528055258 wait complete. 2024-04-25T11:30:14.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:30:14.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:14 smithi082 ceph-mon[32440]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:30:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 -- 172.21.15.80:0/2388845762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8106990 msgr2=0x7f58d8106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/2388845762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8106990 0x7f58d8106dc0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009900 tx=0x7f58c002a410 comp rx=0 tx=0).stop 2024-04-25T11:30:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 -- 172.21.15.80:0/2388845762 shutdown_connections 2024-04-25T11:30:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/2388845762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8106990 0x7f58d8106dc0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/2388845762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d8107450 0x7f58d810ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/2388845762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d8102400 0x7f58d8102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 -- 172.21.15.80:0/2388845762 >> 172.21.15.80:0/2388845762 conn(0x7f58d8077880 msgr2=0x7f58d8077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 -- 172.21.15.80:0/2388845762 shutdown_connections 2024-04-25T11:30:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 -- 172.21.15.80:0/2388845762 wait complete. 2024-04-25T11:30:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.589+0000 7f58ddcf9640 1 Processor -- start 2024-04-25T11:30:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ddcf9640 1 -- start start 2024-04-25T11:30:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ddcf9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8102400 0x7f58d819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ddcf9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d8106990 0x7f58d819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ddcf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d8107450 0x7f58d819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ddcf9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58d8111ae0 con 0x7f58d8102400 2024-04-25T11:30:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ddcf9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58d8111960 con 0x7f58d8107450 2024-04-25T11:30:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ddcf9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f58d8111c60 con 0x7f58d8106990 2024-04-25T11:30:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8102400 0x7f58d819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8102400 0x7f58d819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46110/0 (socket says 172.21.15.80:46110) 2024-04-25T11:30:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 -- 172.21.15.80:0/3538684488 learned_addr learned my addr 172.21.15.80:0/3538684488 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58ceffd640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d8106990 0x7f58d819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d8107450 0x7f58d819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 -- 172.21.15.80:0/3538684488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d8106990 msgr2=0x7f58d819acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d8106990 0x7f58d819acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 -- 172.21.15.80:0/3538684488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d8107450 msgr2=0x7f58d819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d8107450 0x7f58d819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.590+0000 7f58d77fe640 1 -- 172.21.15.80:0/3538684488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d819f5f0 con 0x7f58d8102400 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.591+0000 7f58d77fe640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8102400 0x7f58d819a790 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f58c800d950 tx=0x7f58c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.591+0000 7f58d57fa640 1 -- 172.21.15.80:0/3538684488 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8017070 con 0x7f58d8102400 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.591+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d819f8e0 con 0x7f58d8102400 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.591+0000 7f58d57fa640 1 -- 172.21.15.80:0/3538684488 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58c8009c30 con 0x7f58d8102400 2024-04-25T11:30:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.591+0000 7f58d57fa640 1 -- 172.21.15.80:0/3538684488 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c800f620 con 0x7f58d8102400 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.591+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d81a7260 con 0x7f58d8102400 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 Processor -- start 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 -- start start 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99fe390 0x55bcd9d9f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99d54d0 0x55bcd9d9fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9d04d80 con 0x55bcd99d54d0 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9cbea20 con 0x55bcd99fe390 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58e4baf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9d00d40 con 0x55bcd99dd6b0 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58d57fa640 1 -- 172.21.15.80:0/3538684488 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f58c8010460 con 0x7f58d8102400 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99fe390 0x55bcd9d9f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99fe390 0x55bcd9d9f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:41924/0 (socket says 172.21.15.80:41924) 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58d7fff640 1 -- 172.21.15.80:0/487229139 learned_addr learned my addr 172.21.15.80:0/487229139 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58ceffd640 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.594+0000 7f58d77fe640 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99d54d0 0x55bcd9d9fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d7fff640 1 -- 172.21.15.80:0/487229139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 msgr2=0x55bcd9dac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d7fff640 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d7fff640 1 -- 172.21.15.80:0/487229139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99d54d0 msgr2=0x55bcd9d9fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d7fff640 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99d54d0 0x55bcd9d9fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d7fff640 1 -- 172.21.15.80:0/487229139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd9cc9c30 con 0x55bcd99fe390 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d7fff640 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99fe390 0x55bcd9d9f810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58d000af40 tx=0x7f58d000f8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37c1fe66637f805 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d57fa640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f58c40afc60 0x7f58c40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58cdffb640 1 -- 172.21.15.80:0/487229139 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d000d6a0 con 0x55bcd99fe390 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d77fe640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f58c40afc60 0x7f58c40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58cdffb640 1 -- 172.21.15.80:0/487229139 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d000dcf0 con 0x55bcd99fe390 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58cdffb640 1 -- 172.21.15.80:0/487229139 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0019d20 con 0x55bcd99fe390 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.595+0000 7f58d57fa640 1 -- 172.21.15.80:0/3538684488 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f58c80dec70 con 0x7f58d8102400 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 -- 172.21.15.80:0/487229139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99fe390 msgr2=0x55bcd9d9f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58d77fe640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f58c40afc60 0x7f58c40b2170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f58c80dc480 tx=0x7f58c80e27c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99fe390 0x55bcd9d9f810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58d000af40 tx=0x7f58d000f8f0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 -- 172.21.15.80:0/487229139 shutdown_connections 2024-04-25T11:30:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99d54d0 0x55bcd9d9fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 --2- 172.21.15.80:0/487229139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99fe390 0x55bcd9d9f810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 -- 172.21.15.80:0/487229139 >> 172.21.15.80:0/487229139 conn(0x55bcd99f24e0 msgr2=0x55bcd9d9bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 -- 172.21.15.80:0/487229139 shutdown_connections 2024-04-25T11:30:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 -- 172.21.15.80:0/487229139 wait complete. 2024-04-25T11:30:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.596+0000 7f58e4baf740 1 -- start start 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 1 Processor -- start 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99d54d0 0x55bcd9da9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99dd6b0 0x55bcd9daa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9db6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9dacd90 con 0x55bcd99fe390 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9c8bdc0 con 0x55bcd99dd6b0 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9dacf10 con 0x55bcd99d54d0 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58e4baf740 10 client.0 _ll_register_callbacks cb 0x55bcd9ca7600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9db6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9db6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46128/0 (socket says 172.21.15.80:46128) 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 -- 172.21.15.80:0/526659823 learned_addr learned my addr 172.21.15.80:0/526659823 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99d54d0 0x55bcd9da9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 -- 172.21.15.80:0/526659823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99d54d0 msgr2=0x55bcd9da9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99d54d0 0x55bcd9da9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58ceffd640 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99dd6b0 0x55bcd9daa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 -- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99dd6b0 msgr2=0x55bcd9daa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99dd6b0 0x55bcd9daa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 -- 172.21.15.80:0/526659823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd9a163f0 con 0x55bcd99fe390 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58d7fff640 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9db6210 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f58d001b040 tx=0x7f58d00199a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10019523700110b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.597+0000 7f58b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58b6ffd640 1 -- 172.21.15.80:0/526659823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d002a060 con 0x55bcd99fe390 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58b6ffd640 1 -- 172.21.15.80:0/526659823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f58d0004c40 con 0x55bcd99fe390 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d000dcf0 con 0x55bcd99fe390 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58b6ffd640 1 -- 172.21.15.80:0/526659823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58d000d4a0 con 0x55bcd99fe390 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 10 client.16959 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bcd9ae07d0 con 0x55bcd99fe390 2024-04-25T11:30:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58b6ffd640 1 -- 172.21.15.80:0/526659823 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d000dcf0 con 0x55bcd99fe390 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58b6ffd640 1 -- 172.21.15.80:0/526659823 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f58d000b040 con 0x55bcd99fe390 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 10 client.16959 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 20 client.16959 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99bcf60 0x55bcd9dbc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 4 client.16959 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcd9d12990 con 0x55bcd99bcf60 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.598+0000 7f58ceffd640 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99bcf60 0x55bcd9dbc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.599+0000 7f58b6ffd640 10 client.16959 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.599+0000 7f58ceffd640 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99bcf60 0x55bcd9dbc420 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b35b544f981cf4 server_cookie=8c2d20f29ce9f8ed in_seq=0 out_seq=0 2024-04-25T11:30:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58b6ffd640 1 -- 172.21.15.80:0/526659823 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bcd9d12990 con 0x55bcd99bcf60 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58b6ffd640 10 client.16959 handle_command_reply: tid=0 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 client.16959 shutdown 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 msgr2=0x55bcd9db6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9db6210 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f58d001b040 tx=0x7f58d00199a0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 shutdown_connections 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99bcf60 0x55bcd9dbc420 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9db6210 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99dd6b0 0x55bcd9daa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 --2- 172.21.15.80:0/526659823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99d54d0 0x55bcd9da9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58b6ffd640 0 client.16959 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 >> 172.21.15.80:0/526659823 conn(0x55bcd99f24e0 msgr2=0x55bcd9da1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 shutdown_connections 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 1 -- 172.21.15.80:0/526659823 wait complete. 2024-04-25T11:30:14.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.600+0000 7f58e4baf740 20 client.16959 trim_cache size 0 max 16384 2024-04-25T11:30:14.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.613+0000 7f58e4baf740 1 Processor -- start 2024-04-25T11:30:14.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58e4baf740 1 -- start start 2024-04-25T11:30:14.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9dac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 0x55bcd9da4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9dc1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58e4baf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58d81b23b0 con 0x55bcd99fe390 2024-04-25T11:30:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58e4baf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58d81afc80 con 0x55bcd99d54d0 2024-04-25T11:30:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58e4baf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f58d81adad0 con 0x55bcd99dd6b0 2024-04-25T11:30:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9dc1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9dc1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46142/0 (socket says 172.21.15.80:46142) 2024-04-25T11:30:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 -- 172.21.15.80:0/3054204903 learned_addr learned my addr 172.21.15.80:0/3054204903 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9dac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 -- 172.21.15.80:0/3054204903 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 msgr2=0x55bcd9da4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 0x55bcd9da4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 -- 172.21.15.80:0/3054204903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 msgr2=0x55bcd9dac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9dac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 -- 172.21.15.80:0/3054204903 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd9d97710 con 0x55bcd99fe390 2024-04-25T11:30:14.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9dc1a50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f58d002d440 tx=0x7f58d0019f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7a3cd40876d29d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58cd7fa640 1 -- 172.21.15.80:0/3054204903 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d002a070 con 0x55bcd99fe390 2024-04-25T11:30:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58cd7fa640 1 -- 172.21.15.80:0/3054204903 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d0003e20 con 0x55bcd99fe390 2024-04-25T11:30:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.614+0000 7f58cd7fa640 1 -- 172.21.15.80:0/3054204903 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0024660 con 0x55bcd99fe390 2024-04-25T11:30:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 -- 172.21.15.80:0/3054204903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 msgr2=0x55bcd9dc1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9dc1a50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f58d002d440 tx=0x7f58d0019f30 comp rx=0 tx=0).stop 2024-04-25T11:30:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 -- 172.21.15.80:0/3054204903 shutdown_connections 2024-04-25T11:30:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99fe390 0x55bcd9dc1a50 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99dd6b0 0x55bcd9da4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3054204903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9dac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 -- 172.21.15.80:0/3054204903 >> 172.21.15.80:0/3054204903 conn(0x55bcd99f24e0 msgr2=0x55bcd9da9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 -- 172.21.15.80:0/3054204903 shutdown_connections 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.615+0000 7f58e4baf740 1 -- 172.21.15.80:0/3054204903 wait complete. 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 -- start start 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 Processor -- start 2024-04-25T11:30:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9db2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99fe390 0x55bcd9dadf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58d81ae140 con 0x55bcd99dd6b0 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58d81af5b0 con 0x55bcd99d54d0 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f58d81ae810 con 0x55bcd99fe390 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58e4baf740 10 client.0 _ll_register_callbacks cb 0x7f58d000ad90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46150/0 (socket says 172.21.15.80:46150) 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 -- 172.21.15.80:0/3155312041 learned_addr learned my addr 172.21.15.80:0/3155312041 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9db2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99fe390 0x55bcd9dadf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 -- 172.21.15.80:0/3155312041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99fe390 msgr2=0x55bcd9dadf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99fe390 0x55bcd9dadf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 -- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 msgr2=0x55bcd9db2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9db2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.616+0000 7f58ceffd640 1 -- 172.21.15.80:0/3155312041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd9dae560 con 0x55bcd99dd6b0 2024-04-25T11:30:14.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58ceffd640 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dad9e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000c00 tx=0x7f58c0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a5f4c8823d1e6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58b6ffd640 1 -- 172.21.15.80:0/3155312041 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0035040 con 0x55bcd99dd6b0 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58b6ffd640 1 -- 172.21.15.80:0/3155312041 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f58c0004400 con 0x55bcd99dd6b0 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d0003e20 con 0x55bcd99dd6b0 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58b6ffd640 1 -- 172.21.15.80:0/3155312041 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58c0051050 con 0x55bcd99dd6b0 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 10 client.16965 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bcd9e24410 con 0x55bcd99dd6b0 2024-04-25T11:30:14.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58b6ffd640 1 -- 172.21.15.80:0/3155312041 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d0003e20 con 0x55bcd99dd6b0 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58b6ffd640 1 -- 172.21.15.80:0/3155312041 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f58c004c030 con 0x55bcd99dd6b0 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 10 client.16965 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 20 client.16965 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99923a0 0x55bcd9e26c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 4 client.16965 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.617+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bcd9da00e0 con 0x55bcd99923a0 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99923a0 0x55bcd9e26c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58d7fff640 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99923a0 0x55bcd9e26c20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd88e2c915a21e7a server_cookie=de2b3707d5aa74b1 in_seq=0 out_seq=0 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58b6ffd640 10 client.16965 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:14.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58b6ffd640 1 -- 172.21.15.80:0/3155312041 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bcd9da00e0 con 0x55bcd99923a0 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58b6ffd640 10 client.16965 handle_command_reply: tid=0 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 client.16965 shutdown 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99dd6b0 msgr2=0x55bcd9dad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dad9e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000c00 tx=0x7f58c0004040 comp rx=0 tx=0).stop 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 shutdown_connections 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bcd99923a0 0x55bcd9e26c20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bcd99dd6b0 0x55bcd9dad9e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58b6ffd640 0 client.16965 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bcd99fe390 0x55bcd9dadf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 --2- 172.21.15.80:0/3155312041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcd99d54d0 0x55bcd9db2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 >> 172.21.15.80:0/3155312041 conn(0x55bcd99f24e0 msgr2=0x55bcd9da9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 shutdown_connections 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.618+0000 7f58e4baf740 1 -- 172.21.15.80:0/3155312041 wait complete. 2024-04-25T11:30:14.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58e4baf740 20 client.16965 trim_cache size 0 max 16384 2024-04-25T11:30:14.625 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:30:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f58c40afc60 msgr2=0x7f58c40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f58c40afc60 0x7f58c40b2170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f58c80dc480 tx=0x7f58c80e27c0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8102400 msgr2=0x7f58d819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:14.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8102400 0x7f58d819a790 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f58c800d950 tx=0x7f58c800de10 comp rx=0 tx=0).stop 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 shutdown_connections 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f58c40afc60 0x7f58c40b2170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d8107450 0x7f58d819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58d8106990 0x7f58d819acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 --2- 172.21.15.80:0/3538684488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58d8102400 0x7f58d819a790 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 >> 172.21.15.80:0/3538684488 conn(0x7f58d8077880 msgr2=0x7f58d81008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 shutdown_connections 2024-04-25T11:30:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:14.619+0000 7f58ddcf9640 1 -- 172.21.15.80:0/3538684488 wait complete. 2024-04-25T11:30:15.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1994308993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:30:15.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1994308993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:30:15.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1994308993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:30:15.628 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:30:15.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:30:15.629 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 -- 172.21.15.80:0/1954790939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 msgr2=0x7f0880110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 --2- 172.21.15.80:0/1954790939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f0880110660 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0878009ca0 tx=0x7f087802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 -- 172.21.15.80:0/1954790939 shutdown_connections 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 --2- 172.21.15.80:0/1954790939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f0880110660 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 --2- 172.21.15.80:0/1954790939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0880109fe0 0x7f0880102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 --2- 172.21.15.80:0/1954790939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0880109b40 0x7f0880101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 -- 172.21.15.80:0/1954790939 >> 172.21.15.80:0/1954790939 conn(0x7f0880077920 msgr2=0x7f0880077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 -- 172.21.15.80:0/1954790939 shutdown_connections 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 -- 172.21.15.80:0/1954790939 wait complete. 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.761+0000 7f0886eee640 1 Processor -- start 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0886eee640 1 -- start start 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0886eee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f088019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0886eee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0880109b40 0x7f088019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0886eee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0880109fe0 0x7f088019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0886eee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0880113d30 con 0x7f08801027e0 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0886eee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0880113bb0 con 0x7f0880109b40 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0886eee640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0880113eb0 con 0x7f0880109fe0 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f088019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f088019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46166/0 (socket says 172.21.15.80:46166) 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 -- 172.21.15.80:0/639653014 learned_addr learned my addr 172.21.15.80:0/639653014 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f087ffff640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0880109b40 0x7f088019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f088548b640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0880109fe0 0x7f088019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 -- 172.21.15.80:0/639653014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0880109fe0 msgr2=0x7f088019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0880109fe0 0x7f088019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 -- 172.21.15.80:0/639653014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0880109b40 msgr2=0x7f088019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0880109b40 0x7f088019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 -- 172.21.15.80:0/639653014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088019f510 con 0x7f08801027e0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f087ffff640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0880109b40 0x7f088019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.762+0000 7f0884c8a640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f088019a730 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f087000c9a0 tx=0x7f087000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.763+0000 7f087dffb640 1 -- 172.21.15.80:0/639653014 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870007bb0 con 0x7f08801027e0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.763+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088019f800 con 0x7f08801027e0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.763+0000 7f087dffb640 1 -- 172.21.15.80:0/639653014 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0870007d50 con 0x7f08801027e0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.763+0000 7f087dffb640 1 -- 172.21.15.80:0/639653014 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087000f450 con 0x7f08801027e0 2024-04-25T11:30:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.763+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088019fd00 con 0x7f08801027e0 2024-04-25T11:30:15.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.765+0000 7f087dffb640 1 -- 172.21.15.80:0/639653014 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f08700046c0 con 0x7f08801027e0 2024-04-25T11:30:15.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.765+0000 7f088dd9e740 1 Processor -- start 2024-04-25T11:30:15.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.765+0000 7f088dd9e740 1 -- start start 2024-04-25T11:30:15.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee67a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee67ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee67b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088dd9e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b6ee5e0b00 con 0x55b6ee2da410 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088dd9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b6ee57c920 con 0x55b6ee2b9730 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088dd9e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b6ee5dcac0 con 0x55b6ee2b1550 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee67a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f087dffb640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f08680afc60 0x7f08680b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee67a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46168/0 (socket says 172.21.15.80:46168) 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 -- 172.21.15.80:0/3252344003 learned_addr learned my addr 172.21.15.80:0/3252344003 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f087ffff640 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee67b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f0884c8a640 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee67ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f08680afc60 0x7f08680b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 -- 172.21.15.80:0/3252344003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 msgr2=0x55b6ee67ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f087dffb640 1 -- 172.21.15.80:0/639653014 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f08700deed0 con 0x7f08801027e0 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee67ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 -- 172.21.15.80:0/3252344003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 msgr2=0x55b6ee67b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee67b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 -- 172.21.15.80:0/3252344003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ee3ba7e0 con 0x55b6ee2da410 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f0884c8a640 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee67ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.766+0000 7f088548b640 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee67a620 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0878005cc0 tx=0x7f0878031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7318467c31179225 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f0866ffd640 1 -- 172.21.15.80:0/3252344003 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878004240 con 0x55b6ee2da410 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f0866ffd640 1 -- 172.21.15.80:0/3252344003 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f087804e070 con 0x55b6ee2da410 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f0866ffd640 1 -- 172.21.15.80:0/3252344003 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087802fca0 con 0x55b6ee2da410 2024-04-25T11:30:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f088dd9e740 1 -- 172.21.15.80:0/3252344003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 msgr2=0x55b6ee67a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f088548b640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f08680afc60 0x7f08680b2170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f087804d000 tx=0x7f087804b000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f088dd9e740 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee67a620 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0878005cc0 tx=0x7f0878031f50 comp rx=0 tx=0).stop 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f088dd9e740 1 -- 172.21.15.80:0/3252344003 shutdown_connections 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f088dd9e740 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee67b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f088dd9e740 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee67ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.767+0000 7f088dd9e740 1 --2- 172.21.15.80:0/3252344003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee67a620 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 -- 172.21.15.80:0/3252344003 >> 172.21.15.80:0/3252344003 conn(0x55b6ee2ce560 msgr2=0x55b6ee676dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 -- 172.21.15.80:0/3252344003 shutdown_connections 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 -- 172.21.15.80:0/3252344003 wait complete. 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 -- start start 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 Processor -- start 2024-04-25T11:30:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee684c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2b9730 0x55b6ee685140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2da410 0x55b6ee690e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.768+0000 7f088dd9e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b6ee687970 con 0x55b6ee2b9730 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f088dd9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b6ee57a5d0 con 0x55b6ee2da410 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f088dd9e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b6ee687af0 con 0x55b6ee2b1550 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f088dd9e740 10 client.0 _ll_register_callbacks cb 0x55b6ee568080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2b9730 0x55b6ee685140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2b9730 0x55b6ee685140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46176/0 (socket says 172.21.15.80:46176) 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 -- 172.21.15.80:0/2118840207 learned_addr learned my addr 172.21.15.80:0/2118840207 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f088548b640 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2da410 0x55b6ee690e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 -- 172.21.15.80:0/2118840207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 msgr2=0x55b6ee684c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee684c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 -- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2da410 msgr2=0x55b6ee690e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2da410 0x55b6ee690e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 -- 172.21.15.80:0/2118840207 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ee41af70 con 0x55b6ee2b9730 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f087ffff640 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2b9730 0x55b6ee685140 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f087400ce70 tx=0x7f08740039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8afdff3c27417b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f085ffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f085ffff640 1 -- 172.21.15.80:0/2118840207 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874011a90 con 0x55b6ee2b9730 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f085ffff640 1 -- 172.21.15.80:0/2118840207 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f0874011c30 con 0x55b6ee2b9730 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087804e070 con 0x55b6ee2b9730 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f085ffff640 1 -- 172.21.15.80:0/2118840207 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0874011e30 con 0x55b6ee2b9730 2024-04-25T11:30:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f088dd9e740 10 client.16977 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.769+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b6ee2b2170 con 0x55b6ee2b9730 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f085ffff640 1 -- 172.21.15.80:0/2118840207 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f087804e070 con 0x55b6ee2b9730 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f085ffff640 1 -- 172.21.15.80:0/2118840207 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0874018070 con 0x55b6ee2b9730 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f088dd9e740 10 client.16977 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f088dd9e740 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f088dd9e740 20 client.16977 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f088dd9e740 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee2991f0 0x55b6ee697110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f088dd9e740 4 client.16977 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6ee5ee710 con 0x55b6ee2991f0 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f0884c8a640 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee2991f0 0x55b6ee697110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f0884c8a640 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee2991f0 0x55b6ee697110 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcd72c64b1ee59af server_cookie=bdc89d1604627a38 in_seq=0 out_seq=0 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.770+0000 7f085ffff640 10 client.16977 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f085ffff640 1 -- 172.21.15.80:0/2118840207 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b6ee5ee710 con 0x55b6ee2991f0 2024-04-25T11:30:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f085ffff640 10 client.16977 handle_command_reply: tid=0 2024-04-25T11:30:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 client.16977 shutdown 2024-04-25T11:30:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2b9730 msgr2=0x55b6ee685140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2b9730 0x55b6ee685140 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f087400ce70 tx=0x7f08740039c0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 shutdown_connections 2024-04-25T11:30:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee2991f0 0x55b6ee697110 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2b9730 0x55b6ee685140 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2da410 0x55b6ee690e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f085ffff640 0 client.16977 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 --2- 172.21.15.80:0/2118840207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee684c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 >> 172.21.15.80:0/2118840207 conn(0x55b6ee2ce560 msgr2=0x55b6ee67a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 shutdown_connections 2024-04-25T11:30:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.771+0000 7f088dd9e740 1 -- 172.21.15.80:0/2118840207 wait complete. 2024-04-25T11:30:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.772+0000 7f088dd9e740 20 client.16977 trim_cache size 0 max 16384 2024-04-25T11:30:15.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 Processor -- start 2024-04-25T11:30:15.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 -- start start 2024-04-25T11:30:15.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b1550 0x55b6ee67e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b9730 0x55b6ee69c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee69ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f08801b2290 con 0x55b6ee2da410 2024-04-25T11:30:15.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08801afb60 con 0x55b6ee2b1550 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088dd9e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f08801ad9b0 con 0x55b6ee2b9730 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee69ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee69ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46190/0 (socket says 172.21.15.80:46190) 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 -- 172.21.15.80:0/49842957 learned_addr learned my addr 172.21.15.80:0/49842957 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 -- 172.21.15.80:0/49842957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b9730 msgr2=0x55b6ee69c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 --2- 172.21.15.80:0/49842957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b9730 0x55b6ee69c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 -- 172.21.15.80:0/49842957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b1550 msgr2=0x55b6ee67e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 --2- 172.21.15.80:0/49842957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b1550 0x55b6ee67e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 -- 172.21.15.80:0/49842957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ee685290 con 0x55b6ee2da410 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f088548b640 1 --2- 172.21.15.80:0/49842957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee69ce10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f087802a900 tx=0x7f087802f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21853a8e5d7a3cba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.790+0000 7f08667fc640 1 -- 172.21.15.80:0/49842957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878004d40 con 0x55b6ee2da410 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f08667fc640 1 -- 172.21.15.80:0/49842957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f087804e030 con 0x55b6ee2da410 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f08667fc640 1 -- 172.21.15.80:0/49842957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878004280 con 0x55b6ee2da410 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 -- 172.21.15.80:0/49842957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 msgr2=0x55b6ee69ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 --2- 172.21.15.80:0/49842957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee69ce10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f087802a900 tx=0x7f087802f810 comp rx=0 tx=0).stop 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 -- 172.21.15.80:0/49842957 shutdown_connections 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 --2- 172.21.15.80:0/49842957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee69ce10 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 --2- 172.21.15.80:0/49842957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b9730 0x55b6ee69c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 --2- 172.21.15.80:0/49842957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b1550 0x55b6ee67e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 -- 172.21.15.80:0/49842957 >> 172.21.15.80:0/49842957 conn(0x55b6ee2ce560 msgr2=0x55b6ee67e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 -- 172.21.15.80:0/49842957 shutdown_connections 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.791+0000 7f088dd9e740 1 -- 172.21.15.80:0/49842957 wait complete. 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 -- start start 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 Processor -- start 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee68d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee688510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee688a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f08801ae020 con 0x55b6ee2da410 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08801af490 con 0x55b6ee2b9730 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f08801ae6f0 con 0x55b6ee2b1550 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088dd9e740 10 client.0 _ll_register_callbacks cb 0x7f087400ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:15.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088548b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee688a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088548b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee688a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46194/0 (socket says 172.21.15.80:46194) 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f088548b640 1 -- 172.21.15.80:0/58164528 learned_addr learned my addr 172.21.15.80:0/58164528 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f087ffff640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee688510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.792+0000 7f0884c8a640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee68d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088548b640 1 -- 172.21.15.80:0/58164528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 msgr2=0x55b6ee68d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088548b640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee68d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088548b640 1 -- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 msgr2=0x55b6ee688510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088548b640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee688510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088548b640 1 -- 172.21.15.80:0/58164528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ee689040 con 0x55b6ee2da410 2024-04-25T11:30:15.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f0884c8a640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee68d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:15.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088548b640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee688a50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f08780094e0 tx=0x7f0878031b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea4761023f503c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f085ffff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:15.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f085ffff640 1 -- 172.21.15.80:0/58164528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878031e50 con 0x55b6ee2da410 2024-04-25T11:30:15.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087804e030 con 0x55b6ee2da410 2024-04-25T11:30:15.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f085ffff640 1 -- 172.21.15.80:0/58164528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f087802f900 con 0x55b6ee2da410 2024-04-25T11:30:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f085ffff640 1 -- 172.21.15.80:0/58164528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0878074050 con 0x55b6ee2da410 2024-04-25T11:30:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088dd9e740 10 client.16983 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b6ee6ff260 con 0x55b6ee2da410 2024-04-25T11:30:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f085ffff640 1 -- 172.21.15.80:0/58164528 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f087804e030 con 0x55b6ee2da410 2024-04-25T11:30:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.793+0000 7f085ffff640 1 -- 172.21.15.80:0/58164528 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f08780305c0 con 0x55b6ee2da410 2024-04-25T11:30:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f088dd9e740 10 client.16983 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:15.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f088dd9e740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f088dd9e740 20 client.16983 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f088dd9e740 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee26e630 0x55b6ee701530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f088dd9e740 4 client.16983 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:30:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b6ee67f700 con 0x55b6ee26e630 2024-04-25T11:30:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f0884c8a640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee26e630 0x55b6ee701530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f0884c8a640 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee26e630 0x55b6ee701530 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d369e6a04da4353e server_cookie=c5976df01b0af28b in_seq=0 out_seq=0 2024-04-25T11:30:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.794+0000 7f085ffff640 10 client.16983 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f085ffff640 1 -- 172.21.15.80:0/58164528 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b6ee67f700 con 0x55b6ee26e630 2024-04-25T11:30:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f085ffff640 10 client.16983 handle_command_reply: tid=0 2024-04-25T11:30:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 client.16983 shutdown 2024-04-25T11:30:15.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 msgr2=0x55b6ee688a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee688a50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f08780094e0 tx=0x7f0878031b70 comp rx=0 tx=0).stop 2024-04-25T11:30:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 shutdown_connections 2024-04-25T11:30:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b6ee26e630 0x55b6ee701530 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b6ee2da410 0x55b6ee688a50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6ee2b9730 0x55b6ee688510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 --2- 172.21.15.80:0/58164528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b6ee2b1550 0x55b6ee68d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 >> 172.21.15.80:0/58164528 conn(0x55b6ee2ce560 msgr2=0x55b6ee6832c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.795+0000 7f085ffff640 0 client.16983 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 shutdown_connections 2024-04-25T11:30:15.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f088dd9e740 1 -- 172.21.15.80:0/58164528 wait complete. 2024-04-25T11:30:15.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f088dd9e740 20 client.16983 trim_cache size 0 max 16384 2024-04-25T11:30:15.797 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:30:15.798 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:30:15.798 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "c7f0ea12-a83b-432b-8709-7bb073bb26ba", 2024-04-25T11:30:15.798 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:30:15.799 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:30:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f08680afc60 msgr2=0x7f08680b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f08680afc60 0x7f08680b2170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f087804d000 tx=0x7f087804b000 comp rx=0 tx=0).stop 2024-04-25T11:30:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 msgr2=0x7f088019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f088019a730 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f087000c9a0 tx=0x7f087000ce60 comp rx=0 tx=0).stop 2024-04-25T11:30:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 shutdown_connections 2024-04-25T11:30:15.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f08680afc60 0x7f08680b2170 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0880109fe0 0x7f088019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0880109b40 0x7f088019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 --2- 172.21.15.80:0/639653014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08801027e0 0x7f088019a730 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 >> 172.21.15.80:0/639653014 conn(0x7f0880077920 msgr2=0x7f08801004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 shutdown_connections 2024-04-25T11:30:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.796+0000 7f0886eee640 1 -- 172.21.15.80:0/639653014 wait complete. 2024-04-25T11:30:15.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:30:15.803 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 -- 172.21.15.80:0/3630934558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 msgr2=0x7fc4e410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/3630934558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e410f7a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009ca0 tx=0x7fc4dc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 -- 172.21.15.80:0/3630934558 shutdown_connections 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/3630934558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e410f7a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/3630934558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4e4102af0 0x7fc4e4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/3630934558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4108a20 0x7fc4e41025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 -- 172.21.15.80:0/3630934558 >> 172.21.15.80:0/3630934558 conn(0x7fc4e4078100 msgr2=0x7fc4e4078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 -- 172.21.15.80:0/3630934558 shutdown_connections 2024-04-25T11:30:15.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.923+0000 7fc4e89b2640 1 -- 172.21.15.80:0/3630934558 wait complete. 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 Processor -- start 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 -- start start 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4e4102af0 0x7fc4e41995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4108a20 0x7fc4e4199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e419ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4112c00 con 0x7fc4e410d380 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4112a80 con 0x7fc4e4108a20 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e89b2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4112d80 con 0x7fc4e4102af0 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e419ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e419ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46210/0 (socket says 172.21.15.80:46210) 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 -- 172.21.15.80:0/2344480927 learned_addr learned my addr 172.21.15.80:0/2344480927 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e259c640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4e4102af0 0x7fc4e41995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4108a20 0x7fc4e4199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 -- 172.21.15.80:0/2344480927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4e4102af0 msgr2=0x7fc4e41995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4e4102af0 0x7fc4e41995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 -- 172.21.15.80:0/2344480927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4108a20 msgr2=0x7fc4e4199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4108a20 0x7fc4e4199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e2d9d640 1 -- 172.21.15.80:0/2344480927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e419e400 con 0x7fc4e410d380 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e259c640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4e4102af0 0x7fc4e41995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.924+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4108a20 0x7fc4e4199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.925+0000 7fc4e2d9d640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e419ddc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005cc0 tx=0x7fc4dc02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.925+0000 7fc4d37fe640 1 -- 172.21.15.80:0/2344480927 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc003cf0 con 0x7fc4e410d380 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.925+0000 7fc4d37fe640 1 -- 172.21.15.80:0/2344480927 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4dc0044f0 con 0x7fc4e410d380 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.925+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e419e690 con 0x7fc4e410d380 2024-04-25T11:30:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.925+0000 7fc4d37fe640 1 -- 172.21.15.80:0/2344480927 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc02fd10 con 0x7fc4e410d380 2024-04-25T11:30:15.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.925+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e419ebe0 con 0x7fc4e410d380 2024-04-25T11:30:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.927+0000 7fc4ef85e740 1 Processor -- start 2024-04-25T11:30:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.927+0000 7fc4d37fe640 1 -- 172.21.15.80:0/2344480927 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fc4dc004040 con 0x7fc4e410d380 2024-04-25T11:30:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4ef85e740 1 -- start start 2024-04-25T11:30:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab01a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab01fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f39aa67d80 con 0x55f39a761390 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f39aa218b0 con 0x55f39a7406b0 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f39aa63d40 con 0x55f39a7384d0 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab01a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab01a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46226/0 (socket says 172.21.15.80:46226) 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/4194704755 learned_addr learned my addr 172.21.15.80:0/4194704755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4d37fe640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4cc0afc60 0x7fc4cc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e259c640 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab01fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e2d9d640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4cc0afc60 0x7fc4cc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/4194704755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 msgr2=0x55f39ab01fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab01fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/4194704755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 msgr2=0x55f39ab0e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.928+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/4194704755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39a9f2a40 con 0x55f39a761390 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4e259c640 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab01fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4d37fe640 1 -- 172.21.15.80:0/2344480927 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fc4dc1008a0 con 0x7fc4e410d380 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab01a60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8014520 tx=0x7fc4d800b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679cae9820a3f276 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4d0ff9640 1 -- 172.21.15.80:0/4194704755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8012710 con 0x55f39a761390 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4d0ff9640 1 -- 172.21.15.80:0/4194704755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d801a070 con 0x55f39a761390 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4d0ff9640 1 -- 172.21.15.80:0/4194704755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800eab0 con 0x55f39a761390 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.929+0000 7fc4e2d9d640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4cc0afc60 0x7fc4cc0b2170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c8af0 tx=0x7fc4dc0b1040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 -- 172.21.15.80:0/4194704755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 msgr2=0x55f39ab01a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab01a60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8014520 tx=0x7fc4d800b500 comp rx=0 tx=0).stop 2024-04-25T11:30:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 -- 172.21.15.80:0/4194704755 shutdown_connections 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab01fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/4194704755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab01a60 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 -- 172.21.15.80:0/4194704755 >> 172.21.15.80:0/4194704755 conn(0x55f39a7554e0 msgr2=0x55f39aafe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 -- 172.21.15.80:0/4194704755 shutdown_connections 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 -- 172.21.15.80:0/4194704755 wait complete. 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 -- start start 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.930+0000 7fc4ef85e740 1 Processor -- start 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab0dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab0c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f39ab0efe0 con 0x55f39a761390 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f39a9eed10 con 0x55f39a7406b0 2024-04-25T11:30:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f39ab0f160 con 0x55f39a7384d0 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 10 client.0 _ll_register_callbacks cb 0x55f39aa1b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab0c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab0c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46242/0 (socket says 172.21.15.80:46242) 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1343413505 learned_addr learned my addr 172.21.15.80:0/1343413505 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e259c640 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab0dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1343413505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 msgr2=0x55f39ab0dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab0dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 msgr2=0x55f39ab0e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1343413505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39a8437d0 con 0x55f39a761390 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab0c4a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e790 tx=0x7fc4d800e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9989f25ff9ba15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1343413505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8004220 con 0x55f39a761390 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1343413505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fc4d80043c0 con 0x55f39a761390 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.931+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d801a070 con 0x55f39a761390 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1343413505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc4d8012950 con 0x55f39a761390 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 10 client.16995 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f39a7793f0 con 0x55f39a761390 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1343413505 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d801a070 con 0x55f39a761390 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1343413505 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc4d8003ac0 con 0x55f39a761390 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 10 client.16995 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 10 client.16995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 20 client.16995 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a71ff60 0x55f39ab1e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 4 client.16995 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f39aa75990 con 0x55f39a71ff60 2024-04-25T11:30:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.932+0000 7fc4e259c640 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a71ff60 0x55f39ab1e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4c9ffb640 10 client.16995 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4e259c640 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a71ff60 0x55f39ab1e6b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5df08b393f01c50 server_cookie=caacec7112fd8c0c in_seq=0 out_seq=0 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1343413505 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f39aa75990 con 0x55f39a71ff60 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4c9ffb640 10 client.16995 handle_command_reply: tid=0 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4ef85e740 1 client.16995 shutdown 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 msgr2=0x55f39ab0c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab0c4a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e790 tx=0x7fc4d800e690 comp rx=0 tx=0).stop 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 shutdown_connections 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a71ff60 0x55f39ab1e6b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.934+0000 7fc4c9ffb640 0 client.16995 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.933+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a761390 0x55f39ab0c4a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.934+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7406b0 0x55f39ab0e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.934+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1343413505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7384d0 0x55f39ab0dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.934+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 >> 172.21.15.80:0/1343413505 conn(0x55f39a7554e0 msgr2=0x55f39aafc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.934+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 shutdown_connections 2024-04-25T11:30:15.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.934+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1343413505 wait complete. 2024-04-25T11:30:15.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.934+0000 7fc4ef85e740 20 client.16995 trim_cache size 0 max 16384 2024-04-25T11:30:15.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 Processor -- start 2024-04-25T11:30:15.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 -- start start 2024-04-25T11:30:15.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a71ff60 0x55f39aafe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7384d0 0x55f39ab216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7406b0 0x55f39ab21c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41b1100 con 0x55f39a7406b0 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41ae9d0 con 0x55f39a7384d0 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.951+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41ac820 con 0x55f39a71ff60 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7406b0 0x55f39ab21c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7406b0 0x55f39ab21c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46254/0 (socket says 172.21.15.80:46254) 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1092333175 learned_addr learned my addr 172.21.15.80:0/1092333175 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a71ff60 0x55f39aafe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e259c640 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7384d0 0x55f39ab216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1092333175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a71ff60 msgr2=0x55f39aafe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a71ff60 0x55f39aafe150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1092333175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7384d0 msgr2=0x55f39ab216e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7384d0 0x55f39ab216e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 -- 172.21.15.80:0/1092333175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39a7390f0 con 0x55f39a7406b0 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7406b0 0x55f39ab21c20 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e760 tx=0x7fc4d8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f03e4f0f59bbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4cbfff640 1 -- 172.21.15.80:0/1092333175 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8005b20 con 0x55f39a7406b0 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4cbfff640 1 -- 172.21.15.80:0/1092333175 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d801a040 con 0x55f39a7406b0 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.952+0000 7fc4cbfff640 1 -- 172.21.15.80:0/1092333175 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800f280 con 0x55f39a7406b0 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1092333175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7406b0 msgr2=0x55f39ab21c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7406b0 0x55f39ab21c20 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e760 tx=0x7fc4d8016040 comp rx=0 tx=0).stop 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1092333175 shutdown_connections 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7406b0 0x55f39ab21c20 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a7384d0 0x55f39ab216e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1092333175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a71ff60 0x55f39aafe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1092333175 >> 172.21.15.80:0/1092333175 conn(0x55f39a7554e0 msgr2=0x55f39aafda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1092333175 shutdown_connections 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1092333175 wait complete. 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 -- start start 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.953+0000 7fc4ef85e740 1 Processor -- start 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a71ff60 0x55f39ab20c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7384d0 0x55f39ab21160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7406b0 0x55f39ab80a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41ace90 con 0x55f39a7384d0 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41ae300 con 0x55f39a71ff60 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41ad560 con 0x55f39a7406b0 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 10 client.0 _ll_register_callbacks cb 0x7fc4d800bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7384d0 0x55f39ab21160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7384d0 0x55f39ab21160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46270/0 (socket says 172.21.15.80:46270) 2024-04-25T11:30:15.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 -- 172.21.15.80:0/1851500285 learned_addr learned my addr 172.21.15.80:0/1851500285 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a71ff60 0x55f39ab20c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 -- 172.21.15.80:0/1851500285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7406b0 msgr2=0x55f39ab80a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7406b0 0x55f39ab80a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 -- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a71ff60 msgr2=0x55f39ab20c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a71ff60 0x55f39ab20c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 -- 172.21.15.80:0/1851500285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39aa284b0 con 0x55f39a7384d0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4e259c640 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7384d0 0x55f39ab21160 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4005d90 tx=0x7fc4d4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c986b3aa2f04a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1851500285 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d401a820 con 0x55f39a7384d0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1851500285 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fc4d401a9c0 con 0x55f39a7384d0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d801a040 con 0x55f39a7384d0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1851500285 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc4d4010510 con 0x55f39a7384d0 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 10 client.17001 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:15.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.954+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f39ab88150 con 0x55f39a7384d0 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1851500285 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d801a040 con 0x55f39a7384d0 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1851500285 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc4d4023810 con 0x55f39a7384d0 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4ef85e740 10 client.17001 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4ef85e740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4ef85e740 20 client.17001 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a761390 0x55f39ab8a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4ef85e740 4 client.17001 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f39ab02330 con 0x55f39a761390 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a761390 0x55f39ab8a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4c9ffb640 10 client.17001 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.955+0000 7fc4e1d9b640 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a761390 0x55f39ab8a8a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b87d801f8cd9f209 server_cookie=9cf23e44d3e5bb7a in_seq=0 out_seq=0 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4c9ffb640 1 -- 172.21.15.80:0/1851500285 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f39ab02330 con 0x55f39a761390 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4c9ffb640 10 client.17001 handle_command_reply: tid=0 2024-04-25T11:30:15.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 client.17001 shutdown 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7384d0 msgr2=0x55f39ab21160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7384d0 0x55f39ab21160 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4005d90 tx=0x7fc4d4011a90 comp rx=0 tx=0).stop 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 shutdown_connections 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f39a761390 0x55f39ab8a8a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f39a7384d0 0x55f39ab21160 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f39a7406b0 0x55f39ab80a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4c9ffb640 0 client.17001 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 --2- 172.21.15.80:0/1851500285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f39a71ff60 0x55f39ab20c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 >> 172.21.15.80:0/1851500285 conn(0x55f39a7554e0 msgr2=0x55f39ab05730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 shutdown_connections 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 1 -- 172.21.15.80:0/1851500285 wait complete. 2024-04-25T11:30:15.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4ef85e740 20 client.17001 trim_cache size 0 max 16384 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: "c7f0ea12-a83b-432b-8709-7bb073bb26ba": { 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "c7f0ea12-a83b-432b-8709-7bb073bb26ba", 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:30:15.954 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:30:15.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4cc0afc60 msgr2=0x7fc4cc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4cc0afc60 0x7fc4cc0b2170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c8af0 tx=0x7fc4dc0b1040 comp rx=0 tx=0).stop 2024-04-25T11:30:15.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 msgr2=0x7fc4e419ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:15.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e419ddc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005cc0 tx=0x7fc4dc02f470 comp rx=0 tx=0).stop 2024-04-25T11:30:15.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 shutdown_connections 2024-04-25T11:30:15.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4cc0afc60 0x7fc4cc0b2170 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4e410d380 0x7fc4e419ddc0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4108a20 0x7fc4e4199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 --2- 172.21.15.80:0/2344480927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4e4102af0 0x7fc4e41995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:15.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 >> 172.21.15.80:0/2344480927 conn(0x7fc4e4078100 msgr2=0x7fc4e41040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:15.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 shutdown_connections 2024-04-25T11:30:15.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:15.956+0000 7fc4e89b2640 1 -- 172.21.15.80:0/2344480927 wait complete. 2024-04-25T11:30:15.958 INFO:tasks.cephfs.filesystem:scrub status for tag:c7f0ea12-a83b-432b-8709-7bb073bb26ba - {'path': '/', 'tag': 'c7f0ea12-a83b-432b-8709-7bb073bb26ba', 'options': 'recursive,force'} 2024-04-25T11:30:16.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:16 smithi080 ceph-mon[29126]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:30:16.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:16 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:30:16.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:16 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:16.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:16 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:30:16.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:16 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:16.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:16 smithi196 ceph-mon[32659]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:30:16.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:16 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:30:16.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:16 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:16.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:16 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:30:16.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:16 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:16.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:16 smithi082 ceph-mon[32440]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T11:30:16.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:16 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:30:16.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:16 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:16.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:16 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:30:16.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:16 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:18.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:18 smithi080 ceph-mon[29126]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-25T11:30:18.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:18 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:30:18.437 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:18 smithi196 ceph-mon[32659]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-25T11:30:18.438 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:18 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:30:18.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:18 smithi082 ceph-mon[32440]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-25T11:30:18.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:18 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:30:20.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:20 smithi080 ceph-mon[29126]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:30:20.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:20 smithi196 ceph-mon[32659]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:30:20.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:20 smithi082 ceph-mon[32440]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:30:22.240 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:22 smithi082 ceph-mon[32440]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:30:22.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:22 smithi080 ceph-mon[29126]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:30:22.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:22 smithi196 ceph-mon[32659]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:30:24.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:24 smithi080 ceph-mon[29126]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:24.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:24 smithi196 ceph-mon[32659]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:24.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:24 smithi082 ceph-mon[32440]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:26.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:26 smithi080 ceph-mon[29126]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:26.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:26 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:30:26.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:26 smithi196 ceph-mon[32659]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:26.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:26 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:30:26.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:26 smithi082 ceph-mon[32440]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:26.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:26 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:30:27.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:27 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:30:27.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:27 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:30:27.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:27 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:30:27.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:27 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:30:27.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:27 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:30:27.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:27 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:30:27.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:27 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:30:27.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:27 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:30:27.491 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:27 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:30:28.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:28 smithi080 ceph-mon[29126]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:30:28.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:28 smithi196 ceph-mon[32659]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:30:28.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:28 smithi082 ceph-mon[32440]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:30:30.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:30 smithi080 ceph-mon[29126]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:30.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:30 smithi196 ceph-mon[32659]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:30.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:30 smithi082 ceph-mon[32440]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:32.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:32 smithi080 ceph-mon[29126]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:32.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:32 smithi196 ceph-mon[32659]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:32.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:32 smithi082 ceph-mon[32440]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:34.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:34 smithi080 ceph-mon[29126]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:34.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:34 smithi196 ceph-mon[32659]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:34.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:34 smithi082 ceph-mon[32440]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:36.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:36 smithi080 ceph-mon[29126]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:36.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:36 smithi196 ceph-mon[32659]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:36.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:36 smithi082 ceph-mon[32440]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:38.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:38 smithi080 ceph-mon[29126]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:38.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:38 smithi196 ceph-mon[32659]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:38.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:38 smithi082 ceph-mon[32440]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:40.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:40 smithi080 ceph-mon[29126]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:40.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:40 smithi196 ceph-mon[32659]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:40.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:40 smithi082 ceph-mon[32440]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:42.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:42 smithi080 ceph-mon[29126]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:42.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:42 smithi196 ceph-mon[32659]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:42.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:42 smithi082 ceph-mon[32440]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:44.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:44 smithi080 ceph-mon[29126]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:44.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:44 smithi196 ceph-mon[32659]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:44.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:44 smithi082 ceph-mon[32440]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:45.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:30:45.960 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:30:46.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 -- 172.21.15.80:0/2162554133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53810d380 msgr2=0x7ff53810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 --2- 172.21.15.80:0/2162554133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53810d380 0x7ff53810f7a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff530009ca0 tx=0x7ff53002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 -- 172.21.15.80:0/2162554133 shutdown_connections 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 --2- 172.21.15.80:0/2162554133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53810d380 0x7ff53810f7a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 --2- 172.21.15.80:0/2162554133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff538102af0 0x7ff538102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 --2- 172.21.15.80:0/2162554133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff538108a20 0x7ff5381025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 -- 172.21.15.80:0/2162554133 >> 172.21.15.80:0/2162554133 conn(0x7ff538078100 msgr2=0x7ff538078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 -- 172.21.15.80:0/2162554133 shutdown_connections 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 -- 172.21.15.80:0/2162554133 wait complete. 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 Processor -- start 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.100+0000 7ff53fd34640 1 -- start start 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53fd34640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff538102af0 0x7ff5381995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53fd34640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538108a20 0x7ff538199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53fd34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff53810d380 0x7ff53819de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53fd34640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff538112c00 con 0x7ff538108a20 2024-04-25T11:30:46.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53fd34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff538112a80 con 0x7ff53810d380 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53fd34640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff538112d80 con 0x7ff538102af0 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538108a20 0x7ff538199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538108a20 0x7ff538199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59410/0 (socket says 172.21.15.80:59410) 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 -- 172.21.15.80:0/4005070754 learned_addr learned my addr 172.21.15.80:0/4005070754 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53dad0640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff538102af0 0x7ff5381995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff53810d380 0x7ff53819de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 -- 172.21.15.80:0/4005070754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff538102af0 msgr2=0x7ff5381995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff538102af0 0x7ff5381995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 -- 172.21.15.80:0/4005070754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff53810d380 msgr2=0x7ff53819de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff53810d380 0x7ff53819de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 -- 172.21.15.80:0/4005070754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53819e3c0 con 0x7ff538108a20 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538108a20 0x7ff538199b40 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff52800c9a0 tx=0x7ff52800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.101+0000 7ff52effd640 1 -- 172.21.15.80:0/4005070754 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528007c70 con 0x7ff538108a20 2024-04-25T11:30:46.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.102+0000 7ff52effd640 1 -- 172.21.15.80:0/4005070754 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff528007e10 con 0x7ff538108a20 2024-04-25T11:30:46.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.102+0000 7ff52effd640 1 -- 172.21.15.80:0/4005070754 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528018850 con 0x7ff538108a20 2024-04-25T11:30:46.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.102+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53819e6b0 con 0x7ff538108a20 2024-04-25T11:30:46.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.102+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53819ebb0 con 0x7ff538108a20 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 Processor -- start 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff52effd640 1 -- 172.21.15.80:0/4005070754 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff52800fb40 con 0x7ff538108a20 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 -- start start 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb71390 0x55f4acf11a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf11fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb506b0 0x55f4acf1e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f4ace77d80 con 0x55f4acb484d0 2024-04-25T11:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4ace318b0 con 0x55f4acb506b0 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff546be4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f4ace73d40 con 0x55f4acb71390 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff53dad0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf11fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff53dad0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf11fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59412/0 (socket says 172.21.15.80:59412) 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff53e2d1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb71390 0x55f4acf11a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff53dad0640 1 -- 172.21.15.80:0/96401919 learned_addr learned my addr 172.21.15.80:0/96401919 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.105+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb506b0 0x55f4acf1e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff52effd640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5240afc60 0x7ff5240b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 -- 172.21.15.80:0/96401919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb506b0 msgr2=0x55f4acf1e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb506b0 0x55f4acf1e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 -- 172.21.15.80:0/96401919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 msgr2=0x55f4acf11fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf11fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 -- 172.21.15.80:0/96401919 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ace02a40 con 0x55f4acb71390 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53dad0640 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf11fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5240afc60 0x7ff5240b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff52effd640 1 -- 172.21.15.80:0/4005070754 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff5280df260 con 0x7ff538108a20 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb71390 0x55f4acf11a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff530006010 tx=0x7ff530009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e3dc4167933eb54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff523fff640 1 -- 172.21.15.80:0/96401919 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530031920 con 0x55f4acb71390 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5240afc60 0x7ff5240b2170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff53004c000 tx=0x7ff530049000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff523fff640 1 -- 172.21.15.80:0/96401919 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff530036040 con 0x55f4acb71390 2024-04-25T11:30:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.106+0000 7ff523fff640 1 -- 172.21.15.80:0/96401919 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530004760 con 0x55f4acb71390 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 -- 172.21.15.80:0/96401919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb71390 msgr2=0x55f4acf11a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb71390 0x55f4acf11a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff530006010 tx=0x7ff530009880 comp rx=0 tx=0).stop 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 -- 172.21.15.80:0/96401919 shutdown_connections 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf11fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb506b0 0x55f4acf1e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 --2- 172.21.15.80:0/96401919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb71390 0x55f4acf11a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 -- 172.21.15.80:0/96401919 >> 172.21.15.80:0/96401919 conn(0x55f4acb654e0 msgr2=0x55f4acf0e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 -- 172.21.15.80:0/96401919 shutdown_connections 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.107+0000 7ff546be4740 1 -- 172.21.15.80:0/96401919 wait complete. 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 -- start start 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 Processor -- start 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb484d0 0x55f4acf1c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 0x55f4acf1cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb71390 0x55f4acf224a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f4acf1efe0 con 0x55f4acb71390 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4acdfed10 con 0x55f4acb484d0 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f4acf1f160 con 0x55f4acb506b0 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff546be4740 10 client.0 _ll_register_callbacks cb 0x55f4ace2b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff53e2d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb71390 0x55f4acf224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff53e2d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb71390 0x55f4acf224a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59420/0 (socket says 172.21.15.80:59420) 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.108+0000 7ff53e2d1640 1 -- 172.21.15.80:0/2814511774 learned_addr learned my addr 172.21.15.80:0/2814511774 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53dad0640 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb484d0 0x55f4acf1c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 0x55f4acf1cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53e2d1640 1 -- 172.21.15.80:0/2814511774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 msgr2=0x55f4acf1cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 0x55f4acf1cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53e2d1640 1 -- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb484d0 msgr2=0x55f4acf1c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb484d0 0x55f4acf1c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53e2d1640 1 -- 172.21.15.80:0/2814511774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4acc537d0 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb71390 0x55f4acf224a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff53002ade0 tx=0x7ff530004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f7e7bf55406474 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff5217fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff5217fa640 1 -- 172.21.15.80:0/2814511774 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530059020 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff530036040 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff5217fa640 1 -- 172.21.15.80:0/2814511774 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff530003b80 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff5217fa640 1 -- 172.21.15.80:0/2814511774 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff530064050 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff546be4740 10 client.17013 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f4acb893f0 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.109+0000 7ff5217fa640 1 -- 172.21.15.80:0/2814511774 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff530036040 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff5217fa640 1 -- 172.21.15.80:0/2814511774 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff5300305c0 con 0x55f4acb71390 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff546be4740 10 client.17013 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff546be4740 10 client.17013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff546be4740 20 client.17013 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff546be4740 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb2ff60 0x55f4acf2e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff546be4740 4 client.17013 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4ace85990 con 0x55f4acb2ff60 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.110+0000 7ff53dad0640 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb2ff60 0x55f4acf2e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff53dad0640 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb2ff60 0x55f4acf2e600 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd79001cf01fd06 server_cookie=7799e66cd368256f in_seq=0 out_seq=0 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff5217fa640 10 client.17013 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff5217fa640 1 -- 172.21.15.80:0/2814511774 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f4ace85990 con 0x55f4acb2ff60 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff5217fa640 10 client.17013 handle_command_reply: tid=0 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff546be4740 1 client.17013 shutdown 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb71390 msgr2=0x55f4acf224a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff546be4740 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb71390 0x55f4acf224a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff53002ade0 tx=0x7ff530004340 comp rx=0 tx=0).stop 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 shutdown_connections 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff546be4740 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb2ff60 0x55f4acf2e600 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff546be4740 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb71390 0x55f4acf224a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff5217fa640 0 client.17013 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.111+0000 7ff546be4740 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 0x55f4acf1cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.112+0000 7ff546be4740 1 --2- 172.21.15.80:0/2814511774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb484d0 0x55f4acf1c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.112+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 >> 172.21.15.80:0/2814511774 conn(0x55f4acb654e0 msgr2=0x55f4acf13780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.112+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 shutdown_connections 2024-04-25T11:30:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.112+0000 7ff546be4740 1 -- 172.21.15.80:0/2814511774 wait complete. 2024-04-25T11:30:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.112+0000 7ff546be4740 20 client.17013 trim_cache size 0 max 16384 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 Processor -- start 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 -- start start 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 0x55f4acf1b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf196d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 0x55f4acf19c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381b0f00 con 0x55f4acb484d0 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381ae7d0 con 0x55f4acb2ff60 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff546be4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381ac620 con 0x55f4acb506b0 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf196d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59422/0 (socket says 172.21.15.80:59422) 2024-04-25T11:30:46.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 -- 172.21.15.80:0/3276517351 learned_addr learned my addr 172.21.15.80:0/3276517351 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 -- 172.21.15.80:0/3276517351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 msgr2=0x55f4acf19c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/3276517351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 0x55f4acf19c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 -- 172.21.15.80:0/3276517351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 msgr2=0x55f4acf1b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/3276517351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 0x55f4acf1b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 -- 172.21.15.80:0/3276517351 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4acb490f0 con 0x55f4acb484d0 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.130+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/3276517351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf196d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff5280a3490 tx=0x7ff52800a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e17393af53a426 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff5237fe640 1 -- 172.21.15.80:0/3276517351 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280a6d60 con 0x55f4acb484d0 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff5237fe640 1 -- 172.21.15.80:0/3276517351 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5280a6f20 con 0x55f4acb484d0 2024-04-25T11:30:46.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff5237fe640 1 -- 172.21.15.80:0/3276517351 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280a6b80 con 0x55f4acb484d0 2024-04-25T11:30:46.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 -- 172.21.15.80:0/3276517351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 msgr2=0x55f4acf196d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 --2- 172.21.15.80:0/3276517351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf196d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff5280a3490 tx=0x7ff52800a5e0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 -- 172.21.15.80:0/3276517351 shutdown_connections 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 --2- 172.21.15.80:0/3276517351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb484d0 0x55f4acf196d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 --2- 172.21.15.80:0/3276517351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb506b0 0x55f4acf19c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 --2- 172.21.15.80:0/3276517351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 0x55f4acf1b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 -- 172.21.15.80:0/3276517351 >> 172.21.15.80:0/3276517351 conn(0x55f4acb654e0 msgr2=0x55f4acf1ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 -- 172.21.15.80:0/3276517351 shutdown_connections 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.131+0000 7ff546be4740 1 -- 172.21.15.80:0/3276517351 wait complete. 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 -- start start 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 Processor -- start 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 0x55f4acf288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb484d0 0x55f4acf28de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb506b0 0x55f4acf25da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381acc90 con 0x55f4acb506b0 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381ae100 con 0x55f4acb2ff60 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381ad360 con 0x55f4acb484d0 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff546be4740 10 client.0 _ll_register_callbacks cb 0x7ff53004b020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff53e2d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb506b0 0x55f4acf25da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff53e2d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb506b0 0x55f4acf25da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59426/0 (socket says 172.21.15.80:59426) 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff53e2d1640 1 -- 172.21.15.80:0/3034728993 learned_addr learned my addr 172.21.15.80:0/3034728993 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.132+0000 7ff53d2cf640 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb484d0 0x55f4acf28de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff53dad0640 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 0x55f4acf288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff53e2d1640 1 -- 172.21.15.80:0/3034728993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb484d0 msgr2=0x55f4acf28de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb484d0 0x55f4acf28de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff53e2d1640 1 -- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 msgr2=0x55f4acf288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 0x55f4acf288a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff53e2d1640 1 -- 172.21.15.80:0/3034728993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ace384b0 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff53e2d1640 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb506b0 0x55f4acf25da0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ff530030a30 tx=0x7ff530009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd6d12eb927590c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff5217fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff5217fa640 1 -- 172.21.15.80:0/3034728993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530040070 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff5217fa640 1 -- 172.21.15.80:0/3034728993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7ff530030c20 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5280a6f20 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff5217fa640 1 -- 172.21.15.80:0/3034728993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff530059030 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff546be4740 10 client.17019 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f4acf9a2a0 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff5217fa640 1 -- 172.21.15.80:0/3034728993 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5280a6f20 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff5217fa640 1 -- 172.21.15.80:0/3034728993 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff53002fb10 con 0x55f4acb506b0 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff546be4740 10 client.17019 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff546be4740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff546be4740 20 client.17019 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.133+0000 7ff546be4740 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb71390 0x55f4acf9c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff546be4740 4 client.17019 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f4acf12330 con 0x55f4acb71390 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff53dad0640 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb71390 0x55f4acf9c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff5217fa640 10 client.17019 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff53dad0640 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb71390 0x55f4acf9c8e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2922b384a6a572 server_cookie=ac5acadbc80fb3ee in_seq=0 out_seq=0 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff5217fa640 1 -- 172.21.15.80:0/3034728993 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f4acf12330 con 0x55f4acb71390 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff5217fa640 10 client.17019 handle_command_reply: tid=0 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff546be4740 1 client.17019 shutdown 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb506b0 msgr2=0x55f4acf25da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.134+0000 7ff546be4740 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb506b0 0x55f4acf25da0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ff530030a30 tx=0x7ff530009870 comp rx=0 tx=0).stop 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 shutdown_connections 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f4acb71390 0x55f4acf9c8e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f4acb506b0 0x55f4acf25da0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff5217fa640 0 client.17019 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4acb484d0 0x55f4acf28de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 --2- 172.21.15.80:0/3034728993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4acb2ff60 0x55f4acf288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 >> 172.21.15.80:0/3034728993 conn(0x55f4acb654e0 msgr2=0x55f4acf1d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 shutdown_connections 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 1 -- 172.21.15.80:0/3034728993 wait complete. 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff546be4740 20 client.17019 trim_cache size 0 max 16384 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:30:46.131 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:30:46.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5240afc60 msgr2=0x7ff5240b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5240afc60 0x7ff5240b2170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff53004c000 tx=0x7ff530049000 comp rx=0 tx=0).stop 2024-04-25T11:30:46.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538108a20 msgr2=0x7ff538199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538108a20 0x7ff538199b40 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff52800c9a0 tx=0x7ff52800ce60 comp rx=0 tx=0).stop 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 shutdown_connections 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5240afc60 0x7ff5240b2170 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff538108a20 0x7ff538199b40 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff53810d380 0x7ff53819de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 --2- 172.21.15.80:0/4005070754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff538102af0 0x7ff5381995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 >> 172.21.15.80:0/4005070754 conn(0x7ff538078100 msgr2=0x7ff5381040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 shutdown_connections 2024-04-25T11:30:46.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.135+0000 7ff53fd34640 1 -- 172.21.15.80:0/4005070754 wait complete. 2024-04-25T11:30:46.137 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:30:46.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:30:46.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 -- 172.21.15.80:0/692986806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 msgr2=0x7f51f81025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 --2- 172.21.15.80:0/692986806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f81025b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009900 tx=0x7f51f402a410 comp rx=0 tx=0).stop 2024-04-25T11:30:46.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 -- 172.21.15.80:0/692986806 shutdown_connections 2024-04-25T11:30:46.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 --2- 172.21.15.80:0/692986806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f810d380 0x7f51f810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 --2- 172.21.15.80:0/692986806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51f8102af0 0x7f51f8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 --2- 172.21.15.80:0/692986806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f81025b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 -- 172.21.15.80:0/692986806 >> 172.21.15.80:0/692986806 conn(0x7f51f8078110 msgr2=0x7f51f8078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 -- 172.21.15.80:0/692986806 shutdown_connections 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.254+0000 7f5200106640 1 -- 172.21.15.80:0/692986806 wait complete. 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 Processor -- start 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 -- start start 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51f8102af0 0x7f51f819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f810d380 0x7f51f819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8112be0 con 0x7f51f8108a20 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8112a60 con 0x7f51f810d380 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f5200106640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8112d60 con 0x7f51f8102af0 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f51fd6a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f51fd6a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f819ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59448/0 (socket says 172.21.15.80:59448) 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.255+0000 7f51fd6a1640 1 -- 172.21.15.80:0/99880274 learned_addr learned my addr 172.21.15.80:0/99880274 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fdea2640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51f8102af0 0x7f51f819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fe6a3640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f810d380 0x7f51f819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fd6a1640 1 -- 172.21.15.80:0/99880274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51f8102af0 msgr2=0x7f51f819b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fd6a1640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51f8102af0 0x7f51f819b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fd6a1640 1 -- 172.21.15.80:0/99880274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f810d380 msgr2=0x7f51f819bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fd6a1640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f810d380 0x7f51f819bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fd6a1640 1 -- 172.21.15.80:0/99880274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f81a6820 con 0x7f51f8108a20 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fdea2640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51f8102af0 0x7f51f819b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fe6a3640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f810d380 0x7f51f819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51fd6a1640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f819ba20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005fd0 tx=0x7f51e800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51eeffd640 1 -- 172.21.15.80:0/99880274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8017070 con 0x7f51f8108a20 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51eeffd640 1 -- 172.21.15.80:0/99880274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e8009c30 con 0x7f51f8108a20 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f81a6b10 con 0x7f51f8108a20 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f51eeffd640 1 -- 172.21.15.80:0/99880274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003d10 con 0x7f51f8108a20 2024-04-25T11:30:46.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.256+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f81a7060 con 0x7f51f8108a20 2024-04-25T11:30:46.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.257+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f806afa0 con 0x7f51f8108a20 2024-04-25T11:30:46.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.259+0000 7f51eeffd640 1 -- 172.21.15.80:0/99880274 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f51e8003eb0 con 0x7f51f8108a20 2024-04-25T11:30:46.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.259+0000 7f51eeffd640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51e40afc60 0x7f51e40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.259+0000 7f51fdea2640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51e40afc60 0x7f51e40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.259+0000 7f51eeffd640 1 -- 172.21.15.80:0/99880274 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f51e80df4f0 con 0x7f51f8108a20 2024-04-25T11:30:46.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.260+0000 7f51fdea2640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51e40afc60 0x7f51e40b2170 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f4032cc0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.263+0000 7f51eeffd640 1 -- 172.21.15.80:0/99880274 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f51e8020030 con 0x7f51f8108a20 2024-04-25T11:30:46.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:46 smithi080 ceph-mon[29126]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:46.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:46 smithi196 ceph-mon[32659]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:46.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.481+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51f806a4a0 con 0x7f51f8108a20 2024-04-25T11:30:46.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.481+0000 7f51eeffd640 1 -- 172.21.15.80:0/99880274 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f51e8009de0 con 0x7f51f8108a20 2024-04-25T11:30:46.472 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:30:46.472 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:30:46.472 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51e40afc60 msgr2=0x7f51e40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51e40afc60 0x7f51e40b2170 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f4032cc0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 msgr2=0x7f51f819ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f819ba20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005fd0 tx=0x7f51e800dde0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 shutdown_connections 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f51e40afc60 0x7f51e40b2170 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f8108a20 0x7f51f819ba20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f810d380 0x7f51f819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.483+0000 7f5200106640 1 --2- 172.21.15.80:0/99880274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51f8102af0 0x7f51f819b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.484+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 >> 172.21.15.80:0/99880274 conn(0x7f51f8078110 msgr2=0x7f51f81040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.484+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 shutdown_connections 2024-04-25T11:30:46.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.484+0000 7f5200106640 1 -- 172.21.15.80:0/99880274 wait complete. 2024-04-25T11:30:46.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:30:46.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:46 smithi082 ceph-mon[32440]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:46.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 -- 172.21.15.80:0/652188658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7750109b20 msgr2=0x7f7750101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 --2- 172.21.15.80:0/652188658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7750109b20 0x7f7750101c10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f774c009ca0 tx=0x7f774c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 -- 172.21.15.80:0/652188658 shutdown_connections 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 --2- 172.21.15.80:0/652188658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77501027c0 0x7f7750110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 --2- 172.21.15.80:0/652188658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7750109fc0 0x7f7750102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 --2- 172.21.15.80:0/652188658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7750109b20 0x7f7750101c10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 -- 172.21.15.80:0/652188658 >> 172.21.15.80:0/652188658 conn(0x7f7750077880 msgr2=0x7f7750077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 -- 172.21.15.80:0/652188658 shutdown_connections 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.605+0000 7f7758714640 1 -- 172.21.15.80:0/652188658 wait complete. 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 Processor -- start 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 -- start start 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77501027c0 0x7f775019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7750109b20 0x7f775019acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7750109fc0 0x7f775019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7750113d10 con 0x7f77501027c0 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7750113b90 con 0x7f7750109fc0 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7758714640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7750113e90 con 0x7f7750109b20 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77501027c0 0x7f775019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77501027c0 0x7f775019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58686/0 (socket says 172.21.15.80:58686) 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 -- 172.21.15.80:0/3850911428 learned_addr learned my addr 172.21.15.80:0/3850911428 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7755caf640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7750109b20 0x7f775019acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7756cb1640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7750109fc0 0x7f775019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 -- 172.21.15.80:0/3850911428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7750109b20 msgr2=0x7f775019acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7750109b20 0x7f775019acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 -- 172.21.15.80:0/3850911428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7750109fc0 msgr2=0x7f775019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7750109fc0 0x7f775019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 -- 172.21.15.80:0/3850911428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775019f5f0 con 0x7f77501027c0 2024-04-25T11:30:46.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f7755caf640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7750109b20 0x7f775019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:46.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.606+0000 7f77564b0640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77501027c0 0x7f775019a790 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f774c006010 tx=0x7f774c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.607+0000 7f77477fe640 1 -- 172.21.15.80:0/3850911428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c003bf0 con 0x7f77501027c0 2024-04-25T11:30:46.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.607+0000 7f77477fe640 1 -- 172.21.15.80:0/3850911428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f774c003d90 con 0x7f77501027c0 2024-04-25T11:30:46.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.607+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775019f880 con 0x7f77501027c0 2024-04-25T11:30:46.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.607+0000 7f77477fe640 1 -- 172.21.15.80:0/3850911428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c02fc20 con 0x7f77501027c0 2024-04-25T11:30:46.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.607+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775019fdd0 con 0x7f77501027c0 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.609+0000 7f775f5c8740 1 Processor -- start 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.609+0000 7f77477fe640 1 -- 172.21.15.80:0/3850911428 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f774c0046a0 con 0x7f77501027c0 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.609+0000 7f775f5c8740 1 -- start start 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.609+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce89810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.609+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce89d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.609+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f775f5c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5577dcdeed80 con 0x5577dcac76b0 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f775f5c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5577dcda8a20 con 0x5577dcae8390 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f775f5c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5577dcdead40 con 0x5577dcabf4d0 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58688/0 (socket says 172.21.15.80:58688) 2024-04-25T11:30:46.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 -- 172.21.15.80:0/2221021681 learned_addr learned my addr 172.21.15.80:0/2221021681 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f77477fe640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f773c0afc60 0x7f773c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7756cb1640 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce89810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f77564b0640 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce89d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7756cb1640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f773c0afc60 0x7f773c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 -- 172.21.15.80:0/2221021681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 msgr2=0x5577dce89d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce89d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 -- 172.21.15.80:0/2221021681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 msgr2=0x5577dce89810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce89810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 -- 172.21.15.80:0/2221021681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577dcdb3c30 con 0x5577dcac76b0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7756cb1640 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce89810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f77477fe640 1 -- 172.21.15.80:0/3850911428 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f774c100550 con 0x7f77501027c0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7755caf640 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce966a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7740009b60 tx=0x7f774000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58579234d922c389 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7756cb1640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f773c0afc60 0x7f773c0b2170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5577dce86980 tx=0x7f7748004730 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.610+0000 7f7744ff9640 1 -- 172.21.15.80:0/2221021681 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7740016070 con 0x5577dcac76b0 2024-04-25T11:30:46.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f7744ff9640 1 -- 172.21.15.80:0/2221021681 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7740009e50 con 0x5577dcac76b0 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f7744ff9640 1 -- 172.21.15.80:0/2221021681 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7740011470 con 0x5577dcac76b0 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f775f5c8740 1 -- 172.21.15.80:0/2221021681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 msgr2=0x5577dce966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce966a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7740009b60 tx=0x7f774000e6c0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f775f5c8740 1 -- 172.21.15.80:0/2221021681 shutdown_connections 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce966a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce89d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2221021681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce89810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.611+0000 7f775f5c8740 1 -- 172.21.15.80:0/2221021681 >> 172.21.15.80:0/2221021681 conn(0x5577dcadc4e0 msgr2=0x5577dce85fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 -- 172.21.15.80:0/2221021681 shutdown_connections 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 -- 172.21.15.80:0/2221021681 wait complete. 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 -- start start 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 Processor -- start 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce941e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcac76b0 0x5577dce94720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcae8390 0x5577dcea0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5577dce96d90 con 0x5577dcae8390 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5577dcd75dc0 con 0x5577dcac76b0 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5577dce96f10 con 0x5577dcabf4d0 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f775f5c8740 10 client.0 _ll_register_callbacks cb 0x5577dcd91600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f7756cb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcae8390 0x5577dcea0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f7756cb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcae8390 0x5577dcea0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58690/0 (socket says 172.21.15.80:58690) 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f7756cb1640 1 -- 172.21.15.80:0/731276983 learned_addr learned my addr 172.21.15.80:0/731276983 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f77564b0640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce941e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.612+0000 7f7755caf640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcac76b0 0x5577dce94720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7756cb1640 1 -- 172.21.15.80:0/731276983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 msgr2=0x5577dce941e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7756cb1640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce941e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7756cb1640 1 -- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcac76b0 msgr2=0x5577dce94720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7756cb1640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcac76b0 0x5577dce94720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7756cb1640 1 -- 172.21.15.80:0/731276983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577dcb003f0 con 0x5577dcae8390 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7755caf640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcac76b0 0x5577dce94720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7756cb1640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcae8390 0x5577dcea0210 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7748013f00 tx=0x7f77480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9854b4b1e0f5b940 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7739ffb640 1 -- 172.21.15.80:0/731276983 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748023070 con 0x5577dcae8390 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7739ffb640 1 -- 172.21.15.80:0/731276983 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7748005220 con 0x5577dcae8390 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7740009e50 con 0x5577dcae8390 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7739ffb640 1 -- 172.21.15.80:0/731276983 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f774802e050 con 0x5577dcae8390 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f775f5c8740 10 client.17037 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5577dcbca7d0 con 0x5577dcae8390 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7739ffb640 1 -- 172.21.15.80:0/731276983 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7740009e50 con 0x5577dcae8390 2024-04-25T11:30:46.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f7739ffb640 1 -- 172.21.15.80:0/731276983 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f774801f770 con 0x5577dcae8390 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f775f5c8740 10 client.17037 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.613+0000 7f775f5c8740 10 client.17037 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.614+0000 7f775f5c8740 20 client.17037 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.614+0000 7f775f5c8740 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dcaa6f60 0x5577dcea6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.614+0000 7f775f5c8740 4 client.17037 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.614+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577dcdfc990 con 0x5577dcaa6f60 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.614+0000 7f77564b0640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dcaa6f60 0x5577dcea6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.614+0000 7f7739ffb640 10 client.17037 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.614+0000 7f77564b0640 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dcaa6f60 0x5577dcea6680 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f333c4a2ca9a0bb8 server_cookie=9dd477d158bece7 in_seq=0 out_seq=0 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f7739ffb640 1 -- 172.21.15.80:0/731276983 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5577dcdfc990 con 0x5577dcaa6f60 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f7739ffb640 10 client.17037 handle_command_reply: tid=0 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 client.17037 shutdown 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcae8390 msgr2=0x5577dcea0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcae8390 0x5577dcea0210 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7748013f00 tx=0x7f77480046c0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 shutdown_connections 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dcaa6f60 0x5577dcea6680 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcae8390 0x5577dcea0210 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcac76b0 0x5577dce94720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f7739ffb640 0 client.17037 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 --2- 172.21.15.80:0/731276983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce941e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 >> 172.21.15.80:0/731276983 conn(0x5577dcadc4e0 msgr2=0x5577dce8b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 shutdown_connections 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 1 -- 172.21.15.80:0/731276983 wait complete. 2024-04-25T11:30:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.615+0000 7f775f5c8740 20 client.17037 trim_cache size 0 max 16384 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 Processor -- start 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 -- start start 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcabf4d0 0x5577dce8f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcac76b0 0x5577dce85e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce9fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f77501b2260 con 0x5577dcabf4d0 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77501afb30 con 0x5577dcae8390 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f775f5c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f77501ad980 con 0x5577dcac76b0 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcabf4d0 0x5577dce8f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcabf4d0 0x5577dce8f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58702/0 (socket says 172.21.15.80:58702) 2024-04-25T11:30:46.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 -- 172.21.15.80:0/2905755123 learned_addr learned my addr 172.21.15.80:0/2905755123 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 -- 172.21.15.80:0/2905755123 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcac76b0 msgr2=0x5577dce85e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 --2- 172.21.15.80:0/2905755123 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcac76b0 0x5577dce85e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 -- 172.21.15.80:0/2905755123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 msgr2=0x5577dce9fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 --2- 172.21.15.80:0/2905755123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce9fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 -- 172.21.15.80:0/2905755123 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577dce89fd0 con 0x5577dcabf4d0 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f77564b0640 1 --2- 172.21.15.80:0/2905755123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcabf4d0 0x5577dce8f7d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f774c0c87a0 tx=0x7f774c0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68688c01addef046 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.629+0000 7f773bfff640 1 -- 172.21.15.80:0/2905755123 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c0c8f10 con 0x5577dcabf4d0 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f773bfff640 1 -- 172.21.15.80:0/2905755123 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f774c036040 con 0x5577dcabf4d0 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f773bfff640 1 -- 172.21.15.80:0/2905755123 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c0c4aa0 con 0x5577dcabf4d0 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 -- 172.21.15.80:0/2905755123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcabf4d0 msgr2=0x5577dce8f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2905755123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcabf4d0 0x5577dce8f7d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f774c0c87a0 tx=0x7f774c0cc040 comp rx=0 tx=0).stop 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 -- 172.21.15.80:0/2905755123 shutdown_connections 2024-04-25T11:30:46.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2905755123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce9fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2905755123 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcac76b0 0x5577dce85e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 --2- 172.21.15.80:0/2905755123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcabf4d0 0x5577dce8f7d0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 -- 172.21.15.80:0/2905755123 >> 172.21.15.80:0/2905755123 conn(0x5577dcadc4e0 msgr2=0x5577dce85760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 -- 172.21.15.80:0/2905755123 shutdown_connections 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.630+0000 7f775f5c8740 1 -- 172.21.15.80:0/2905755123 wait complete. 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 -- start start 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 Processor -- start 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce9c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce97900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce97e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f77501adff0 con 0x5577dcac76b0 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77501af460 con 0x5577dcae8390 2024-04-25T11:30:46.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f77501ae6c0 con 0x5577dcabf4d0 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f775f5c8740 10 client.0 _ll_register_callbacks cb 0x7f77480098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce97900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce97900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58706/0 (socket says 172.21.15.80:58706) 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 -- 172.21.15.80:0/4057543294 learned_addr learned my addr 172.21.15.80:0/4057543294 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f77564b0640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce9c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 -- 172.21.15.80:0/4057543294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 msgr2=0x5577dce9c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce9c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 -- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 msgr2=0x5577dce97e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7756cb1640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce97e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce97e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f7755caf640 1 -- 172.21.15.80:0/4057543294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577dce983b0 con 0x5577dcac76b0 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.631+0000 7f77564b0640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce9c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f7755caf640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce97900 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7740009ab0 tx=0x7f77400048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c32eb5ef52a6782 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f7739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f7739ffb640 1 -- 172.21.15.80:0/4057543294 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7740016040 con 0x5577dcac76b0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f7739ffb640 1 -- 172.21.15.80:0/4057543294 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f7740011880 con 0x5577dcac76b0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f774c036040 con 0x5577dcac76b0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f7739ffb640 1 -- 172.21.15.80:0/4057543294 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7740009400 con 0x5577dcac76b0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 10 client.17043 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5577dcf0e710 con 0x5577dcac76b0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f7739ffb640 1 -- 172.21.15.80:0/4057543294 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f774c036040 con 0x5577dcac76b0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f7739ffb640 1 -- 172.21.15.80:0/4057543294 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f774000f040 con 0x5577dcac76b0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 10 client.17043 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 10 client.17043 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 20 client.17043 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dca7c3a0 0x5577dcf10b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 4 client.17043 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.632+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577dcdf6800 con 0x5577dca7c3a0 2024-04-25T11:30:46.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f77564b0640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dca7c3a0 0x5577dcf10b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f7739ffb640 10 client.17043 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f77564b0640 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dca7c3a0 0x5577dcf10b50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64719ada2b16004a server_cookie=3ac488ac8ec086f1 in_seq=0 out_seq=0 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f7739ffb640 1 -- 172.21.15.80:0/4057543294 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577dcdf6800 con 0x5577dca7c3a0 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f7739ffb640 10 client.17043 handle_command_reply: tid=0 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 client.17043 shutdown 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 msgr2=0x5577dce97900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce97900 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7740009ab0 tx=0x7f77400048b0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 shutdown_connections 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5577dca7c3a0 0x5577dcf10b50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5577dcac76b0 0x5577dce97900 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f7739ffb640 0 client.17043 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5577dcae8390 0x5577dce97e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 --2- 172.21.15.80:0/4057543294 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5577dcabf4d0 0x5577dce9c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 >> 172.21.15.80:0/4057543294 conn(0x5577dcadc4e0 msgr2=0x5577dce85700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 shutdown_connections 2024-04-25T11:30:46.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 1 -- 172.21.15.80:0/4057543294 wait complete. 2024-04-25T11:30:46.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.633+0000 7f775f5c8740 20 client.17043 trim_cache size 0 max 16384 2024-04-25T11:30:46.631 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:30:46.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f773c0afc60 msgr2=0x7f773c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f773c0afc60 0x7f773c0b2170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5577dce86980 tx=0x7f7748004730 comp rx=0 tx=0).stop 2024-04-25T11:30:46.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77501027c0 msgr2=0x7f775019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77501027c0 0x7f775019a790 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f774c006010 tx=0x7f774c0319f0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 shutdown_connections 2024-04-25T11:30:46.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f773c0afc60 0x7f773c0b2170 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7750109fc0 0x7f775019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7750109b20 0x7f775019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 --2- 172.21.15.80:0/3850911428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77501027c0 0x7f775019a790 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 >> 172.21.15.80:0/3850911428 conn(0x7f7750077880 msgr2=0x7f7750105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 shutdown_connections 2024-04-25T11:30:46.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.634+0000 7f7758714640 1 -- 172.21.15.80:0/3850911428 wait complete. 2024-04-25T11:30:46.635 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:30:46.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 -- 172.21.15.80:0/2107107957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb600104c70 msgr2=0x7fb600105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 --2- 172.21.15.80:0/2107107957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb600104c70 0x7fb600105080 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009900 tx=0x7fb5fc02a480 comp rx=0 tx=0).stop 2024-04-25T11:30:46.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 -- 172.21.15.80:0/2107107957 shutdown_connections 2024-04-25T11:30:46.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 --2- 172.21.15.80:0/2107107957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60010e080 0x7fb600110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 --2- 172.21.15.80:0/2107107957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60010b6d0 0x7fb60010daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 --2- 172.21.15.80:0/2107107957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb600104c70 0x7fb600105080 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 -- 172.21.15.80:0/2107107957 >> 172.21.15.80:0/2107107957 conn(0x7fb600078100 msgr2=0x7fb600078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 -- 172.21.15.80:0/2107107957 shutdown_connections 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 -- 172.21.15.80:0/2107107957 wait complete. 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 Processor -- start 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.755+0000 7fb608546640 1 -- start start 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb608546640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104c70 0x7fb60019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb608546640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60010b6d0 0x7fb60019ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb608546640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60010e080 0x7fb60019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb608546640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb600113cc0 con 0x7fb60010b6d0 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb608546640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb600113b40 con 0x7fb600104c70 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb608546640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb600113e40 con 0x7fb60010e080 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60010b6d0 0x7fb60019ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60010b6d0 0x7fb60019ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58734/0 (socket says 172.21.15.80:58734) 2024-04-25T11:30:46.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 -- 172.21.15.80:0/1034844997 learned_addr learned my addr 172.21.15.80:0/1034844997 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb6062e2640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104c70 0x7fb60019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 -- 172.21.15.80:0/1034844997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60010e080 msgr2=0x7fb60019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60010e080 0x7fb60019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 -- 172.21.15.80:0/1034844997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104c70 msgr2=0x7fb60019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104c70 0x7fb60019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 -- 172.21.15.80:0/1034844997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60019f5c0 con 0x7fb60010b6d0 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb605ae1640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60010b6d0 0x7fb60019ad40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c950 tx=0x7fb5f000ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb5f77fe640 1 -- 172.21.15.80:0/1034844997 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007c70 con 0x7fb60010b6d0 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.756+0000 7fb5f77fe640 1 -- 172.21.15.80:0/1034844997 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f0007e10 con 0x7fb60010b6d0 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.757+0000 7fb5f77fe640 1 -- 172.21.15.80:0/1034844997 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00187f0 con 0x7fb60010b6d0 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.757+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60019f8b0 con 0x7fb60010b6d0 2024-04-25T11:30:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.757+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60019fdb0 con 0x7fb60010b6d0 2024-04-25T11:30:46.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.759+0000 7fb5f77fe640 1 -- 172.21.15.80:0/1034844997 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fb5f0018990 con 0x7fb60010b6d0 2024-04-25T11:30:46.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.759+0000 7fb60f3fb740 1 Processor -- start 2024-04-25T11:30:46.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.759+0000 7fb60f3fb740 1 -- start start 2024-04-25T11:30:46.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a058390 0x55fa3a3f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a35ed80 con 0x55fa3a0376b0 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a318a20 con 0x55fa3a02f4d0 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a35ad40 con 0x55fa3a058390 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58748/0 (socket says 172.21.15.80:58748) 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 -- 172.21.15.80:0/2245807129 learned_addr learned my addr 172.21.15.80:0/2245807129 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb5f77fe640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb5ec0afce0 0x7fb5ec0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb606ae3640 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a058390 0x55fa3a3f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 -- 172.21.15.80:0/2245807129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a058390 msgr2=0x55fa3a3f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a058390 0x55fa3a3f9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 -- 172.21.15.80:0/2245807129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a02f4d0 msgr2=0x55fa3a3f9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 -- 172.21.15.80:0/2245807129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3a323c30 con 0x55fa3a0376b0 2024-04-25T11:30:46.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb606ae3640 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a058390 0x55fa3a3f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb5f77fe640 1 -- 172.21.15.80:0/1034844997 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb5f00df0f0 con 0x7fb60010b6d0 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb606ae3640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb5ec0afce0 0x7fb5ec0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.760+0000 7fb605ae1640 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4066a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00a45b0 tx=0x7fb5f00620e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa135fdb93a9c398 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.761+0000 7fb5f4bfe640 1 -- 172.21.15.80:0/2245807129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00a7a40 con 0x55fa3a0376b0 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.761+0000 7fb5f4bfe640 1 -- 172.21.15.80:0/2245807129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f00ab6f0 con 0x55fa3a0376b0 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.761+0000 7fb5f4bfe640 1 -- 172.21.15.80:0/2245807129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00a35d0 con 0x55fa3a0376b0 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.761+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2245807129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 msgr2=0x55fa3a4066a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.761+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4066a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00a45b0 tx=0x7fb5f00620e0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.761+0000 7fb606ae3640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb5ec0afce0 0x7fb5ec0b21f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55fa3a3f6980 tx=0x7fb5f8004a40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2245807129 shutdown_connections 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4066a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2245807129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a058390 0x55fa3a3f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2245807129 >> 172.21.15.80:0/2245807129 conn(0x55fa3a04c4e0 msgr2=0x55fa3a3f5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2245807129 shutdown_connections 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2245807129 wait complete. 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- start start 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 Processor -- start 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a404260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a4047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a058390 0x55fa3a410150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a406cd0 con 0x55fa3a02f4d0 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a2e5dc0 con 0x55fa3a058390 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fa3a406e50 con 0x55fa3a0376b0 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb60f3fb740 10 client.0 _ll_register_callbacks cb 0x55fa3a301600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb6062e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a404260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb6062e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a404260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58756/0 (socket says 172.21.15.80:58756) 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.762+0000 7fb6062e2640 1 -- 172.21.15.80:0/2161893905 learned_addr learned my addr 172.21.15.80:0/2161893905 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb606ae3640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a058390 0x55fa3a410150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb605ae1640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a4047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb6062e2640 1 -- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 msgr2=0x55fa3a4047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a4047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb6062e2640 1 -- 172.21.15.80:0/2161893905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a058390 msgr2=0x55fa3a410150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a058390 0x55fa3a410150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb6062e2640 1 -- 172.21.15.80:0/2161893905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3a0703f0 con 0x55fa3a02f4d0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb606ae3640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a058390 0x55fa3a410150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a404260 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc02a9a0 tx=0x7fb5fc031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f2d8109ec63eba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb5e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2161893905 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc035040 con 0x55fa3a02f4d0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2161893905 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb5fc004240 con 0x55fa3a02f4d0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f00ab6f0 con 0x55fa3a02f4d0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2161893905 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb5fc004440 con 0x55fa3a02f4d0 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb60f3fb740 10 client.17055 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fa3a13a7d0 con 0x55fa3a02f4d0 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.763+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2161893905 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f00ab6f0 con 0x55fa3a02f4d0 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2161893905 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb5fc004bc0 con 0x55fa3a02f4d0 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb60f3fb740 10 client.17055 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb60f3fb740 10 client.17055 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb60f3fb740 20 client.17055 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a016f60 0x55fa3a416580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb60f3fb740 4 client.17055 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa3a36c990 con 0x55fa3a016f60 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.764+0000 7fb605ae1640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a016f60 0x55fa3a416580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.765+0000 7fb5e9ffb640 10 client.17055 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:46.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.765+0000 7fb605ae1640 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a016f60 0x55fa3a416580 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c81d83b2f2f00880 server_cookie=9e73c4d00b3003d9 in_seq=0 out_seq=0 2024-04-25T11:30:46.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.765+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2161893905 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fa3a36c990 con 0x55fa3a016f60 2024-04-25T11:30:46.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.765+0000 7fb5e9ffb640 10 client.17055 handle_command_reply: tid=0 2024-04-25T11:30:46.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.765+0000 7fb60f3fb740 1 client.17055 shutdown 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 msgr2=0x55fa3a404260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a404260 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc02a9a0 tx=0x7fb5fc031810 comp rx=0 tx=0).stop 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 shutdown_connections 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a016f60 0x55fa3a416580 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a058390 0x55fa3a410150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb5e9ffb640 0 client.17055 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a4047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2161893905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a404260 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 >> 172.21.15.80:0/2161893905 conn(0x55fa3a04c4e0 msgr2=0x55fa3a3fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 shutdown_connections 2024-04-25T11:30:46.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2161893905 wait complete. 2024-04-25T11:30:46.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.766+0000 7fb60f3fb740 20 client.17055 trim_cache size 0 max 16384 2024-04-25T11:30:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 Processor -- start 2024-04-25T11:30:46.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 -- start start 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a3ff850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a40fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b0000 con 0x55fa3a02f4d0 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ad8d0 con 0x55fa3a016f60 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.779+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ab740 con 0x55fa3a0376b0 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58760/0 (socket says 172.21.15.80:58760) 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 -- 172.21.15.80:0/178134486 learned_addr learned my addr 172.21.15.80:0/178134486 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb606ae3640 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a40fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 -- 172.21.15.80:0/178134486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 msgr2=0x55fa3a40fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a40fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 -- 172.21.15.80:0/178134486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 msgr2=0x55fa3a3ff850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a3ff850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 -- 172.21.15.80:0/178134486 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3a3f95a0 con 0x55fa3a02f4d0 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb606ae3640 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a40fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb605ae1640 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f5f10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00a33c0 tx=0x7fb5f00a6ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825c11794b90493c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb5ebfff640 1 -- 172.21.15.80:0/178134486 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00a6e50 con 0x55fa3a02f4d0 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb5ebfff640 1 -- 172.21.15.80:0/178134486 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f00a7a40 con 0x55fa3a02f4d0 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.780+0000 7fb5ebfff640 1 -- 172.21.15.80:0/178134486 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0016300 con 0x55fa3a02f4d0 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 -- 172.21.15.80:0/178134486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 msgr2=0x55fa3a3f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f5f10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00a33c0 tx=0x7fb5f00a6ab0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 -- 172.21.15.80:0/178134486 shutdown_connections 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a02f4d0 0x55fa3a3f5f10 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a0376b0 0x55fa3a40fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/178134486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a3ff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 -- 172.21.15.80:0/178134486 >> 172.21.15.80:0/178134486 conn(0x55fa3a04c4e0 msgr2=0x55fa3a3f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 -- 172.21.15.80:0/178134486 shutdown_connections 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 -- 172.21.15.80:0/178134486 wait complete. 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 -- start start 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.781+0000 7fb60f3fb740 1 Processor -- start 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a476d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a02f4d0 0x55fa3a477240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001abd90 con 0x55fa3a0376b0 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ad200 con 0x55fa3a016f60 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001ac460 con 0x55fa3a02f4d0 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 10 client.0 _ll_register_callbacks cb 0x7fb5fc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4076f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58768/0 (socket says 172.21.15.80:58768) 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 -- 172.21.15.80:0/2527300473 learned_addr learned my addr 172.21.15.80:0/2527300473 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a476d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 -- 172.21.15.80:0/2527300473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a02f4d0 msgr2=0x55fa3a477240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a02f4d0 0x55fa3a477240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 -- 172.21.15.80:0/2527300473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 msgr2=0x55fa3a476d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a476d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 -- 172.21.15.80:0/2527300473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3a410d50 con 0x55fa3a0376b0 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a476d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb606ae3640 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4076f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8005c40 tx=0x7fb5f80094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0216b63c3a09ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb5e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2527300473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80127c0 con 0x55fa3a0376b0 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f00a7a40 con 0x55fa3a0376b0 2024-04-25T11:30:46.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2527300473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7fb5f8012960 con 0x55fa3a0376b0 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2527300473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb5f8012b60 con 0x55fa3a0376b0 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.782+0000 7fb60f3fb740 10 client.17061 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fa3a47e180 con 0x55fa3a0376b0 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2527300473 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f00a7a40 con 0x55fa3a0376b0 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2527300473 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb5f8028420 con 0x55fa3a0376b0 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb60f3fb740 10 client.17061 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb60f3fb740 10 client.17061 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb60f3fb740 20 client.17061 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a058390 0x55fa3a480920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb60f3fb740 4 client.17061 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa3a366800 con 0x55fa3a058390 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.783+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a058390 0x55fa3a480920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb5e9ffb640 10 client.17061 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb6062e2640 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a058390 0x55fa3a480920 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83b3fcb82c5b87d3 server_cookie=3a67acf3ef7b23b in_seq=0 out_seq=0 2024-04-25T11:30:46.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb5e9ffb640 1 -- 172.21.15.80:0/2527300473 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa3a366800 con 0x55fa3a058390 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb5e9ffb640 10 client.17061 handle_command_reply: tid=0 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 client.17061 shutdown 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 msgr2=0x55fa3a4076f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4076f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8005c40 tx=0x7fb5f80094d0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 shutdown_connections 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa3a0376b0 0x55fa3a4076f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fa3a058390 0x55fa3a480920 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa3a02f4d0 0x55fa3a477240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb5e9ffb640 0 client.17061 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 --2- 172.21.15.80:0/2527300473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa3a016f60 0x55fa3a476d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 >> 172.21.15.80:0/2527300473 conn(0x55fa3a04c4e0 msgr2=0x55fa3a3fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 shutdown_connections 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 1 -- 172.21.15.80:0/2527300473 wait complete. 2024-04-25T11:30:46.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.784+0000 7fb60f3fb740 20 client.17061 trim_cache size 0 max 16384 2024-04-25T11:30:46.782 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:30:46.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb5ec0afce0 msgr2=0x7fb5ec0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb5ec0afce0 0x7fb5ec0b21f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55fa3a3f6980 tx=0x7fb5f8004a40 comp rx=0 tx=0).stop 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60010b6d0 msgr2=0x7fb60019ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60010b6d0 0x7fb60019ad40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c950 tx=0x7fb5f000ce10 comp rx=0 tx=0).stop 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 shutdown_connections 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb5ec0afce0 0x7fb5ec0b21f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb60010b6d0 0x7fb60019ad40 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb60010e080 0x7fb60019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 --2- 172.21.15.80:0/1034844997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104c70 0x7fb60019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 >> 172.21.15.80:0/1034844997 conn(0x7fb600078100 msgr2=0x7fb600101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 shutdown_connections 2024-04-25T11:30:46.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.785+0000 7fb608546640 1 -- 172.21.15.80:0/1034844997 wait complete. 2024-04-25T11:30:46.786 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:30:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 -- 172.21.15.80:0/1759097956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 msgr2=0x7f5be4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 --2- 172.21.15.80:0/1759097956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be4110640 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009ca0 tx=0x7f5bdc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 -- 172.21.15.80:0/1759097956 shutdown_connections 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 --2- 172.21.15.80:0/1759097956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be4110640 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 --2- 172.21.15.80:0/1759097956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4109fc0 0x7f5be4103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 --2- 172.21.15.80:0/1759097956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4109b20 0x7f5be41036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 -- 172.21.15.80:0/1759097956 >> 172.21.15.80:0/1759097956 conn(0x7f5be40ff1e0 msgr2=0x7f5be4101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 -- 172.21.15.80:0/1759097956 shutdown_connections 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.906+0000 7f5beb17a640 1 -- 172.21.15.80:0/1759097956 wait complete. 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 Processor -- start 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 -- start start 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4109b20 0x7f5be419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4109fc0 0x7f5be419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4113d30 con 0x7f5be4104270 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4113bb0 con 0x7f5be4109fc0 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5beb17a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4113eb0 con 0x7f5be4109b20 2024-04-25T11:30:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5be8f16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5be8f16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58788/0 (socket says 172.21.15.80:58788) 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.907+0000 7f5be8f16640 1 -- 172.21.15.80:0/2753873872 learned_addr learned my addr 172.21.15.80:0/2753873872 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be3fff640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4109b20 0x7f5be419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be9717640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4109fc0 0x7f5be419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be8f16640 1 -- 172.21.15.80:0/2753873872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4109b20 msgr2=0x7f5be419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be8f16640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4109b20 0x7f5be419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be8f16640 1 -- 172.21.15.80:0/2753873872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4109fc0 msgr2=0x7f5be419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be8f16640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4109fc0 0x7f5be419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be8f16640 1 -- 172.21.15.80:0/2753873872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be419f570 con 0x7f5be4104270 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be8f16640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be419a710 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800d770 tx=0x7f5bd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be1ffb640 1 -- 172.21.15.80:0/2753873872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8017070 con 0x7f5be4104270 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be1ffb640 1 -- 172.21.15.80:0/2753873872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd8009c30 con 0x7f5be4104270 2024-04-25T11:30:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be419f860 con 0x7f5be4104270 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5be1ffb640 1 -- 172.21.15.80:0/2753873872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800f620 con 0x7f5be4104270 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.908+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be41a71e0 con 0x7f5be4104270 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be1ffb640 1 -- 172.21.15.80:0/2753873872 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f5bd801a070 con 0x7f5be4104270 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 Processor -- start 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 -- start start 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5bd390 0x55ef0a95e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a95ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55ef0a8c3d80 con 0x55ef0a5944d0 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ef0a87da20 con 0x55ef0a5bd390 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5bf202a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ef0a8bfd40 con 0x55ef0a59c6b0 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a95ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a95ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58790/0 (socket says 172.21.15.80:58790) 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 -- 172.21.15.80:0/1825834692 learned_addr learned my addr 172.21.15.80:0/1825834692 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be9717640 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5bd390 0x55ef0a95e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be3fff640 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 -- 172.21.15.80:0/1825834692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 msgr2=0x55ef0a96b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 -- 172.21.15.80:0/1825834692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5bd390 msgr2=0x55ef0a95e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5bd390 0x55ef0a95e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be1ffb640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5bd40afc60 0x7f5bd40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be8f16640 1 -- 172.21.15.80:0/1825834692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0a888c30 con 0x55ef0a5944d0 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.911+0000 7f5be9717640 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5bd390 0x55ef0a95e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.912+0000 7f5be3fff640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5bd40afc60 0x7f5bd40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.912+0000 7f5be8f16640 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a95ed50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80dc2f0 tx=0x7f5bd80a34e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc067562e84f5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.912+0000 7f5be1ffb640 1 -- 172.21.15.80:0/2753873872 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f5bd80dec20 con 0x7f5be4104270 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.912+0000 7f5bceffd640 1 -- 172.21.15.80:0/1825834692 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8021020 con 0x55ef0a5944d0 2024-04-25T11:30:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.912+0000 7f5bceffd640 1 -- 172.21.15.80:0/1825834692 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd80e2e30 con 0x55ef0a5944d0 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.912+0000 7f5bceffd640 1 -- 172.21.15.80:0/1825834692 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80a6ba0 con 0x55ef0a5944d0 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 -- 172.21.15.80:0/1825834692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 msgr2=0x55ef0a95ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5be3fff640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5bd40afc60 0x7f5bd40b2170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0005fd0 tx=0x7f5bd0005d10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a95ed50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80dc2f0 tx=0x7f5bd80a34e0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 -- 172.21.15.80:0/1825834692 shutdown_connections 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a95ed50 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 --2- 172.21.15.80:0/1825834692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5bd390 0x55ef0a95e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 -- 172.21.15.80:0/1825834692 >> 172.21.15.80:0/1825834692 conn(0x55ef0a5b14e0 msgr2=0x55ef0a95afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 -- 172.21.15.80:0/1825834692 shutdown_connections 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 -- 172.21.15.80:0/1825834692 wait complete. 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 -- start start 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.913+0000 7f5bf202a740 1 Processor -- start 2024-04-25T11:30:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5944d0 0x55ef0a9692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a969810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a975210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55ef0a96bd90 con 0x55ef0a5bd390 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ef0a84adc0 con 0x55ef0a59c6b0 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ef0a96bf10 con 0x55ef0a5944d0 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 10 client.0 _ll_register_callbacks cb 0x55ef0a866600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a975210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a975210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58796/0 (socket says 172.21.15.80:58796) 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 -- 172.21.15.80:0/4049699589 learned_addr learned my addr 172.21.15.80:0/4049699589 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be8f16640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5944d0 0x55ef0a9692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be3fff640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a969810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 -- 172.21.15.80:0/4049699589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5944d0 msgr2=0x55ef0a9692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5944d0 0x55ef0a9692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 -- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 msgr2=0x55ef0a969810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a969810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 -- 172.21.15.80:0/4049699589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef0a5d53f0 con 0x55ef0a5bd390 2024-04-25T11:30:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be3fff640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a969810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5be9717640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a975210 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc02b0b0 tx=0x7f5bdc02f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce5d50256712fb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bc3fff640 1 -- 172.21.15.80:0/4049699589 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc003970 con 0x55ef0a5bd390 2024-04-25T11:30:46.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bc3fff640 1 -- 172.21.15.80:0/4049699589 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f5bdc003b10 con 0x55ef0a5bd390 2024-04-25T11:30:46.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.914+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd80e2e30 con 0x55ef0a5bd390 2024-04-25T11:30:46.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bc3fff640 1 -- 172.21.15.80:0/4049699589 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5bdc003d10 con 0x55ef0a5bd390 2024-04-25T11:30:46.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 10 client.17073 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ef0a69f7d0 con 0x55ef0a5bd390 2024-04-25T11:30:46.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bc3fff640 1 -- 172.21.15.80:0/4049699589 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd80e2e30 con 0x55ef0a5bd390 2024-04-25T11:30:46.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bc3fff640 1 -- 172.21.15.80:0/4049699589 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5bdc044070 con 0x55ef0a5bd390 2024-04-25T11:30:46.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 10 client.17073 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 10 client.17073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:46.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 20 client.17073 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a57bf60 0x55ef0a97b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 4 client.17073 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef0a8d1990 con 0x55ef0a57bf60 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.915+0000 7f5be8f16640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a57bf60 0x55ef0a97b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.916+0000 7f5be8f16640 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a57bf60 0x55ef0a97b750 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb6a7549c6cde4e3 server_cookie=fbbb77993267f339 in_seq=0 out_seq=0 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.916+0000 7f5bc3fff640 10 client.17073 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.916+0000 7f5bc3fff640 1 -- 172.21.15.80:0/4049699589 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ef0a8d1990 con 0x55ef0a57bf60 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.916+0000 7f5bc3fff640 10 client.17073 handle_command_reply: tid=0 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.916+0000 7f5bf202a740 1 client.17073 shutdown 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 msgr2=0x55ef0a975210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a975210 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc02b0b0 tx=0x7f5bdc02f400 comp rx=0 tx=0).stop 2024-04-25T11:30:46.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 shutdown_connections 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a57bf60 0x55ef0a97b750 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a975210 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a969810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bc3fff640 0 client.17073 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 --2- 172.21.15.80:0/4049699589 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5944d0 0x55ef0a9692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 >> 172.21.15.80:0/4049699589 conn(0x55ef0a5b14e0 msgr2=0x55ef0a960530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 shutdown_connections 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 1 -- 172.21.15.80:0/4049699589 wait complete. 2024-04-25T11:30:46.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.917+0000 7f5bf202a740 20 client.17073 trim_cache size 0 max 16384 2024-04-25T11:30:46.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 Processor -- start 2024-04-25T11:30:46.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 -- start start 2024-04-25T11:30:46.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a974e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a967990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5bd390 0x55ef0a967ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b2270 con 0x55ef0a5944d0 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41afb40 con 0x55ef0a59c6b0 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.930+0000 7f5bf202a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41ad990 con 0x55ef0a5bd390 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a974e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a974e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58802/0 (socket says 172.21.15.80:58802) 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 -- 172.21.15.80:0/3066134410 learned_addr learned my addr 172.21.15.80:0/3066134410 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be3fff640 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a967990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 -- 172.21.15.80:0/3066134410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5bd390 msgr2=0x55ef0a967ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5bd390 0x55ef0a967ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 -- 172.21.15.80:0/3066134410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 msgr2=0x55ef0a967990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a967990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 -- 172.21.15.80:0/3066134410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0a960050 con 0x55ef0a5944d0 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5be8f16640 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a974e70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009610 tx=0x7f5bd80a3550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9571aca55e36fd2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5bce7fc640 1 -- 172.21.15.80:0/3066134410 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80aa070 con 0x55ef0a5944d0 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5bce7fc640 1 -- 172.21.15.80:0/3066134410 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd80a68e0 con 0x55ef0a5944d0 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.931+0000 7f5bce7fc640 1 -- 172.21.15.80:0/3066134410 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8021040 con 0x55ef0a5944d0 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 -- 172.21.15.80:0/3066134410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 msgr2=0x55ef0a974e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a974e70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009610 tx=0x7f5bd80a3550 comp rx=0 tx=0).stop 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 -- 172.21.15.80:0/3066134410 shutdown_connections 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a5bd390 0x55ef0a967ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a59c6b0 0x55ef0a967990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3066134410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5944d0 0x55ef0a974e70 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 -- 172.21.15.80:0/3066134410 >> 172.21.15.80:0/3066134410 conn(0x55ef0a5b14e0 msgr2=0x55ef0a9692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 -- 172.21.15.80:0/3066134410 shutdown_connections 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 -- 172.21.15.80:0/3066134410 wait complete. 2024-04-25T11:30:46.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 -- start start 2024-04-25T11:30:46.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.932+0000 7f5bf202a740 1 Processor -- start 2024-04-25T11:30:46.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5944d0 0x55ef0a971410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a96ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41ae000 con 0x55ef0a5bd390 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41af470 con 0x55ef0a5944d0 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41ae6d0 con 0x55ef0a59c6b0 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 10 client.0 _ll_register_callbacks cb 0x7f5bdc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a96ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a96ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58814/0 (socket says 172.21.15.80:58814) 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 -- 172.21.15.80:0/3050974560 learned_addr learned my addr 172.21.15.80:0/3050974560 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be8f16640 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5944d0 0x55ef0a971410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be3fff640 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 -- 172.21.15.80:0/3050974560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 msgr2=0x55ef0a96c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 -- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5944d0 msgr2=0x55ef0a971410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5944d0 0x55ef0a971410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 -- 172.21.15.80:0/3050974560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef0a96bc70 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5be9717640 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a96ccf0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0094e0 tx=0x7f5bdc009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c10741668511f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bc3fff640 1 -- 172.21.15.80:0/3050974560 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc02fa60 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bc3fff640 1 -- 172.21.15.80:0/3050974560 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f5bdc02fc00 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.933+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd80a68e0 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bc3fff640 1 -- 172.21.15.80:0/3050974560 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5bdc05b050 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 10 client.17079 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ef0a9e3480 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bc3fff640 1 -- 172.21.15.80:0/3050974560 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd80a68e0 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bc3fff640 1 -- 172.21.15.80:0/3050974560 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5bdc044050 con 0x55ef0a5bd390 2024-04-25T11:30:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 10 client.17079 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 20 client.17079 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a5513a0 0x55ef0a9e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 4 client.17079 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ef0a8cb800 con 0x55ef0a5513a0 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.934+0000 7f5be8f16640 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a5513a0 0x55ef0a9e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bc3fff640 10 client.17079 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5be8f16640 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a5513a0 0x55ef0a9e5c30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b685ac8aa9f1c998 server_cookie=37260d71e9e1f4d2 in_seq=0 out_seq=0 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bc3fff640 1 -- 172.21.15.80:0/3050974560 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ef0a8cb800 con 0x55ef0a5513a0 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bc3fff640 10 client.17079 handle_command_reply: tid=0 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 client.17079 shutdown 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 msgr2=0x55ef0a96ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a96ccf0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0094e0 tx=0x7f5bdc009540 comp rx=0 tx=0).stop 2024-04-25T11:30:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 shutdown_connections 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55ef0a5513a0 0x55ef0a9e5c30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef0a5bd390 0x55ef0a96ccf0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef0a59c6b0 0x55ef0a96c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bc3fff640 0 client.17079 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 --2- 172.21.15.80:0/3050974560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef0a5944d0 0x55ef0a971410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 >> 172.21.15.80:0/3050974560 conn(0x55ef0a5b14e0 msgr2=0x55ef0a9678d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 shutdown_connections 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 1 -- 172.21.15.80:0/3050974560 wait complete. 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.935+0000 7f5bf202a740 20 client.17079 trim_cache size 0 max 16384 2024-04-25T11:30:46.932 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:30:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5bd40afc60 msgr2=0x7f5bd40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5bd40afc60 0x7f5bd40b2170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0005fd0 tx=0x7f5bd0005d10 comp rx=0 tx=0).stop 2024-04-25T11:30:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 msgr2=0x7f5be419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be419a710 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800d770 tx=0x7f5bd800dc30 comp rx=0 tx=0).stop 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 shutdown_connections 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5bd40afc60 0x7f5bd40b2170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4109fc0 0x7f5be419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4109b20 0x7f5be419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 --2- 172.21.15.80:0/2753873872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5be4104270 0x7f5be419a710 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 >> 172.21.15.80:0/2753873872 conn(0x7f5be40ff1e0 msgr2=0x7f5be4106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 shutdown_connections 2024-04-25T11:30:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:46.936+0000 7f5beb17a640 1 -- 172.21.15.80:0/2753873872 wait complete. 2024-04-25T11:30:47.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:47 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/99880274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:30:47.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:47 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/99880274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:30:47.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:47 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/99880274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:30:47.938 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:30:47.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:30:47.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:30:48.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 -- 172.21.15.80:0/1112492886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68801027b0 msgr2=0x7f6880110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 --2- 172.21.15.80:0/1112492886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68801027b0 0x7f6880110630 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6878009ca0 tx=0x7f687802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 -- 172.21.15.80:0/1112492886 shutdown_connections 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 --2- 172.21.15.80:0/1112492886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68801027b0 0x7f6880110630 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 --2- 172.21.15.80:0/1112492886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6880109fb0 0x7f6880102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 --2- 172.21.15.80:0/1112492886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6880109b10 0x7f6880101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 -- 172.21.15.80:0/1112492886 >> 172.21.15.80:0/1112492886 conn(0x7f68800fd850 msgr2=0x7f68800ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 -- 172.21.15.80:0/1112492886 shutdown_connections 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 -- 172.21.15.80:0/1112492886 wait complete. 2024-04-25T11:30:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.078+0000 7f6885b14640 1 Processor -- start 2024-04-25T11:30:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f6885b14640 1 -- start start 2024-04-25T11:30:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f6885b14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6880109b10 0x7f6880199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f6885b14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f688019a450 0x7f688019e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f6885b14640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f688019ec70 0x7f688019f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f6885b14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6880113d20 con 0x7f6880109b10 2024-04-25T11:30:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f6885b14640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6880113ba0 con 0x7f688019a450 2024-04-25T11:30:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f6885b14640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6880113ea0 con 0x7f688019ec70 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6880109b10 0x7f6880199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6880109b10 0x7f6880199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58824/0 (socket says 172.21.15.80:58824) 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 -- 172.21.15.80:0/3839025945 learned_addr learned my addr 172.21.15.80:0/3839025945 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687ffff640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f688019ec70 0x7f688019f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687effd640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f688019a450 0x7f688019e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 -- 172.21.15.80:0/3839025945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f688019ec70 msgr2=0x7f688019f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f688019ec70 0x7f688019f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 -- 172.21.15.80:0/3839025945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f688019a450 msgr2=0x7f688019e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f688019a450 0x7f688019e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687f7fe640 1 -- 172.21.15.80:0/3839025945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68801a69e0 con 0x7f6880109b10 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.079+0000 7f687ffff640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f688019ec70 0x7f688019f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.080+0000 7f687f7fe640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6880109b10 0x7f6880199f10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f687000d740 tx=0x7f687000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.080+0000 7f687cff9640 1 -- 172.21.15.80:0/3839025945 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870017070 con 0x7f6880109b10 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.080+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68801a6bb0 con 0x7f6880109b10 2024-04-25T11:30:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.080+0000 7f687cff9640 1 -- 172.21.15.80:0/3839025945 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f687000de50 con 0x7f6880109b10 2024-04-25T11:30:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.080+0000 7f687cff9640 1 -- 172.21.15.80:0/3839025945 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870004ce0 con 0x7f6880109b10 2024-04-25T11:30:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.080+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68801a7020 con 0x7f6880109b10 2024-04-25T11:30:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.082+0000 7f688c9ca740 1 Processor -- start 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f688c9ca740 1 -- start start 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687cff9640 1 -- 172.21.15.80:0/3839025945 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f6870004e80 con 0x7f6880109b10 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c354410 0x55819c6f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c6f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c333730 0x55819c6f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f688c9ca740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55819c65ab00 con 0x55819c354410 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f688c9ca740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55819c5f6920 con 0x55819c32b550 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f688c9ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55819c656ac0 con 0x55819c333730 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c354410 0x55819c6f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c354410 0x55819c6f44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58834/0 (socket says 172.21.15.80:58834) 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 -- 172.21.15.80:0/3841620239 learned_addr learned my addr 172.21.15.80:0/3841620239 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687effd640 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c333730 0x55819c6f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687f7fe640 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c6f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 -- 172.21.15.80:0/3841620239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c333730 msgr2=0x55819c6f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c333730 0x55819c6f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 -- 172.21.15.80:0/3841620239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 msgr2=0x55819c6f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c6f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687cff9640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f68680afc60 0x7f68680b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687ffff640 1 -- 172.21.15.80:0/3841620239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55819c4347e0 con 0x55819c354410 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.083+0000 7f687effd640 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c333730 0x55819c6f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.084+0000 7f687f7fe640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f68680afc60 0x7f68680b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.084+0000 7f687ffff640 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c354410 0x55819c6f44d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6878006010 tx=0x7f6878009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf6383ce7f648ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.084+0000 7f687cff9640 1 -- 172.21.15.80:0/3839025945 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f68700deab0 con 0x7f6880109b10 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.084+0000 7f6865ffb640 1 -- 172.21.15.80:0/3841620239 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878031cf0 con 0x55819c354410 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.084+0000 7f6865ffb640 1 -- 172.21.15.80:0/3841620239 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6878036070 con 0x55819c354410 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.084+0000 7f6865ffb640 1 -- 172.21.15.80:0/3841620239 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780042a0 con 0x55819c354410 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 -- 172.21.15.80:0/3841620239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c354410 msgr2=0x55819c6f44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c354410 0x55819c6f44d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6878006010 tx=0x7f6878009800 comp rx=0 tx=0).stop 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f687f7fe640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f68680afc60 0x7f68680b2170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68700dc2c0 tx=0x7f68700a1040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 -- 172.21.15.80:0/3841620239 shutdown_connections 2024-04-25T11:30:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c333730 0x55819c6f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c6f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 --2- 172.21.15.80:0/3841620239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c354410 0x55819c6f44d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 -- 172.21.15.80:0/3841620239 >> 172.21.15.80:0/3841620239 conn(0x55819c348560 msgr2=0x55819c6f0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 -- 172.21.15.80:0/3841620239 shutdown_connections 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 -- 172.21.15.80:0/3841620239 wait complete. 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 -- start start 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.085+0000 7f688c9ca740 1 Processor -- start 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c32b550 0x55819c703090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c7035d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c354410 0x55819c7091a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f688c9ca740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55819c705d20 con 0x55819c32b550 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f688c9ca740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55819c5f45d0 con 0x55819c333730 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f688c9ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55819c705ea0 con 0x55819c354410 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f688c9ca740 10 client.0 _ll_register_callbacks cb 0x55819c5e2080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c32b550 0x55819c703090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c32b550 0x55819c703090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58848/0 (socket says 172.21.15.80:58848) 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 -- 172.21.15.80:0/324953574 learned_addr learned my addr 172.21.15.80:0/324953574 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c354410 0x55819c7091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687effd640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c7035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 -- 172.21.15.80:0/324953574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c354410 msgr2=0x55819c7091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c354410 0x55819c7091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 -- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 msgr2=0x55819c7035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c7035d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 -- 172.21.15.80:0/324953574 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55819c494f70 con 0x55819c32b550 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687effd640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c7035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f687ffff640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c32b550 0x55819c703090 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6878003e70 tx=0x7f687802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb615549d8cb48f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.086+0000 7f685effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f685effd640 1 -- 172.21.15.80:0/324953574 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878057060 con 0x55819c32b550 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f685effd640 1 -- 172.21.15.80:0/324953574 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6878031660 con 0x55819c32b550 2024-04-25T11:30:48.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6878036070 con 0x55819c32b550 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f685effd640 1 -- 172.21.15.80:0/324953574 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6878031860 con 0x55819c32b550 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 10 client.17091 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55819c32c170 con 0x55819c32b550 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f685effd640 1 -- 172.21.15.80:0/324953574 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6878036070 con 0x55819c32b550 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f685effd640 1 -- 172.21.15.80:0/324953574 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6878030920 con 0x55819c32b550 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 10 client.17091 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 10 client.17091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 20 client.17091 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c3131f0 0x55819c7151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 4 client.17091 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55819c668710 con 0x55819c3131f0 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.087+0000 7f687effd640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c3131f0 0x55819c7151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.088+0000 7f685effd640 10 client.17091 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.088+0000 7f687effd640 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c3131f0 0x55819c7151d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa181eb2a2c2735 server_cookie=db6850aa4d720255 in_seq=0 out_seq=0 2024-04-25T11:30:48.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f685effd640 1 -- 172.21.15.80:0/324953574 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55819c668710 con 0x55819c3131f0 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f685effd640 10 client.17091 handle_command_reply: tid=0 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 client.17091 shutdown 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c32b550 msgr2=0x55819c703090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c32b550 0x55819c703090 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6878003e70 tx=0x7f687802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 shutdown_connections 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c3131f0 0x55819c7151d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c354410 0x55819c7091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c7035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f685effd640 0 client.17091 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 --2- 172.21.15.80:0/324953574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c32b550 0x55819c703090 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 >> 172.21.15.80:0/324953574 conn(0x55819c348560 msgr2=0x55819c6f62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 shutdown_connections 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 1 -- 172.21.15.80:0/324953574 wait complete. 2024-04-25T11:30:48.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.089+0000 7f688c9ca740 20 client.17091 trim_cache size 0 max 16384 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.107+0000 7f688c9ca740 1 Processor -- start 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.107+0000 7f688c9ca740 1 -- start start 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c3131f0 0x55819c6efef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c32b550 0x55819c6f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c6f5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f688c9ca740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f68801b00a0 con 0x55819c3131f0 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f688c9ca740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68801ad970 con 0x55819c333730 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f688c9ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f68801ab7e0 con 0x55819c32b550 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c3131f0 0x55819c6efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c3131f0 0x55819c6efef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58854/0 (socket says 172.21.15.80:58854) 2024-04-25T11:30:48.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 -- 172.21.15.80:0/387083233 learned_addr learned my addr 172.21.15.80:0/387083233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687effd640 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c32b550 0x55819c6f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 -- 172.21.15.80:0/387083233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c32b550 msgr2=0x55819c6f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c32b550 0x55819c6f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 -- 172.21.15.80:0/387083233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 msgr2=0x55819c6f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c6f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 -- 172.21.15.80:0/387083233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55819c6f7090 con 0x55819c3131f0 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687effd640 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c32b550 0x55819c6f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f687ffff640 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c3131f0 0x55819c6efef0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6878003e40 tx=0x7f6878003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c173ea623c7be82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.108+0000 7f68657fa640 1 -- 172.21.15.80:0/387083233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878057070 con 0x55819c3131f0 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f68657fa640 1 -- 172.21.15.80:0/387083233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6878036040 con 0x55819c3131f0 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f68657fa640 1 -- 172.21.15.80:0/387083233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780040d0 con 0x55819c3131f0 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 -- 172.21.15.80:0/387083233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c3131f0 msgr2=0x55819c6efef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c3131f0 0x55819c6efef0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6878003e40 tx=0x7f6878003bf0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 -- 172.21.15.80:0/387083233 shutdown_connections 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c333730 0x55819c6f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c32b550 0x55819c6f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 --2- 172.21.15.80:0/387083233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c3131f0 0x55819c6efef0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 -- 172.21.15.80:0/387083233 >> 172.21.15.80:0/387083233 conn(0x55819c348560 msgr2=0x55819c6f43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 -- 172.21.15.80:0/387083233 shutdown_connections 2024-04-25T11:30:48.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.109+0000 7f688c9ca740 1 -- 172.21.15.80:0/387083233 wait complete. 2024-04-25T11:30:48.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 -- start start 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 Processor -- start 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c3131f0 0x55819c70c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c70cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c333730 0x55819c70d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f68801abe30 con 0x55819c333730 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68801ad2a0 con 0x55819c32b550 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.110+0000 7f688c9ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f68801ac500 con 0x55819c3131f0 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f688c9ca740 10 client.0 _ll_register_callbacks cb 0x7f6878032bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c333730 0x55819c70d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c333730 0x55819c70d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58868/0 (socket says 172.21.15.80:58868) 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 -- 172.21.15.80:0/2548659845 learned_addr learned my addr 172.21.15.80:0/2548659845 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687effd640 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c70cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c3131f0 0x55819c70c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 -- 172.21.15.80:0/2548659845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c3131f0 msgr2=0x55819c70c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c3131f0 0x55819c70c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 -- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 msgr2=0x55819c70cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c70cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 -- 172.21.15.80:0/2548659845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55819c77b520 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f687ffff640 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c333730 0x55819c70d0d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x55819c70be90 tx=0x7f6878032b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0e71321e1b5aac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f685effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f685effd640 1 -- 172.21.15.80:0/2548659845 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878057040 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f685effd640 1 -- 172.21.15.80:0/2548659845 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f6878004d40 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6878036040 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f685effd640 1 -- 172.21.15.80:0/2548659845 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f687806e050 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f688c9ca740 10 client.17097 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.111+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55819c77c7e0 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f685effd640 1 -- 172.21.15.80:0/2548659845 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6878036040 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f685effd640 1 -- 172.21.15.80:0/2548659845 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f687802f660 con 0x55819c333730 2024-04-25T11:30:48.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f688c9ca740 10 client.17097 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f688c9ca740 10 client.17097 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f688c9ca740 20 client.17097 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f688c9ca740 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c354410 0x55819c77ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f688c9ca740 4 client.17097 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55819c662580 con 0x55819c354410 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f687effd640 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c354410 0x55819c77ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.112+0000 7f685effd640 10 client.17097 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.113+0000 7f687effd640 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c354410 0x55819c77ec60 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ceeb3d24328d7b server_cookie=412290f7842dd774 in_seq=0 out_seq=0 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.114+0000 7f685effd640 1 -- 172.21.15.80:0/2548659845 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55819c662580 con 0x55819c354410 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.114+0000 7f685effd640 10 client.17097 handle_command_reply: tid=0 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.114+0000 7f688c9ca740 1 client.17097 shutdown 2024-04-25T11:30:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c333730 msgr2=0x55819c70d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c333730 0x55819c70d0d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x55819c70be90 tx=0x7f6878032b80 comp rx=0 tx=0).stop 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 shutdown_connections 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55819c354410 0x55819c77ec60 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55819c333730 0x55819c70d0d0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f685effd640 0 client.17097 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55819c32b550 0x55819c70cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 --2- 172.21.15.80:0/2548659845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55819c3131f0 0x55819c70c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 >> 172.21.15.80:0/2548659845 conn(0x55819c348560 msgr2=0x55819c6efc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 shutdown_connections 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 1 -- 172.21.15.80:0/2548659845 wait complete. 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f688c9ca740 20 client.17097 trim_cache size 0 max 16384 2024-04-25T11:30:48.109 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:30:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:30:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "59e2c647-a887-4a8c-91ab-a8942fdbde34", 2024-04-25T11:30:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:30:48.110 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f68680afc60 msgr2=0x7f68680b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f68680afc60 0x7f68680b2170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68700dc2c0 tx=0x7f68700a1040 comp rx=0 tx=0).stop 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6880109b10 msgr2=0x7f6880199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6880109b10 0x7f6880199f10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f687000d740 tx=0x7f687000dc00 comp rx=0 tx=0).stop 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 shutdown_connections 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f68680afc60 0x7f68680b2170 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f688019ec70 0x7f688019f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f688019a450 0x7f688019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 --2- 172.21.15.80:0/3839025945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6880109b10 0x7f6880199f10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 >> 172.21.15.80:0/3839025945 conn(0x7f68800fd850 msgr2=0x7f68801071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.115+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 shutdown_connections 2024-04-25T11:30:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.116+0000 7f6885b14640 1 -- 172.21.15.80:0/3839025945 wait complete. 2024-04-25T11:30:48.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:30:48.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:30:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 -- 172.21.15.80:0/1881608595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f9010e570 msgr2=0x7f4f90110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 --2- 172.21.15.80:0/1881608595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f9010e570 0x7f4f90110990 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009ca0 tx=0x7f4f8802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 -- 172.21.15.80:0/1881608595 shutdown_connections 2024-04-25T11:30:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 --2- 172.21.15.80:0/1881608595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f9010e570 0x7f4f90110990 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 --2- 172.21.15.80:0/1881608595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f90102070 0x7f4f90102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 --2- 172.21.15.80:0/1881608595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f90109bc0 0x7f4f90101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 -- 172.21.15.80:0/1881608595 >> 172.21.15.80:0/1881608595 conn(0x7f4f90077920 msgr2=0x7f4f90077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 -- 172.21.15.80:0/1881608595 shutdown_connections 2024-04-25T11:30:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 -- 172.21.15.80:0/1881608595 wait complete. 2024-04-25T11:30:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 Processor -- start 2024-04-25T11:30:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.237+0000 7f4f97d84640 1 -- start start 2024-04-25T11:30:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f97d84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f90102070 0x7f4f9019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f97d84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f90109bc0 0x7f4f9019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f97d84640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9010e570 0x7f4f9019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f97d84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90113d30 con 0x7f4f90102070 2024-04-25T11:30:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f97d84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90113bb0 con 0x7f4f90109bc0 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f97d84640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90113eb0 con 0x7f4f9010e570 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f90102070 0x7f4f9019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f90102070 0x7f4f9019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58886/0 (socket says 172.21.15.80:58886) 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 -- 172.21.15.80:0/292673790 learned_addr learned my addr 172.21.15.80:0/292673790 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f9531f640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f90109bc0 0x7f4f9019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f96321640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9010e570 0x7f4f9019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 -- 172.21.15.80:0/292673790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9010e570 msgr2=0x7f4f9019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9010e570 0x7f4f9019ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 -- 172.21.15.80:0/292673790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f90109bc0 msgr2=0x7f4f9019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f90109bc0 0x7f4f9019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 -- 172.21.15.80:0/292673790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9019f570 con 0x7f4f90102070 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f9531f640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f90109bc0 0x7f4f9019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f95b20640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f90102070 0x7f4f9019a710 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00d740 tx=0x7f4f8c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f86ffd640 1 -- 172.21.15.80:0/292673790 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c017070 con 0x7f4f90102070 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f86ffd640 1 -- 172.21.15.80:0/292673790 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f8c00de50 con 0x7f4f90102070 2024-04-25T11:30:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f86ffd640 1 -- 172.21.15.80:0/292673790 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c003c20 con 0x7f4f90102070 2024-04-25T11:30:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.238+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9019f860 con 0x7f4f90102070 2024-04-25T11:30:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.239+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f901a71e0 con 0x7f4f90102070 2024-04-25T11:30:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.241+0000 7f4f9ec3b740 1 Processor -- start 2024-04-25T11:30:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9ec3b740 1 -- start start 2024-04-25T11:30:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d5a390 0x558ab30faa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d314d0 0x558ab30fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d396b0 0x558ab31078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558ab3060d80 con 0x558ab2d396b0 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ab301a8b0 con 0x558ab2d314d0 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558ab305cd40 con 0x558ab2d5a390 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f86ffd640 1 -- 172.21.15.80:0/292673790 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f4f8c003dc0 con 0x7f4f90102070 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9531f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d396b0 0x558ab31078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9531f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d396b0 0x558ab31078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58900/0 (socket says 172.21.15.80:58900) 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f9531f640 1 -- 172.21.15.80:0/3251734146 learned_addr learned my addr 172.21.15.80:0/3251734146 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f96321640 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d5a390 0x558ab30faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.242+0000 7f4f95b20640 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d314d0 0x558ab30fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f9531f640 1 -- 172.21.15.80:0/3251734146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d5a390 msgr2=0x558ab30faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f9531f640 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d5a390 0x558ab30faa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f9531f640 1 -- 172.21.15.80:0/3251734146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d314d0 msgr2=0x558ab30fafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f9531f640 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d314d0 0x558ab30fafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f9531f640 1 -- 172.21.15.80:0/3251734146 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab2feba40 con 0x558ab2d396b0 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f9531f640 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d396b0 0x558ab31078f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009ca0 tx=0x7f4f80010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49597e95ffd7e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f86ffd640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f7c0afc60 0x7f4f7c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f7bfff640 1 -- 172.21.15.80:0/3251734146 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80004030 con 0x558ab2d396b0 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f96321640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f7c0afc60 0x7f4f7c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f7bfff640 1 -- 172.21.15.80:0/3251734146 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f800035f0 con 0x558ab2d396b0 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f7bfff640 1 -- 172.21.15.80:0/3251734146 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f800126b0 con 0x558ab2d396b0 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.243+0000 7f4f86ffd640 1 -- 172.21.15.80:0/292673790 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f4f8c0deb10 con 0x7f4f90102070 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3251734146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d396b0 msgr2=0x558ab31078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f96321640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f7c0afc60 0x7f4f7c0b2170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f88006010 tx=0x7f4f88009460 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d396b0 0x558ab31078f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009ca0 tx=0x7f4f80010740 comp rx=0 tx=0).stop 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3251734146 shutdown_connections 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d396b0 0x558ab31078f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d314d0 0x558ab30fafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3251734146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d5a390 0x558ab30faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3251734146 >> 172.21.15.80:0/3251734146 conn(0x558ab2d4e4e0 msgr2=0x558ab30f7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3251734146 shutdown_connections 2024-04-25T11:30:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3251734146 wait complete. 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 -- start start 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.244+0000 7f4f9ec3b740 1 Processor -- start 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d314d0 0x558ab3105570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d396b0 0x558ab3105ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d5a390 0x558ab3111460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x558ab3107fe0 con 0x558ab2d5a390 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ab2fe7d10 con 0x558ab2d396b0 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558ab3108160 con 0x558ab2d314d0 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9ec3b740 10 client.0 _ll_register_callbacks cb 0x558ab3014210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d5a390 0x558ab3111460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d5a390 0x558ab3111460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58902/0 (socket says 172.21.15.80:58902) 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 -- 172.21.15.80:0/794638713 learned_addr learned my addr 172.21.15.80:0/794638713 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f95b20640 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d314d0 0x558ab3105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f9531f640 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d396b0 0x558ab3105ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 -- 172.21.15.80:0/794638713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d314d0 msgr2=0x558ab3105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d314d0 0x558ab3105570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 -- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d396b0 msgr2=0x558ab3105ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d396b0 0x558ab3105ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.245+0000 7f4f96321640 1 -- 172.21.15.80:0/794638713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab2e3c7d0 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f96321640 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d5a390 0x558ab3111460 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009ca0 tx=0x7f4f8802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b44e9fe85af53e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f797fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f797fa640 1 -- 172.21.15.80:0/794638713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f880318e0 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f797fa640 1 -- 172.21.15.80:0/794638713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f4f88004250 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f800035f0 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f797fa640 1 -- 172.21.15.80:0/794638713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4f88004450 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 10 client.17109 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558ab2d723f0 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f797fa640 1 -- 172.21.15.80:0/794638713 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f800035f0 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f797fa640 1 -- 172.21.15.80:0/794638713 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4f88050070 con 0x558ab2d5a390 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 10 client.17109 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:48.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 10 client.17109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:48.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 20 client.17109 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:48.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d18f60 0x558ab3117630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 4 client.17109 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:30:48.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.246+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ab306e990 con 0x558ab2d18f60 2024-04-25T11:30:48.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.247+0000 7f4f95b20640 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d18f60 0x558ab3117630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.247+0000 7f4f797fa640 10 client.17109 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.247+0000 7f4f95b20640 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d18f60 0x558ab3117630 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deeafd7aafa6abb4 server_cookie=5284aa56bd851d64 in_seq=0 out_seq=0 2024-04-25T11:30:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f797fa640 1 -- 172.21.15.80:0/794638713 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558ab306e990 con 0x558ab2d18f60 2024-04-25T11:30:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f797fa640 10 client.17109 handle_command_reply: tid=0 2024-04-25T11:30:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 client.17109 shutdown 2024-04-25T11:30:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d5a390 msgr2=0x558ab3111460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d5a390 0x558ab3111460 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009ca0 tx=0x7f4f8802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 shutdown_connections 2024-04-25T11:30:48.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d18f60 0x558ab3117630 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d5a390 0x558ab3111460 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d396b0 0x558ab3105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f797fa640 0 client.17109 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/794638713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d314d0 0x558ab3105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 >> 172.21.15.80:0/794638713 conn(0x558ab2d4e4e0 msgr2=0x558ab30fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 shutdown_connections 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/794638713 wait complete. 2024-04-25T11:30:48.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.248+0000 7f4f9ec3b740 20 client.17109 trim_cache size 0 max 16384 2024-04-25T11:30:48.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 Processor -- start 2024-04-25T11:30:48.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 -- start start 2024-04-25T11:30:48.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab30fae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab3100560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3104210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901b22c0 con 0x558ab2d314d0 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901afb90 con 0x558ab2d18f60 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901ad9e0 con 0x558ab2d396b0 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9531f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab3100560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9531f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab3100560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58908/0 (socket says 172.21.15.80:58908) 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9531f640 1 -- 172.21.15.80:0/2596218230 learned_addr learned my addr 172.21.15.80:0/2596218230 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f95b20640 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab30fae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f9531f640 1 -- 172.21.15.80:0/2596218230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 msgr2=0x558ab3104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.266+0000 7f4f96321640 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f9531f640 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3104210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f9531f640 1 -- 172.21.15.80:0/2596218230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 msgr2=0x558ab30fae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f9531f640 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab30fae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f9531f640 1 -- 172.21.15.80:0/2596218230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab2d320f0 con 0x558ab2d314d0 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f95b20640 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab30fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:48.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f96321640 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:30:48.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f9531f640 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab3100560 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4f80003f10 tx=0x7f4f80009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01e612bf4856328 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f7b7fe640 1 -- 172.21.15.80:0/2596218230 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f800097b0 con 0x558ab2d314d0 2024-04-25T11:30:48.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f7b7fe640 1 -- 172.21.15.80:0/2596218230 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f80005570 con 0x558ab2d314d0 2024-04-25T11:30:48.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.267+0000 7f4f7b7fe640 1 -- 172.21.15.80:0/2596218230 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80027470 con 0x558ab2d314d0 2024-04-25T11:30:48.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/2596218230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 msgr2=0x558ab3100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab3100560 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4f80003f10 tx=0x7f4f80009f20 comp rx=0 tx=0).stop 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/2596218230 shutdown_connections 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab3100560 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/2596218230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab30fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/2596218230 >> 172.21.15.80:0/2596218230 conn(0x558ab2d4e4e0 msgr2=0x558ab3103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/2596218230 shutdown_connections 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/2596218230 wait complete. 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 -- start start 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 Processor -- start 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab317af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.268+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab317b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3102110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901ae050 con 0x558ab2d314d0 2024-04-25T11:30:48.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901af4c0 con 0x558ab2d18f60 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901ae720 con 0x558ab2d396b0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 10 client.0 _ll_register_callbacks cb 0x7f4f88009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab317b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab317b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58918/0 (socket says 172.21.15.80:58918) 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 -- 172.21.15.80:0/3937817246 learned_addr learned my addr 172.21.15.80:0/3937817246 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f96321640 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f95b20640 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab317af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 -- 172.21.15.80:0/3937817246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 msgr2=0x558ab3102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 -- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 msgr2=0x558ab317af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab317af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 -- 172.21.15.80:0/3937817246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab30214b0 con 0x558ab2d314d0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9531f640 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab317b4d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000a010 tx=0x7f4f80003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3c96bfaaab45e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f797fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:30:48.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f797fa640 1 -- 172.21.15.80:0/3937817246 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80003800 con 0x558ab2d314d0 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f797fa640 1 -- 172.21.15.80:0/3937817246 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8506+0+0 (secure 0 0 0) 0x7f4f80005050 con 0x558ab2d314d0 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f80005570 con 0x558ab2d314d0 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f797fa640 1 -- 172.21.15.80:0/3937817246 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4f80005250 con 0x558ab2d314d0 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 10 client.17115 fetch_fsmap learned FSMap version 24 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.269+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558ab31833f0 con 0x558ab2d314d0 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f797fa640 1 -- 172.21.15.80:0/3937817246 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f80005570 con 0x558ab2d314d0 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f797fa640 1 -- 172.21.15.80:0/3937817246 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4f8000f040 con 0x558ab2d314d0 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f9ec3b740 10 client.17115 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f9ec3b740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f9ec3b740 20 client.17115 populate_metadata read hostname 'smithi080' 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d5a390 0x558ab31858c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f9ec3b740 4 client.17115 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ab3068800 con 0x558ab2d5a390 2024-04-25T11:30:48.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f95b20640 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d5a390 0x558ab31858c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f797fa640 10 client.17115 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.270+0000 7f4f95b20640 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d5a390 0x558ab31858c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6730098168ebc46 server_cookie=2823a7c7592a00fe in_seq=0 out_seq=0 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f797fa640 1 -- 172.21.15.80:0/3937817246 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558ab3068800 con 0x558ab2d5a390 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f797fa640 10 client.17115 handle_command_reply: tid=0 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 client.17115 shutdown 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 msgr2=0x558ab317b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab317b4d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000a010 tx=0x7f4f80003e50 comp rx=0 tx=0).stop 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 shutdown_connections 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x558ab2d5a390 0x558ab31858c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558ab2d314d0 0x558ab317b4d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558ab2d396b0 0x558ab3102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f797fa640 0 client.17115 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 --2- 172.21.15.80:0/3937817246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ab2d18f60 0x558ab317af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 >> 172.21.15.80:0/3937817246 conn(0x558ab2d4e4e0 msgr2=0x558ab3106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 shutdown_connections 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 1 -- 172.21.15.80:0/3937817246 wait complete. 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f9ec3b740 20 client.17115 trim_cache size 0 max 16384 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout: "59e2c647-a887-4a8c-91ab-a8942fdbde34": { 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "59e2c647-a887-4a8c-91ab-a8942fdbde34", 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:30:48.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:30:48.268 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:30:48.268 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:30:48.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f7c0afc60 msgr2=0x7f4f7c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f7c0afc60 0x7f4f7c0b2170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f88006010 tx=0x7f4f88009460 comp rx=0 tx=0).stop 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f90102070 msgr2=0x7f4f9019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f90102070 0x7f4f9019a710 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00d740 tx=0x7f4f8c00dc00 comp rx=0 tx=0).stop 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 shutdown_connections 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f7c0afc60 0x7f4f7c0b2170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9010e570 0x7f4f9019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f90109bc0 0x7f4f9019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 --2- 172.21.15.80:0/292673790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f90102070 0x7f4f9019a710 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.271+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 >> 172.21.15.80:0/292673790 conn(0x7f4f90077920 msgr2=0x7f4f9010a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.272+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 shutdown_connections 2024-04-25T11:30:48.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:30:48.272+0000 7f4f97d84640 1 -- 172.21.15.80:0/292673790 wait complete. 2024-04-25T11:30:48.272 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:48 smithi080 ceph-mon[29126]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:48.273 INFO:tasks.cephfs.filesystem:scrub status for tag:59e2c647-a887-4a8c-91ab-a8942fdbde34 - {'path': '/', 'tag': '59e2c647-a887-4a8c-91ab-a8942fdbde34', 'options': 'recursive,force'} 2024-04-25T11:30:48.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:48 smithi196 ceph-mon[32659]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:48.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:48 smithi082 ceph-mon[32440]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:30:49.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:49 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:30:49.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:49 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:49.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:49 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:30:49.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:49 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:49.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:49 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:30:49.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:49 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:49.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:49 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:30:49.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:49 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:49.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:49 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:30:49.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:49 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:49.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:49 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:30:49.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:49 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:30:50.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:50 smithi080 ceph-mon[29126]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:50.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:50 smithi196 ceph-mon[32659]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:50.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:50 smithi082 ceph-mon[32440]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:30:52.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:52 smithi080 ceph-mon[29126]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:30:52.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:52 smithi196 ceph-mon[32659]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:30:52.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:52 smithi082 ceph-mon[32440]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:30:53.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:53 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:30:53.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:53 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:30:53.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:53 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:30:54.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:54 smithi080 ceph-mon[29126]: pgmap v203: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:54.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:54 smithi196 ceph-mon[32659]: pgmap v203: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:54.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:54 smithi082 ceph-mon[32440]: pgmap v203: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:56.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:56 smithi080 ceph-mon[29126]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:56.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:56 smithi196 ceph-mon[32659]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:56.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:56 smithi082 ceph-mon[32440]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:30:58.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:30:58 smithi080 ceph-mon[29126]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T11:30:58.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:30:58 smithi196 ceph-mon[32659]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T11:30:58.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:30:58 smithi082 ceph-mon[32440]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T11:31:00.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:00 smithi080 ceph-mon[29126]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-04-25T11:31:00.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:00 smithi196 ceph-mon[32659]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-04-25T11:31:00.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:00 smithi082 ceph-mon[32440]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-04-25T11:31:02.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:02 smithi080 ceph-mon[29126]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:31:02.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:02 smithi196 ceph-mon[32659]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:31:02.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:02 smithi082 ceph-mon[32440]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:31:04.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:04 smithi080 ceph-mon[29126]: pgmap v208: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:04.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:04 smithi196 ceph-mon[32659]: pgmap v208: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:04.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:04 smithi082 ceph-mon[32440]: pgmap v208: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:06.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:06 smithi080 ceph-mon[29126]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:06.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:06 smithi196 ceph-mon[32659]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:06.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:06 smithi082 ceph-mon[32440]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:08.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:08 smithi196 ceph-mon[32659]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T11:31:08.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:08 smithi082 ceph-mon[32440]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T11:31:08.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:08 smithi080 ceph-mon[29126]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T11:31:09.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:09 smithi196 ceph-mon[32659]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T11:31:09.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:09 smithi082 ceph-mon[32440]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T11:31:09.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:09 smithi080 ceph-mon[29126]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T11:31:10.391 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:10 smithi082 ceph-mon[32440]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:31:10.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:10 smithi196 ceph-mon[32659]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:31:10.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:10 smithi080 ceph-mon[29126]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:31:12.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:12 smithi196 ceph-mon[32659]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:31:12.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:12 smithi196 ceph-mon[32659]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T11:31:12.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:12 smithi082 ceph-mon[32440]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:31:12.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:12 smithi082 ceph-mon[32440]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T11:31:12.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:12 smithi080 ceph-mon[29126]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:31:12.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:12 smithi080 ceph-mon[29126]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T11:31:14.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:14 smithi196 ceph-mon[32659]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:31:14.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:14 smithi082 ceph-mon[32440]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:31:14.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:14 smithi080 ceph-mon[29126]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:31:16.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:16 smithi196 ceph-mon[32659]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:31:16.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:16 smithi082 ceph-mon[32440]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:31:16.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:16 smithi080 ceph-mon[29126]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:31:18.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:31:18.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:31:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 -- 172.21.15.80:0/4194084766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 msgr2=0x7ff268110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 --2- 172.21.15.80:0/4194084766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff268110630 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff260009ca0 tx=0x7ff26002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 -- 172.21.15.80:0/4194084766 shutdown_connections 2024-04-25T11:31:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 --2- 172.21.15.80:0/4194084766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff268110630 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 --2- 172.21.15.80:0/4194084766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff268109fb0 0x7ff268103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 --2- 172.21.15.80:0/4194084766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff268109b10 0x7ff2681036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 -- 172.21.15.80:0/4194084766 >> 172.21.15.80:0/4194084766 conn(0x7ff2680ff1d0 msgr2=0x7ff268101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 -- 172.21.15.80:0/4194084766 shutdown_connections 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 -- 172.21.15.80:0/4194084766 wait complete. 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.418+0000 7ff2704f9640 1 Processor -- start 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff2704f9640 1 -- start start 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff2704f9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff26819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff2704f9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff268109b10 0x7ff26819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff2704f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff268109fb0 0x7ff26819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff2704f9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff268113d00 con 0x7ff268104260 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff2704f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff268113b80 con 0x7ff268109fb0 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff2704f9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff268113e80 con 0x7ff268109b10 2024-04-25T11:31:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff26819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff26819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41194/0 (socket says 172.21.15.80:41194) 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 -- 172.21.15.80:0/1797498327 learned_addr learned my addr 172.21.15.80:0/1797498327 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26ea96640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff268109fb0 0x7ff26819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26da94640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff268109b10 0x7ff26819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 -- 172.21.15.80:0/1797498327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff268109b10 msgr2=0x7ff26819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff268109b10 0x7ff26819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 -- 172.21.15.80:0/1797498327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff268109fb0 msgr2=0x7ff26819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff268109fb0 0x7ff26819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.419+0000 7ff26e295640 1 -- 172.21.15.80:0/1797498327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26819f540 con 0x7ff268104260 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.420+0000 7ff26e295640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff26819a6e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d770 tx=0x7ff26400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.420+0000 7ff25f7fe640 1 -- 172.21.15.80:0/1797498327 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264017070 con 0x7ff268104260 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.420+0000 7ff25f7fe640 1 -- 172.21.15.80:0/1797498327 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff264009c30 con 0x7ff268104260 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.420+0000 7ff25f7fe640 1 -- 172.21.15.80:0/1797498327 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26400f620 con 0x7ff268104260 2024-04-25T11:31:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.420+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26819f830 con 0x7ff268104260 2024-04-25T11:31:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.420+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2681a71b0 con 0x7ff268104260 2024-04-25T11:31:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff25f7fe640 1 -- 172.21.15.80:0/1797498327 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff26401a070 con 0x7ff268104260 2024-04-25T11:31:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 Processor -- start 2024-04-25T11:31:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 -- start start 2024-04-25T11:31:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f04d0 0x55938e9b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55938e91fd80 con 0x55938e619390 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55938e8d98b0 con 0x55938e5f04d0 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.423+0000 7ff2773a9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55938e91bd40 con 0x55938e5f86b0 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff26da94640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff26e295640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f04d0 0x55938e9b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff25f7fe640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff2540afce0 0x7ff2540b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff26ea96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff26ea96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9b9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41202/0 (socket says 172.21.15.80:41202) 2024-04-25T11:31:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff26ea96640 1 -- 172.21.15.80:0/525149997 learned_addr learned my addr 172.21.15.80:0/525149997 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff25f7fe640 1 -- 172.21.15.80:0/1797498327 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ff2640dea70 con 0x7ff268104260 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.424+0000 7ff26ea96640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff2540afce0 0x7ff2540b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff26da94640 1 -- 172.21.15.80:0/525149997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f04d0 msgr2=0x55938e9b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff26da94640 1 --2- 172.21.15.80:0/525149997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f04d0 0x55938e9b9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff26da94640 1 -- 172.21.15.80:0/525149997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 msgr2=0x55938e9b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff26da94640 1 --2- 172.21.15.80:0/525149997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9b9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff26da94640 1 -- 172.21.15.80:0/525149997 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55938e8aaa40 con 0x55938e5f86b0 2024-04-25T11:31:18.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff26da94640 1 --2- 172.21.15.80:0/525149997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c68f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff26810a3e0 tx=0x7ff2580103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92fd51381dcb8481 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff26ea96640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff2540afce0 0x7ff2540b21f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff260009a60 tx=0x7ff26002a8c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff25cbfe640 1 -- 172.21.15.80:0/525149997 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258010e90 con 0x55938e5f86b0 2024-04-25T11:31:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff25cbfe640 1 -- 172.21.15.80:0/525149997 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff258005020 con 0x55938e5f86b0 2024-04-25T11:31:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.425+0000 7ff25cbfe640 1 -- 172.21.15.80:0/525149997 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258004a80 con 0x55938e5f86b0 2024-04-25T11:31:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.426+0000 7ff2773a9740 1 -- 172.21.15.80:0/525149997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 msgr2=0x55938e9c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.426+0000 7ff2773a9740 1 --2- 172.21.15.80:0/525149997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c68f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff26810a3e0 tx=0x7ff2580103d0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.426+0000 7ff2773a9740 1 -- 172.21.15.80:0/525149997 shutdown_connections 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.426+0000 7ff2773a9740 1 --2- 172.21.15.80:0/525149997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c68f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.426+0000 7ff2773a9740 1 --2- 172.21.15.80:0/525149997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f04d0 0x55938e9b9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.426+0000 7ff2773a9740 1 --2- 172.21.15.80:0/525149997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9b9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.426+0000 7ff2773a9740 1 -- 172.21.15.80:0/525149997 >> 172.21.15.80:0/525149997 conn(0x55938e60d4e0 msgr2=0x55938e9b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 -- 172.21.15.80:0/525149997 shutdown_connections 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 -- 172.21.15.80:0/525149997 wait complete. 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 -- start start 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 Processor -- start 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f04d0 0x55938e9c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55938e9c6fe0 con 0x55938e5f04d0 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55938e8a6d10 con 0x55938e619390 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55938e9c7160 con 0x55938e5f86b0 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff2773a9740 10 client.0 _ll_register_callbacks cb 0x55938e8d3210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff26e295640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f04d0 0x55938e9c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff26e295640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f04d0 0x55938e9c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41204/0 (socket says 172.21.15.80:41204) 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.427+0000 7ff26e295640 1 -- 172.21.15.80:0/226411831 learned_addr learned my addr 172.21.15.80:0/226411831 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26da94640 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26ea96640 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26e295640 1 -- 172.21.15.80:0/226411831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 msgr2=0x55938e9c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26e295640 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26e295640 1 -- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 msgr2=0x55938e9d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26e295640 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26e295640 1 -- 172.21.15.80:0/226411831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55938e6fb7d0 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff26e295640 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f04d0 0x55938e9c4580 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff264010bb0 tx=0x7ff26400df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9237a26abc715f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff251ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff251ffb640 1 -- 172.21.15.80:0/226411831 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264021040 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff251ffb640 1 -- 172.21.15.80:0/226411831 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ff2640a6110 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff258005020 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff251ffb640 1 -- 172.21.15.80:0/226411831 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff2640af390 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff2773a9740 10 client.17127 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55938e6313f0 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.428+0000 7ff251ffb640 1 -- 172.21.15.80:0/226411831 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff258005020 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff251ffb640 1 -- 172.21.15.80:0/226411831 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff2640a5970 con 0x55938e5f04d0 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff2773a9740 10 client.17127 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff2773a9740 10 client.17127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff2773a9740 20 client.17127 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff2773a9740 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5d7f60 0x55938e9d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff2773a9740 4 client.17127 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55938e92d990 con 0x55938e5d7f60 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff26da94640 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5d7f60 0x55938e9d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff251ffb640 10 client.17127 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.429+0000 7ff26da94640 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5d7f60 0x55938e9d6600 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3467ca4442aa82 server_cookie=893fef87640febff in_seq=0 out_seq=0 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff251ffb640 1 -- 172.21.15.80:0/226411831 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55938e92d990 con 0x55938e5d7f60 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff251ffb640 10 client.17127 handle_command_reply: tid=0 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 client.17127 shutdown 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f04d0 msgr2=0x55938e9c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f04d0 0x55938e9c4580 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff264010bb0 tx=0x7ff26400df10 comp rx=0 tx=0).stop 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 shutdown_connections 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5d7f60 0x55938e9d6600 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f86b0 0x55938e9c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 --2- 172.21.15.80:0/226411831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f04d0 0x55938e9c4580 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff251ffb640 0 client.17127 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 >> 172.21.15.80:0/226411831 conn(0x55938e60d4e0 msgr2=0x55938e9bb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 shutdown_connections 2024-04-25T11:31:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 1 -- 172.21.15.80:0/226411831 wait complete. 2024-04-25T11:31:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.430+0000 7ff2773a9740 20 client.17127 trim_cache size 0 max 16384 2024-04-25T11:31:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:18 smithi196 ceph-mon[32659]: pgmap v217: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 234 B/s wr, 7 op/s 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 Processor -- start 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 -- start start 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f86b0 0x55938e9cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681b0170 con 0x55938e619390 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681ada40 con 0x55938e5f86b0 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff2773a9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681ab8b0 con 0x55938e5f04d0 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41214/0 (socket says 172.21.15.80:41214) 2024-04-25T11:31:18.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 -- 172.21.15.80:0/2100003815 learned_addr learned my addr 172.21.15.80:0/2100003815 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26e295640 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 -- 172.21.15.80:0/2100003815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 msgr2=0x55938e9c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26da94640 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f86b0 0x55938e9cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 -- 172.21.15.80:0/2100003815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f86b0 msgr2=0x55938e9cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f86b0 0x55938e9cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 -- 172.21.15.80:0/2100003815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55938e5f10f0 con 0x55938e619390 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26e295640 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26da94640 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f86b0 0x55938e9cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.449+0000 7ff26ea96640 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9cc970 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x55938e9b6bd0 tx=0x7ff260048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4bae6ef424ee5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.450+0000 7ff253fff640 1 -- 172.21.15.80:0/2100003815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260003a30 con 0x55938e619390 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.450+0000 7ff253fff640 1 -- 172.21.15.80:0/2100003815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff260036050 con 0x55938e619390 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.450+0000 7ff253fff640 1 -- 172.21.15.80:0/2100003815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600043c0 con 0x55938e619390 2024-04-25T11:31:18.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.450+0000 7ff2773a9740 1 -- 172.21.15.80:0/2100003815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 msgr2=0x55938e9cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.450+0000 7ff2773a9740 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9cc970 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x55938e9b6bd0 tx=0x7ff260048000 comp rx=0 tx=0).stop 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- 172.21.15.80:0/2100003815 shutdown_connections 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e619390 0x55938e9cc970 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e5f86b0 0x55938e9cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 --2- 172.21.15.80:0/2100003815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- 172.21.15.80:0/2100003815 >> 172.21.15.80:0/2100003815 conn(0x55938e60d4e0 msgr2=0x55938e9c2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- 172.21.15.80:0/2100003815 shutdown_connections 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- 172.21.15.80:0/2100003815 wait complete. 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- start start 2024-04-25T11:31:18.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 Processor -- start 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f86b0 0x55938e9c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681abf00 con 0x55938e5f86b0 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681ad370 con 0x55938e619390 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681ac5d0 con 0x55938e5f04d0 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff2773a9740 10 client.0 _ll_register_callbacks cb 0x7ff26400d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff26da94640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f86b0 0x55938e9c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff26da94640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f86b0 0x55938e9c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41222/0 (socket says 172.21.15.80:41222) 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.451+0000 7ff26da94640 1 -- 172.21.15.80:0/1018475010 learned_addr learned my addr 172.21.15.80:0/1018475010 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26e295640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26ea96640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26da94640 1 -- 172.21.15.80:0/1018475010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 msgr2=0x55938e9cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26da94640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26da94640 1 -- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 msgr2=0x55938e9c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26da94640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26da94640 1 -- 172.21.15.80:0/1018475010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55938e8e04b0 con 0x55938e5f86b0 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26ea96640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff26da94640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f86b0 0x55938e9c7bf0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff258000c00 tx=0x7ff2580109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704e89cb2738711f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff251ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff251ffb640 1 -- 172.21.15.80:0/1018475010 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25802f060 con 0x55938e5f86b0 2024-04-25T11:31:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff251ffb640 1 -- 172.21.15.80:0/1018475010 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ff258005240 con 0x55938e5f86b0 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff260036050 con 0x55938e5f86b0 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff251ffb640 1 -- 172.21.15.80:0/1018475010 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff25801f070 con 0x55938e5f86b0 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff2773a9740 10 client.17133 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55938ea3e4c0 con 0x55938e5f86b0 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.452+0000 7ff251ffb640 1 -- 172.21.15.80:0/1018475010 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff260036050 con 0x55938e5f86b0 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff251ffb640 1 -- 172.21.15.80:0/1018475010 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff258004730 con 0x55938e5f86b0 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff2773a9740 10 client.17133 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff2773a9740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff2773a9740 20 client.17133 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff2773a9740 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5ad3a0 0x55938ea40af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff2773a9740 4 client.17133 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55938e927800 con 0x55938e5ad3a0 2024-04-25T11:31:18.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff26e295640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5ad3a0 0x55938ea40af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff251ffb640 10 client.17133 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff26e295640 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5ad3a0 0x55938ea40af0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b5971f90d2fb775 server_cookie=d03557347b0e78bc in_seq=0 out_seq=0 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff251ffb640 1 -- 172.21.15.80:0/1018475010 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55938e927800 con 0x55938e5ad3a0 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff251ffb640 10 client.17133 handle_command_reply: tid=0 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.453+0000 7ff2773a9740 1 client.17133 shutdown 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f86b0 msgr2=0x55938e9c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f86b0 0x55938e9c7bf0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff258000c00 tx=0x7ff2580109c0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 shutdown_connections 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55938e5ad3a0 0x55938ea40af0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55938e5f86b0 0x55938e9c7bf0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55938e619390 0x55938e9c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 --2- 172.21.15.80:0/1018475010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55938e5f04d0 0x55938e9cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 >> 172.21.15.80:0/1018475010 conn(0x55938e60d4e0 msgr2=0x55938e9c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff251ffb640 0 client.17133 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:18.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 shutdown_connections 2024-04-25T11:31:18.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 1 -- 172.21.15.80:0/1018475010 wait complete. 2024-04-25T11:31:18.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2773a9740 20 client.17133 trim_cache size 0 max 16384 2024-04-25T11:31:18.451 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:18.451 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:31:18.451 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:31:18.451 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:18.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff2540afce0 msgr2=0x7ff2540b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff2540afce0 0x7ff2540b21f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff260009a60 tx=0x7ff26002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 msgr2=0x7ff26819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff26819a6e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d770 tx=0x7ff26400dc30 comp rx=0 tx=0).stop 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 shutdown_connections 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff2540afce0 0x7ff2540b21f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff268109fb0 0x7ff26819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff268109b10 0x7ff26819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 --2- 172.21.15.80:0/1797498327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff268104260 0x7ff26819a6e0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 >> 172.21.15.80:0/1797498327 conn(0x7ff2680ff1d0 msgr2=0x7ff268106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 shutdown_connections 2024-04-25T11:31:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.454+0000 7ff2704f9640 1 -- 172.21.15.80:0/1797498327 wait complete. 2024-04-25T11:31:18.455 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:18 smithi080 ceph-mon[29126]: pgmap v217: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 234 B/s wr, 7 op/s 2024-04-25T11:31:18.456 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:31:18.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:31:18.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:18 smithi082 ceph-mon[32440]: pgmap v217: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 234 B/s wr, 7 op/s 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 -- 172.21.15.80:0/1552389102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650102060 msgr2=0x7f4650102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 --2- 172.21.15.80:0/1552389102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650102060 0x7f4650102470 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4640009900 tx=0x7f464002a410 comp rx=0 tx=0).stop 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 -- 172.21.15.80:0/1552389102 shutdown_connections 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 --2- 172.21.15.80:0/1552389102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650102060 0x7f4650102470 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 --2- 172.21.15.80:0/1552389102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f465010e560 0x7f4650110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 --2- 172.21.15.80:0/1552389102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4650109bb0 0x7f4650101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 -- 172.21.15.80:0/1552389102 >> 172.21.15.80:0/1552389102 conn(0x7f46500fd850 msgr2=0x7f46500ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 -- 172.21.15.80:0/1552389102 shutdown_connections 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.574+0000 7f4657692640 1 -- 172.21.15.80:0/1552389102 wait complete. 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 Processor -- start 2024-04-25T11:31:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 -- start start 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4650102060 0x7f465019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4650109bb0 0x7f465019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465010e560 0x7f465019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4650113d20 con 0x7f465010e560 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4650113ba0 con 0x7f4650109bb0 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4657692640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4650113ea0 con 0x7f4650102060 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465010e560 0x7f465019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465010e560 0x7f465019ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41242/0 (socket says 172.21.15.80:41242) 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 -- 172.21.15.80:0/2726852448 learned_addr learned my addr 172.21.15.80:0/2726852448 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f465542e640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4650102060 0x7f465019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4654c2d640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4650109bb0 0x7f465019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 -- 172.21.15.80:0/2726852448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4650102060 msgr2=0x7f465019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4650102060 0x7f465019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 -- 172.21.15.80:0/2726852448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4650109bb0 msgr2=0x7f465019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4650109bb0 0x7f465019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4655c2f640 1 -- 172.21.15.80:0/2726852448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465019f5a0 con 0x7f465010e560 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.575+0000 7f4654c2d640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4650109bb0 0x7f465019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.576+0000 7f4655c2f640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465010e560 0x7f465019ef60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f464800cab0 tx=0x7f464800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.576+0000 7f46467fc640 1 -- 172.21.15.80:0/2726852448 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464800ae20 con 0x7f465010e560 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.576+0000 7f46467fc640 1 -- 172.21.15.80:0/2726852448 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f464800f900 con 0x7f465010e560 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.576+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465019f890 con 0x7f465010e560 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.576+0000 7f46467fc640 1 -- 172.21.15.80:0/2726852448 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648018a50 con 0x7f465010e560 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.576+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46501a7210 con 0x7f465010e560 2024-04-25T11:31:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.577+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465006a190 con 0x7f465010e560 2024-04-25T11:31:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.579+0000 7f46467fc640 1 -- 172.21.15.80:0/2726852448 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f464800f450 con 0x7f465010e560 2024-04-25T11:31:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.580+0000 7f46467fc640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f463c0afce0 0x7f463c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.580+0000 7f465542e640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f463c0afce0 0x7f463c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.580+0000 7f46467fc640 1 -- 172.21.15.80:0/2726852448 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f46480dfa90 con 0x7f465010e560 2024-04-25T11:31:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.580+0000 7f465542e640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f463c0afce0 0x7f463c0b21f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f464c0058c0 tx=0x7f464c00a2d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.583+0000 7f46467fc640 1 -- 172.21.15.80:0/2726852448 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4648014030 con 0x7f465010e560 2024-04-25T11:31:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.797+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f465019ba90 con 0x7f465010e560 2024-04-25T11:31:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.798+0000 7f46467fc640 1 -- 172.21.15.80:0/2726852448 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f46480a8420 con 0x7f465010e560 2024-04-25T11:31:18.788 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:31:18.788 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:31:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:31:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f463c0afce0 msgr2=0x7f463c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f463c0afce0 0x7f463c0b21f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f464c0058c0 tx=0x7f464c00a2d0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465010e560 msgr2=0x7f465019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465010e560 0x7f465019ef60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f464800cab0 tx=0x7f464800cf70 comp rx=0 tx=0).stop 2024-04-25T11:31:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 shutdown_connections 2024-04-25T11:31:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f463c0afce0 0x7f463c0b21f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465010e560 0x7f465019ef60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4650109bb0 0x7f465019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 --2- 172.21.15.80:0/2726852448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4650102060 0x7f465019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 >> 172.21.15.80:0/2726852448 conn(0x7f46500fd850 msgr2=0x7f46500fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 shutdown_connections 2024-04-25T11:31:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.800+0000 7f4657692640 1 -- 172.21.15.80:0/2726852448 wait complete. 2024-04-25T11:31:18.802 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:31:18.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 -- 172.21.15.80:0/3132438722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 msgr2=0x7f1b9c10f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/3132438722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c10f4a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009ca0 tx=0x7f1b9402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 -- 172.21.15.80:0/3132438722 shutdown_connections 2024-04-25T11:31:18.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/3132438722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c10f4a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/3132438722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b9c108eb0 0x7f1b9c102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/3132438722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c108a10 0x7f1b9c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 -- 172.21.15.80:0/3132438722 >> 172.21.15.80:0/3132438722 conn(0x7f1b9c078110 msgr2=0x7f1b9c078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 -- 172.21.15.80:0/3132438722 shutdown_connections 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.921+0000 7f1ba0e30640 1 -- 172.21.15.80:0/3132438722 wait complete. 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.922+0000 7f1ba0e30640 1 Processor -- start 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.922+0000 7f1ba0e30640 1 -- start start 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.922+0000 7f1ba0e30640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.922+0000 7f1ba0e30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c108a10 0x7f1b9c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.922+0000 7f1ba0e30640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b9c108eb0 0x7f1b9c19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.922+0000 7f1ba0e30640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c112c50 con 0x7f1b9c1031c0 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1ba0e30640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c112ad0 con 0x7f1b9c108a10 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1ba0e30640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c112dd0 con 0x7f1b9c108eb0 2024-04-25T11:31:18.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c19b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41256/0 (socket says 172.21.15.80:41256) 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 -- 172.21.15.80:0/907110690 learned_addr learned my addr 172.21.15.80:0/907110690 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b93fff640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c108a10 0x7f1b9c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b9c108eb0 0x7f1b9c19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 -- 172.21.15.80:0/907110690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b9c108eb0 msgr2=0x7f1b9c19c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b9c108eb0 0x7f1b9c19c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 -- 172.21.15.80:0/907110690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c108a10 msgr2=0x7f1b9c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c108a10 0x7f1b9c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 -- 172.21.15.80:0/907110690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c1a68a0 con 0x7f1b9c1031c0 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b93fff640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c108a10 0x7f1b9c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:18.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b9a59c640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c19b590 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00d740 tx=0x7f1b8c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b937fe640 1 -- 172.21.15.80:0/907110690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c017070 con 0x7f1b9c1031c0 2024-04-25T11:31:18.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9c1a6b90 con 0x7f1b9c1031c0 2024-04-25T11:31:18.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b937fe640 1 -- 172.21.15.80:0/907110690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b8c00de50 con 0x7f1b9c1031c0 2024-04-25T11:31:18.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1b937fe640 1 -- 172.21.15.80:0/907110690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00f620 con 0x7f1b9c1031c0 2024-04-25T11:31:18.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.923+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b9c1a70e0 con 0x7f1b9c1031c0 2024-04-25T11:31:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 Processor -- start 2024-04-25T11:31:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 -- start start 2024-04-25T11:31:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b937fe640 1 -- 172.21.15.80:0/907110690 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1b8c01a070 con 0x7f1b9c1031c0 2024-04-25T11:31:18.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d3c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d3cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5593b3ca1d80 con 0x5593b399b390 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5593b3c5ba20 con 0x5593b397a6b0 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5593b3c9dd40 con 0x5593b39724d0 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d3c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d3c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41262/0 (socket says 172.21.15.80:41262) 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3084064442 learned_addr learned my addr 172.21.15.80:0/3084064442 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9a59c640 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d3cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b93fff640 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3084064442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 msgr2=0x5593b3d3cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d3cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3084064442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 msgr2=0x5593b3d496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3084064442 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b3c66c30 con 0x5593b399b390 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b93fff640 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.926+0000 7f1b9a59c640 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d3cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.927+0000 7f1b937fe640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1b880afc60 0x7f1b880b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.927+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d3c810 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005cc0 tx=0x7f1b9402f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6a214025b52123 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.927+0000 7f1b9a59c640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1b880afc60 0x7f1b880b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.927+0000 7f1b937fe640 1 -- 172.21.15.80:0/907110690 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f1b8c0deb30 con 0x7f1b9c1031c0 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.927+0000 7f1b90ff9640 1 -- 172.21.15.80:0/3084064442 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94031cf0 con 0x5593b399b390 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.927+0000 7f1b90ff9640 1 -- 172.21.15.80:0/3084064442 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b94036040 con 0x5593b399b390 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.927+0000 7f1b90ff9640 1 -- 172.21.15.80:0/3084064442 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94004040 con 0x5593b399b390 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3084064442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 msgr2=0x5593b3d3c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1b9a59c640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1b880afc60 0x7f1b880b2170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0dc310 tx=0x7f1b8c08f8e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d3c810 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005cc0 tx=0x7f1b9402f420 comp rx=0 tx=0).stop 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3084064442 shutdown_connections 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d3cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3084064442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d3c810 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3084064442 >> 172.21.15.80:0/3084064442 conn(0x5593b398f4e0 msgr2=0x5593b3d38fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3084064442 shutdown_connections 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3084064442 wait complete. 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 -- start start 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.928+0000 7f1ba7db6740 1 Processor -- start 2024-04-25T11:31:18.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d47240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b397a6b0 0x5593b3d47780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b399b390 0x5593b3d531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5593b3d49d30 con 0x5593b397a6b0 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5593b3c28dc0 con 0x5593b399b390 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5593b3d49eb0 con 0x5593b39724d0 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1ba7db6740 10 client.0 _ll_register_callbacks cb 0x5593b3c44600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b397a6b0 0x5593b3d47780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b397a6b0 0x5593b3d47780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41272/0 (socket says 172.21.15.80:41272) 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 -- 172.21.15.80:0/2219586555 learned_addr learned my addr 172.21.15.80:0/2219586555 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d47240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b399b390 0x5593b3d531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 -- 172.21.15.80:0/2219586555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 msgr2=0x5593b3d47240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d47240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 -- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b399b390 msgr2=0x5593b3d531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b399b390 0x5593b3d531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 -- 172.21.15.80:0/2219586555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b39b33f0 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b93fff640 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b397a6b0 0x5593b3d47780 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1b84011430 tx=0x7f1b840118f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b27a47ee2cfa6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.929+0000 7f1b81ffb640 1 -- 172.21.15.80:0/2219586555 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84012980 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1b81ffb640 1 -- 172.21.15.80:0/2219586555 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f1b84012b20 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b94036040 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1b81ffb640 1 -- 172.21.15.80:0/2219586555 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b84012d20 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 10 client.17151 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5593b3a7d7d0 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1b81ffb640 1 -- 172.21.15.80:0/2219586555 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b94036040 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1b81ffb640 1 -- 172.21.15.80:0/2219586555 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1b8400f560 con 0x5593b397a6b0 2024-04-25T11:31:18.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 10 client.17151 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 10 client.17151 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 20 client.17151 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b3959f60 0x5593b3d59650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 4 client.17151 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593b3caf990 con 0x5593b3959f60 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.930+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b3959f60 0x5593b3d59650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.931+0000 7f1b81ffb640 10 client.17151 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.931+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b3959f60 0x5593b3d59650 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bfa23dd46a8c6eaf server_cookie=f4062aacb1a2a974 in_seq=0 out_seq=0 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.931+0000 7f1b81ffb640 1 -- 172.21.15.80:0/2219586555 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5593b3caf990 con 0x5593b3959f60 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.931+0000 7f1b81ffb640 10 client.17151 handle_command_reply: tid=0 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.931+0000 7f1ba7db6740 1 client.17151 shutdown 2024-04-25T11:31:18.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b397a6b0 msgr2=0x5593b3d47780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b397a6b0 0x5593b3d47780 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1b84011430 tx=0x7f1b840118f0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 shutdown_connections 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b3959f60 0x5593b3d59650 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b397a6b0 0x5593b3d47780 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b399b390 0x5593b3d531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/2219586555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d47240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1b81ffb640 0 client.17151 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 >> 172.21.15.80:0/2219586555 conn(0x5593b398f4e0 msgr2=0x5593b3d3e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 shutdown_connections 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 1 -- 172.21.15.80:0/2219586555 wait complete. 2024-04-25T11:31:18.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.932+0000 7f1ba7db6740 20 client.17151 trim_cache size 0 max 16384 2024-04-25T11:31:18.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 Processor -- start 2024-04-25T11:31:18.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 -- start start 2024-04-25T11:31:18.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b39724d0 0x5593b3d38ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d52e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b399b390 0x5593b3d5ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c1b24b0 con 0x5593b39724d0 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c1afd80 con 0x5593b397a6b0 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.945+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c1adbf0 con 0x5593b399b390 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b39724d0 0x5593b3d38ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b39724d0 0x5593b3d38ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41288/0 (socket says 172.21.15.80:41288) 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3262732459 learned_addr learned my addr 172.21.15.80:0/3262732459 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3262732459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b399b390 msgr2=0x5593b3d5ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3262732459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b399b390 0x5593b3d5ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3262732459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 msgr2=0x5593b3d52e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3262732459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d52e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3262732459 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b3d49dd0 con 0x5593b39724d0 2024-04-25T11:31:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3262732459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b39724d0 0x5593b3d38ed0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005e30 tx=0x7f1b94003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e86214a95d82a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b83fff640 1 -- 172.21.15.80:0/3262732459 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94058070 con 0x5593b39724d0 2024-04-25T11:31:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b83fff640 1 -- 172.21.15.80:0/3262732459 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b94036040 con 0x5593b39724d0 2024-04-25T11:31:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.946+0000 7f1b83fff640 1 -- 172.21.15.80:0/3262732459 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b940042a0 con 0x5593b39724d0 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3262732459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b39724d0 msgr2=0x5593b3d38ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3262732459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b39724d0 0x5593b3d38ed0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005e30 tx=0x7f1b94003b60 comp rx=0 tx=0).stop 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3262732459 shutdown_connections 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3262732459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b399b390 0x5593b3d5ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3262732459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d52e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3262732459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b39724d0 0x5593b3d38ed0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3262732459 >> 172.21.15.80:0/3262732459 conn(0x5593b398f4e0 msgr2=0x5593b3d387c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3262732459 shutdown_connections 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3262732459 wait complete. 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 -- start start 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.947+0000 7f1ba7db6740 1 Processor -- start 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d4f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d4ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d4b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c1ae240 con 0x5593b399b390 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c1af6b0 con 0x5593b397a6b0 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c1ae910 con 0x5593b39724d0 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 10 client.0 _ll_register_callbacks cb 0x7f1b84009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d4b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d4b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41290/0 (socket says 172.21.15.80:41290) 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3499648423 learned_addr learned my addr 172.21.15.80:0/3499648423 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d4f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b93fff640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d4ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3499648423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 msgr2=0x5593b3d4f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d4f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 msgr2=0x5593b3d4ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d4ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 -- 172.21.15.80:0/3499648423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b3d4b850 con 0x5593b399b390 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b93fff640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d4ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b9ad9d640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d4b0c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005d50 tx=0x7f1b940099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f818da9e6f121df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b81ffb640 1 -- 172.21.15.80:0/3499648423 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94058040 con 0x5593b399b390 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1b81ffb640 1 -- 172.21.15.80:0/3499648423 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f1b94004b40 con 0x5593b399b390 2024-04-25T11:31:18.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.948+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b94036040 con 0x5593b399b390 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1b81ffb640 1 -- 172.21.15.80:0/3499648423 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b94031510 con 0x5593b399b390 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 10 client.17157 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5593b3dc1990 con 0x5593b399b390 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1b81ffb640 1 -- 172.21.15.80:0/3499648423 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b94036040 con 0x5593b399b390 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1b81ffb640 1 -- 172.21.15.80:0/3499648423 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1b9402f660 con 0x5593b399b390 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 10 client.17157 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 10 client.17157 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 20 client.17157 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b392f3a0 0x5593b3dc3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 4 client.17157 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593b3ca9800 con 0x5593b392f3a0 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1b93fff640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b392f3a0 0x5593b3dc3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1b81ffb640 10 client.17157 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.949+0000 7f1b93fff640 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b392f3a0 0x5593b3dc3b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7962f592ba7ea00 server_cookie=6be669a998adfe6b in_seq=0 out_seq=0 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1b81ffb640 1 -- 172.21.15.80:0/3499648423 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593b3ca9800 con 0x5593b392f3a0 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1b81ffb640 10 client.17157 handle_command_reply: tid=0 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 client.17157 shutdown 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 msgr2=0x5593b3d4b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d4b0c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005d50 tx=0x7f1b940099e0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 shutdown_connections 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5593b392f3a0 0x5593b3dc3b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5593b399b390 0x5593b3d4b0c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5593b397a6b0 0x5593b3d4ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 --2- 172.21.15.80:0/3499648423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593b39724d0 0x5593b3d4f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1b81ffb640 0 client.17157 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 >> 172.21.15.80:0/3499648423 conn(0x5593b398f4e0 msgr2=0x5593b3d38690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 shutdown_connections 2024-04-25T11:31:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 1 -- 172.21.15.80:0/3499648423 wait complete. 2024-04-25T11:31:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba7db6740 20 client.17157 trim_cache size 0 max 16384 2024-04-25T11:31:18.948 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1b880afc60 msgr2=0x7f1b880b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1b880afc60 0x7f1b880b2170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0dc310 tx=0x7f1b8c08f8e0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 msgr2=0x7f1b9c19b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.950+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c19b590 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00d740 tx=0x7f1b8c00dc00 comp rx=0 tx=0).stop 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 shutdown_connections 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1b880afc60 0x7f1b880b2170 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b9c108eb0 0x7f1b9c19c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c108a10 0x7f1b9c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 --2- 172.21.15.80:0/907110690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b9c1031c0 0x7f1b9c19b590 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 >> 172.21.15.80:0/907110690 conn(0x7f1b9c078110 msgr2=0x7f1b9c100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 shutdown_connections 2024-04-25T11:31:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:18.951+0000 7f1ba0e30640 1 -- 172.21.15.80:0/907110690 wait complete. 2024-04-25T11:31:18.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 -- 172.21.15.80:0/3632178561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4104260 msgr2=0x7f0aa4110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 --2- 172.21.15.80:0/3632178561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4104260 0x7f0aa4110630 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009ca0 tx=0x7f0a9c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 -- 172.21.15.80:0/3632178561 shutdown_connections 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 --2- 172.21.15.80:0/3632178561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4104260 0x7f0aa4110630 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 --2- 172.21.15.80:0/3632178561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0aa4109fb0 0x7f0aa4103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 --2- 172.21.15.80:0/3632178561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa4109b10 0x7f0aa41036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 -- 172.21.15.80:0/3632178561 >> 172.21.15.80:0/3632178561 conn(0x7f0aa40ff1d0 msgr2=0x7f0aa4101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 -- 172.21.15.80:0/3632178561 shutdown_connections 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.072+0000 7f0aabbce640 1 -- 172.21.15.80:0/3632178561 wait complete. 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 Processor -- start 2024-04-25T11:31:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 -- start start 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0aa4104260 0x7f0aa419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa4109b10 0x7f0aa419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4109fb0 0x7f0aa419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4113d20 con 0x7f0aa4109fb0 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4113ba0 con 0x7f0aa4109b10 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aabbce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4113ea0 con 0x7f0aa4104260 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aaa16b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4109fb0 0x7f0aa419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aaa16b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4109fb0 0x7f0aa419ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41300/0 (socket says 172.21.15.80:41300) 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aaa16b640 1 -- 172.21.15.80:0/592324618 learned_addr learned my addr 172.21.15.80:0/592324618 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aa996a640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0aa4104260 0x7f0aa419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.073+0000 7f0aa9169640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa4109b10 0x7f0aa419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aaa16b640 1 -- 172.21.15.80:0/592324618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0aa4104260 msgr2=0x7f0aa419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aaa16b640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0aa4104260 0x7f0aa419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aaa16b640 1 -- 172.21.15.80:0/592324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa4109b10 msgr2=0x7f0aa419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aaa16b640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa4109b10 0x7f0aa419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aaa16b640 1 -- 172.21.15.80:0/592324618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa419f540 con 0x7f0aa4109fb0 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aaa16b640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4109fb0 0x7f0aa419ef00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0098d0 tx=0x7f0a9c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0a9affd640 1 -- 172.21.15.80:0/592324618 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c003b70 con 0x7f0aa4109fb0 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0a9affd640 1 -- 172.21.15.80:0/592324618 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a9c003d10 con 0x7f0aa4109fb0 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa419f7d0 con 0x7f0aa4109fb0 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0a9affd640 1 -- 172.21.15.80:0/592324618 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c02fa20 con 0x7f0aa4109fb0 2024-04-25T11:31:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.074+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa419fd20 con 0x7f0aa4109fb0 2024-04-25T11:31:19.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.076+0000 7f0a9affd640 1 -- 172.21.15.80:0/592324618 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f0a9c02fc40 con 0x7f0aa4109fb0 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.076+0000 7f0ab2a84740 1 Processor -- start 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0ab2a84740 1 -- start start 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2dab390 0x55b2a314c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d824d0 0x55b2a314cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b2a30b1d80 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b2a306ba20 con 0x55b2a2d824d0 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b2a30add40 con 0x55b2a2dab390 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41306/0 (socket says 172.21.15.80:41306) 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 -- 172.21.15.80:0/3693183131 learned_addr learned my addr 172.21.15.80:0/3693183131 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0a9affd640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0a900afc60 0x7f0a900b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2dab390 0x55b2a314c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa996a640 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d824d0 0x55b2a314cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 -- 172.21.15.80:0/3693183131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2dab390 msgr2=0x55b2a314c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2dab390 0x55b2a314c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 -- 172.21.15.80:0/3693183131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d824d0 msgr2=0x55b2a314cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aaa16b640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0a900afc60 0x7f0a900b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d824d0 0x55b2a314cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa9169640 1 -- 172.21.15.80:0/3693183131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a3076c30 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.077+0000 7f0aa996a640 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d824d0 0x55b2a314cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.078+0000 7f0a9affd640 1 -- 172.21.15.80:0/592324618 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f0a9c1004b0 con 0x7f0aa4109fb0 2024-04-25T11:31:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.078+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31596a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009fa0 tx=0x7f0a940096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de8147ac791f16b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.078+0000 7f0a8ffff640 1 -- 172.21.15.80:0/3693183131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94004250 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.078+0000 7f0a8ffff640 1 -- 172.21.15.80:0/3693183131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a940043f0 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.078+0000 7f0a8ffff640 1 -- 172.21.15.80:0/3693183131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400f840 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3693183131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 msgr2=0x55b2a31596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0aaa16b640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0a900afc60 0x7f0a900b2170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0fdda0 tx=0x7f0a9c041b80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31596a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009fa0 tx=0x7f0a940096b0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3693183131 shutdown_connections 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31596a0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d824d0 0x55b2a314cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3693183131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2dab390 0x55b2a314c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3693183131 >> 172.21.15.80:0/3693183131 conn(0x55b2a2d9f4e0 msgr2=0x55b2a3148fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3693183131 shutdown_connections 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3693183131 wait complete. 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 -- start start 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.079+0000 7f0ab2a84740 1 Processor -- start 2024-04-25T11:31:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a31573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a315d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b2a3159d90 con 0x55b2a2dab390 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b2a3038dc0 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b2a3159f10 con 0x55b2a2d824d0 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0ab2a84740 10 client.0 _ll_register_callbacks cb 0x55b2a3054600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a315d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a315d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41320/0 (socket says 172.21.15.80:41320) 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 -- 172.21.15.80:0/3200219777 learned_addr learned my addr 172.21.15.80:0/3200219777 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a31573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa996a640 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 -- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 msgr2=0x55b2a31573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a31573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 -- 172.21.15.80:0/3200219777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 msgr2=0x55b2a31578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 -- 172.21.15.80:0/3200219777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a2dc33f0 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0aa9169640 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a315d1e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0a94004650 tx=0x7f0a940045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bbf6c3f59e5aed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.080+0000 7f0a8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/3200219777 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94022030 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/3200219777 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f0a94003b70 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a940043f0 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/3200219777 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0a94003d70 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 10 client.17169 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b2a2e8d7d0 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/3200219777 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a940043f0 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/3200219777 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0a9401c020 con 0x55b2a2dab390 2024-04-25T11:31:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 10 client.17169 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 10 client.17169 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 20 client.17169 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d69f60 0x55b2a3169640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 4 client.17169 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2a30bf990 con 0x55b2a2d69f60 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.081+0000 7f0aa996a640 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d69f60 0x55b2a3169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.082+0000 7f0aa996a640 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d69f60 0x55b2a3169640 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fc7f1b4e87bae553 server_cookie=fb81cefc2077f27 in_seq=0 out_seq=0 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.082+0000 7f0a8d7fa640 10 client.17169 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/3200219777 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b2a30bf990 con 0x55b2a2d69f60 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0a8d7fa640 10 client.17169 handle_command_reply: tid=0 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 client.17169 shutdown 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 msgr2=0x55b2a315d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a315d1e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0a94004650 tx=0x7f0a940045a0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 shutdown_connections 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a315d1e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d69f60 0x55b2a3169640 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a31578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/3200219777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a31573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0a8d7fa640 0 client.17169 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 >> 172.21.15.80:0/3200219777 conn(0x55b2a2d9f4e0 msgr2=0x55b2a314e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 shutdown_connections 2024-04-25T11:31:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 1 -- 172.21.15.80:0/3200219777 wait complete. 2024-04-25T11:31:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.083+0000 7f0ab2a84740 20 client.17169 trim_cache size 0 max 16384 2024-04-25T11:31:19.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.096+0000 7f0ab2a84740 1 Processor -- start 2024-04-25T11:31:19.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.096+0000 7f0ab2a84740 1 -- start start 2024-04-25T11:31:19.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a3156950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a3151430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a3151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41b2260 con 0x55b2a2dab390 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41afb30 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41ad9a0 con 0x55b2a2d824d0 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a3151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a3151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41332/0 (socket says 172.21.15.80:41332) 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 -- 172.21.15.80:0/48951705 learned_addr learned my addr 172.21.15.80:0/48951705 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a3156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa996a640 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a3151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 -- 172.21.15.80:0/48951705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 msgr2=0x55b2a3156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a3156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 -- 172.21.15.80:0/48951705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 msgr2=0x55b2a3151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a3151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 -- 172.21.15.80:0/48951705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a314e010 con 0x55b2a2dab390 2024-04-25T11:31:19.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0aa9169640 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a3151970 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0a94003fb0 tx=0x7f0a940058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a1437214218a22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0a8f7fe640 1 -- 172.21.15.80:0/48951705 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94022040 con 0x55b2a2dab390 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0a8f7fe640 1 -- 172.21.15.80:0/48951705 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a94005410 con 0x55b2a2dab390 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.097+0000 7f0a8f7fe640 1 -- 172.21.15.80:0/48951705 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a940039d0 con 0x55b2a2dab390 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 -- 172.21.15.80:0/48951705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 msgr2=0x55b2a3151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a3151970 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0a94003fb0 tx=0x7f0a940058d0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 -- 172.21.15.80:0/48951705 shutdown_connections 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2dab390 0x55b2a3151970 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2d8a6b0 0x55b2a3151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/48951705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a3156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 -- 172.21.15.80:0/48951705 >> 172.21.15.80:0/48951705 conn(0x55b2a2d9f4e0 msgr2=0x55b2a3147610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 -- 172.21.15.80:0/48951705 shutdown_connections 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 -- 172.21.15.80:0/48951705 wait complete. 2024-04-25T11:31:19.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 -- start start 2024-04-25T11:31:19.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.098+0000 7f0ab2a84740 1 Processor -- start 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a315e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a315e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0ab2a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2dab390 0x55b2a315eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41adff0 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41af460 con 0x55b2a2dab390 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0ab2a84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41ae6c0 con 0x55b2a2d824d0 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0ab2a84740 10 client.0 _ll_register_callbacks cb 0x7f0a94009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a315e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a315e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41334/0 (socket says 172.21.15.80:41334) 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 -- 172.21.15.80:0/2732604226 learned_addr learned my addr 172.21.15.80:0/2732604226 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa9169640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a315e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 -- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 msgr2=0x55b2a315e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a315e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 -- 172.21.15.80:0/2732604226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2dab390 msgr2=0x55b2a315eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa9169640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2dab390 0x55b2a315eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2dab390 0x55b2a315eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 -- 172.21.15.80:0/2732604226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a31cf8b0 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa9169640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2dab390 0x55b2a315eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0aa996a640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a315e5a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0004700 tx=0x7f0aa00118f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a046d030924480 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.099+0000 7f0a8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/2732604226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa001d940 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/2732604226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f0aa0004020 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a94005410 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/2732604226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0aa002c050 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 10 client.17175 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b2a31d0a90 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/2732604226 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a94005410 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/2732604226 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0aa0010430 con 0x55b2a2d8a6b0 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 10 client.17175 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 10 client.17175 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 20 client.17175 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d3f3a0 0x55b2a31d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 4 client.17175 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.100+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b2a30b9800 con 0x55b2a2d3f3a0 2024-04-25T11:31:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0aa9169640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d3f3a0 0x55b2a31d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0a8d7fa640 10 client.17175 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0aa9169640 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d3f3a0 0x55b2a31d3230 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cdf72b448499f30f server_cookie=cc9707fe6cc2ed6a in_seq=0 out_seq=0 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0a8d7fa640 1 -- 172.21.15.80:0/2732604226 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b2a30b9800 con 0x55b2a2d3f3a0 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0a8d7fa640 10 client.17175 handle_command_reply: tid=0 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 client.17175 shutdown 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 msgr2=0x55b2a315e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a315e5a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0004700 tx=0x7f0aa00118f0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 shutdown_connections 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2a2d8a6b0 0x55b2a315e5a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55b2a2d3f3a0 0x55b2a31d3230 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2a2dab390 0x55b2a315eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 --2- 172.21.15.80:0/2732604226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b2a2d824d0 0x55b2a315e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0a8d7fa640 0 client.17175 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 >> 172.21.15.80:0/2732604226 conn(0x55b2a2d9f4e0 msgr2=0x55b2a3158850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 shutdown_connections 2024-04-25T11:31:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.101+0000 7f0ab2a84740 1 -- 172.21.15.80:0/2732604226 wait complete. 2024-04-25T11:31:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0ab2a84740 20 client.17175 trim_cache size 0 max 16384 2024-04-25T11:31:19.099 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0a900afc60 msgr2=0x7f0a900b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0a900afc60 0x7f0a900b2170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0fdda0 tx=0x7f0a9c041b80 comp rx=0 tx=0).stop 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4109fb0 msgr2=0x7f0aa419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4109fb0 0x7f0aa419ef00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0098d0 tx=0x7f0a9c0317b0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 shutdown_connections 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0a900afc60 0x7f0a900b2170 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0aa4109fb0 0x7f0aa419ef00 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa4109b10 0x7f0aa419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 --2- 172.21.15.80:0/592324618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0aa4104260 0x7f0aa419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 >> 172.21.15.80:0/592324618 conn(0x7f0aa40ff1d0 msgr2=0x7f0aa4101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 shutdown_connections 2024-04-25T11:31:19.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.102+0000 7f0aabbce640 1 -- 172.21.15.80:0/592324618 wait complete. 2024-04-25T11:31:19.103 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 -- 172.21.15.80:0/2590284808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e010e090 msgr2=0x7f65e0110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 --2- 172.21.15.80:0/2590284808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e010e090 0x7f65e0110580 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009ca0 tx=0x7f65d802a9e0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 -- 172.21.15.80:0/2590284808 shutdown_connections 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 --2- 172.21.15.80:0/2590284808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e010e090 0x7f65e0110580 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 --2- 172.21.15.80:0/2590284808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65e010b6e0 0x7f65e010db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 --2- 172.21.15.80:0/2590284808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e0104c80 0x7f65e0105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 -- 172.21.15.80:0/2590284808 >> 172.21.15.80:0/2590284808 conn(0x7f65e0078150 msgr2=0x7f65e0078590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 -- 172.21.15.80:0/2590284808 shutdown_connections 2024-04-25T11:31:19.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.225+0000 7f65e6096640 1 -- 172.21.15.80:0/2590284808 wait complete. 2024-04-25T11:31:19.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 Processor -- start 2024-04-25T11:31:19.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 -- start start 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e0104c80 0x7f65e019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65e010b6e0 0x7f65e019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e010e090 0x7f65e019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0113cf0 con 0x7f65e0104c80 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0113b70 con 0x7f65e010e090 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.226+0000 7f65e6096640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0113e70 con 0x7f65e010b6e0 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e0104c80 0x7f65e019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e0104c80 0x7f65e019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41362/0 (socket says 172.21.15.80:41362) 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 -- 172.21.15.80:0/2941379495 learned_addr learned my addr 172.21.15.80:0/2941379495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65e010b6e0 0x7f65e019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 -- 172.21.15.80:0/2941379495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65e010b6e0 msgr2=0x7f65e019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65e010b6e0 0x7f65e019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 -- 172.21.15.80:0/2941379495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e010e090 msgr2=0x7f65e019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65dffff640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e010e090 0x7f65e019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e010e090 0x7f65e019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 -- 172.21.15.80:0/2941379495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e019f550 con 0x7f65e0104c80 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65e010b6e0 0x7f65e019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65df7fe640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e0104c80 0x7f65e019a6f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f65d000d950 tx=0x7f65d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65dd7fa640 1 -- 172.21.15.80:0/2941379495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0017070 con 0x7f65e0104c80 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e019f840 con 0x7f65e0104c80 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65dd7fa640 1 -- 172.21.15.80:0/2941379495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65d0009c30 con 0x7f65e0104c80 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65dd7fa640 1 -- 172.21.15.80:0/2941379495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d000f620 con 0x7f65e0104c80 2024-04-25T11:31:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.227+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e01a71c0 con 0x7f65e0104c80 2024-04-25T11:31:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.230+0000 7f65ed029740 1 Processor -- start 2024-04-25T11:31:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.230+0000 7f65ed029740 1 -- start start 2024-04-25T11:31:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.230+0000 7f65dd7fa640 1 -- 172.21.15.80:0/2941379495 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f65d0010460 con 0x7f65e0104c80 2024-04-25T11:31:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65ed029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e559810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65ed029740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65ed029740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e5666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65ed029740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556f1e4bed80 con 0x556f1e1976b0 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65ed029740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f1e478a20 con 0x556f1e18f4d0 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65ed029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556f1e4bad40 con 0x556f1e1b8390 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e5666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e5666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41366/0 (socket says 172.21.15.80:41366) 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 -- 172.21.15.80:0/3070012776 learned_addr learned my addr 172.21.15.80:0/3070012776 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65df7fe640 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65dffff640 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e559810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 -- 172.21.15.80:0/3070012776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 msgr2=0x556f1e559810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e559810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 -- 172.21.15.80:0/3070012776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 msgr2=0x556f1e559d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 -- 172.21.15.80:0/3070012776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f1e483c30 con 0x556f1e1976b0 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e5666a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009ba0 tx=0x7f65c800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60db5af63ef5d8b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65dd7fa640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f65cc0afc60 0x7f65cc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d5ffb640 1 -- 172.21.15.80:0/3070012776 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8016070 con 0x556f1e1976b0 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65dffff640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f65cc0afc60 0x7f65cc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d5ffb640 1 -- 172.21.15.80:0/3070012776 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65c8011920 con 0x556f1e1976b0 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.231+0000 7f65d5ffb640 1 -- 172.21.15.80:0/3070012776 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8010850 con 0x556f1e1976b0 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65dd7fa640 1 -- 172.21.15.80:0/2941379495 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f65d00ded60 con 0x7f65e0104c80 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 -- 172.21.15.80:0/3070012776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 msgr2=0x556f1e5666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65dffff640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f65cc0afc60 0x7f65cc0b2170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009880 tx=0x7f65d8009990 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e5666a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009ba0 tx=0x7f65c800e6c0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 -- 172.21.15.80:0/3070012776 shutdown_connections 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e5666a0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 --2- 172.21.15.80:0/3070012776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e559810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 -- 172.21.15.80:0/3070012776 >> 172.21.15.80:0/3070012776 conn(0x556f1e1ac4e0 msgr2=0x556f1e555fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 -- 172.21.15.80:0/3070012776 shutdown_connections 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.232+0000 7f65ed029740 1 -- 172.21.15.80:0/3070012776 wait complete. 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 -- start start 2024-04-25T11:31:19.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 Processor -- start 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e18f4d0 0x556f1e56e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e56eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1b8390 0x556f1e568990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556f1e566d90 con 0x556f1e1976b0 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f1e445dc0 con 0x556f1e1b8390 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556f1e566f10 con 0x556f1e18f4d0 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65ed029740 10 client.0 _ll_register_callbacks cb 0x556f1e461600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e56eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e56eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41370/0 (socket says 172.21.15.80:41370) 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.233+0000 7f65d6ffd640 1 -- 172.21.15.80:0/517839331 learned_addr learned my addr 172.21.15.80:0/517839331 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65df7fe640 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e18f4d0 0x556f1e56e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65dffff640 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1b8390 0x556f1e568990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65d6ffd640 1 -- 172.21.15.80:0/517839331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e18f4d0 msgr2=0x556f1e56e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e18f4d0 0x556f1e56e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65d6ffd640 1 -- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1b8390 msgr2=0x556f1e568990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1b8390 0x556f1e568990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65d6ffd640 1 -- 172.21.15.80:0/517839331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f1e1d03f0 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e56eae0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f65c80104b0 tx=0x7f65c8009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdedada986bbfbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65beffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65beffd640 1 -- 172.21.15.80:0/517839331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8027020 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c8011920 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65beffd640 1 -- 172.21.15.80:0/517839331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f65c8004020 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65beffd640 1 -- 172.21.15.80:0/517839331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f65c8016050 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65ed029740 10 client.17187 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556f1e29a7d0 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.234+0000 7f65beffd640 1 -- 172.21.15.80:0/517839331 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65c8011920 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65beffd640 1 -- 172.21.15.80:0/517839331 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f65c800f040 con 0x556f1e1976b0 2024-04-25T11:31:19.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65ed029740 10 client.17187 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65ed029740 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65ed029740 20 client.17187 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65ed029740 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e176f60 0x556f1e57a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65ed029740 4 client.17187 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f1e4cc990 con 0x556f1e176f60 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65df7fe640 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e176f60 0x556f1e57a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65beffd640 10 client.17187 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.235+0000 7f65df7fe640 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e176f60 0x556f1e57a960 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75032404ee58b8b7 server_cookie=5a4e8807ca50cd8b in_seq=0 out_seq=0 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65beffd640 1 -- 172.21.15.80:0/517839331 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556f1e4cc990 con 0x556f1e176f60 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65beffd640 10 client.17187 handle_command_reply: tid=0 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 client.17187 shutdown 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 msgr2=0x556f1e56eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e56eae0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f65c80104b0 tx=0x7f65c8009ea0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 shutdown_connections 2024-04-25T11:31:19.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e176f60 0x556f1e57a960 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1976b0 0x556f1e56eae0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1b8390 0x556f1e568990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65beffd640 0 client.17187 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 --2- 172.21.15.80:0/517839331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e18f4d0 0x556f1e56e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.236+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 >> 172.21.15.80:0/517839331 conn(0x556f1e1ac4e0 msgr2=0x556f1e55b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.237+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 shutdown_connections 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.237+0000 7f65ed029740 1 -- 172.21.15.80:0/517839331 wait complete. 2024-04-25T11:31:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.237+0000 7f65ed029740 20 client.17187 trim_cache size 0 max 16384 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 Processor -- start 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 -- start start 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1976b0 0x556f1e567290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1b8390 0x556f1e5677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01b0200 con 0x556f1e1b8390 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01adad0 con 0x556f1e18f4d0 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65ed029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01ab960 con 0x556f1e1976b0 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1b8390 0x556f1e5677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1b8390 0x556f1e5677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41380/0 (socket says 172.21.15.80:41380) 2024-04-25T11:31:19.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65dffff640 1 -- 172.21.15.80:0/25519681 learned_addr learned my addr 172.21.15.80:0/25519681 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.250+0000 7f65df7fe640 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65dffff640 1 -- 172.21.15.80:0/25519681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1976b0 msgr2=0x556f1e567290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1976b0 0x556f1e567290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65dffff640 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1976b0 0x556f1e567290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65dffff640 1 -- 172.21.15.80:0/25519681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 msgr2=0x556f1e559cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65dffff640 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65dffff640 1 -- 172.21.15.80:0/25519681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f1e55a1f0 con 0x556f1e1b8390 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1976b0 0x556f1e567290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65dffff640 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1b8390 0x556f1e5677d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006010 tx=0x7f65d803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00a7501bce95f4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65d57fa640 1 -- 172.21.15.80:0/25519681 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8033040 con 0x556f1e1b8390 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65d57fa640 1 -- 172.21.15.80:0/25519681 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65d802e840 con 0x556f1e1b8390 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.251+0000 7f65d57fa640 1 -- 172.21.15.80:0/25519681 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80040e0 con 0x556f1e1b8390 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 -- 172.21.15.80:0/25519681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1b8390 msgr2=0x556f1e5677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1b8390 0x556f1e5677d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006010 tx=0x7f65d803f000 comp rx=0 tx=0).stop 2024-04-25T11:31:19.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 -- 172.21.15.80:0/25519681 shutdown_connections 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e1b8390 0x556f1e5677d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1976b0 0x556f1e567290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 --2- 172.21.15.80:0/25519681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e18f4d0 0x556f1e559cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 -- 172.21.15.80:0/25519681 >> 172.21.15.80:0/25519681 conn(0x556f1e1ac4e0 msgr2=0x556f1e5595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 -- 172.21.15.80:0/25519681 shutdown_connections 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 -- 172.21.15.80:0/25519681 wait complete. 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 -- start start 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.252+0000 7f65ed029740 1 Processor -- start 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e18f4d0 0x556f1e573670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1976b0 0x556f1e573bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e5740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01abfb0 con 0x556f1e18f4d0 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01ad400 con 0x556f1e1976b0 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01ac660 con 0x556f1e1b8390 2024-04-25T11:31:19.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 10 client.0 _ll_register_callbacks cb 0x7f65c8009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e18f4d0 0x556f1e573670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e18f4d0 0x556f1e573670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41388/0 (socket says 172.21.15.80:41388) 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 -- 172.21.15.80:0/2685831039 learned_addr learned my addr 172.21.15.80:0/2685831039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65dffff640 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e5740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 -- 172.21.15.80:0/2685831039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 msgr2=0x556f1e5740f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e5740f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1976b0 0x556f1e573bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 -- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1976b0 msgr2=0x556f1e573bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1976b0 0x556f1e573bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 -- 172.21.15.80:0/2685831039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f1e5e0c40 con 0x556f1e18f4d0 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65df7fe640 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e18f4d0 0x556f1e573670 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f65d00a4150 tx=0x7f65d00def60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0ab9d58e32b813 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:19.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65beffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65beffd640 1 -- 172.21.15.80:0/2685831039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0020040 con 0x556f1e18f4d0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65beffd640 1 -- 172.21.15.80:0/2685831039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f65d00af8b0 con 0x556f1e18f4d0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d802e840 con 0x556f1e18f4d0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65beffd640 1 -- 172.21.15.80:0/2685831039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f65d00a6ee0 con 0x556f1e18f4d0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 10 client.17193 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.253+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556f1e5e1e50 con 0x556f1e18f4d0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65beffd640 1 -- 172.21.15.80:0/2685831039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65d802e840 con 0x556f1e18f4d0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65beffd640 1 -- 172.21.15.80:0/2685831039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f65d00a2970 con 0x556f1e18f4d0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65ed029740 10 client.17193 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65ed029740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65ed029740 20 client.17193 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65ed029740 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e14c3a0 0x556f1e5e4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65ed029740 4 client.17193 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f1e4c6800 con 0x556f1e14c3a0 2024-04-25T11:31:19.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e14c3a0 0x556f1e5e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65d6ffd640 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e14c3a0 0x556f1e5e4540 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c953d3921b43e3 server_cookie=d35a84b46a1622f6 in_seq=0 out_seq=0 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.254+0000 7f65beffd640 10 client.17193 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65beffd640 1 -- 172.21.15.80:0/2685831039 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f1e4c6800 con 0x556f1e14c3a0 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65beffd640 10 client.17193 handle_command_reply: tid=0 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 client.17193 shutdown 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e18f4d0 msgr2=0x556f1e573670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e18f4d0 0x556f1e573670 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f65d00a4150 tx=0x7f65d00def60 comp rx=0 tx=0).stop 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 shutdown_connections 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x556f1e14c3a0 0x556f1e5e4540 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556f1e1b8390 0x556f1e5740f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f1e1976b0 0x556f1e573bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 --2- 172.21.15.80:0/2685831039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556f1e18f4d0 0x556f1e573670 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65beffd640 0 client.17193 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:19.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 >> 172.21.15.80:0/2685831039 conn(0x556f1e1ac4e0 msgr2=0x556f1e554610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 shutdown_connections 2024-04-25T11:31:19.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 1 -- 172.21.15.80:0/2685831039 wait complete. 2024-04-25T11:31:19.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65ed029740 20 client.17193 trim_cache size 0 max 16384 2024-04-25T11:31:19.252 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:19.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f65cc0afc60 msgr2=0x7f65cc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65e6096640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f65cc0afc60 0x7f65cc0b2170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009880 tx=0x7f65d8009990 comp rx=0 tx=0).stop 2024-04-25T11:31:19.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e0104c80 msgr2=0x7f65e019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:19.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.255+0000 7f65e6096640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e0104c80 0x7f65e019a6f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f65d000d950 tx=0x7f65d000de10 comp rx=0 tx=0).stop 2024-04-25T11:31:19.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 shutdown_connections 2024-04-25T11:31:19.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f65cc0afc60 0x7f65cc0b2170 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e010e090 0x7f65e019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65e010b6e0 0x7f65e019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 --2- 172.21.15.80:0/2941379495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65e0104c80 0x7f65e019a6f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:19.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 >> 172.21.15.80:0/2941379495 conn(0x7f65e0078150 msgr2=0x7f65e0101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:19.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 shutdown_connections 2024-04-25T11:31:19.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:19.256+0000 7f65e6096640 1 -- 172.21.15.80:0/2941379495 wait complete. 2024-04-25T11:31:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2726852448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2726852448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2726852448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:20.258 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:31:20.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:31:20.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:31:20.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 -- 172.21.15.80:0/3478413683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 msgr2=0x7fc448110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 --2- 172.21.15.80:0/3478413683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc448110650 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ca0 tx=0x7fc44002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 -- 172.21.15.80:0/3478413683 shutdown_connections 2024-04-25T11:31:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 --2- 172.21.15.80:0/3478413683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc448110650 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 --2- 172.21.15.80:0/3478413683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc448109fd0 0x7fc448103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 --2- 172.21.15.80:0/3478413683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc448109b30 0x7fc448103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 -- 172.21.15.80:0/3478413683 >> 172.21.15.80:0/3478413683 conn(0x7fc448079280 msgr2=0x7fc4480796c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 -- 172.21.15.80:0/3478413683 shutdown_connections 2024-04-25T11:31:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.392+0000 7fc44d034640 1 -- 172.21.15.80:0/3478413683 wait complete. 2024-04-25T11:31:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 Processor -- start 2024-04-25T11:31:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 -- start start 2024-04-25T11:31:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc44819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc448109b30 0x7fc44819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc448109fd0 0x7fc44819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc448113d20 con 0x7fc4481042d0 2024-04-25T11:31:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc448113ba0 con 0x7fc448109b30 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44d034640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc448113ea0 con 0x7fc448109fd0 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc44819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc44819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41398/0 (socket says 172.21.15.80:41398) 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 -- 172.21.15.80:0/3539924682 learned_addr learned my addr 172.21.15.80:0/3539924682 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44759e640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc448109fd0 0x7fc44819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc44659c640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc448109b30 0x7fc44819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 -- 172.21.15.80:0/3539924682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc448109fd0 msgr2=0x7fc44819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc448109fd0 0x7fc44819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 -- 172.21.15.80:0/3539924682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc448109b30 msgr2=0x7fc44819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc448109b30 0x7fc44819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.393+0000 7fc446d9d640 1 -- 172.21.15.80:0/3539924682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44819f4c0 con 0x7fc4481042d0 2024-04-25T11:31:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.394+0000 7fc44659c640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc448109b30 0x7fc44819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.394+0000 7fc446d9d640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc44819a6e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00d7a0 tx=0x7fc43c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.394+0000 7fc42ffff640 1 -- 172.21.15.80:0/3539924682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c017070 con 0x7fc4481042d0 2024-04-25T11:31:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.394+0000 7fc42ffff640 1 -- 172.21.15.80:0/3539924682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc43c009c30 con 0x7fc4481042d0 2024-04-25T11:31:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.394+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44819f7b0 con 0x7fc4481042d0 2024-04-25T11:31:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.394+0000 7fc42ffff640 1 -- 172.21.15.80:0/3539924682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c00f620 con 0x7fc4481042d0 2024-04-25T11:31:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.394+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44819fd00 con 0x7fc4481042d0 2024-04-25T11:31:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 Processor -- start 2024-04-25T11:31:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 -- start start 2024-04-25T11:31:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc42ffff640 1 -- 172.21.15.80:0/3539924682 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fc43c01a070 con 0x7fc4481042d0 2024-04-25T11:31:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c86620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88bd550 0x55a0f8c86b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88c5730 0x55a0f8c870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a0f8becb00 con 0x55a0f88e6410 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a0f8b88920 con 0x55a0f88bd550 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc453fbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a0f8be8ac0 con 0x55a0f88c5730 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c86620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c86620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41402/0 (socket says 172.21.15.80:41402) 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 -- 172.21.15.80:0/1253082604 learned_addr learned my addr 172.21.15.80:0/1253082604 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44659c640 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88c5730 0x55a0f8c870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 -- 172.21.15.80:0/1253082604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88c5730 msgr2=0x55a0f8c870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88c5730 0x55a0f8c870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc446d9d640 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88bd550 0x55a0f8c86b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 -- 172.21.15.80:0/1253082604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88bd550 msgr2=0x55a0f8c86b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88bd550 0x55a0f8c86b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 -- 172.21.15.80:0/1253082604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0f89c67e0 con 0x55a0f88e6410 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.397+0000 7fc44759e640 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c86620 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc440009930 tx=0x7fc440009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed1c0dc5e534890 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.398+0000 7fc42ffff640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4300afc60 0x7fc4300b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.398+0000 7fc42d7fa640 1 -- 172.21.15.80:0/1253082604 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440031df0 con 0x55a0f88e6410 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.398+0000 7fc446d9d640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4300afc60 0x7fc4300b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.398+0000 7fc42d7fa640 1 -- 172.21.15.80:0/1253082604 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc440036040 con 0x55a0f88e6410 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.398+0000 7fc42d7fa640 1 -- 172.21.15.80:0/1253082604 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440004330 con 0x55a0f88e6410 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.398+0000 7fc42ffff640 1 -- 172.21.15.80:0/3539924682 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fc43c0deba0 con 0x7fc4481042d0 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- 172.21.15.80:0/1253082604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 msgr2=0x55a0f8c86620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc446d9d640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4300afc60 0x7fc4300b2170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0dc380 tx=0x7fc43c0c9040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c86620 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc440009930 tx=0x7fc440009960 comp rx=0 tx=0).stop 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- 172.21.15.80:0/1253082604 shutdown_connections 2024-04-25T11:31:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88c5730 0x55a0f8c870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88bd550 0x55a0f8c86b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1253082604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c86620 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- 172.21.15.80:0/1253082604 >> 172.21.15.80:0/1253082604 conn(0x55a0f88da560 msgr2=0x55a0f8c82dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- 172.21.15.80:0/1253082604 shutdown_connections 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- 172.21.15.80:0/1253082604 wait complete. 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- start start 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 Processor -- start 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c90b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 0x55a0f8c91070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c9cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a0f8c93910 con 0x55a0f88e6410 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a0f8b865d0 con 0x55a0f88c5730 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.399+0000 7fc453fbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a0f8c93a90 con 0x55a0f88bd550 2024-04-25T11:31:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc453fbf740 10 client.0 _ll_register_callbacks cb 0x55a0f8b74080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c9cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c9cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41416/0 (socket says 172.21.15.80:41416) 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 -- 172.21.15.80:0/4100710324 learned_addr learned my addr 172.21.15.80:0/4100710324 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c90b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44659c640 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 0x55a0f8c91070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 -- 172.21.15.80:0/4100710324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 msgr2=0x55a0f8c90b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c90b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 -- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 msgr2=0x55a0f8c91070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 0x55a0f8c91070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 -- 172.21.15.80:0/4100710324 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0f8a26f70 con 0x55a0f88e6410 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc44759e640 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c9cdc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc44002ade0 tx=0x7fc44003e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5c85861f14da5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc42aff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc42aff5640 1 -- 172.21.15.80:0/4100710324 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440059060 con 0x55a0f88e6410 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc42aff5640 1 -- 172.21.15.80:0/4100710324 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fc440031650 con 0x55a0f88e6410 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc440036040 con 0x55a0f88e6410 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.400+0000 7fc42aff5640 1 -- 172.21.15.80:0/4100710324 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc440031850 con 0x55a0f88e6410 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 10 client.17205 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a0f88be170 con 0x55a0f88e6410 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc42aff5640 1 -- 172.21.15.80:0/4100710324 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc440036040 con 0x55a0f88e6410 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc42aff5640 1 -- 172.21.15.80:0/4100710324 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc44002f660 con 0x55a0f88e6410 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 10 client.17205 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 10 client.17205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 20 client.17205 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88a51f0 0x55a0f8ca2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 4 client.17205 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0f8bfa710 con 0x55a0f88a51f0 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.401+0000 7fc44659c640 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88a51f0 0x55a0f8ca2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.402+0000 7fc42aff5640 10 client.17205 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.402+0000 7fc44659c640 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88a51f0 0x55a0f8ca2d10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b46ddce2dfccc8e2 server_cookie=8934cf972f809eee in_seq=0 out_seq=0 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.402+0000 7fc42aff5640 1 -- 172.21.15.80:0/4100710324 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a0f8bfa710 con 0x55a0f88a51f0 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.402+0000 7fc42aff5640 10 client.17205 handle_command_reply: tid=0 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.402+0000 7fc453fbf740 1 client.17205 shutdown 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.402+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 msgr2=0x55a0f8c9cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.402+0000 7fc453fbf740 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c9cdc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc44002ade0 tx=0x7fc44003e040 comp rx=0 tx=0).stop 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 shutdown_connections 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88a51f0 0x55a0f8ca2d10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88e6410 0x55a0f8c9cdc0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc42aff5640 0 client.17205 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 0x55a0f8c91070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 --2- 172.21.15.80:0/4100710324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c90b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 >> 172.21.15.80:0/4100710324 conn(0x55a0f88da560 msgr2=0x55a0f8c86450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 shutdown_connections 2024-04-25T11:31:20.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 1 -- 172.21.15.80:0/4100710324 wait complete. 2024-04-25T11:31:20.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.403+0000 7fc453fbf740 20 client.17205 trim_cache size 0 max 16384 2024-04-25T11:31:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 Processor -- start 2024-04-25T11:31:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 -- start start 2024-04-25T11:31:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88a51f0 0x55a0f8c8fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c81bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88c5730 0x55a0f8c9cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481b2330 con 0x55a0f88c5730 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481afc00 con 0x55a0f88a51f0 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.420+0000 7fc453fbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ada70 con 0x55a0f88bd550 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88c5730 0x55a0f8c9cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88c5730 0x55a0f8c9cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41432/0 (socket says 172.21.15.80:41432) 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 -- 172.21.15.80:0/2903042525 learned_addr learned my addr 172.21.15.80:0/2903042525 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44659c640 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c81bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88a51f0 0x55a0f8c8fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 -- 172.21.15.80:0/2903042525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 msgr2=0x55a0f8c81bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c81bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 -- 172.21.15.80:0/2903042525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88a51f0 msgr2=0x55a0f8c8fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88a51f0 0x55a0f8c8fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 -- 172.21.15.80:0/2903042525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0f8c8abf0 con 0x55a0f88c5730 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc44759e640 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88c5730 0x55a0f8c9cd30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ca0 tx=0x7fc44002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de89004a6ee9df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc42cff9640 1 -- 172.21.15.80:0/2903042525 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440059040 con 0x55a0f88c5730 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc42cff9640 1 -- 172.21.15.80:0/2903042525 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc440036070 con 0x55a0f88c5730 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.421+0000 7fc42cff9640 1 -- 172.21.15.80:0/2903042525 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440031450 con 0x55a0f88c5730 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 -- 172.21.15.80:0/2903042525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88c5730 msgr2=0x55a0f8c9cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88c5730 0x55a0f8c9cd30 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ca0 tx=0x7fc44002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 -- 172.21.15.80:0/2903042525 shutdown_connections 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88c5730 0x55a0f8c9cd30 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88bd550 0x55a0f8c81bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 --2- 172.21.15.80:0/2903042525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88a51f0 0x55a0f8c8fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 -- 172.21.15.80:0/2903042525 >> 172.21.15.80:0/2903042525 conn(0x55a0f88da560 msgr2=0x55a0f8c814c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 -- 172.21.15.80:0/2903042525 shutdown_connections 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 -- 172.21.15.80:0/2903042525 wait complete. 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 -- start start 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.422+0000 7fc453fbf740 1 Processor -- start 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88a51f0 0x55a0f8ca5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88bd550 0x55a0f8ca32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 0x55a0f8ca3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ae0c0 con 0x55a0f88bd550 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481af530 con 0x55a0f88c5730 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ae790 con 0x55a0f88a51f0 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 10 client.0 _ll_register_callbacks cb 0x7fc440031dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88bd550 0x55a0f8ca32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88bd550 0x55a0f8ca32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41444/0 (socket says 172.21.15.80:41444) 2024-04-25T11:31:20.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 -- 172.21.15.80:0/1964680982 learned_addr learned my addr 172.21.15.80:0/1964680982 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44759e640 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88a51f0 0x55a0f8ca5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 -- 172.21.15.80:0/1964680982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88a51f0 msgr2=0x55a0f8ca5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88a51f0 0x55a0f8ca5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 -- 172.21.15.80:0/1964680982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 msgr2=0x55a0f8ca3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 0x55a0f8ca3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 -- 172.21.15.80:0/1964680982 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0f8ca3d60 con 0x55a0f88bd550 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44759e640 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88a51f0 0x55a0f8ca5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc44659c640 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88bd550 0x55a0f8ca32e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc44810a400 tx=0x7fc4380039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdcfc4f6d011085 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc42aff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc42aff5640 1 -- 172.21.15.80:0/1964680982 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43801c800 con 0x55a0f88bd550 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc42aff5640 1 -- 172.21.15.80:0/1964680982 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fc43801c9a0 con 0x55a0f88bd550 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc440036070 con 0x55a0f88bd550 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc42aff5640 1 -- 172.21.15.80:0/1964680982 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc438025470 con 0x55a0f88bd550 2024-04-25T11:31:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 10 client.17211 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.423+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a0f8d0aa80 con 0x55a0f88bd550 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc42aff5640 1 -- 172.21.15.80:0/1964680982 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc440036070 con 0x55a0f88bd550 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc42aff5640 1 -- 172.21.15.80:0/1964680982 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc438010690 con 0x55a0f88bd550 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc453fbf740 10 client.17211 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc453fbf740 10 client.17211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc453fbf740 20 client.17211 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88e6410 0x55a0f8d0d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc453fbf740 4 client.17211 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a0f8bf4580 con 0x55a0f88e6410 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.424+0000 7fc44759e640 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88e6410 0x55a0f8d0d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.425+0000 7fc42aff5640 10 client.17211 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.425+0000 7fc44759e640 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88e6410 0x55a0f8d0d270 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b84c50f0537d4141 server_cookie=c85dc66ce7a88086 in_seq=0 out_seq=0 2024-04-25T11:31:20.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc42aff5640 1 -- 172.21.15.80:0/1964680982 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a0f8bf4580 con 0x55a0f88e6410 2024-04-25T11:31:20.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc42aff5640 10 client.17211 handle_command_reply: tid=0 2024-04-25T11:31:20.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 client.17211 shutdown 2024-04-25T11:31:20.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88bd550 msgr2=0x55a0f8ca32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88bd550 0x55a0f8ca32e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc44810a400 tx=0x7fc4380039c0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 shutdown_connections 2024-04-25T11:31:20.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a0f88e6410 0x55a0f8d0d270 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a0f88bd550 0x55a0f8ca32e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0f88c5730 0x55a0f8ca3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 --2- 172.21.15.80:0/1964680982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a0f88a51f0 0x55a0f8ca5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 >> 172.21.15.80:0/1964680982 conn(0x55a0f88da560 msgr2=0x55a0f8c8f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc42aff5640 0 client.17211 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 shutdown_connections 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 1 -- 172.21.15.80:0/1964680982 wait complete. 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.426+0000 7fc453fbf740 20 client.17211 trim_cache size 0 max 16384 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "39854ffb-48db-43b2-915b-87b2ce04047b", 2024-04-25T11:31:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:31:20.424 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:20.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4300afc60 msgr2=0x7fc4300b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4300afc60 0x7fc4300b2170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0dc380 tx=0x7fc43c0c9040 comp rx=0 tx=0).stop 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 msgr2=0x7fc44819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc44819a6e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00d7a0 tx=0x7fc43c00dc60 comp rx=0 tx=0).stop 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 shutdown_connections 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc4300afc60 0x7fc4300b2170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc448109fd0 0x7fc44819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc448109b30 0x7fc44819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 --2- 172.21.15.80:0/3539924682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4481042d0 0x7fc44819a6e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 >> 172.21.15.80:0/3539924682 conn(0x7fc448079280 msgr2=0x7fc448100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 shutdown_connections 2024-04-25T11:31:20.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.427+0000 7fc44d034640 1 -- 172.21.15.80:0/3539924682 wait complete. 2024-04-25T11:31:20.427 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:20 smithi080 ceph-mon[29126]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:31:20.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:31:20.428 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:31:20.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:20 smithi196 ceph-mon[32659]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:31:20.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:20 smithi082 ceph-mon[32440]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:31:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 -- 172.21.15.80:0/694137851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b0109b20 msgr2=0x7fc4b0101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/694137851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b0109b20 0x7fc4b0101bd0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009900 tx=0x7fc4a002a410 comp rx=0 tx=0).stop 2024-04-25T11:31:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 -- 172.21.15.80:0/694137851 shutdown_connections 2024-04-25T11:31:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/694137851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4b01027c0 0x7fc4b0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/694137851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b0109fc0 0x7fc4b0102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/694137851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b0109b20 0x7fc4b0101bd0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 -- 172.21.15.80:0/694137851 >> 172.21.15.80:0/694137851 conn(0x7fc4b0077880 msgr2=0x7fc4b0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 -- 172.21.15.80:0/694137851 shutdown_connections 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.548+0000 7fc4b50e0640 1 -- 172.21.15.80:0/694137851 wait complete. 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 Processor -- start 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 -- start start 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4b0109b20 0x7fc4b0199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b019a530 0x7fc4b019e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b019ed50 0x7fc4b019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0113d10 con 0x7fc4b019ed50 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0113b90 con 0x7fc4b019a530 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.549+0000 7fc4b50e0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0113e90 con 0x7fc4b0109b20 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b019ed50 0x7fc4b019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b019ed50 0x7fc4b019f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41450/0 (socket says 172.21.15.80:41450) 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 -- 172.21.15.80:0/3714617965 learned_addr learned my addr 172.21.15.80:0/3714617965 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4b0109b20 0x7fc4b0199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b019a530 0x7fc4b019e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 -- 172.21.15.80:0/3714617965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4b0109b20 msgr2=0x7fc4b0199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4b0109b20 0x7fc4b0199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 -- 172.21.15.80:0/3714617965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b019a530 msgr2=0x7fc4b019e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b019a530 0x7fc4b019e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 -- 172.21.15.80:0/3714617965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b01a6ac0 con 0x7fc4b019ed50 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4af59e640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b019ed50 0x7fc4b019f160 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800eaa0 tx=0x7fc4a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4acd99640 1 -- 172.21.15.80:0/3714617965 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a800cdb0 con 0x7fc4b019ed50 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b01a6c90 con 0x7fc4b019ed50 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4acd99640 1 -- 172.21.15.80:0/3714617965 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4a8005020 con 0x7fc4b019ed50 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4acd99640 1 -- 172.21.15.80:0/3714617965 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80116d0 con 0x7fc4b019ed50 2024-04-25T11:31:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.550+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b01a7150 con 0x7fc4b019ed50 2024-04-25T11:31:20.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4acd99640 1 -- 172.21.15.80:0/3714617965 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fc4a80051d0 con 0x7fc4b019ed50 2024-04-25T11:31:20.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 Processor -- start 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 -- start start 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed855f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed855fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8570d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aed84c5d80 con 0x55aed819e6b0 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aed847f8b0 con 0x55aed81bf390 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aed84c1d40 con 0x55aed81964d0 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8570d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8570d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41464/0 (socket says 172.21.15.80:41464) 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4a7fff640 1 -- 172.21.15.80:0/153543566 learned_addr learned my addr 172.21.15.80:0/153543566 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed855fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.553+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed855f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4acd99640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc49c0afc60 0x7fc49c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a7fff640 1 -- 172.21.15.80:0/153543566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 msgr2=0x55aed855fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed855fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a7fff640 1 -- 172.21.15.80:0/153543566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 msgr2=0x55aed855f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed855f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a7fff640 1 -- 172.21.15.80:0/153543566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aed8450a40 con 0x55aed819e6b0 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4af59e640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc49c0afc60 0x7fc49c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8570d00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc4980124e0 tx=0x7fc49800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20eba11617c35ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4acd99640 1 -- 172.21.15.80:0/3714617965 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fc4a80df100 con 0x7fc4b019ed50 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a57fa640 1 -- 172.21.15.80:0/153543566 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498004230 con 0x55aed819e6b0 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a57fa640 1 -- 172.21.15.80:0/153543566 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4980043d0 con 0x55aed819e6b0 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.554+0000 7fc4a57fa640 1 -- 172.21.15.80:0/153543566 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49800f880 con 0x55aed819e6b0 2024-04-25T11:31:20.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 -- 172.21.15.80:0/153543566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 msgr2=0x55aed8570d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4af59e640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc49c0afc60 0x7fc49c0b2170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80dc980 tx=0x7fc4a8074c30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8570d00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc4980124e0 tx=0x7fc49800b790 comp rx=0 tx=0).stop 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 -- 172.21.15.80:0/153543566 shutdown_connections 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8570d00 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed855fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/153543566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed855f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 -- 172.21.15.80:0/153543566 >> 172.21.15.80:0/153543566 conn(0x55aed81b34e0 msgr2=0x55aed855c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 -- 172.21.15.80:0/153543566 shutdown_connections 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 -- 172.21.15.80:0/153543566 wait complete. 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.555+0000 7fc4bbf94740 1 -- start start 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 1 Processor -- start 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed856ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed819e6b0 0x55aed856ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed8574900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55aed85713f0 con 0x55aed81964d0 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aed844cd10 con 0x55aed81bf390 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55aed8571570 con 0x55aed819e6b0 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4bbf94740 10 client.0 _ll_register_callbacks cb 0x55aed8479210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed856ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed856ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41476/0 (socket says 172.21.15.80:41476) 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 -- 172.21.15.80:0/2319131678 learned_addr learned my addr 172.21.15.80:0/2319131678 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed819e6b0 0x55aed856ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed8574900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 -- 172.21.15.80:0/2319131678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed819e6b0 msgr2=0x55aed856ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed819e6b0 0x55aed856ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 -- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 msgr2=0x55aed8574900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed8574900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 -- 172.21.15.80:0/2319131678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aed82a17d0 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed856ea10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc498012d70 tx=0x7fc49800b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbe51d49ce62455 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.556+0000 7fc4967fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4967fc640 1 -- 172.21.15.80:0/2319131678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498003a80 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4980043d0 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4967fc640 1 -- 172.21.15.80:0/2319131678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fc498003c20 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4967fc640 1 -- 172.21.15.80:0/2319131678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc498003e20 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 10 client.17223 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aed81d73f0 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4967fc640 1 -- 172.21.15.80:0/2319131678 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4980043d0 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4967fc640 1 -- 172.21.15.80:0/2319131678 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc49801f640 con 0x55aed81964d0 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 10 client.17223 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 10 client.17223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 20 client.17223 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:20.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed817df60 0x55aed85809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 4 client.17223 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.557+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aed84d3990 con 0x55aed817df60 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.558+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed817df60 0x55aed85809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.558+0000 7fc4967fc640 10 client.17223 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.558+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed817df60 0x55aed85809c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c55b0a24a284f6fa server_cookie=370be877816714ce in_seq=0 out_seq=0 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4967fc640 1 -- 172.21.15.80:0/2319131678 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aed84d3990 con 0x55aed817df60 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4967fc640 10 client.17223 handle_command_reply: tid=0 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 client.17223 shutdown 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 msgr2=0x55aed856ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed856ea10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc498012d70 tx=0x7fc49800b590 comp rx=0 tx=0).stop 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 shutdown_connections 2024-04-25T11:31:20.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed817df60 0x55aed85809c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed81bf390 0x55aed8574900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4967fc640 0 client.17223 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed819e6b0 0x55aed856ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2319131678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed856ea10 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 >> 172.21.15.80:0/2319131678 conn(0x55aed81b34e0 msgr2=0x55aed8561780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 shutdown_connections 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2319131678 wait complete. 2024-04-25T11:31:20.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.559+0000 7fc4bbf94740 20 client.17223 trim_cache size 0 max 16384 2024-04-25T11:31:20.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.576+0000 7fc4bbf94740 1 Processor -- start 2024-04-25T11:31:20.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4bbf94740 1 -- start start 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed817df60 0x55aed8570630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed8570b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8586050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01b01d0 con 0x55aed819e6b0 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01adaa0 con 0x55aed817df60 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01ab910 con 0x55aed81964d0 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8586050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8586050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41484/0 (socket says 172.21.15.80:41484) 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 -- 172.21.15.80:0/454933316 learned_addr learned my addr 172.21.15.80:0/454933316 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed817df60 0x55aed8570630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed8570b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 -- 172.21.15.80:0/454933316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 msgr2=0x55aed8570b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed8570b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 -- 172.21.15.80:0/454933316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed817df60 msgr2=0x55aed8570630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed817df60 0x55aed8570630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.577+0000 7fc4a7fff640 1 -- 172.21.15.80:0/454933316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aed81970f0 con 0x55aed819e6b0 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.578+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8586050 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc49801fa40 tx=0x7fc49800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb531456296ef1d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.578+0000 7fc4a4ff9640 1 -- 172.21.15.80:0/454933316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49801fc30 con 0x55aed819e6b0 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.578+0000 7fc4a4ff9640 1 -- 172.21.15.80:0/454933316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4980120c0 con 0x55aed819e6b0 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.578+0000 7fc4a4ff9640 1 -- 172.21.15.80:0/454933316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49801f460 con 0x55aed819e6b0 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.578+0000 7fc4bbf94740 1 -- 172.21.15.80:0/454933316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 msgr2=0x55aed8586050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.578+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8586050 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc49801fa40 tx=0x7fc49800beb0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- 172.21.15.80:0/454933316 shutdown_connections 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed819e6b0 0x55aed8586050 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed81964d0 0x55aed8570b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/454933316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed817df60 0x55aed8570630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- 172.21.15.80:0/454933316 >> 172.21.15.80:0/454933316 conn(0x55aed81b34e0 msgr2=0x55aed856ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- 172.21.15.80:0/454933316 shutdown_connections 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- 172.21.15.80:0/454933316 wait complete. 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- start start 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 Processor -- start 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed817df60 0x55aed8575ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed8576410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed819e6b0 0x55aed85e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01abf60 con 0x55aed81964d0 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01ad3d0 con 0x55aed819e6b0 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01ac630 con 0x55aed817df60 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4bbf94740 10 client.0 _ll_register_callbacks cb 0x7fc4a0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed8576410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed8576410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41488/0 (socket says 172.21.15.80:41488) 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4aed9d640 1 -- 172.21.15.80:0/2175372948 learned_addr learned my addr 172.21.15.80:0/2175372948 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed817df60 0x55aed8575ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.579+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed819e6b0 0x55aed85e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4aed9d640 1 -- 172.21.15.80:0/2175372948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed817df60 msgr2=0x55aed8575ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed817df60 0x55aed8575ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4aed9d640 1 -- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed819e6b0 msgr2=0x55aed85e6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed819e6b0 0x55aed85e6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4aed9d640 1 -- 172.21.15.80:0/2175372948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aed84864b0 con 0x55aed81964d0 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed819e6b0 0x55aed85e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4aed9d640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed8576410 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0069b30 tx=0x7fc4a0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f6c336533ccfae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4967fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4967fc640 1 -- 172.21.15.80:0/2175372948 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0035040 con 0x55aed81964d0 2024-04-25T11:31:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4967fc640 1 -- 172.21.15.80:0/2175372948 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fc4a0005040 con 0x55aed81964d0 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4980120c0 con 0x55aed81964d0 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4967fc640 1 -- 172.21.15.80:0/2175372948 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc4a0054050 con 0x55aed81964d0 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4bbf94740 10 client.17229 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aed85e8000 con 0x55aed81964d0 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4967fc640 1 -- 172.21.15.80:0/2175372948 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4980120c0 con 0x55aed81964d0 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.580+0000 7fc4967fc640 1 -- 172.21.15.80:0/2175372948 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fc4a0046330 con 0x55aed81964d0 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4bbf94740 10 client.17229 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4bbf94740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4bbf94740 20 client.17229 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed81bf390 0x55aed85ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4bbf94740 4 client.17229 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aed856deb0 con 0x55aed81bf390 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed81bf390 0x55aed85ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4967fc640 10 client.17229 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4a7fff640 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed81bf390 0x55aed85ea7f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61602c385c6f1c50 server_cookie=f1046fd3708556ff in_seq=0 out_seq=0 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4967fc640 1 -- 172.21.15.80:0/2175372948 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55aed856deb0 con 0x55aed81bf390 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4967fc640 10 client.17229 handle_command_reply: tid=0 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.581+0000 7fc4bbf94740 1 client.17229 shutdown 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 msgr2=0x55aed8576410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed8576410 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0069b30 tx=0x7fc4a0004040 comp rx=0 tx=0).stop 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 shutdown_connections 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55aed81bf390 0x55aed85ea7f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55aed81964d0 0x55aed8576410 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aed819e6b0 0x55aed85e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4967fc640 0 client.17229 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 --2- 172.21.15.80:0/2175372948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55aed817df60 0x55aed8575ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 >> 172.21.15.80:0/2175372948 conn(0x55aed81b34e0 msgr2=0x55aed856d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 shutdown_connections 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 1 -- 172.21.15.80:0/2175372948 wait complete. 2024-04-25T11:31:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4bbf94740 20 client.17229 trim_cache size 0 max 16384 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "39854ffb-48db-43b2-915b-87b2ce04047b": { 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "39854ffb-48db-43b2-915b-87b2ce04047b", 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:31:20.579 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc49c0afc60 msgr2=0x7fc49c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc49c0afc60 0x7fc49c0b2170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80dc980 tx=0x7fc4a8074c30 comp rx=0 tx=0).stop 2024-04-25T11:31:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b019ed50 msgr2=0x7fc4b019f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b019ed50 0x7fc4b019f160 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800eaa0 tx=0x7fc4a800ef60 comp rx=0 tx=0).stop 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 shutdown_connections 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc49c0afc60 0x7fc49c0b2170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4b019ed50 0x7fc4b019f160 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b019a530 0x7fc4b019e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 --2- 172.21.15.80:0/3714617965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4b0109b20 0x7fc4b0199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 >> 172.21.15.80:0/3714617965 conn(0x7fc4b0077880 msgr2=0x7fc4b0100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 shutdown_connections 2024-04-25T11:31:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:20.582+0000 7fc4b50e0640 1 -- 172.21.15.80:0/3714617965 wait complete. 2024-04-25T11:31:20.583 INFO:tasks.cephfs.filesystem:scrub status for tag:39854ffb-48db-43b2-915b-87b2ce04047b - {'path': '/', 'tag': '39854ffb-48db-43b2-915b-87b2ce04047b', 'options': 'recursive,force'} 2024-04-25T11:31:21.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:21 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:31:21.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:21 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:21.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:21 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:31:21.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:21 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:21.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:21 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:31:21.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:21 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:21.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:21 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:31:21.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:21 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:21.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:21 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:31:21.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:21 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:21.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:21 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:31:21.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:21 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:22.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:22 smithi196 ceph-mon[32659]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-04-25T11:31:22.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:22 smithi082 ceph-mon[32440]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-04-25T11:31:22.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:22 smithi080 ceph-mon[29126]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-04-25T11:31:23.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:23 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:31:23.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:23 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:31:23.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:23 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:31:24.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:24 smithi196 ceph-mon[32659]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 90 B/s wr, 6 op/s 2024-04-25T11:31:24.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:24 smithi082 ceph-mon[32440]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 90 B/s wr, 6 op/s 2024-04-25T11:31:24.525 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:24 smithi080 ceph-mon[29126]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 90 B/s wr, 6 op/s 2024-04-25T11:31:26.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:26 smithi196 ceph-mon[32659]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:31:26.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:26 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:31:26.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:26 smithi082 ceph-mon[32440]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:31:26.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:26 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:31:26.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:26 smithi080 ceph-mon[29126]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T11:31:26.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:26 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:31:27.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:27 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:31:27.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:27 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:31:27.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:27 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:31:27.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:27 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:31:27.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:27 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:31:27.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:27 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:31:27.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:27 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:31:27.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:27 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:31:27.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:27 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:31:28.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:28 smithi196 ceph-mon[32659]: pgmap v222: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:31:28.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:28 smithi082 ceph-mon[32440]: pgmap v222: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:31:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:28 smithi080 ceph-mon[29126]: pgmap v222: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-25T11:31:30.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:30 smithi196 ceph-mon[32659]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:31:30.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:30 smithi082 ceph-mon[32440]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:31:30.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:30 smithi080 ceph-mon[29126]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:31:32.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:32 smithi082 ceph-mon[32440]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:31:32.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:32 smithi080 ceph-mon[29126]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:31:32.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:32 smithi196 ceph-mon[32659]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:31:34.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:34 smithi082 ceph-mon[32440]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:34.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:34 smithi080 ceph-mon[29126]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:34.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:34 smithi196 ceph-mon[32659]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:36.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:36 smithi082 ceph-mon[32440]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:36.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:36 smithi080 ceph-mon[29126]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:36.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:36 smithi196 ceph-mon[32659]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:38.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:38 smithi082 ceph-mon[32440]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:38.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:38 smithi080 ceph-mon[29126]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:38.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:38 smithi196 ceph-mon[32659]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:40.488 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:40 smithi196 ceph-mon[32659]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:40.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:40 smithi082 ceph-mon[32440]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:40.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:40 smithi080 ceph-mon[29126]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:42.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:42 smithi082 ceph-mon[32440]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:42.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:42 smithi080 ceph-mon[29126]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:42.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:42 smithi196 ceph-mon[32659]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:44.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:44 smithi082 ceph-mon[32440]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:44.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:44 smithi080 ceph-mon[29126]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:44.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:44 smithi196 ceph-mon[32659]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:46.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:46 smithi082 ceph-mon[32440]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:46.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:46 smithi080 ceph-mon[29126]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:46.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:46 smithi196 ceph-mon[32659]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:48.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:48 smithi082 ceph-mon[32440]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:48.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:48 smithi080 ceph-mon[29126]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:48.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:48 smithi196 ceph-mon[32659]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:50.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:50 smithi082 ceph-mon[32440]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:50.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:31:50.584 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:31:50.609 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:50 smithi080 ceph-mon[29126]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:50.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:50 smithi196 ceph-mon[32659]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:50.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 -- 172.21.15.80:0/3412316441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 msgr2=0x7fdc04102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 --2- 172.21.15.80:0/3412316441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc04102f10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec02a410 comp rx=0 tx=0).stop 2024-04-25T11:31:50.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 -- 172.21.15.80:0/3412316441 shutdown_connections 2024-04-25T11:31:50.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 --2- 172.21.15.80:0/3412316441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc04102f10 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 --2- 172.21.15.80:0/3412316441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0410d390 0x7fdc0410f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 --2- 172.21.15.80:0/3412316441 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc04108a30 0x7fdc041025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 -- 172.21.15.80:0/3412316441 >> 172.21.15.80:0/3412316441 conn(0x7fdc040fe260 msgr2=0x7fdc04100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:50.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 -- 172.21.15.80:0/3412316441 shutdown_connections 2024-04-25T11:31:50.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.723+0000 7fdc08da8640 1 -- 172.21.15.80:0/3412316441 wait complete. 2024-04-25T11:31:50.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 Processor -- start 2024-04-25T11:31:50.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 -- start start 2024-04-25T11:31:50.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc041996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc04108a30 0x7fdc04199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc0410d390 0x7fdc0419ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04112c50 con 0x7fdc04102b00 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04112ad0 con 0x7fdc04108a30 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.724+0000 7fdc08da8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04112dd0 con 0x7fdc0410d390 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc041996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc041996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50480/0 (socket says 172.21.15.80:50480) 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 -- 172.21.15.80:0/1071882661 learned_addr learned my addr 172.21.15.80:0/1071882661 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc02d9d640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc0410d390 0x7fdc0419ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc04108a30 0x7fdc04199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 -- 172.21.15.80:0/1071882661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc0410d390 msgr2=0x7fdc0419ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc0410d390 0x7fdc0419ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 -- 172.21.15.80:0/1071882661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc04108a30 msgr2=0x7fdc04199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc04108a30 0x7fdc04199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 -- 172.21.15.80:0/1071882661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0419e490 con 0x7fdc04102b00 2024-04-25T11:31:50.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc0259c640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc041996b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400b480 tx=0x7fdbf400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdbfb7fe640 1 -- 172.21.15.80:0/1071882661 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4014070 con 0x7fdc04102b00 2024-04-25T11:31:50.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0419e780 con 0x7fdc04102b00 2024-04-25T11:31:50.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdbfb7fe640 1 -- 172.21.15.80:0/1071882661 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbf4010d20 con 0x7fdc04102b00 2024-04-25T11:31:50.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdbfb7fe640 1 -- 172.21.15.80:0/1071882661 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4017360 con 0x7fdc04102b00 2024-04-25T11:31:50.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.725+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0419ecd0 con 0x7fdc04102b00 2024-04-25T11:31:50.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.728+0000 7fdbfb7fe640 1 -- 172.21.15.80:0/1071882661 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fdbf4017070 con 0x7fdc04102b00 2024-04-25T11:31:50.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.728+0000 7fdc0fc5a740 1 Processor -- start 2024-04-25T11:31:50.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.728+0000 7fdc0fc5a740 1 -- start start 2024-04-25T11:31:50.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362869d390 0x563628a3d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636286744d0 0x563628a3de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5636289a3d80 con 0x56362867c6b0 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56362895d8b0 con 0x5636286744d0 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56362899fd40 con 0x56362869d390 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfb7fe640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdbf00afc60 0x7fdbf00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50494/0 (socket says 172.21.15.80:50494) 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc02d9d640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdbf00afc60 0x7fdbf00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 -- 172.21.15.80:0/4235519179 learned_addr learned my addr 172.21.15.80:0/4235519179 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfb7fe640 1 -- 172.21.15.80:0/1071882661 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fdbf40de790 con 0x7fdc04102b00 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc02d9d640 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362869d390 0x563628a3d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0259c640 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636286744d0 0x563628a3de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 -- 172.21.15.80:0/4235519179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362869d390 msgr2=0x563628a3d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362869d390 0x563628a3d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 -- 172.21.15.80:0/4235519179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636286744d0 msgr2=0x563628a3de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636286744d0 0x563628a3de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 -- 172.21.15.80:0/4235519179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56362892ea40 con 0x56362867c6b0 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc0259c640 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636286744d0 0x563628a3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdc02d9d640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdbf00afc60 0x7fdbf00b2170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc007fd0 tx=0x7fdbfc007ce0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.729+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4cb00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdc04069590 tx=0x7fdbec031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1e780f2c41c540 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.730+0000 7fdbf8ff9640 1 -- 172.21.15.80:0/4235519179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec03f070 con 0x56362867c6b0 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.730+0000 7fdbf8ff9640 1 -- 172.21.15.80:0/4235519179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbec004030 con 0x56362867c6b0 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.730+0000 7fdbf8ff9640 1 -- 172.21.15.80:0/4235519179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec035070 con 0x56362867c6b0 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.730+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/4235519179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 msgr2=0x563628a4cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.730+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4cb00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdc04069590 tx=0x7fdbec031b10 comp rx=0 tx=0).stop 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/4235519179 shutdown_connections 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4cb00 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636286744d0 0x563628a3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/4235519179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362869d390 0x563628a3d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/4235519179 >> 172.21.15.80:0/4235519179 conn(0x5636286914e0 msgr2=0x563628a3a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/4235519179 shutdown_connections 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/4235519179 wait complete. 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- start start 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 Processor -- start 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a4a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a4acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a56670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x563628a4d190 con 0x5636286744d0 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56362892ad10 con 0x56362869d390 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563628a4d310 con 0x56362867c6b0 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.731+0000 7fdc0fc5a740 10 client.0 _ll_register_callbacks cb 0x563628957210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a4a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a4a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50510/0 (socket says 172.21.15.80:50510) 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 -- 172.21.15.80:0/3960547722 learned_addr learned my addr 172.21.15.80:0/3960547722 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc02d9d640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a56670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a4acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 -- 172.21.15.80:0/3960547722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 msgr2=0x563628a4acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a4acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 -- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 msgr2=0x563628a56670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a56670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 -- 172.21.15.80:0/3960547722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56362877f7d0 con 0x5636286744d0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a4acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0259c640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a4a780 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40dc030 tx=0x7fdbf400f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0cec7182bcd9f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdbe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/3960547722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf401e070 con 0x5636286744d0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/3960547722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fdbf40c92f0 con 0x5636286744d0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbec004030 con 0x5636286744d0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/3960547722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbf40af1c0 con 0x5636286744d0 2024-04-25T11:31:50.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0fc5a740 10 client.17241 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.732+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5636286b53f0 con 0x5636286744d0 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/3960547722 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbec004030 con 0x5636286744d0 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/3960547722 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fdbf40a5d10 con 0x5636286744d0 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdc0fc5a740 10 client.17241 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdc0fc5a740 10 client.17241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdc0fc5a740 20 client.17241 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56362865bf60 0x563628a5c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdc0fc5a740 4 client.17241 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636289b1990 con 0x56362865bf60 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.733+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56362865bf60 0x563628a5c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56362865bf60 0x563628a5c8c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28bd8e30c6c9522 server_cookie=5224c8a1114dbc65 in_seq=0 out_seq=0 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdbe9ffb640 10 client.17241 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/3960547722 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5636289b1990 con 0x56362865bf60 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdbe9ffb640 10 client.17241 handle_command_reply: tid=0 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 client.17241 shutdown 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 msgr2=0x563628a4a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a4a780 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40dc030 tx=0x7fdbf400f6f0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 shutdown_connections 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x56362865bf60 0x563628a5c8c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a56670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a4acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdbe9ffb640 0 client.17241 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/3960547722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a4a780 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.734+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 >> 172.21.15.80:0/3960547722 conn(0x5636286914e0 msgr2=0x563628a3f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.735+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 shutdown_connections 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.735+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/3960547722 wait complete. 2024-04-25T11:31:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.735+0000 7fdc0fc5a740 20 client.17241 trim_cache size 0 max 16384 2024-04-25T11:31:50.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 Processor -- start 2024-04-25T11:31:50.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 -- start start 2024-04-25T11:31:50.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a49550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a62600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041afe90 con 0x5636286744d0 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ad760 con 0x56362869d390 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ab5d0 con 0x56362867c6b0 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a49550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a49550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50520/0 (socket says 172.21.15.80:50520) 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 -- 172.21.15.80:0/2353197839 learned_addr learned my addr 172.21.15.80:0/2353197839 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc02d9d640 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a62600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 -- 172.21.15.80:0/2353197839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 msgr2=0x563628a620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 -- 172.21.15.80:0/2353197839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 msgr2=0x563628a62600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a62600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 -- 172.21.15.80:0/2353197839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636286750f0 con 0x5636286744d0 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.753+0000 7fdc0259c640 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a49550 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40a3d20 tx=0x7fdbf400f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec959a24f1234282 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdbebfff640 1 -- 172.21.15.80:0/2353197839 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf401e070 con 0x5636286744d0 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdbebfff640 1 -- 172.21.15.80:0/2353197839 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbf40a65c0 con 0x5636286744d0 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdbebfff640 1 -- 172.21.15.80:0/2353197839 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40a6ab0 con 0x5636286744d0 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/2353197839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 msgr2=0x563628a49550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a49550 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40a3d20 tx=0x7fdbf400f7b0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/2353197839 shutdown_connections 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628a62600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56362867c6b0 0x563628a620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/2353197839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5636286744d0 0x563628a49550 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/2353197839 >> 172.21.15.80:0/2353197839 conn(0x5636286914e0 msgr2=0x563628a48e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:50.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/2353197839 shutdown_connections 2024-04-25T11:31:50.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.754+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/2353197839 wait complete. 2024-04-25T11:31:50.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 -- start start 2024-04-25T11:31:50.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 Processor -- start 2024-04-25T11:31:50.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5636286744d0 0x563628a4f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628ac2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041abc20 con 0x56362867c6b0 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ad090 con 0x56362869d390 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ac2f0 con 0x5636286744d0 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0fc5a740 10 client.0 _ll_register_callbacks cb 0x7fdbf400b3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50528/0 (socket says 172.21.15.80:50528) 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdbfbfff640 1 -- 172.21.15.80:0/1702136341 learned_addr learned my addr 172.21.15.80:0/1702136341 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc02d9d640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628ac2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdc0259c640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5636286744d0 0x563628a4f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.755+0000 7fdbfbfff640 1 -- 172.21.15.80:0/1702136341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5636286744d0 msgr2=0x563628a4f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5636286744d0 0x563628a4f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbfbfff640 1 -- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 msgr2=0x563628ac2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:50.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628ac2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbfbfff640 1 -- 172.21.15.80:0/1702136341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636289644b0 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0259c640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5636286744d0 0x563628a4f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbfbfff640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4fe40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec0045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9052bdd40f10fc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/1702136341 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec03f040 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/1702136341 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fdbec005020 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbf40a65c0 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/1702136341 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbec05d050 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 10 client.17247 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563628ac4250 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/1702136341 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbf40a65c0 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/1702136341 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fdbec03b430 con 0x56362867c6b0 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 10 client.17247 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:50.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 20 client.17247 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5636286313a0 0x563628ac66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 4 client.17247 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.756+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5636289ab800 con 0x5636286313a0 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0259c640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5636286313a0 0x563628ac66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdbe9ffb640 10 client.17247 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0259c640 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5636286313a0 0x563628ac66b0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25896d032c82b5ab server_cookie=a2920c243a70a25a in_seq=0 out_seq=0 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdbe9ffb640 1 -- 172.21.15.80:0/1702136341 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5636289ab800 con 0x5636286313a0 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdbe9ffb640 10 client.17247 handle_command_reply: tid=0 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 client.17247 shutdown 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 msgr2=0x563628a4fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4fe40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec0045a0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 shutdown_connections 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5636286313a0 0x563628ac66b0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56362867c6b0 0x563628a4fe40 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56362869d390 0x563628ac2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdbe9ffb640 0 client.17247 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 --2- 172.21.15.80:0/1702136341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5636286744d0 0x563628a4f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 >> 172.21.15.80:0/1702136341 conn(0x5636286914e0 msgr2=0x563628a393f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 shutdown_connections 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.757+0000 7fdc0fc5a740 1 -- 172.21.15.80:0/1702136341 wait complete. 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc0fc5a740 20 client.17247 trim_cache size 0 max 16384 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:31:50.753 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:50.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdbf00afc60 msgr2=0x7fdbf00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdbf00afc60 0x7fdbf00b2170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc007fd0 tx=0x7fdbfc007ce0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 msgr2=0x7fdc041996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc041996b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400b480 tx=0x7fdbf400b940 comp rx=0 tx=0).stop 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 shutdown_connections 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdbf00afc60 0x7fdbf00b2170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc0410d390 0x7fdc0419ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc04108a30 0x7fdc04199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 --2- 172.21.15.80:0/1071882661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc04102b00 0x7fdc041996b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 >> 172.21.15.80:0/1071882661 conn(0x7fdc040fe260 msgr2=0x7fdc040fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 shutdown_connections 2024-04-25T11:31:50.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.758+0000 7fdc08da8640 1 -- 172.21.15.80:0/1071882661 wait complete. 2024-04-25T11:31:50.758 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:31:50.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:31:50.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 -- 172.21.15.80:0/2245364948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 msgr2=0x7fc3901025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 --2- 172.21.15.80:0/2245364948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc3901025b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009900 tx=0x7fc38c02a410 comp rx=0 tx=0).stop 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 -- 172.21.15.80:0/2245364948 shutdown_connections 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 --2- 172.21.15.80:0/2245364948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc39010d380 0x7fc39010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 --2- 172.21.15.80:0/2245364948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc390102af0 0x7fc390102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 --2- 172.21.15.80:0/2245364948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc3901025b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 -- 172.21.15.80:0/2245364948 >> 172.21.15.80:0/2245364948 conn(0x7fc390078110 msgr2=0x7fc390078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 -- 172.21.15.80:0/2245364948 shutdown_connections 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.921+0000 7fc3981b7640 1 -- 172.21.15.80:0/2245364948 wait complete. 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 Processor -- start 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 -- start start 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390102af0 0x7fc39019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc39019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39010d380 0x7fc39019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc390112be0 con 0x7fc390108a20 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc390112a60 con 0x7fc39010d380 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc3981b7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc390112d60 con 0x7fc390102af0 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc395752640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc39019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc395752640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc39019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50556/0 (socket says 172.21.15.80:50556) 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc395752640 1 -- 172.21.15.80:0/908215528 learned_addr learned my addr 172.21.15.80:0/908215528 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc396754640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39010d380 0x7fc39019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc395f53640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390102af0 0x7fc39019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.922+0000 7fc395752640 1 -- 172.21.15.80:0/908215528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390102af0 msgr2=0x7fc39019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc395752640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390102af0 0x7fc39019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc395752640 1 -- 172.21.15.80:0/908215528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39010d380 msgr2=0x7fc39019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc395752640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39010d380 0x7fc39019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc395752640 1 -- 172.21.15.80:0/908215528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39019f570 con 0x7fc390108a20 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc396754640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39010d380 0x7fc39019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc395752640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc39019ac70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc38000e9f0 tx=0x7fc38000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc386ffd640 1 -- 172.21.15.80:0/908215528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38000ccc0 con 0x7fc390108a20 2024-04-25T11:31:50.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39019f860 con 0x7fc390108a20 2024-04-25T11:31:50.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc386ffd640 1 -- 172.21.15.80:0/908215528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3800035f0 con 0x7fc390108a20 2024-04-25T11:31:50.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc386ffd640 1 -- 172.21.15.80:0/908215528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38000ce60 con 0x7fc390108a20 2024-04-25T11:31:50.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.923+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901a71e0 con 0x7fc390108a20 2024-04-25T11:31:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.924+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc390103cd0 con 0x7fc390108a20 2024-04-25T11:31:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.926+0000 7fc386ffd640 1 -- 172.21.15.80:0/908215528 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fc380003aa0 con 0x7fc390108a20 2024-04-25T11:31:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.927+0000 7fc386ffd640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc37c0afc60 0x7fc37c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.927+0000 7fc395f53640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc37c0afc60 0x7fc37c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.927+0000 7fc386ffd640 1 -- 172.21.15.80:0/908215528 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7fc3800df5c0 con 0x7fc390108a20 2024-04-25T11:31:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.927+0000 7fc395f53640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc37c0afc60 0x7fc37c0b2170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc38c000c00 tx=0x7fc38c031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:50.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:50.931+0000 7fc386ffd640 1 -- 172.21.15.80:0/908215528 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc3800a7e40 con 0x7fc390108a20 2024-04-25T11:31:51.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.145+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc39006afa0 con 0x7fc390108a20 2024-04-25T11:31:51.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.146+0000 7fc386ffd640 1 -- 172.21.15.80:0/908215528 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7fc3800a7740 con 0x7fc390108a20 2024-04-25T11:31:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:31:51.135 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:31:51.135 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:31:51.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc37c0afc60 msgr2=0x7fc37c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc37c0afc60 0x7fc37c0b2170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc38c000c00 tx=0x7fc38c031400 comp rx=0 tx=0).stop 2024-04-25T11:31:51.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 msgr2=0x7fc39019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc39019ac70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc38000e9f0 tx=0x7fc38000eeb0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 shutdown_connections 2024-04-25T11:31:51.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fc37c0afc60 0x7fc37c0b2170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc390108a20 0x7fc39019ac70 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc39010d380 0x7fc39019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 --2- 172.21.15.80:0/908215528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc390102af0 0x7fc39019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 >> 172.21.15.80:0/908215528 conn(0x7fc390078110 msgr2=0x7fc390069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 shutdown_connections 2024-04-25T11:31:51.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.148+0000 7fc3981b7640 1 -- 172.21.15.80:0/908215528 wait complete. 2024-04-25T11:31:51.148 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:31:51.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3279487014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4102720 msgr2=0x7f32f4110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3279487014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4102720 0x7f32f4110570 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009900 tx=0x7f32ec02a410 comp rx=0 tx=0).stop 2024-04-25T11:31:51.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3279487014 shutdown_connections 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3279487014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4102720 0x7f32f4110570 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3279487014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32f4109f90 0x7f32f41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3279487014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f4109af0 0x7f32f4101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3279487014 >> 172.21.15.80:0/3279487014 conn(0x7f32f4077880 msgr2=0x7f32f4077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3279487014 shutdown_connections 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.270+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3279487014 wait complete. 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 Processor -- start 2024-04-25T11:31:51.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 -- start start 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f4102720 0x7f32f419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4109af0 0x7f32f419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32f4109f90 0x7f32f419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4113ce0 con 0x7f32f4109af0 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4113b60 con 0x7f32f4102720 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32fb6d1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4113e60 con 0x7f32f4109f90 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4109af0 0x7f32f419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4109af0 0x7f32f419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50578/0 (socket says 172.21.15.80:50578) 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3872030847 learned_addr learned my addr 172.21.15.80:0/3872030847 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f946d640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f4102720 0x7f32f419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f9c6e640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32f4109f90 0x7f32f419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3872030847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32f4109f90 msgr2=0x7f32f419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32f4109f90 0x7f32f419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3872030847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f4102720 msgr2=0x7f32f419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f4102720 0x7f32f419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3872030847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f419f4e0 con 0x7f32f4109af0 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.271+0000 7f32f946d640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f4102720 0x7f32f419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.272+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4109af0 0x7f32f419abe0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f32e800e9f0 tx=0x7f32e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.272+0000 7f32e67fc640 1 -- 172.21.15.80:0/3872030847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e800ccc0 con 0x7f32f4109af0 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.272+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f419f7d0 con 0x7f32f4109af0 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.272+0000 7f32e67fc640 1 -- 172.21.15.80:0/3872030847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e80054d0 con 0x7f32f4109af0 2024-04-25T11:31:51.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.272+0000 7f32e67fc640 1 -- 172.21.15.80:0/3872030847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8010430 con 0x7f32f4109af0 2024-04-25T11:31:51.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.272+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f419fcd0 con 0x7f32f4109af0 2024-04-25T11:31:51.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 Processor -- start 2024-04-25T11:31:51.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 -- start start 2024-04-25T11:31:51.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f32e67fc640 1 -- 172.21.15.80:0/3872030847 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f32e80046c0 con 0x7f32f4109af0 2024-04-25T11:31:51.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f360d390 0x5624f39ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 0x5624f39bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5624f3913d80 con 0x5624f35e44d0 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5624f38cda20 con 0x5624f35ec6b0 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f330257d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5624f390fd40 con 0x5624f360d390 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f32f946d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f32f946d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50590/0 (socket says 172.21.15.80:50590) 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f32f946d640 1 -- 172.21.15.80:0/3444792239 learned_addr learned my addr 172.21.15.80:0/3444792239 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.275+0000 7f32f9c6e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f360d390 0x5624f39ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 0x5624f39bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f946d640 1 -- 172.21.15.80:0/3444792239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f360d390 msgr2=0x5624f39ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f946d640 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f360d390 0x5624f39ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f946d640 1 -- 172.21.15.80:0/3444792239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 msgr2=0x5624f39bb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f946d640 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 0x5624f39bb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f946d640 1 -- 172.21.15.80:0/3444792239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f38d8c30 con 0x5624f35e44d0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32e67fc640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32e00afc60 0x7f32e00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f946d640 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39aed50 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f32f00104a0 tx=0x7f32f0010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41612aaa1eec9ccd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32f9c6e640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32e00afc60 0x7f32e00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32e67fc640 1 -- 172.21.15.80:0/3872030847 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f32e80df500 con 0x7f32f4109af0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32df7fe640 1 -- 172.21.15.80:0/3444792239 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0017070 con 0x5624f35e44d0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32df7fe640 1 -- 172.21.15.80:0/3444792239 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f0011bb0 con 0x5624f35e44d0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.276+0000 7f32df7fe640 1 -- 172.21.15.80:0/3444792239 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f000eca0 con 0x5624f35e44d0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 -- 172.21.15.80:0/3444792239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 msgr2=0x5624f39aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f32f9c6e640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32e00afc60 0x7f32e00b2170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32ec031440 tx=0x7f32ec005a40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39aed50 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f32f00104a0 tx=0x7f32f0010960 comp rx=0 tx=0).stop 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 -- 172.21.15.80:0/3444792239 shutdown_connections 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39aed50 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 0x5624f39bb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 --2- 172.21.15.80:0/3444792239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f360d390 0x5624f39ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 -- 172.21.15.80:0/3444792239 >> 172.21.15.80:0/3444792239 conn(0x5624f36014e0 msgr2=0x5624f39aafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 -- 172.21.15.80:0/3444792239 shutdown_connections 2024-04-25T11:31:51.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 -- 172.21.15.80:0/3444792239 wait complete. 2024-04-25T11:31:51.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.277+0000 7f330257d740 1 -- start start 2024-04-25T11:31:51.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 1 Processor -- start 2024-04-25T11:31:51.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35e44d0 0x5624f39b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35ec6b0 0x5624f39b9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f360d390 0x5624f39c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5624f39bbd90 con 0x5624f35ec6b0 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5624f389adc0 con 0x5624f360d390 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5624f39bbf10 con 0x5624f35e44d0 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f330257d740 10 client.0 _ll_register_callbacks cb 0x5624f38b6600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35ec6b0 0x5624f39b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35ec6b0 0x5624f39b9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50602/0 (socket says 172.21.15.80:50602) 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 -- 172.21.15.80:0/1239701598 learned_addr learned my addr 172.21.15.80:0/1239701598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f9c6e640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f360d390 0x5624f39c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f946d640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35e44d0 0x5624f39b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 -- 172.21.15.80:0/1239701598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35e44d0 msgr2=0x5624f39b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35e44d0 0x5624f39b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 -- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f360d390 msgr2=0x5624f39c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f360d390 0x5624f39c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f8c6c640 1 -- 172.21.15.80:0/1239701598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f36253f0 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.278+0000 7f32f946d640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35e44d0 0x5624f39b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35ec6b0 0x5624f39b9780 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f32e80dcc90 tx=0x7f32e80e2c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a94aa89c241190 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f32dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f32dcff9640 1 -- 172.21.15.80:0/1239701598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e80a6fd0 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f32dcff9640 1 -- 172.21.15.80:0/1239701598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f32e80b0050 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f0011bb0 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f32dcff9640 1 -- 172.21.15.80:0/1239701598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32e80c1050 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 10 client.17265 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624f36ef7d0 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f32dcff9640 1 -- 172.21.15.80:0/1239701598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f0011bb0 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f32dcff9640 1 -- 172.21.15.80:0/1239701598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f32e80a68e0 con 0x5624f35ec6b0 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 10 client.17265 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 10 client.17265 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 20 client.17265 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f35cbf60 0x5624f39cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 4 client.17265 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.279+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f3921990 con 0x5624f35cbf60 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.280+0000 7f32f946d640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f35cbf60 0x5624f39cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.280+0000 7f32f946d640 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f35cbf60 0x5624f39cb620 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26636d0079856e52 server_cookie=e0cac7263e89bbb3 in_seq=0 out_seq=0 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.280+0000 7f32dcff9640 10 client.17265 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f32dcff9640 1 -- 172.21.15.80:0/1239701598 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5624f3921990 con 0x5624f35cbf60 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f32dcff9640 10 client.17265 handle_command_reply: tid=0 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 client.17265 shutdown 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35ec6b0 msgr2=0x5624f39b9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35ec6b0 0x5624f39b9780 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f32e80dcc90 tx=0x7f32e80e2c40 comp rx=0 tx=0).stop 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 shutdown_connections 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f35cbf60 0x5624f39cb620 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35ec6b0 0x5624f39b9780 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f32dcff9640 0 client.17265 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:51.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f360d390 0x5624f39c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 --2- 172.21.15.80:0/1239701598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35e44d0 0x5624f39b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 >> 172.21.15.80:0/1239701598 conn(0x5624f36014e0 msgr2=0x5624f39b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 shutdown_connections 2024-04-25T11:31:51.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 1 -- 172.21.15.80:0/1239701598 wait complete. 2024-04-25T11:31:51.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.281+0000 7f330257d740 20 client.17265 trim_cache size 0 max 16384 2024-04-25T11:31:51.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 Processor -- start 2024-04-25T11:31:51.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 -- start start 2024-04-25T11:31:51.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35cbf60 0x5624f39c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 0x5624f39d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41b2280 con 0x5624f35e44d0 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41afb50 con 0x5624f35ec6b0 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f330257d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41ad9c0 con 0x5624f35cbf60 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50610/0 (socket says 172.21.15.80:50610) 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 -- 172.21.15.80:0/2347737165 learned_addr learned my addr 172.21.15.80:0/2347737165 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f946d640 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35cbf60 0x5624f39c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 -- 172.21.15.80:0/2347737165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35cbf60 msgr2=0x5624f39c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35cbf60 0x5624f39c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 -- 172.21.15.80:0/2347737165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 msgr2=0x5624f39d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 0x5624f39d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f8c6c640 1 -- 172.21.15.80:0/2347737165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f39ae5a0 con 0x5624f35e44d0 2024-04-25T11:31:51.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.295+0000 7f32f946d640 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35cbf60 0x5624f39c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39b3430 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f32e80dd230 tx=0x7f32e800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32295d222a9e0894 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f32deffd640 1 -- 172.21.15.80:0/2347737165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e806c070 con 0x5624f35e44d0 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f32deffd640 1 -- 172.21.15.80:0/2347737165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e8005680 con 0x5624f35e44d0 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f32deffd640 1 -- 172.21.15.80:0/2347737165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e80a6df0 con 0x5624f35e44d0 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 -- 172.21.15.80:0/2347737165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 msgr2=0x5624f39b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39b3430 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f32e80dd230 tx=0x7f32e800ce60 comp rx=0 tx=0).stop 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 -- 172.21.15.80:0/2347737165 shutdown_connections 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39b3430 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35ec6b0 0x5624f39d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 --2- 172.21.15.80:0/2347737165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35cbf60 0x5624f39c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 -- 172.21.15.80:0/2347737165 >> 172.21.15.80:0/2347737165 conn(0x5624f36014e0 msgr2=0x5624f39b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 -- 172.21.15.80:0/2347737165 shutdown_connections 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.296+0000 7f330257d740 1 -- 172.21.15.80:0/2347737165 wait complete. 2024-04-25T11:31:51.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 -- start start 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 Processor -- start 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35cbf60 0x5624f39c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39bcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35ec6b0 0x5624f39bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41ae010 con 0x5624f35e44d0 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41af480 con 0x5624f35cbf60 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41ae6e0 con 0x5624f35ec6b0 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f330257d740 10 client.0 _ll_register_callbacks cb 0x7f32e800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39bcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f32f8c6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39bcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50622/0 (socket says 172.21.15.80:50622) 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3554083417 learned_addr learned my addr 172.21.15.80:0/3554083417 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f32f9c6e640 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35ec6b0 0x5624f39bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.297+0000 7f32f946d640 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35cbf60 0x5624f39c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3554083417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35ec6b0 msgr2=0x5624f39bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35ec6b0 0x5624f39bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35cbf60 msgr2=0x5624f39c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35cbf60 0x5624f39c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32f8c6c640 1 -- 172.21.15.80:0/3554083417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f39b4bf0 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32f8c6c640 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39bcae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f32e800c6a0 tx=0x7f32e80ca110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376e4d63777d056b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32dcff9640 1 -- 172.21.15.80:0/3554083417 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e806c070 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32dcff9640 1 -- 172.21.15.80:0/3554083417 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f32e8005210 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e8005680 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32dcff9640 1 -- 172.21.15.80:0/3554083417 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32e80a6df0 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f330257d740 10 client.17271 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624f3a335b0 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32dcff9640 1 -- 172.21.15.80:0/3554083417 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e8005680 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f32dcff9640 1 -- 172.21.15.80:0/3554083417 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f32e80a2ff0 con 0x5624f35e44d0 2024-04-25T11:31:51.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f330257d740 10 client.17271 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f330257d740 10 client.17271 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.298+0000 7f330257d740 20 client.17271 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f360d390 0x5624f3a35bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 4 client.17271 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624f391b800 con 0x5624f360d390 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f32f946d640 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f360d390 0x5624f3a35bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f32dcff9640 10 client.17271 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f32f946d640 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f360d390 0x5624f3a35bd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0988ffc1dcb5bc5 server_cookie=a3a734b2de4f4827 in_seq=0 out_seq=0 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f32dcff9640 1 -- 172.21.15.80:0/3554083417 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624f391b800 con 0x5624f360d390 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f32dcff9640 10 client.17271 handle_command_reply: tid=0 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 1 client.17271 shutdown 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 msgr2=0x5624f39bcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39bcae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f32e800c6a0 tx=0x7f32e80ca110 comp rx=0 tx=0).stop 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 shutdown_connections 2024-04-25T11:31:51.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.299+0000 7f330257d740 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5624f360d390 0x5624f3a35bd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f330257d740 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5624f35e44d0 0x5624f39bcae0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f330257d740 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624f35ec6b0 0x5624f39bd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32dcff9640 0 client.17271 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f330257d740 1 --2- 172.21.15.80:0/3554083417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624f35cbf60 0x5624f39c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 >> 172.21.15.80:0/3554083417 conn(0x5624f36014e0 msgr2=0x5624f39ba6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 shutdown_connections 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f330257d740 1 -- 172.21.15.80:0/3554083417 wait complete. 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f330257d740 20 client.17271 trim_cache size 0 max 16384 2024-04-25T11:31:51.295 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32e00afc60 msgr2=0x7f32e00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32e00afc60 0x7f32e00b2170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32ec031440 tx=0x7f32ec005a40 comp rx=0 tx=0).stop 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4109af0 msgr2=0x7f32f419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4109af0 0x7f32f419abe0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f32e800e9f0 tx=0x7f32e800eeb0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 shutdown_connections 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f32e00afc60 0x7f32e00b2170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32f4109af0 0x7f32f419abe0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32f4109f90 0x7f32f419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 --2- 172.21.15.80:0/3872030847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f4102720 0x7f32f419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 >> 172.21.15.80:0/3872030847 conn(0x7f32f4077880 msgr2=0x7f32f4100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 shutdown_connections 2024-04-25T11:31:51.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.300+0000 7f32fb6d1640 1 -- 172.21.15.80:0/3872030847 wait complete. 2024-04-25T11:31:51.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:31:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 -- 172.21.15.80:0/1044399129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898102720 msgr2=0x7f8898110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 --2- 172.21.15.80:0/1044399129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898102720 0x7f8898110570 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8890009ca0 tx=0x7f889002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 -- 172.21.15.80:0/1044399129 shutdown_connections 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 --2- 172.21.15.80:0/1044399129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898102720 0x7f8898110570 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 --2- 172.21.15.80:0/1044399129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8898109f90 0x7f88981020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 --2- 172.21.15.80:0/1044399129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8898109af0 0x7f8898101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 -- 172.21.15.80:0/1044399129 >> 172.21.15.80:0/1044399129 conn(0x7f8898077880 msgr2=0x7f8898077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 -- 172.21.15.80:0/1044399129 shutdown_connections 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.420+0000 7f889dc92640 1 -- 172.21.15.80:0/1044399129 wait complete. 2024-04-25T11:31:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.421+0000 7f889dc92640 1 Processor -- start 2024-04-25T11:31:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.421+0000 7f889dc92640 1 -- start start 2024-04-25T11:31:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.421+0000 7f889dc92640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8898102720 0x7f889819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.421+0000 7f889dc92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898109af0 0x7f889819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f889dc92640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8898109f90 0x7f889819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f889dc92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8898113ce0 con 0x7f8898109af0 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f889dc92640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8898113b60 con 0x7f8898109f90 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f889dc92640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8898113e60 con 0x7f8898102720 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898109af0 0x7f889819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898109af0 0x7f889819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50640/0 (socket says 172.21.15.80:50640) 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 -- 172.21.15.80:0/169693763 learned_addr learned my addr 172.21.15.80:0/169693763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f88977fe640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8898102720 0x7f889819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8897fff640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8898109f90 0x7f889819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 -- 172.21.15.80:0/169693763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8898102720 msgr2=0x7f889819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8898102720 0x7f889819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 -- 172.21.15.80:0/169693763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8898109f90 msgr2=0x7f889819eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8898109f90 0x7f889819eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 -- 172.21.15.80:0/169693763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889819f4e0 con 0x7f8898109af0 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8897fff640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8898109f90 0x7f889819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8896ffd640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898109af0 0x7f889819abe0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f888c00d740 tx=0x7f888c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8894ff9640 1 -- 172.21.15.80:0/169693763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c017070 con 0x7f8898109af0 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8894ff9640 1 -- 172.21.15.80:0/169693763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c00de50 con 0x7f8898109af0 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889819f7d0 con 0x7f8898109af0 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f8894ff9640 1 -- 172.21.15.80:0/169693763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c004ce0 con 0x7f8898109af0 2024-04-25T11:31:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.422+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889819fcd0 con 0x7f8898109af0 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 Processor -- start 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f8894ff9640 1 -- 172.21.15.80:0/169693763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f888c004e80 con 0x7f8898109af0 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 -- start start 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e578390 0x56497e919810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e919d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e9266a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56497e87ed80 con 0x56497e54f4d0 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56497e838a20 con 0x56497e5576b0 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56497e87ad40 con 0x56497e578390 2024-04-25T11:31:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e919d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e919d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50648/0 (socket says 172.21.15.80:50648) 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88977fe640 1 -- 172.21.15.80:0/3731074961 learned_addr learned my addr 172.21.15.80:0/3731074961 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f8896ffd640 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e9266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f8897fff640 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e578390 0x56497e919810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88977fe640 1 -- 172.21.15.80:0/3731074961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e578390 msgr2=0x56497e919810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f8894ff9640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88800afc60 0x7f88800b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88977fe640 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e578390 0x56497e919810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88977fe640 1 -- 172.21.15.80:0/3731074961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 msgr2=0x56497e9266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.425+0000 7f88977fe640 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e9266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f88977fe640 1 -- 172.21.15.80:0/3731074961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497e843c30 con 0x56497e54f4d0 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f8896ffd640 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e9266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f8897fff640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88800afc60 0x7f88800b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f8894ff9640 1 -- 172.21.15.80:0/169693763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f888c0deab0 con 0x7f8898109af0 2024-04-25T11:31:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f88977fe640 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e919d50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8888009c80 tx=0x7f88880117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c38fc0851a7f01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f887dffb640 1 -- 172.21.15.80:0/3731074961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888012450 con 0x56497e54f4d0 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f887dffb640 1 -- 172.21.15.80:0/3731074961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8888012aa0 con 0x56497e54f4d0 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.426+0000 7f887dffb640 1 -- 172.21.15.80:0/3731074961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888800fae0 con 0x56497e54f4d0 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3731074961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 msgr2=0x56497e919d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f8897fff640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88800afc60 0x7f88800b2170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8890005e30 tx=0x7f88900095c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e919d50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8888009c80 tx=0x7f88880117b0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3731074961 shutdown_connections 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e919d50 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e9266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3731074961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e578390 0x56497e919810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3731074961 >> 172.21.15.80:0/3731074961 conn(0x56497e56c4e0 msgr2=0x56497e915fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3731074961 shutdown_connections 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3731074961 wait complete. 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 -- start start 2024-04-25T11:31:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.427+0000 7f88a4c1c740 1 Processor -- start 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e54f4d0 0x56497e924230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e924770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e930210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56497e926d90 con 0x56497e578390 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56497e805dc0 con 0x56497e5576b0 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56497e926f10 con 0x56497e54f4d0 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88a4c1c740 10 client.0 _ll_register_callbacks cb 0x56497e821600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e930210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e930210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50662/0 (socket says 172.21.15.80:50662) 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 -- 172.21.15.80:0/991603856 learned_addr learned my addr 172.21.15.80:0/991603856 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8896ffd640 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e924770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f88977fe640 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e54f4d0 0x56497e924230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 -- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e54f4d0 msgr2=0x56497e924230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e54f4d0 0x56497e924230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 -- 172.21.15.80:0/991603856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 msgr2=0x56497e924770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e924770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 -- 172.21.15.80:0/991603856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497e5903f0 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8897fff640 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e930210 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8890035000 tx=0x7f889002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fc091f3187237b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.428+0000 7f8876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f8876ffd640 1 -- 172.21.15.80:0/991603856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890004040 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f8876ffd640 1 -- 172.21.15.80:0/991603856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f88900041e0 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8888012aa0 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f8876ffd640 1 -- 172.21.15.80:0/991603856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f88900043e0 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 10 client.17283 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56497e65a7d0 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f8876ffd640 1 -- 172.21.15.80:0/991603856 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8888012aa0 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f8876ffd640 1 -- 172.21.15.80:0/991603856 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f88900305c0 con 0x56497e578390 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 10 client.17283 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 10 client.17283 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 20 client.17283 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e536f60 0x56497e9366c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 4 client.17283 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56497e88c990 con 0x56497e536f60 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.429+0000 7f88977fe640 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e536f60 0x56497e9366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.430+0000 7f8876ffd640 10 client.17283 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.430+0000 7f88977fe640 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e536f60 0x56497e9366c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfe72a35e36f3b5b server_cookie=4a7f7f2c46ef99bb in_seq=0 out_seq=0 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f8876ffd640 1 -- 172.21.15.80:0/991603856 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56497e88c990 con 0x56497e536f60 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f8876ffd640 10 client.17283 handle_command_reply: tid=0 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 client.17283 shutdown 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 msgr2=0x56497e930210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e930210 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8890035000 tx=0x7f889002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 shutdown_connections 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e930210 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e536f60 0x56497e9366c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e5576b0 0x56497e924770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f8876ffd640 0 client.17283 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/991603856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e54f4d0 0x56497e924230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 >> 172.21.15.80:0/991603856 conn(0x56497e56c4e0 msgr2=0x56497e91b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 shutdown_connections 2024-04-25T11:31:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 1 -- 172.21.15.80:0/991603856 wait complete. 2024-04-25T11:31:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.431+0000 7f88a4c1c740 20 client.17283 trim_cache size 0 max 16384 2024-04-25T11:31:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.444+0000 7f88a4c1c740 1 Processor -- start 2024-04-25T11:31:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.444+0000 7f88a4c1c740 1 -- start start 2024-04-25T11:31:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e54f4d0 0x56497e919cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e92fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e91e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88981b21f0 con 0x56497e578390 2024-04-25T11:31:51.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88981afac0 con 0x56497e54f4d0 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88981ad930 con 0x56497e5576b0 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e91e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e91e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50678/0 (socket says 172.21.15.80:50678) 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 -- 172.21.15.80:0/3273286541 learned_addr learned my addr 172.21.15.80:0/3273286541 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88977fe640 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e54f4d0 0x56497e919cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8896ffd640 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e92fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 -- 172.21.15.80:0/3273286541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 msgr2=0x56497e92fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e92fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 -- 172.21.15.80:0/3273286541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e54f4d0 msgr2=0x56497e919cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e54f4d0 0x56497e919cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 -- 172.21.15.80:0/3273286541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497e923320 con 0x56497e578390 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f88977fe640 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e54f4d0 0x56497e919cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f8897fff640 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e91e430 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8890030b00 tx=0x7f88900099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f28f0d5554b16d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f887d7fa640 1 -- 172.21.15.80:0/3273286541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889005d070 con 0x56497e578390 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f887d7fa640 1 -- 172.21.15.80:0/3273286541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889004c030 con 0x56497e578390 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.445+0000 7f887d7fa640 1 -- 172.21.15.80:0/3273286541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890004580 con 0x56497e578390 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3273286541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 msgr2=0x56497e91e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e91e430 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8890030b00 tx=0x7f88900099d0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3273286541 shutdown_connections 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e578390 0x56497e91e430 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e92fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/3273286541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e54f4d0 0x56497e919cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3273286541 >> 172.21.15.80:0/3273286541 conn(0x56497e56c4e0 msgr2=0x56497e9195a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3273286541 shutdown_connections 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 -- 172.21.15.80:0/3273286541 wait complete. 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.446+0000 7f88a4c1c740 1 -- start start 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 1 Processor -- start 2024-04-25T11:31:51.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e92c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e9277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e578390 0x56497e927cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88981adf80 con 0x56497e54f4d0 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88981af3f0 con 0x56497e578390 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88981ae650 con 0x56497e5576b0 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88a4c1c740 10 client.0 _ll_register_callbacks cb 0x7f8888005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e92c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e92c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50688/0 (socket says 172.21.15.80:50688) 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 -- 172.21.15.80:0/867858841 learned_addr learned my addr 172.21.15.80:0/867858841 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f8897fff640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e578390 0x56497e927cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 -- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 msgr2=0x56497e9277b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f8896ffd640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e9277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e9277b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 -- 172.21.15.80:0/867858841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e578390 msgr2=0x56497e927cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e578390 0x56497e927cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f88977fe640 1 -- 172.21.15.80:0/867858841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497e928230 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.447+0000 7f8897fff640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e578390 0x56497e927cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88977fe640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e92c400 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f888801c040 tx=0x7f888800f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2576ef84b0f2b387 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f8876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f8876ffd640 1 -- 172.21.15.80:0/867858841 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880054c0 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f8876ffd640 1 -- 172.21.15.80:0/867858841 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f8888012450 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f889004c030 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f8876ffd640 1 -- 172.21.15.80:0/867858841 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8888036050 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 10 client.17289 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56497e99e610 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f8876ffd640 1 -- 172.21.15.80:0/867858841 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889004c030 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f8876ffd640 1 -- 172.21.15.80:0/867858841 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f888800f9d0 con 0x56497e54f4d0 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 10 client.17289 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:51.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 10 client.17289 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 20 client.17289 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e50c3a0 0x56497e9a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 4 client.17289 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.448+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56497e886800 con 0x56497e50c3a0 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f8896ffd640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e50c3a0 0x56497e9a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f8876ffd640 10 client.17289 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f8896ffd640 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e50c3a0 0x56497e9a0c40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad35796a6e995725 server_cookie=f0272281f1fc480d in_seq=0 out_seq=0 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f8876ffd640 1 -- 172.21.15.80:0/867858841 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56497e886800 con 0x56497e50c3a0 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f8876ffd640 10 client.17289 handle_command_reply: tid=0 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 client.17289 shutdown 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 msgr2=0x56497e92c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e92c400 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f888801c040 tx=0x7f888800f530 comp rx=0 tx=0).stop 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 shutdown_connections 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x56497e50c3a0 0x56497e9a0c40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56497e578390 0x56497e927cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56497e5576b0 0x56497e9277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f8876ffd640 0 client.17289 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 --2- 172.21.15.80:0/867858841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56497e54f4d0 0x56497e92c400 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 >> 172.21.15.80:0/867858841 conn(0x56497e56c4e0 msgr2=0x56497e9255f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.449+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 shutdown_connections 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f88a4c1c740 1 -- 172.21.15.80:0/867858841 wait complete. 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f88a4c1c740 20 client.17289 trim_cache size 0 max 16384 2024-04-25T11:31:51.445 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88800afc60 msgr2=0x7f88800b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88800afc60 0x7f88800b2170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8890005e30 tx=0x7f88900095c0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898109af0 msgr2=0x7f889819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898109af0 0x7f889819abe0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f888c00d740 tx=0x7f888c00dc00 comp rx=0 tx=0).stop 2024-04-25T11:31:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 shutdown_connections 2024-04-25T11:31:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f88800afc60 0x7f88800b2170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8898109af0 0x7f889819abe0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8898109f90 0x7f889819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 --2- 172.21.15.80:0/169693763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8898102720 0x7f889819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 >> 172.21.15.80:0/169693763 conn(0x7f8898077880 msgr2=0x7f8898100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 shutdown_connections 2024-04-25T11:31:51.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.450+0000 7f889dc92640 1 -- 172.21.15.80:0/169693763 wait complete. 2024-04-25T11:31:51.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:51 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/908215528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:51.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:31:51.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:51 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/908215528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 -- 172.21.15.80:0/2634102340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 msgr2=0x7f3708102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 --2- 172.21.15.80:0/2634102340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708102f00 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009ca0 tx=0x7f36fc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 -- 172.21.15.80:0/2634102340 shutdown_connections 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 --2- 172.21.15.80:0/2634102340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708102f00 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 --2- 172.21.15.80:0/2634102340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f370810d380 0x7f370810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 --2- 172.21.15.80:0/2634102340 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3708108a20 0x7f37081025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 -- 172.21.15.80:0/2634102340 >> 172.21.15.80:0/2634102340 conn(0x7f3708078100 msgr2=0x7f3708078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 -- 172.21.15.80:0/2634102340 shutdown_connections 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.570+0000 7f370fc92640 1 -- 172.21.15.80:0/2634102340 wait complete. 2024-04-25T11:31:51.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 Processor -- start 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 -- start start 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3708108a20 0x7f3708199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f370810d380 0x7f370819de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3708112be0 con 0x7f3708102af0 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3708112a60 con 0x7f3708108a20 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370fc92640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3708112d60 con 0x7f370810d380 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50708/0 (socket says 172.21.15.80:50708) 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 -- 172.21.15.80:0/473962121 learned_addr learned my addr 172.21.15.80:0/473962121 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370d22d640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3708108a20 0x7f3708199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 -- 172.21.15.80:0/473962121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f370810d380 msgr2=0x7f370819de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f370810d380 0x7f370819de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 -- 172.21.15.80:0/473962121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3708108a20 msgr2=0x7f3708199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3708108a20 0x7f3708199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.571+0000 7f370da2e640 1 -- 172.21.15.80:0/473962121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370819e400 con 0x7f3708102af0 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.572+0000 7f370da2e640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708199620 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f370000c9a0 tx=0x7f370000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.572+0000 7f3706ffd640 1 -- 172.21.15.80:0/473962121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700014070 con 0x7f3708102af0 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.572+0000 7f3706ffd640 1 -- 172.21.15.80:0/473962121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3700004440 con 0x7f3708102af0 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.572+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370819e6f0 con 0x7f3708102af0 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.572+0000 7f3706ffd640 1 -- 172.21.15.80:0/473962121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370000f450 con 0x7f3708102af0 2024-04-25T11:31:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.572+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370819ec10 con 0x7f3708102af0 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.574+0000 7f3716c11740 1 Processor -- start 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.574+0000 7f3716c11740 1 -- start start 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3706ffd640 1 -- 172.21.15.80:0/473962121 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f3700017070 con 0x7f3708102af0 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3716c11740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9cd390 0x561eecd6e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3716c11740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9a44d0 0x561eecd6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3716c11740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9ac6b0 0x561eecd7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3716c11740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561eeccd3d80 con 0x561eec9cd390 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3716c11740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561eecc8da20 con 0x561eec9a44d0 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3716c11740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561eecccfd40 con 0x561eec9ac6b0 2024-04-25T11:31:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9cd390 0x561eecd6e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9cd390 0x561eecd6e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50724/0 (socket says 172.21.15.80:50724) 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 -- 172.21.15.80:0/562424286 learned_addr learned my addr 172.21.15.80:0/562424286 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370da2e640 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9a44d0 0x561eecd6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 -- 172.21.15.80:0/562424286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9ac6b0 msgr2=0x561eecd7b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9ac6b0 0x561eecd7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 -- 172.21.15.80:0/562424286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9a44d0 msgr2=0x561eecd6ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9a44d0 0x561eecd6ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 -- 172.21.15.80:0/562424286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eecc98c30 con 0x561eec9cd390 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370da2e640 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9a44d0 0x561eecd6ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f370e22f640 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9cd390 0x561eecd6e810 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009c40 tx=0x7f36f800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8396bfc02deeb2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f3706ffd640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36f00afc60 0x7f36f00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.575+0000 7f36effff640 1 -- 172.21.15.80:0/562424286 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8005020 con 0x561eec9cd390 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.576+0000 7f370da2e640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36f00afc60 0x7f36f00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.576+0000 7f36effff640 1 -- 172.21.15.80:0/562424286 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36f80047a0 con 0x561eec9cd390 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.576+0000 7f36effff640 1 -- 172.21.15.80:0/562424286 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8010690 con 0x561eec9cd390 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.576+0000 7f3706ffd640 1 -- 172.21.15.80:0/473962121 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f37000dec40 con 0x7f3708102af0 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 -- 172.21.15.80:0/562424286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9cd390 msgr2=0x561eecd6e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f370da2e640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36f00afc60 0x7f36f00b2170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f37000dc420 tx=0x7f37000045f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9cd390 0x561eecd6e810 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009c40 tx=0x7f36f800e720 comp rx=0 tx=0).stop 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 -- 172.21.15.80:0/562424286 shutdown_connections 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9ac6b0 0x561eecd7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9a44d0 0x561eecd6ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 --2- 172.21.15.80:0/562424286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9cd390 0x561eecd6e810 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 -- 172.21.15.80:0/562424286 >> 172.21.15.80:0/562424286 conn(0x561eec9c14e0 msgr2=0x561eecd6afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 -- 172.21.15.80:0/562424286 shutdown_connections 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 -- 172.21.15.80:0/562424286 wait complete. 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 -- start start 2024-04-25T11:31:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.577+0000 7f3716c11740 1 Processor -- start 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd79230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd79770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd85210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561eecd7bd90 con 0x561eec9ac6b0 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561eecc5adc0 con 0x561eec9cd390 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561eecd7bf10 con 0x561eec9a44d0 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 10 client.0 _ll_register_callbacks cb 0x561eecc76600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd79770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd79770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50732/0 (socket says 172.21.15.80:50732) 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 -- 172.21.15.80:0/3536885036 learned_addr learned my addr 172.21.15.80:0/3536885036 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370e22f640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd85210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370e22f640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd79230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 -- 172.21.15.80:0/3536885036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 msgr2=0x561eecd79230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd79230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 -- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 msgr2=0x561eecd85210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd85210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 -- 172.21.15.80:0/3536885036 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eec9e53f0 con 0x561eec9ac6b0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370e22f640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd79230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f370d22d640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd79770 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f36fc005cc0 tx=0x7f36fc009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b22e9d5b5c07759 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f36ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3536885036 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc031650 con 0x561eec9ac6b0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3536885036 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f36fc0317f0 con 0x561eec9ac6b0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.578+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f80047a0 con 0x561eec9ac6b0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3536885036 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f36fc003970 con 0x561eec9ac6b0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 10 client.17301 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561eecaaf7d0 con 0x561eec9ac6b0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3536885036 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36f80047a0 con 0x561eec9ac6b0 2024-04-25T11:31:51.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3536885036 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f36fc02f660 con 0x561eec9ac6b0 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 10 client.17301 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 10 client.17301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 20 client.17301 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec98bf60 0x561eecd8b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 4 client.17301 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eecce1990 con 0x561eec98bf60 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.579+0000 7f370e22f640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec98bf60 0x561eecd8b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.580+0000 7f36ed7fa640 10 client.17301 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.580+0000 7f370e22f640 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec98bf60 0x561eecd8b680 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c85bf24afa1d17 server_cookie=9965ff578927feaf in_seq=0 out_seq=0 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.580+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3536885036 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561eecce1990 con 0x561eec98bf60 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.580+0000 7f36ed7fa640 10 client.17301 handle_command_reply: tid=0 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 client.17301 shutdown 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 msgr2=0x561eecd79770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd79770 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f36fc005cc0 tx=0x7f36fc009800 comp rx=0 tx=0).stop 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 shutdown_connections 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec98bf60 0x561eecd8b680 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd79770 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd85210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f36ed7fa640 0 client.17301 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 --2- 172.21.15.80:0/3536885036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd79230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 >> 172.21.15.80:0/3536885036 conn(0x561eec9c14e0 msgr2=0x561eecd70530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 shutdown_connections 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 1 -- 172.21.15.80:0/3536885036 wait complete. 2024-04-25T11:31:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.581+0000 7f3716c11740 20 client.17301 trim_cache size 0 max 16384 2024-04-25T11:31:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 Processor -- start 2024-04-25T11:31:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 -- start start 2024-04-25T11:31:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd6b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd78000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd84e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b1190 con 0x561eec9ac6b0 2024-04-25T11:31:51.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37081aea60 con 0x561eec9cd390 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f3716c11740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ac8d0 con 0x561eec9a44d0 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f370d22d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd78000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f370d22d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd78000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50740/0 (socket says 172.21.15.80:50740) 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.594+0000 7f370d22d640 1 -- 172.21.15.80:0/2515026360 learned_addr learned my addr 172.21.15.80:0/2515026360 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f370e22f640 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd84e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f370d22d640 1 -- 172.21.15.80:0/2515026360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 msgr2=0x561eecd6b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f370d22d640 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd6b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f370d22d640 1 -- 172.21.15.80:0/2515026360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 msgr2=0x561eecd84e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f370d22d640 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd84e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f370d22d640 1 -- 172.21.15.80:0/2515026360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eecd6ff30 con 0x561eec9ac6b0 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f370d22d640 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd78000 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f36fc02ade0 tx=0x7f36fc0048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255f6fbea3c57233 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f36ef7fe640 1 -- 172.21.15.80:0/2515026360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc05a070 con 0x561eec9ac6b0 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f36ef7fe640 1 -- 172.21.15.80:0/2515026360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36fc036040 con 0x561eec9ac6b0 2024-04-25T11:31:51.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.595+0000 7f36ef7fe640 1 -- 172.21.15.80:0/2515026360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0309b0 con 0x561eec9ac6b0 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 -- 172.21.15.80:0/2515026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 msgr2=0x561eecd78000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd78000 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f36fc02ade0 tx=0x7f36fc0048e0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 -- 172.21.15.80:0/2515026360 shutdown_connections 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9ac6b0 0x561eecd78000 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9cd390 0x561eecd84e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 --2- 172.21.15.80:0/2515026360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9a44d0 0x561eecd6b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 -- 172.21.15.80:0/2515026360 >> 172.21.15.80:0/2515026360 conn(0x561eec9c14e0 msgr2=0x561eecd778f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 -- 172.21.15.80:0/2515026360 shutdown_connections 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 -- 172.21.15.80:0/2515026360 wait complete. 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 -- start start 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.596+0000 7f3716c11740 1 Processor -- start 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9a44d0 0x561eecd767a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9ac6b0 0x561eecd76ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9cd390 0x561eecd753b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f37081acf20 con 0x561eec9a44d0 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ae390 con 0x561eec9ac6b0 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ad5f0 con 0x561eec9cd390 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 10 client.0 _ll_register_callbacks cb 0x7f36f8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9a44d0 0x561eecd767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9a44d0 0x561eecd767a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50742/0 (socket says 172.21.15.80:50742) 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 -- 172.21.15.80:0/3742466561 learned_addr learned my addr 172.21.15.80:0/3742466561 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370d22d640 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9ac6b0 0x561eecd76ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 -- 172.21.15.80:0/3742466561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9cd390 msgr2=0x561eecd753b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9cd390 0x561eecd753b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 -- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9ac6b0 msgr2=0x561eecd76ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9ac6b0 0x561eecd76ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 -- 172.21.15.80:0/3742466561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eecd75b20 con 0x561eec9a44d0 2024-04-25T11:31:51.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f370e22f640 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9a44d0 0x561eecd767a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f36f8000c00 tx=0x7f36f8009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f607d2311ed5a3aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f36ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3742466561 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8004040 con 0x561eec9a44d0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3742466561 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f36f80041e0 con 0x561eec9a44d0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36fc036040 con 0x561eec9a44d0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3742466561 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f36f8004400 con 0x561eec9a44d0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 10 client.17307 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.597+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561eecdf5550 con 0x561eec9a44d0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3742466561 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36fc036040 con 0x561eec9a44d0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3742466561 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f36f80265f0 con 0x561eec9a44d0 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f3716c11740 10 client.17307 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f3716c11740 10 client.17307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f3716c11740 20 client.17307 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f3716c11740 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec9613a0 0x561eecdf7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f3716c11740 4 client.17307 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561eeccdb800 con 0x561eec9613a0 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f370d22d640 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec9613a0 0x561eecdf7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f36ed7fa640 10 client.17307 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.598+0000 7f370d22d640 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec9613a0 0x561eecdf7b80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e95b377d2315ee server_cookie=ad7a7dd0d3cd108d in_seq=0 out_seq=0 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f36ed7fa640 1 -- 172.21.15.80:0/3742466561 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561eeccdb800 con 0x561eec9613a0 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f36ed7fa640 10 client.17307 handle_command_reply: tid=0 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 client.17307 shutdown 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9a44d0 msgr2=0x561eecd767a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9a44d0 0x561eecd767a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f36f8000c00 tx=0x7f36f8009d30 comp rx=0 tx=0).stop 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 shutdown_connections 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x561eec9613a0 0x561eecdf7b80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561eec9cd390 0x561eecd753b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561eec9ac6b0 0x561eecd76ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f36ed7fa640 0 client.17307 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 --2- 172.21.15.80:0/3742466561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561eec9a44d0 0x561eecd767a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 >> 172.21.15.80:0/3742466561 conn(0x561eec9c14e0 msgr2=0x561eecd69610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 shutdown_connections 2024-04-25T11:31:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 1 -- 172.21.15.80:0/3742466561 wait complete. 2024-04-25T11:31:51.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f3716c11740 20 client.17307 trim_cache size 0 max 16384 2024-04-25T11:31:51.595 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36f00afc60 msgr2=0x7f36f00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.599+0000 7f370fc92640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36f00afc60 0x7f36f00b2170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f37000dc420 tx=0x7f37000045f0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 msgr2=0x7f3708199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708199620 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f370000c9a0 tx=0x7f370000ce60 comp rx=0 tx=0).stop 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 shutdown_connections 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36f00afc60 0x7f36f00b2170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f370810d380 0x7f370819de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3708108a20 0x7f3708199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 --2- 172.21.15.80:0/473962121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708102af0 0x7f3708199620 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 >> 172.21.15.80:0/473962121 conn(0x7f3708078100 msgr2=0x7f37081040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 shutdown_connections 2024-04-25T11:31:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:51.600+0000 7f370fc92640 1 -- 172.21.15.80:0/473962121 wait complete. 2024-04-25T11:31:51.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:51 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/908215528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:52.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:52 smithi082 ceph-mon[32440]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:52.601 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:31:52.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:31:52.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:31:52.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:52 smithi080 ceph-mon[29126]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:52.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:52 smithi196 ceph-mon[32659]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.742+0000 7f500d6d8640 1 -- 172.21.15.80:0/4291316670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f500810d380 msgr2=0x7f500810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.742+0000 7f500d6d8640 1 --2- 172.21.15.80:0/4291316670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f500810d380 0x7f500810f7a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f5000009ca0 tx=0x7f500002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 -- 172.21.15.80:0/4291316670 shutdown_connections 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 --2- 172.21.15.80:0/4291316670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f500810d380 0x7f500810f7a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 --2- 172.21.15.80:0/4291316670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5008102af0 0x7f5008102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 --2- 172.21.15.80:0/4291316670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5008108a20 0x7f50081025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 -- 172.21.15.80:0/4291316670 >> 172.21.15.80:0/4291316670 conn(0x7f5008078100 msgr2=0x7f5008078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 -- 172.21.15.80:0/4291316670 shutdown_connections 2024-04-25T11:31:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 -- 172.21.15.80:0/4291316670 wait complete. 2024-04-25T11:31:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 Processor -- start 2024-04-25T11:31:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.743+0000 7f500d6d8640 1 -- start start 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f500d6d8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5008102af0 0x7f500819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f500d6d8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5008108a20 0x7f500819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f500d6d8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500810d380 0x7f50081a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f500d6d8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5008112c00 con 0x7f5008108a20 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f500d6d8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5008112a80 con 0x7f500810d380 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f500d6d8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5008112d80 con 0x7f5008102af0 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5008108a20 0x7f500819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5008108a20 0x7f500819b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50760/0 (socket says 172.21.15.80:50760) 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 -- 172.21.15.80:0/1878085140 learned_addr learned my addr 172.21.15.80:0/1878085140 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f50077fe640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500810d380 0x7f50081a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f5006ffd640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5008102af0 0x7f500819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 -- 172.21.15.80:0/1878085140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5008102af0 msgr2=0x7f500819b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5008102af0 0x7f500819b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 -- 172.21.15.80:0/1878085140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500810d380 msgr2=0x7f50081a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500810d380 0x7f50081a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 -- 172.21.15.80:0/1878085140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500819c260 con 0x7f5008108a20 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f5006ffd640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5008102af0 0x7f500819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f4ffffff640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5008108a20 0x7f500819b9e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000e9f0 tx=0x7f4ff000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f5004ff9640 1 -- 172.21.15.80:0/1878085140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000ccc0 con 0x7f5008108a20 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f5004ff9640 1 -- 172.21.15.80:0/1878085140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff00035f0 con 0x7f5008108a20 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f5004ff9640 1 -- 172.21.15.80:0/1878085140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000ce60 con 0x7f5008108a20 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.744+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50081a6b20 con 0x7f5008108a20 2024-04-25T11:31:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.745+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50081a7070 con 0x7f5008108a20 2024-04-25T11:31:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 Processor -- start 2024-04-25T11:31:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5004ff9640 1 -- 172.21.15.80:0/1878085140 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f4ff0003aa0 con 0x7f5008108a20 2024-04-25T11:31:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 -- start start 2024-04-25T11:31:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c60620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca9897550 0x562ca9c60b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c610a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562ca9bc6b00 con 0x562ca9897550 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562ca9b62920 con 0x562ca98c0410 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.747+0000 7f5014588740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ca9bc2ac0 con 0x562ca989f730 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca9897550 0x562ca9c60b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca9897550 0x562ca9c60b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50774/0 (socket says 172.21.15.80:50774) 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 -- 172.21.15.80:0/1684606323 learned_addr learned my addr 172.21.15.80:0/1684606323 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f50077fe640 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c60620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f4ffffff640 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5004ff9640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ff40afce0 0x7f4ff40b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 -- 172.21.15.80:0/1684606323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 msgr2=0x562ca9c610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 -- 172.21.15.80:0/1684606323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 msgr2=0x562ca9c60620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c60620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 -- 172.21.15.80:0/1684606323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca99a07e0 con 0x562ca9897550 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f50077fe640 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c60620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f50077fe640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ff40afce0 0x7f4ff40b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5004ff9640 1 -- 172.21.15.80:0/1878085140 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f4ff00df410 con 0x7f5008108a20 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f5006ffd640 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca9897550 0x562ca9c60b60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009c50 tx=0x7f4ff8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c5f316cc9d609c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/1684606323 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8004030 con 0x562ca9897550 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/1684606323 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff80041d0 con 0x562ca9897550 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.748+0000 7f4ffd7fa640 1 -- 172.21.15.80:0/1684606323 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80126b0 con 0x562ca9897550 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 -- 172.21.15.80:0/1684606323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca9897550 msgr2=0x562ca9c60b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f50077fe640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ff40afce0 0x7f4ff40b21f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x562ca9c5d790 tx=0x7f500003f040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca9897550 0x562ca9c60b60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009c50 tx=0x7f4ff8010740 comp rx=0 tx=0).stop 2024-04-25T11:31:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 -- 172.21.15.80:0/1684606323 shutdown_connections 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca9897550 0x562ca9c60b60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 --2- 172.21.15.80:0/1684606323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c60620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 -- 172.21.15.80:0/1684606323 >> 172.21.15.80:0/1684606323 conn(0x562ca98b4560 msgr2=0x562ca9c5cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 -- 172.21.15.80:0/1684606323 shutdown_connections 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.749+0000 7f5014588740 1 -- 172.21.15.80:0/1684606323 wait complete. 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 -- start start 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 Processor -- start 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c6abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca989f730 0x562ca9c6b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c76e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562ca9c6d970 con 0x562ca989f730 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562ca9b605d0 con 0x562ca98c0410 2024-04-25T11:31:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ca9c6daf0 con 0x562ca9897550 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5014588740 10 client.0 _ll_register_callbacks cb 0x562ca9b4e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca989f730 0x562ca9c6b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca989f730 0x562ca9c6b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50778/0 (socket says 172.21.15.80:50778) 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 -- 172.21.15.80:0/419595227 learned_addr learned my addr 172.21.15.80:0/419595227 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f50077fe640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c76e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5006ffd640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c6abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 -- 172.21.15.80:0/419595227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 msgr2=0x562ca9c6abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c6abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 -- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 msgr2=0x562ca9c76e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c76e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f4ffffff640 1 -- 172.21.15.80:0/419595227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca9a00f70 con 0x562ca989f730 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.750+0000 7f5006ffd640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c6abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f4ffffff640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca989f730 0x562ca9c6b130 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00a7290 tx=0x7f4ff00a6fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15454ed21d5e962c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f4fee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f4fee7fc640 1 -- 172.21.15.80:0/419595227 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00a7c90 con 0x562ca989f730 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f4fee7fc640 1 -- 172.21.15.80:0/419595227 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f4ff00a77f0 con 0x562ca989f730 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ff80041d0 con 0x562ca989f730 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f4fee7fc640 1 -- 172.21.15.80:0/419595227 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ff00a7590 con 0x562ca989f730 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 10 client.17319 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ca9898170 con 0x562ca989f730 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f4fee7fc640 1 -- 172.21.15.80:0/419595227 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff80041d0 con 0x562ca989f730 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f4fee7fc640 1 -- 172.21.15.80:0/419595227 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4ff00aff60 con 0x562ca989f730 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 10 client.17319 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 20 client.17319 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca987f1f0 0x562ca9c7d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 4 client.17319 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.751+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ca9bd4710 con 0x562ca987f1f0 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.752+0000 7f5006ffd640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca987f1f0 0x562ca9c7d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.752+0000 7f4fee7fc640 10 client.17319 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.752+0000 7f5006ffd640 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca987f1f0 0x562ca9c7d130 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=409d9e49d590a69f server_cookie=efb793493b72b620 in_seq=0 out_seq=0 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f4fee7fc640 1 -- 172.21.15.80:0/419595227 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562ca9bd4710 con 0x562ca987f1f0 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f4fee7fc640 10 client.17319 handle_command_reply: tid=0 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 client.17319 shutdown 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca989f730 msgr2=0x562ca9c6b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca989f730 0x562ca9c6b130 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00a7290 tx=0x7f4ff00a6fa0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 shutdown_connections 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca987f1f0 0x562ca9c7d130 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca989f730 0x562ca9c6b130 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca98c0410 0x562ca9c76e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 --2- 172.21.15.80:0/419595227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c6abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f4fee7fc640 0 client.17319 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 >> 172.21.15.80:0/419595227 conn(0x562ca98b4560 msgr2=0x562ca9c62340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 shutdown_connections 2024-04-25T11:31:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 1 -- 172.21.15.80:0/419595227 wait complete. 2024-04-25T11:31:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.753+0000 7f5014588740 20 client.17319 trim_cache size 0 max 16384 2024-04-25T11:31:52.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.771+0000 7f5014588740 1 Processor -- start 2024-04-25T11:31:52.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.771+0000 7f5014588740 1 -- start start 2024-04-25T11:31:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.771+0000 7f5014588740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca9897550 0x562ca9c69ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.771+0000 7f5014588740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f5014588740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c82e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f5014588740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f50081b23c0 con 0x562ca98c0410 2024-04-25T11:31:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f5014588740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50081afc90 con 0x562ca9897550 2024-04-25T11:31:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f5014588740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f50081adb00 con 0x562ca989f730 2024-04-25T11:31:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c82e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c82e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50792/0 (socket says 172.21.15.80:50792) 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 -- 172.21.15.80:0/2384476934 learned_addr learned my addr 172.21.15.80:0/2384476934 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f5006ffd640 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca9897550 0x562ca9c69ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f4ffffff640 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 -- 172.21.15.80:0/2384476934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 msgr2=0x562ca9c828f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c828f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 -- 172.21.15.80:0/2384476934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca9897550 msgr2=0x562ca9c69ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca9897550 0x562ca9c69ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 -- 172.21.15.80:0/2384476934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca9c64ce0 con 0x562ca98c0410 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f50077fe640 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c82e30 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5000035000 tx=0x7f5000041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6a00b2c101e49e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f4ffcff9640 1 -- 172.21.15.80:0/2384476934 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000316d0 con 0x562ca98c0410 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f4ffcff9640 1 -- 172.21.15.80:0/2384476934 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5000036050 con 0x562ca98c0410 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.772+0000 7f4ffcff9640 1 -- 172.21.15.80:0/2384476934 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000047b0 con 0x562ca98c0410 2024-04-25T11:31:52.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 -- 172.21.15.80:0/2384476934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 msgr2=0x562ca9c82e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c82e30 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5000035000 tx=0x7f5000041000 comp rx=0 tx=0).stop 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 -- 172.21.15.80:0/2384476934 shutdown_connections 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c82e30 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca989f730 0x562ca9c828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 --2- 172.21.15.80:0/2384476934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca9897550 0x562ca9c69ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 -- 172.21.15.80:0/2384476934 >> 172.21.15.80:0/2384476934 conn(0x562ca98b4560 msgr2=0x562ca9c5cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 -- 172.21.15.80:0/2384476934 shutdown_connections 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 -- 172.21.15.80:0/2384476934 wait complete. 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.773+0000 7f5014588740 1 -- start start 2024-04-25T11:31:52.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 1 Processor -- start 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c70ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca989f730 0x562ca9c71000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c71540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f50081ae150 con 0x562ca98c0410 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50081af5c0 con 0x562ca989f730 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f50081ae820 con 0x562ca9897550 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5014588740 10 client.0 _ll_register_callbacks cb 0x7f4ff00a2d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c71540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c71540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50808/0 (socket says 172.21.15.80:50808) 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 -- 172.21.15.80:0/3061542372 learned_addr learned my addr 172.21.15.80:0/3061542372 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f4ffffff640 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca989f730 0x562ca9c71000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f5006ffd640 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c70ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 -- 172.21.15.80:0/3061542372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 msgr2=0x562ca9c70ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c70ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 -- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca989f730 msgr2=0x562ca9c71000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca989f730 0x562ca9c71000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 -- 172.21.15.80:0/3061542372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca9ce4530 con 0x562ca98c0410 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f50077fe640 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c71540 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5000004700 tx=0x7f50000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fe23e17fd480db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.774+0000 7f4fee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f4fee7fc640 1 -- 172.21.15.80:0/3061542372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500004b070 con 0x562ca98c0410 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f4fee7fc640 1 -- 172.21.15.80:0/3061542372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f500004e040 con 0x562ca98c0410 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5000036050 con 0x562ca98c0410 2024-04-25T11:31:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f4fee7fc640 1 -- 172.21.15.80:0/3061542372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5000003b80 con 0x562ca98c0410 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 10 client.17325 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ca9ce57d0 con 0x562ca98c0410 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f4fee7fc640 1 -- 172.21.15.80:0/3061542372 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5000036050 con 0x562ca98c0410 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f4fee7fc640 1 -- 172.21.15.80:0/3061542372 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5000030630 con 0x562ca98c0410 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 10 client.17325 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 20 client.17325 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca9854630 0x562ca9ce7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 4 client.17325 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562ca9bce580 con 0x562ca9854630 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.775+0000 7f5006ffd640 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca9854630 0x562ca9ce7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.776+0000 7f4fee7fc640 10 client.17325 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.776+0000 7f5006ffd640 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca9854630 0x562ca9ce7f20 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94c1574d6f924908 server_cookie=fbd3c628a9a2174d in_seq=0 out_seq=0 2024-04-25T11:31:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f4fee7fc640 1 -- 172.21.15.80:0/3061542372 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562ca9bce580 con 0x562ca9854630 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f4fee7fc640 10 client.17325 handle_command_reply: tid=0 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 client.17325 shutdown 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 msgr2=0x562ca9c71540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c71540 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5000004700 tx=0x7f50000095c0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 shutdown_connections 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x562ca9854630 0x562ca9ce7f20 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562ca98c0410 0x562ca9c71540 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562ca989f730 0x562ca9c71000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 --2- 172.21.15.80:0/3061542372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ca9897550 0x562ca9c70ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 >> 172.21.15.80:0/3061542372 conn(0x562ca98b4560 msgr2=0x562ca9c5cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f4fee7fc640 0 client.17325 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 shutdown_connections 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 1 -- 172.21.15.80:0/3061542372 wait complete. 2024-04-25T11:31:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.777+0000 7f5014588740 20 client.17325 trim_cache size 0 max 16384 2024-04-25T11:31:52.772 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:52.772 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:31:52.772 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "ec15690d-83b1-4b99-9dfe-e8bb3b0e37c7", 2024-04-25T11:31:52.772 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:31:52.772 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ff40afce0 msgr2=0x7f4ff40b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ff40afce0 0x7f4ff40b21f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x562ca9c5d790 tx=0x7f500003f040 comp rx=0 tx=0).stop 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5008108a20 msgr2=0x7f500819b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5008108a20 0x7f500819b9e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000e9f0 tx=0x7f4ff000eeb0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 shutdown_connections 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ff40afce0 0x7f4ff40b21f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5008108a20 0x7f500819b9e0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500810d380 0x7f50081a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 --2- 172.21.15.80:0/1878085140 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5008102af0 0x7f500819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 >> 172.21.15.80:0/1878085140 conn(0x7f5008078100 msgr2=0x7f50081040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 shutdown_connections 2024-04-25T11:31:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.778+0000 7f500d6d8640 1 -- 172.21.15.80:0/1878085140 wait complete. 2024-04-25T11:31:52.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:31:52.778 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:31:52.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 -- 172.21.15.80:0/3256478654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874102af0 msgr2=0x7f8874102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 --2- 172.21.15.80:0/3256478654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874102af0 0x7f8874102f00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8864009900 tx=0x7f886402a410 comp rx=0 tx=0).stop 2024-04-25T11:31:52.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 -- 172.21.15.80:0/3256478654 shutdown_connections 2024-04-25T11:31:52.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 --2- 172.21.15.80:0/3256478654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874102af0 0x7f8874102f00 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 --2- 172.21.15.80:0/3256478654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f887410d380 0x7f887410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 --2- 172.21.15.80:0/3256478654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8874108a20 0x7f88741025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 -- 172.21.15.80:0/3256478654 >> 172.21.15.80:0/3256478654 conn(0x7f8874078100 msgr2=0x7f8874078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 -- 172.21.15.80:0/3256478654 shutdown_connections 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.940+0000 7f887a70e640 1 -- 172.21.15.80:0/3256478654 wait complete. 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 Processor -- start 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 -- start start 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874102af0 0x7f887419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874108a20 0x7f887419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f887410d380 0x7f887419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8874112be0 con 0x7f8874108a20 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8874112a60 con 0x7f887410d380 2024-04-25T11:31:52.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f887a70e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8874112d60 con 0x7f8874102af0 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f88737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874108a20 0x7f887419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f88737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874108a20 0x7f887419bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50826/0 (socket says 172.21.15.80:50826) 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f88737fe640 1 -- 172.21.15.80:0/2192290696 learned_addr learned my addr 172.21.15.80:0/2192290696 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f8873fff640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874102af0 0x7f887419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f8878cab640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f887410d380 0x7f887419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f88737fe640 1 -- 172.21.15.80:0/2192290696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874102af0 msgr2=0x7f887419b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f88737fe640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874102af0 0x7f887419b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f88737fe640 1 -- 172.21.15.80:0/2192290696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f887410d380 msgr2=0x7f887419c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.941+0000 7f88737fe640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f887410d380 0x7f887419c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f88737fe640 1 -- 172.21.15.80:0/2192290696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88741a68c0 con 0x7f8874108a20 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f8873fff640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874102af0 0x7f887419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f88737fe640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874108a20 0x7f887419bac0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f886402a930 tx=0x7f8864004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f88717fa640 1 -- 172.21.15.80:0/2192290696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886403f030 con 0x7f8874108a20 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f88717fa640 1 -- 172.21.15.80:0/2192290696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8864003aa0 con 0x7f8874108a20 2024-04-25T11:31:52.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88741a6b50 con 0x7f8874108a20 2024-04-25T11:31:52.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f88717fa640 1 -- 172.21.15.80:0/2192290696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864035070 con 0x7f8874108a20 2024-04-25T11:31:52.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.942+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88741a7040 con 0x7f8874108a20 2024-04-25T11:31:52.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.944+0000 7f88815bd740 1 Processor -- start 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.944+0000 7f88717fa640 1 -- 172.21.15.80:0/2192290696 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f8864042030 con 0x7f8874108a20 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.944+0000 7f88815bd740 1 -- start start 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88815bd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267ec390 0x557426b8ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88815bd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b8cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88815bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267cb6b0 0x557426b998f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88815bd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557426af2d80 con 0x5574267c34d0 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88815bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557426aac8b0 con 0x5574267cb6b0 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88815bd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557426aeed40 con 0x5574267ec390 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b8cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b8cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50828/0 (socket says 172.21.15.80:50828) 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 -- 172.21.15.80:0/4257353328 learned_addr learned my addr 172.21.15.80:0/4257353328 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8878cab640 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267ec390 0x557426b8ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88737fe640 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267cb6b0 0x557426b998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88717fa640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f885c0afc60 0x7f885c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 -- 172.21.15.80:0/4257353328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267ec390 msgr2=0x557426b8ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267ec390 0x557426b8ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 -- 172.21.15.80:0/4257353328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267cb6b0 msgr2=0x557426b998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267cb6b0 0x557426b998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 -- 172.21.15.80:0/4257353328 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557426a7da40 con 0x5574267c34d0 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88737fe640 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267cb6b0 0x557426b998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8878cab640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f885c0afc60 0x7f885c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f8873fff640 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b8cfa0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f886800bd30 tx=0x7f886800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d7fa84d7a182f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f88717fa640 1 -- 172.21.15.80:0/2192290696 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f88640ff810 con 0x7f8874108a20 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f885a7fc640 1 -- 172.21.15.80:0/4257353328 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868015070 con 0x5574267c34d0 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f885a7fc640 1 -- 172.21.15.80:0/4257353328 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f886800be20 con 0x5574267c34d0 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.945+0000 7f885a7fc640 1 -- 172.21.15.80:0/4257353328 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680119d0 con 0x5574267c34d0 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 -- 172.21.15.80:0/4257353328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 msgr2=0x557426b8cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b8cfa0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f886800bd30 tx=0x7f886800f730 comp rx=0 tx=0).stop 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f8878cab640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f885c0afc60 0x7f885c0b2170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x557426b89bd0 tx=0x7f886c004a40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 -- 172.21.15.80:0/4257353328 shutdown_connections 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b8cfa0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267cb6b0 0x557426b998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 --2- 172.21.15.80:0/4257353328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267ec390 0x557426b8ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 -- 172.21.15.80:0/4257353328 >> 172.21.15.80:0/4257353328 conn(0x5574267e04e0 msgr2=0x557426b89210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 -- 172.21.15.80:0/4257353328 shutdown_connections 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.946+0000 7f88815bd740 1 -- 172.21.15.80:0/4257353328 wait complete. 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 -- start start 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 Processor -- start 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b97640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426b97b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b9d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557426b99fe0 con 0x5574267c34d0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557426a79d10 con 0x5574267ec390 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557426b9a160 con 0x5574267cb6b0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f88815bd740 10 client.0 _ll_register_callbacks cb 0x557426aa6210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f8873fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b97640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f8873fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b97640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50842/0 (socket says 172.21.15.80:50842) 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f8873fff640 1 -- 172.21.15.80:0/2269233948 learned_addr learned my addr 172.21.15.80:0/2269233948 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.947+0000 7f8878cab640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b9d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88737fe640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426b97b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f8873fff640 1 -- 172.21.15.80:0/2269233948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 msgr2=0x557426b97b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f8873fff640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426b97b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f8873fff640 1 -- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 msgr2=0x557426b9d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f8873fff640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b9d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f8873fff640 1 -- 172.21.15.80:0/2269233948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574268ce7d0 con 0x5574267c34d0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f8878cab640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b9d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f8873fff640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b97640 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f88680116b0 tx=0x7f886800ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ca83e29c07abe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88537fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88537fe640 1 -- 172.21.15.80:0/2269233948 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868015040 con 0x5574267c34d0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88537fe640 1 -- 172.21.15.80:0/2269233948 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f8868011750 con 0x5574267c34d0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f886800be20 con 0x5574267c34d0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88537fe640 1 -- 172.21.15.80:0/2269233948 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8868030050 con 0x5574267c34d0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88815bd740 10 client.17337 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5574268043f0 con 0x5574267c34d0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.948+0000 7f88537fe640 1 -- 172.21.15.80:0/2269233948 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f886800be20 con 0x5574267c34d0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88537fe640 1 -- 172.21.15.80:0/2269233948 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f886802b030 con 0x5574267c34d0 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88815bd740 10 client.17337 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88815bd740 10 client.17337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88815bd740 20 client.17337 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88815bd740 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267aaf60 0x557426ba95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88815bd740 4 client.17337 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:52.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557426b00990 con 0x5574267aaf60 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88737fe640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267aaf60 0x557426ba95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88537fe640 10 client.17337 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.949+0000 7f88737fe640 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267aaf60 0x557426ba95b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=604431a0b91d24e2 server_cookie=192fece2ce12fe1b in_seq=0 out_seq=0 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88537fe640 1 -- 172.21.15.80:0/2269233948 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557426b00990 con 0x5574267aaf60 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88537fe640 10 client.17337 handle_command_reply: tid=0 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 client.17337 shutdown 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 msgr2=0x557426b97640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b97640 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f88680116b0 tx=0x7f886800ba70 comp rx=0 tx=0).stop 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 shutdown_connections 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267aaf60 0x557426ba95b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b9d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88537fe640 0 client.17337 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426b97b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 --2- 172.21.15.80:0/2269233948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267c34d0 0x557426b97640 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 >> 172.21.15.80:0/2269233948 conn(0x5574267e04e0 msgr2=0x557426b8e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 shutdown_connections 2024-04-25T11:31:52.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 1 -- 172.21.15.80:0/2269233948 wait complete. 2024-04-25T11:31:52.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.950+0000 7f88815bd740 20 client.17337 trim_cache size 0 max 16384 2024-04-25T11:31:52.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 Processor -- start 2024-04-25T11:31:52.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 -- start start 2024-04-25T11:31:52.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267c34d0 0x557426b95f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267cb6b0 0x557426b8ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88741b2420 con 0x5574267cb6b0 2024-04-25T11:31:52.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88741afcf0 con 0x5574267ec390 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88815bd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88741adb60 con 0x5574267c34d0 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267cb6b0 0x557426b8ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88737fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267cb6b0 0x557426b8ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50848/0 (socket says 172.21.15.80:50848) 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.968+0000 7f88737fe640 1 -- 172.21.15.80:0/1843387201 learned_addr learned my addr 172.21.15.80:0/1843387201 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f8878cab640 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f88737fe640 1 -- 172.21.15.80:0/1843387201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267c34d0 msgr2=0x557426b95f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f8873fff640 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267c34d0 0x557426b95f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f88737fe640 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267c34d0 0x557426b95f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f88737fe640 1 -- 172.21.15.80:0/1843387201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 msgr2=0x557426b973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f88737fe640 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f88737fe640 1 -- 172.21.15.80:0/1843387201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574267c40f0 con 0x5574267cb6b0 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f8873fff640 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267c34d0 0x557426b95f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:52.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f8878cab640 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f88737fe640 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267cb6b0 0x557426b8ce60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f88640c3a10 tx=0x7f886403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a71a7ebcdcab82f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f8859ffb640 1 -- 172.21.15.80:0/1843387201 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864049040 con 0x5574267cb6b0 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f8859ffb640 1 -- 172.21.15.80:0/1843387201 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88640c8090 con 0x5574267cb6b0 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.969+0000 7f8859ffb640 1 -- 172.21.15.80:0/1843387201 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864003c50 con 0x5574267cb6b0 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 -- 172.21.15.80:0/1843387201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267cb6b0 msgr2=0x557426b8ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267cb6b0 0x557426b8ce60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f88640c3a10 tx=0x7f886403b6b0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 -- 172.21.15.80:0/1843387201 shutdown_connections 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267cb6b0 0x557426b8ce60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267ec390 0x557426b973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 --2- 172.21.15.80:0/1843387201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267c34d0 0x557426b95f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 -- 172.21.15.80:0/1843387201 >> 172.21.15.80:0/1843387201 conn(0x5574267e04e0 msgr2=0x557426b96cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 -- 172.21.15.80:0/1843387201 shutdown_connections 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 -- 172.21.15.80:0/1843387201 wait complete. 2024-04-25T11:31:52.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 -- start start 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.970+0000 7f88815bd740 1 Processor -- start 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267c34d0 0x557426ba0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426ba0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267ec390 0x557426ba0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f88741ae1b0 con 0x5574267ec390 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88741af620 con 0x5574267c34d0 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88741ae880 con 0x5574267cb6b0 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 10 client.0 _ll_register_callbacks cb 0x7f886c008430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267ec390 0x557426ba0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267ec390 0x557426ba0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50860/0 (socket says 172.21.15.80:50860) 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 -- 172.21.15.80:0/3548863242 learned_addr learned my addr 172.21.15.80:0/3548863242 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8873fff640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267c34d0 0x557426ba0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88737fe640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426ba0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 -- 172.21.15.80:0/3548863242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 msgr2=0x557426ba0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426ba0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 -- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267c34d0 msgr2=0x557426ba0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267c34d0 0x557426ba0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 -- 172.21.15.80:0/3548863242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557426ab34b0 con 0x5574267ec390 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8873fff640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267c34d0 0x557426ba0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f8878cab640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267ec390 0x557426ba0ad0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f886c01fe90 tx=0x7f886c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac5062f2f1e85c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88537fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88537fe640 1 -- 172.21.15.80:0/3548863242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c012e60 con 0x5574267ec390 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88537fe640 1 -- 172.21.15.80:0/3548863242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f886c01f240 con 0x5574267ec390 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.971+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88640c8090 con 0x5574267ec390 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88537fe640 1 -- 172.21.15.80:0/3548863242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f886c01e450 con 0x5574267ec390 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 10 client.17343 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:52.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557426c10990 con 0x5574267ec390 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88537fe640 1 -- 172.21.15.80:0/3548863242 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88640c8090 con 0x5574267ec390 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88537fe640 1 -- 172.21.15.80:0/3548863242 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f886c032800 con 0x5574267ec390 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 10 client.17343 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 20 client.17343 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267803a0 0x557426c13130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 4 client.17343 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557426afa800 con 0x5574267803a0 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.972+0000 7f8873fff640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267803a0 0x557426c13130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88537fe640 10 client.17343 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f8873fff640 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267803a0 0x557426c13130 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a03e3a0a29ca2e2 server_cookie=46713d07cef7c985 in_seq=0 out_seq=0 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88537fe640 1 -- 172.21.15.80:0/3548863242 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557426afa800 con 0x5574267803a0 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88537fe640 10 client.17343 handle_command_reply: tid=0 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 client.17343 shutdown 2024-04-25T11:31:52.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267ec390 msgr2=0x557426ba0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267ec390 0x557426ba0ad0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f886c01fe90 tx=0x7f886c004ab0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 shutdown_connections 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5574267803a0 0x557426c13130 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5574267ec390 0x557426ba0ad0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88537fe640 0 client.17343 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5574267cb6b0 0x557426ba0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 --2- 172.21.15.80:0/3548863242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574267c34d0 0x557426ba0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 >> 172.21.15.80:0/3548863242 conn(0x5574267e04e0 msgr2=0x557426b976f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 shutdown_connections 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 1 -- 172.21.15.80:0/3548863242 wait complete. 2024-04-25T11:31:52.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.973+0000 7f88815bd740 20 client.17343 trim_cache size 0 max 16384 2024-04-25T11:31:52.970 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:52.970 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:31:52.970 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:31:52.970 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f885c0afc60 msgr2=0x7f885c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f885c0afc60 0x7f885c0b2170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x557426b89bd0 tx=0x7f886c004a40 comp rx=0 tx=0).stop 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874108a20 msgr2=0x7f887419bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874108a20 0x7f887419bac0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f886402a930 tx=0x7f8864004270 comp rx=0 tx=0).stop 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 shutdown_connections 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f885c0afc60 0x7f885c0b2170 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8874108a20 0x7f887419bac0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f887410d380 0x7f887419c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 --2- 172.21.15.80:0/2192290696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874102af0 0x7f887419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:52.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 >> 172.21.15.80:0/2192290696 conn(0x7f8874078100 msgr2=0x7f88741040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:52.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 shutdown_connections 2024-04-25T11:31:52.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:52.974+0000 7f887a70e640 1 -- 172.21.15.80:0/2192290696 wait complete. 2024-04-25T11:31:52.974 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:31:52.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:31:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 -- 172.21.15.80:0/2188117039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 msgr2=0x7f33a4102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/2188117039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a4102b60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009900 tx=0x7f33a002a410 comp rx=0 tx=0).stop 2024-04-25T11:31:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 -- 172.21.15.80:0/2188117039 shutdown_connections 2024-04-25T11:31:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/2188117039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a4102b60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/2188117039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33a41031d0 0x7f33a410f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/2188117039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4108a20 0x7f33a4102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 -- 172.21.15.80:0/2188117039 >> 172.21.15.80:0/2188117039 conn(0x7f33a4078180 msgr2=0x7f33a40785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 -- 172.21.15.80:0/2188117039 shutdown_connections 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 -- 172.21.15.80:0/2188117039 wait complete. 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.092+0000 7f33ab6b6640 1 Processor -- start 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33ab6b6640 1 -- start start 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33ab6b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a41031d0 0x7f33a4199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33ab6b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33a4108a20 0x7f33a4199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33ab6b6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a419de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33ab6b6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4112c40 con 0x7f33a4108ec0 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33ab6b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4112ac0 con 0x7f33a41031d0 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33ab6b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4112dc0 con 0x7f33a4108a20 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a419de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a419de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50878/0 (socket says 172.21.15.80:50878) 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 -- 172.21.15.80:0/4171226169 learned_addr learned my addr 172.21.15.80:0/4171226169 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a8c51640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33a4108a20 0x7f33a4199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9452640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a41031d0 0x7f33a4199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 -- 172.21.15.80:0/4171226169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33a4108a20 msgr2=0x7f33a4199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33a4108a20 0x7f33a4199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 -- 172.21.15.80:0/4171226169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a41031d0 msgr2=0x7f33a4199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a41031d0 0x7f33a4199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 -- 172.21.15.80:0/4171226169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a419e4a0 con 0x7f33a4108ec0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.093+0000 7f33a9c53640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a419de60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f339c00eb10 tx=0x7f339c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.094+0000 7f339a7fc640 1 -- 172.21.15.80:0/4171226169 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c004b20 con 0x7f33a4108ec0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.094+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a419e790 con 0x7f33a4108ec0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.094+0000 7f339a7fc640 1 -- 172.21.15.80:0/4171226169 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f339c004cc0 con 0x7f33a4108ec0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.094+0000 7f339a7fc640 1 -- 172.21.15.80:0/4171226169 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c010690 con 0x7f33a4108ec0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.094+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a41a6110 con 0x7f33a4108ec0 2024-04-25T11:31:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.095+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a406a190 con 0x7f33a4108ec0 2024-04-25T11:31:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.096+0000 7f339a7fc640 1 -- 172.21.15.80:0/4171226169 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f339c005000 con 0x7f33a4108ec0 2024-04-25T11:31:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.097+0000 7f339a7fc640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33900afc60 0x7f33900b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.097+0000 7f33a9452640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33900afc60 0x7f33900b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.097+0000 7f339a7fc640 1 -- 172.21.15.80:0/4171226169 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f339c0df870 con 0x7f33a4108ec0 2024-04-25T11:31:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.097+0000 7f33a9452640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33900afc60 0x7f33900b2170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3394005fd0 tx=0x7f3394005850 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.101+0000 7f339a7fc640 1 -- 172.21.15.80:0/4171226169 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f339c053ff0 con 0x7f33a4108ec0 2024-04-25T11:31:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.317+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33a419a990 con 0x7f33a4108ec0 2024-04-25T11:31:53.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.318+0000 7f339a7fc640 1 -- 172.21.15.80:0/4171226169 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f339c0a80f0 con 0x7f33a4108ec0 2024-04-25T11:31:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:31:53.307 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:31:53.307 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33900afc60 msgr2=0x7f33900b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33900afc60 0x7f33900b2170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3394005fd0 tx=0x7f3394005850 comp rx=0 tx=0).stop 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 msgr2=0x7f33a419de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a419de60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f339c00eb10 tx=0x7f339c00c2d0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 shutdown_connections 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f33900afc60 0x7f33900b2170 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33a4108ec0 0x7f33a419de60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33a4108a20 0x7f33a4199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 --2- 172.21.15.80:0/4171226169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a41031d0 0x7f33a4199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 >> 172.21.15.80:0/4171226169 conn(0x7f33a4078180 msgr2=0x7f33a4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 shutdown_connections 2024-04-25T11:31:53.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.320+0000 7f33ab6b6640 1 -- 172.21.15.80:0/4171226169 wait complete. 2024-04-25T11:31:53.320 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:31:53.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 -- 172.21.15.80:0/3582734072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc108a20 msgr2=0x7f8bdc1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 --2- 172.21.15.80:0/3582734072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc108a20 0x7f8bdc1025d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009ca0 tx=0x7f8bcc02a8e0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 -- 172.21.15.80:0/3582734072 shutdown_connections 2024-04-25T11:31:53.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 --2- 172.21.15.80:0/3582734072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bdc103180 0x7f8bdc10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 --2- 172.21.15.80:0/3582734072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bdc108ec0 0x7f8bdc102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 --2- 172.21.15.80:0/3582734072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc108a20 0x7f8bdc1025d0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 -- 172.21.15.80:0/3582734072 >> 172.21.15.80:0/3582734072 conn(0x7f8bdc078110 msgr2=0x7f8bdc078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 -- 172.21.15.80:0/3582734072 shutdown_connections 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 -- 172.21.15.80:0/3582734072 wait complete. 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.440+0000 7f8be371f640 1 Processor -- start 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be371f640 1 -- start start 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be371f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc103180 0x7f8bdc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be371f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bdc108a20 0x7f8bdc19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be371f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bdc108ec0 0x7f8bdc19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be371f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc113d80 con 0x7f8bdc103180 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be371f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc113c00 con 0x7f8bdc108a20 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be371f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc113f00 con 0x7f8bdc108ec0 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc103180 0x7f8bdc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc103180 0x7f8bdc19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50906/0 (socket says 172.21.15.80:50906) 2024-04-25T11:31:53.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 -- 172.21.15.80:0/3223426279 learned_addr learned my addr 172.21.15.80:0/3223426279 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bdc108ec0 0x7f8bdc19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be0cba640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bdc108a20 0x7f8bdc19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 -- 172.21.15.80:0/3223426279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bdc108ec0 msgr2=0x7f8bdc19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bdc108ec0 0x7f8bdc19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 -- 172.21.15.80:0/3223426279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bdc108a20 msgr2=0x7f8bdc19ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bdc108a20 0x7f8bdc19ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 -- 172.21.15.80:0/3223426279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc19f5c0 con 0x7f8bdc103180 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.441+0000 7f8be14bb640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc103180 0x7f8bdc19a7e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc003ba0 tx=0x7f8bcc003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.442+0000 7f8bda7fc640 1 -- 172.21.15.80:0/3223426279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc004240 con 0x7f8bdc103180 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.442+0000 7f8bda7fc640 1 -- 172.21.15.80:0/3223426279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bcc003e30 con 0x7f8bdc103180 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.442+0000 7f8bda7fc640 1 -- 172.21.15.80:0/3223426279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc030ec0 con 0x7f8bdc103180 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.442+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc19f850 con 0x7f8bdc103180 2024-04-25T11:31:53.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.442+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bdc19fe20 con 0x7f8bdc103180 2024-04-25T11:31:53.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bda7fc640 1 -- 172.21.15.80:0/3223426279 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f8bcc0305e0 con 0x7f8bdc103180 2024-04-25T11:31:53.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 Processor -- start 2024-04-25T11:31:53.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 -- start start 2024-04-25T11:31:53.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe115810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe115d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe1226a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564bbe07ad80 con 0x564bbdd536b0 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564bbe034a20 con 0x564bbdd4b4d0 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.444+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564bbe076d40 con 0x564bbdd74390 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe1226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe1226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50914/0 (socket says 172.21.15.80:50914) 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 -- 172.21.15.80:0/659073393 learned_addr learned my addr 172.21.15.80:0/659073393 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8bda7fc640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bc40afe00 0x7f8bc40b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be14bb640 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bc40afe00 0x7f8bc40b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 -- 172.21.15.80:0/659073393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 msgr2=0x564bbe115810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe115810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 -- 172.21.15.80:0/659073393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 msgr2=0x564bbe115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 -- 172.21.15.80:0/659073393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bbe03fc30 con 0x564bbdd536b0 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be14bb640 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8bda7fc640 1 -- 172.21.15.80:0/3223426279 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f8bcc100460 con 0x7f8bdc103180 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be0cba640 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe1226a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b790 tx=0x7f8bd000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314164adb36c9879 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bc40afe00 0x7f8bc40b2310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x564bbe112980 tx=0x7f8bd40046c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8bc37fe640 1 -- 172.21.15.80:0/659073393 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000d950 con 0x564bbdd536b0 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8bc37fe640 1 -- 172.21.15.80:0/659073393 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd0018070 con 0x564bbdd536b0 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.445+0000 7f8bc37fe640 1 -- 172.21.15.80:0/659073393 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00123e0 con 0x564bbdd536b0 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 -- 172.21.15.80:0/659073393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 msgr2=0x564bbe1226a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe1226a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b790 tx=0x7f8bd000bc50 comp rx=0 tx=0).stop 2024-04-25T11:31:53.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 -- 172.21.15.80:0/659073393 shutdown_connections 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe1226a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/659073393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 -- 172.21.15.80:0/659073393 >> 172.21.15.80:0/659073393 conn(0x564bbdd684e0 msgr2=0x564bbe111fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 -- 172.21.15.80:0/659073393 shutdown_connections 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.446+0000 7f8bea5d3740 1 -- 172.21.15.80:0/659073393 wait complete. 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 -- start start 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 Processor -- start 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd4b4d0 0x564bbe1202a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd536b0 0x564bbe1207e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd74390 0x564bbe12c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564bbe122d90 con 0x564bbdd4b4d0 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564bbe001dc0 con 0x564bbdd74390 2024-04-25T11:31:53.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564bbe122f10 con 0x564bbdd536b0 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8bea5d3740 10 client.0 _ll_register_callbacks cb 0x564bbe01d600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8be14bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd4b4d0 0x564bbe1202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8be14bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd4b4d0 0x564bbe1202a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50928/0 (socket says 172.21.15.80:50928) 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8be14bb640 1 -- 172.21.15.80:0/1481575064 learned_addr learned my addr 172.21.15.80:0/1481575064 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.447+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd74390 0x564bbe12c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be0cba640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd536b0 0x564bbe1207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be14bb640 1 -- 172.21.15.80:0/1481575064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd536b0 msgr2=0x564bbe1207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be14bb640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd536b0 0x564bbe1207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be14bb640 1 -- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd74390 msgr2=0x564bbe12c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be14bb640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd74390 0x564bbe12c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be14bb640 1 -- 172.21.15.80:0/1481575064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bbdd8c3f0 con 0x564bbdd4b4d0 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be0cba640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd536b0 0x564bbe1207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8be14bb640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd4b4d0 0x564bbe1202a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0c5960 tx=0x7f8bcc0c8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539e003c85cc635b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1481575064 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0098d0 con 0x564bbdd4b4d0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1481575064 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f8bcc0d10c0 con 0x564bbdd4b4d0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd0018070 con 0x564bbdd4b4d0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1481575064 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8bcc0c8200 con 0x564bbdd4b4d0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 10 client.17361 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564bbde567d0 con 0x564bbdd4b4d0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1481575064 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd0018070 con 0x564bbdd4b4d0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1481575064 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8bcc0c7950 con 0x564bbdd4b4d0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 10 client.17361 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 10 client.17361 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 20 client.17361 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd32f60 0x564bbe1325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 4 client.17361 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.448+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bbe088990 con 0x564bbdd32f60 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.449+0000 7f8be0cba640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd32f60 0x564bbe1325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.449+0000 7f8bc0ff9640 10 client.17361 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.449+0000 7f8be0cba640 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd32f60 0x564bbe1325f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e08cf6d70b1c115 server_cookie=2a440a4688edba88 in_seq=0 out_seq=0 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1481575064 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564bbe088990 con 0x564bbdd32f60 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bc0ff9640 10 client.17361 handle_command_reply: tid=0 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 client.17361 shutdown 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd4b4d0 msgr2=0x564bbe1202a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd4b4d0 0x564bbe1202a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0c5960 tx=0x7f8bcc0c8040 comp rx=0 tx=0).stop 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 shutdown_connections 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd32f60 0x564bbe1325f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd74390 0x564bbe12c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd536b0 0x564bbe1207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bc0ff9640 0 client.17361 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1481575064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd4b4d0 0x564bbe1202a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 >> 172.21.15.80:0/1481575064 conn(0x564bbdd684e0 msgr2=0x564bbe117530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 shutdown_connections 2024-04-25T11:31:53.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1481575064 wait complete. 2024-04-25T11:31:53.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.450+0000 7f8bea5d3740 20 client.17361 trim_cache size 0 max 16384 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 Processor -- start 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 -- start start 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe12be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe117be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe137d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc1b2330 con 0x564bbdd536b0 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc1afc00 con 0x564bbdd4b4d0 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc1ada70 con 0x564bbdd74390 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe117be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50930/0 (socket says 172.21.15.80:50930) 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 -- 172.21.15.80:0/3794555907 learned_addr learned my addr 172.21.15.80:0/3794555907 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe137d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be14bb640 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe12be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 -- 172.21.15.80:0/3794555907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 msgr2=0x564bbe137d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe137d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 -- 172.21.15.80:0/3794555907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 msgr2=0x564bbe12be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe12be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.464+0000 7f8be0cba640 1 -- 172.21.15.80:0/3794555907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bbe120fb0 con 0x564bbdd536b0 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.465+0000 7f8be14bb640 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe12be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.465+0000 7f8be0cba640 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe117be0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b790 tx=0x7f8bd000f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fe1e16c6dd3c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.465+0000 7f8bc2ffd640 1 -- 172.21.15.80:0/3794555907 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0029070 con 0x564bbdd536b0 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.465+0000 7f8bc2ffd640 1 -- 172.21.15.80:0/3794555907 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd0021030 con 0x564bbdd536b0 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.465+0000 7f8bc2ffd640 1 -- 172.21.15.80:0/3794555907 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00249b0 con 0x564bbdd536b0 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- 172.21.15.80:0/3794555907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 msgr2=0x564bbe117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe117be0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b790 tx=0x7f8bd000f040 comp rx=0 tx=0).stop 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- 172.21.15.80:0/3794555907 shutdown_connections 2024-04-25T11:31:53.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd536b0 0x564bbe117be0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd74390 0x564bbe137d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/3794555907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd4b4d0 0x564bbe12be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- 172.21.15.80:0/3794555907 >> 172.21.15.80:0/3794555907 conn(0x564bbdd684e0 msgr2=0x564bbe1174d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- 172.21.15.80:0/3794555907 shutdown_connections 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- 172.21.15.80:0/3794555907 wait complete. 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- start start 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 Processor -- start 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd4b4d0 0x564bbe128800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd536b0 0x564bbe123b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd74390 0x564bbe1240d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc1ae0c0 con 0x564bbdd74390 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc1af530 con 0x564bbdd536b0 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc1ae790 con 0x564bbdd4b4d0 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.466+0000 7f8bea5d3740 10 client.0 _ll_register_callbacks cb 0x7f8bcc009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd74390 0x564bbe1240d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd74390 0x564bbe1240d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50934/0 (socket says 172.21.15.80:50934) 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 -- 172.21.15.80:0/1397923730 learned_addr learned my addr 172.21.15.80:0/1397923730 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be14bb640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd4b4d0 0x564bbe128800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be0cba640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd536b0 0x564bbe123b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 -- 172.21.15.80:0/1397923730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd4b4d0 msgr2=0x564bbe128800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd4b4d0 0x564bbe128800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 -- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd536b0 msgr2=0x564bbe123b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd536b0 0x564bbe123b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 -- 172.21.15.80:0/1397923730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bbe124860 con 0x564bbdd74390 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be0cba640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd536b0 0x564bbe123b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8be1cbc640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd74390 0x564bbe1240d0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4010f50 tx=0x7f8bd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771046c7bef1626 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1397923730 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400f690 con 0x564bbdd74390 2024-04-25T11:31:53.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1397923730 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f8bd400f830 con 0x564bbdd74390 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd0021030 con 0x564bbdd74390 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1397923730 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8bd400fa30 con 0x564bbdd74390 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bea5d3740 10 client.17367 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564bbe19a830 con 0x564bbdd74390 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.467+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1397923730 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd0021030 con 0x564bbdd74390 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1397923730 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8bd4026070 con 0x564bbdd74390 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bea5d3740 10 client.17367 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bea5d3740 10 client.17367 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bea5d3740 20 client.17367 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd083a0 0x564bbe19d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bea5d3740 4 client.17367 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564bbe082800 con 0x564bbdd083a0 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8be14bb640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd083a0 0x564bbe19d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8bc0ff9640 10 client.17367 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.468+0000 7f8be14bb640 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd083a0 0x564bbe19d070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f472b7d95d413e40 server_cookie=13a0eeaa86a69292 in_seq=0 out_seq=0 2024-04-25T11:31:53.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bc0ff9640 1 -- 172.21.15.80:0/1397923730 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564bbe082800 con 0x564bbdd083a0 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bc0ff9640 10 client.17367 handle_command_reply: tid=0 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 client.17367 shutdown 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd74390 msgr2=0x564bbe1240d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd74390 0x564bbe1240d0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4010f50 tx=0x7f8bd4004730 comp rx=0 tx=0).stop 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 shutdown_connections 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x564bbdd083a0 0x564bbe19d070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564bbdd74390 0x564bbe1240d0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bc0ff9640 0 client.17367 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bbdd536b0 0x564bbe123b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 --2- 172.21.15.80:0/1397923730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564bbdd4b4d0 0x564bbe128800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 >> 172.21.15.80:0/1397923730 conn(0x564bbdd684e0 msgr2=0x564bbe110610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 shutdown_connections 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 1 -- 172.21.15.80:0/1397923730 wait complete. 2024-04-25T11:31:53.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8bea5d3740 20 client.17367 trim_cache size 0 max 16384 2024-04-25T11:31:53.465 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bc40afe00 msgr2=0x7f8bc40b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bc40afe00 0x7f8bc40b2310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x564bbe112980 tx=0x7f8bd40046c0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc103180 msgr2=0x7f8bdc19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc103180 0x7f8bdc19a7e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc003ba0 tx=0x7f8bcc003bd0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 shutdown_connections 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f8bc40afe00 0x7f8bc40b2310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bdc108ec0 0x7f8bdc19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bdc108a20 0x7f8bdc19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.469+0000 7f8be371f640 1 --2- 172.21.15.80:0/3223426279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc103180 0x7f8bdc19a7e0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.470+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 >> 172.21.15.80:0/3223426279 conn(0x7f8bdc078110 msgr2=0x7f8bdc104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.470+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 shutdown_connections 2024-04-25T11:31:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.470+0000 7f8be371f640 1 -- 172.21.15.80:0/3223426279 wait complete. 2024-04-25T11:31:53.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:31:53.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:53 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:31:53.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:53 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:53.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:53 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:31:53.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:53 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:53.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:53 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:31:53.490 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:53 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:31:53.490 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:53 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:53.490 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:53 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:31:53.490 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:53 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:53.490 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:53 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:31:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 -- 172.21.15.80:0/340995367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b010d390 msgr2=0x7f80b010f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/340995367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b010d390 0x7f80b010f7b0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009ca0 tx=0x7f80a802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 -- 172.21.15.80:0/340995367 shutdown_connections 2024-04-25T11:31:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/340995367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b010d390 0x7f80b010f7b0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/340995367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80b0102b00 0x7f80b0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/340995367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80b0108a30 0x7f80b01025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 -- 172.21.15.80:0/340995367 >> 172.21.15.80:0/340995367 conn(0x7f80b00fe260 msgr2=0x7f80b0100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 -- 172.21.15.80:0/340995367 shutdown_connections 2024-04-25T11:31:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.590+0000 7f80b7cf9640 1 -- 172.21.15.80:0/340995367 wait complete. 2024-04-25T11:31:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 Processor -- start 2024-04-25T11:31:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 -- start start 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80b0102b00 0x7f80b01995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b0108a30 0x7f80b0199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80b010d390 0x7f80b019ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80b0112bf0 con 0x7f80b0108a30 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80b0112a70 con 0x7f80b0102b00 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b7cf9640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f80b0112d70 con 0x7f80b010d390 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b0108a30 0x7f80b0199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b0108a30 0x7f80b0199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50960/0 (socket says 172.21.15.80:50960) 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 -- 172.21.15.80:0/2847948612 learned_addr learned my addr 172.21.15.80:0/2847948612 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5a95640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80b0102b00 0x7f80b01995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b6296640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80b010d390 0x7f80b019ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 -- 172.21.15.80:0/2847948612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80b010d390 msgr2=0x7f80b019ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80b010d390 0x7f80b019ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 -- 172.21.15.80:0/2847948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80b0102b00 msgr2=0x7f80b01995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80b0102b00 0x7f80b01995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5294640 1 -- 172.21.15.80:0/2847948612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b019e390 con 0x7f80b0108a30 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.591+0000 7f80b5a95640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80b0102b00 0x7f80b01995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.592+0000 7f80b5294640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b0108a30 0x7f80b0199b10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f80a400d950 tx=0x7f80a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.592+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2847948612 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4017070 con 0x7f80b0108a30 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.592+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2847948612 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a4009c30 con 0x7f80b0108a30 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.592+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b019e680 con 0x7f80b0108a30 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.592+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2847948612 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4003d10 con 0x7f80b0108a30 2024-04-25T11:31:53.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.592+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b019ebd0 con 0x7f80b0108a30 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.594+0000 7f80bebaa740 1 Processor -- start 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.594+0000 7f80bebaa740 1 -- start start 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2847948612 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f80a4010460 con 0x7f80b0108a30 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb601810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb601d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80bebaa740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5585bb566d80 con 0x5585bb260390 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80bebaa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585bb520a20 con 0x5585bb23f6b0 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80bebaa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5585bb562d40 con 0x5585bb2374d0 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb601810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb601810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50974/0 (socket says 172.21.15.80:50974) 2024-04-25T11:31:53.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 -- 172.21.15.80:0/1021498815 learned_addr learned my addr 172.21.15.80:0/1021498815 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b5294640 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b5a95640 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb601d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 -- 172.21.15.80:0/1021498815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 msgr2=0x5585bb601d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb601d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 -- 172.21.15.80:0/1021498815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 msgr2=0x5585bb60e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.595+0000 7f80b6296640 1 -- 172.21.15.80:0/1021498815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585bb52bc30 con 0x5585bb260390 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.596+0000 7f80a2ffd640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f809c0afc60 0x7f809c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.596+0000 7f80b6296640 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb601810 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f80a802f4d0 tx=0x7f80a8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa396fdc990be1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.596+0000 7f80b5a95640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f809c0afc60 0x7f809c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.596+0000 7f809bfff640 1 -- 172.21.15.80:0/1021498815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8031cf0 con 0x5585bb260390 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.596+0000 7f80a2ffd640 1 -- 172.21.15.80:0/2847948612 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f80a40dee10 con 0x7f80b0108a30 2024-04-25T11:31:53.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.596+0000 7f809bfff640 1 -- 172.21.15.80:0/1021498815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a8036040 con 0x5585bb260390 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.596+0000 7f809bfff640 1 -- 172.21.15.80:0/1021498815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a80042a0 con 0x5585bb260390 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 -- 172.21.15.80:0/1021498815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 msgr2=0x5585bb601810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb601810 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f80a802f4d0 tx=0x7f80a8009800 comp rx=0 tx=0).stop 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80b5a95640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f809c0afc60 0x7f809c0b2170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005fd0 tx=0x7f80ac005f60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 -- 172.21.15.80:0/1021498815 shutdown_connections 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb601d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1021498815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb601810 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 -- 172.21.15.80:0/1021498815 >> 172.21.15.80:0/1021498815 conn(0x5585bb2544e0 msgr2=0x5585bb5fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 -- 172.21.15.80:0/1021498815 shutdown_connections 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 -- 172.21.15.80:0/1021498815 wait complete. 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 -- start start 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.597+0000 7f80bebaa740 1 Processor -- start 2024-04-25T11:31:53.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb60c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6181b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80bebaa740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5585bb60ed30 con 0x5585bb260390 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80bebaa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585bb4eddc0 con 0x5585bb23f6b0 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80bebaa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5585bb60eeb0 con 0x5585bb2374d0 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80bebaa740 10 client.0 _ll_register_callbacks cb 0x5585bb509600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6181b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50982/0 (socket says 172.21.15.80:50982) 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 -- 172.21.15.80:0/1447117119 learned_addr learned my addr 172.21.15.80:0/1447117119 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b5a95640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb60c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b5294640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 -- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 msgr2=0x5585bb60c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb60c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 -- 172.21.15.80:0/1447117119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 msgr2=0x5585bb60c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 -- 172.21.15.80:0/1447117119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585bb2783f0 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b5294640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80b6296640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6181b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009a30 tx=0x7f80a8003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad3be001b709169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80997fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.598+0000 7f80997fa640 1 -- 172.21.15.80:0/1447117119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8052020 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80997fa640 1 -- 172.21.15.80:0/1447117119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f80a8031450 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a8036040 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80997fa640 1 -- 172.21.15.80:0/1447117119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80a805d050 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 10 client.17379 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5585bb3427d0 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80997fa640 1 -- 172.21.15.80:0/1447117119 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a8036040 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80997fa640 1 -- 172.21.15.80:0/1447117119 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f80a804d030 con 0x5585bb260390 2024-04-25T11:31:53.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 10 client.17379 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 10 client.17379 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 20 client.17379 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb21ef60 0x5585bb61e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 4 client.17379 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585bb574990 con 0x5585bb21ef60 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.599+0000 7f80b5a95640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb21ef60 0x5585bb61e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.600+0000 7f80997fa640 10 client.17379 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:53.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.600+0000 7f80b5a95640 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb21ef60 0x5585bb61e4e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfd4feee120b710 server_cookie=d0b1c4facb32c81d in_seq=0 out_seq=0 2024-04-25T11:31:53.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80997fa640 1 -- 172.21.15.80:0/1447117119 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5585bb574990 con 0x5585bb21ef60 2024-04-25T11:31:53.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80997fa640 10 client.17379 handle_command_reply: tid=0 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 client.17379 shutdown 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 msgr2=0x5585bb6181b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6181b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009a30 tx=0x7f80a8003b00 comp rx=0 tx=0).stop 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 shutdown_connections 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6181b0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb21ef60 0x5585bb61e4e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb60c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1447117119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb2374d0 0x5585bb60c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80997fa640 0 client.17379 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 >> 172.21.15.80:0/1447117119 conn(0x5585bb2544e0 msgr2=0x5585bb603530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 shutdown_connections 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 1 -- 172.21.15.80:0/1447117119 wait complete. 2024-04-25T11:31:53.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.601+0000 7f80bebaa740 20 client.17379 trim_cache size 0 max 16384 2024-04-25T11:31:53.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 Processor -- start 2024-04-25T11:31:53.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 -- start start 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb2374d0 0x5585bb60ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb23f6b0 0x5585bb60b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80b01b1080 con 0x5585bb260390 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80b01ae950 con 0x5585bb2374d0 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80bebaa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f80b01ac7c0 con 0x5585bb23f6b0 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50990/0 (socket says 172.21.15.80:50990) 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 -- 172.21.15.80:0/382073053 learned_addr learned my addr 172.21.15.80:0/382073053 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b5a95640 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb2374d0 0x5585bb60ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b5294640 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb23f6b0 0x5585bb60b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 -- 172.21.15.80:0/382073053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb23f6b0 msgr2=0x5585bb60b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb23f6b0 0x5585bb60b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 -- 172.21.15.80:0/382073053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb2374d0 msgr2=0x5585bb60ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb2374d0 0x5585bb60ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 -- 172.21.15.80:0/382073053 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585bb603010 con 0x5585bb260390 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b5294640 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb23f6b0 0x5585bb60b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.615+0000 7f80b6296640 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6064f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f80a802ade0 tx=0x7f80a8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca9e6893a176c7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f809b7fe640 1 -- 172.21.15.80:0/382073053 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8052070 con 0x5585bb260390 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f809b7fe640 1 -- 172.21.15.80:0/382073053 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a8036040 con 0x5585bb260390 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f809b7fe640 1 -- 172.21.15.80:0/382073053 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a804a040 con 0x5585bb260390 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 -- 172.21.15.80:0/382073053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 msgr2=0x5585bb6064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6064f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f80a802ade0 tx=0x7f80a8000f40 comp rx=0 tx=0).stop 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 -- 172.21.15.80:0/382073053 shutdown_connections 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb260390 0x5585bb6064f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb23f6b0 0x5585bb60b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 --2- 172.21.15.80:0/382073053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb2374d0 0x5585bb60ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 -- 172.21.15.80:0/382073053 >> 172.21.15.80:0/382073053 conn(0x5585bb2544e0 msgr2=0x5585bb60d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 -- 172.21.15.80:0/382073053 shutdown_connections 2024-04-25T11:31:53.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.616+0000 7f80bebaa740 1 -- 172.21.15.80:0/382073053 wait complete. 2024-04-25T11:31:53.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 -- start start 2024-04-25T11:31:53.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 Processor -- start 2024-04-25T11:31:53.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb2374d0 0x5585bb680cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb681210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb260390 0x5585bb620c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80b01ace10 con 0x5585bb2374d0 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80b01ae280 con 0x5585bb23f6b0 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f80b01ad4e0 con 0x5585bb260390 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80bebaa740 10 client.0 _ll_register_callbacks cb 0x7f80a40e2830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80b5a95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb2374d0 0x5585bb680cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80b5a95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb2374d0 0x5585bb680cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51004/0 (socket says 172.21.15.80:51004) 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80b5a95640 1 -- 172.21.15.80:0/1724202527 learned_addr learned my addr 172.21.15.80:0/1724202527 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80b5294640 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb681210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.617+0000 7f80b6296640 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb260390 0x5585bb620c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80b5a95640 1 -- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb260390 msgr2=0x5585bb620c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80b5a95640 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb260390 0x5585bb620c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80b5a95640 1 -- 172.21.15.80:0/1724202527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 msgr2=0x5585bb681210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80b5a95640 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb681210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80b5a95640 1 -- 172.21.15.80:0/1724202527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585bb6212e0 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80b5a95640 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb2374d0 0x5585bb680cd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x5585bb602fe0 tx=0x7f80ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6224394ce7cce5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80997fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80997fa640 1 -- 172.21.15.80:0/1724202527 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac01eb00 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a8036040 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80997fa640 1 -- 172.21.15.80:0/1724202527 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f80ac01eca0 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80997fa640 1 -- 172.21.15.80:0/1724202527 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80ac02f430 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80bebaa740 10 client.17385 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5585bb688360 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80997fa640 1 -- 172.21.15.80:0/1724202527 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a8036040 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.618+0000 7f80997fa640 1 -- 172.21.15.80:0/1724202527 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f80ac026ce0 con 0x5585bb2374d0 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80bebaa740 10 client.17385 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80bebaa740 10 client.17385 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80bebaa740 20 client.17385 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:53.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb1f43a0 0x5585bb68ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80bebaa740 4 client.17385 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585bb56e800 con 0x5585bb1f43a0 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80b5294640 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb1f43a0 0x5585bb68ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80997fa640 10 client.17385 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.619+0000 7f80b5294640 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb1f43a0 0x5585bb68ab20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9a4aea5cefcee22 server_cookie=7bcc8b95748fa10 in_seq=0 out_seq=0 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80997fa640 1 -- 172.21.15.80:0/1724202527 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585bb56e800 con 0x5585bb1f43a0 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80997fa640 10 client.17385 handle_command_reply: tid=0 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 client.17385 shutdown 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb2374d0 msgr2=0x5585bb680cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb2374d0 0x5585bb680cd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x5585bb602fe0 tx=0x7f80ac0046c0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 shutdown_connections 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5585bb1f43a0 0x5585bb68ab20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5585bb260390 0x5585bb620c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585bb23f6b0 0x5585bb681210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 --2- 172.21.15.80:0/1724202527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585bb2374d0 0x5585bb680cd0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80997fa640 0 client.17385 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 >> 172.21.15.80:0/1724202527 conn(0x5585bb2544e0 msgr2=0x5585bb617190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 shutdown_connections 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 1 -- 172.21.15.80:0/1724202527 wait complete. 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80bebaa740 20 client.17385 trim_cache size 0 max 16384 2024-04-25T11:31:53.615 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:53.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f809c0afc60 msgr2=0x7f809c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f809c0afc60 0x7f809c0b2170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005fd0 tx=0x7f80ac005f60 comp rx=0 tx=0).stop 2024-04-25T11:31:53.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b0108a30 msgr2=0x7f80b0199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b0108a30 0x7f80b0199b10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f80a400d950 tx=0x7f80a400de10 comp rx=0 tx=0).stop 2024-04-25T11:31:53.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 shutdown_connections 2024-04-25T11:31:53.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f809c0afc60 0x7f809c0b2170 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80b0108a30 0x7f80b0199b10 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80b010d390 0x7f80b019ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.620+0000 7f80b7cf9640 1 --2- 172.21.15.80:0/2847948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80b0102b00 0x7f80b01995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.621+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 >> 172.21.15.80:0/2847948612 conn(0x7f80b00fe260 msgr2=0x7f80b00fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.621+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 shutdown_connections 2024-04-25T11:31:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.621+0000 7f80b7cf9640 1 -- 172.21.15.80:0/2847948612 wait complete. 2024-04-25T11:31:53.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:31:53.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:53 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:31:53.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:53 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:53.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:53 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:31:53.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:53 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:53.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:53 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.781+0000 7ffa68a42640 1 -- 172.21.15.80:0/3423161543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 msgr2=0x7ffa64101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.781+0000 7ffa68a42640 1 --2- 172.21.15.80:0/3423161543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa64101b70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009900 tx=0x7ffa5c02a410 comp rx=0 tx=0).stop 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 -- 172.21.15.80:0/3423161543 shutdown_connections 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 --2- 172.21.15.80:0/3423161543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa64102720 0x7ffa64110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 --2- 172.21.15.80:0/3423161543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa64109f90 0x7ffa641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 --2- 172.21.15.80:0/3423161543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa64101b70 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 -- 172.21.15.80:0/3423161543 >> 172.21.15.80:0/3423161543 conn(0x7ffa64077880 msgr2=0x7ffa64077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 -- 172.21.15.80:0/3423161543 shutdown_connections 2024-04-25T11:31:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 -- 172.21.15.80:0/3423161543 wait complete. 2024-04-25T11:31:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 Processor -- start 2024-04-25T11:31:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.782+0000 7ffa68a42640 1 -- start start 2024-04-25T11:31:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa64102720 0x7ffa6419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa6419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa64109f90 0x7ffa6419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64113d00 con 0x7ffa64109af0 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64113b80 con 0x7ffa64102720 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64113e80 con 0x7ffa64109f90 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa6419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa6419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51020/0 (socket says 172.21.15.80:51020) 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 -- 172.21.15.80:0/146262692 learned_addr learned my addr 172.21.15.80:0/146262692 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa6259c640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa64102720 0x7ffa6419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa64109f90 0x7ffa6419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 -- 172.21.15.80:0/146262692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa64109f90 msgr2=0x7ffa6419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa64109f90 0x7ffa6419ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 -- 172.21.15.80:0/146262692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa64102720 msgr2=0x7ffa6419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa64102720 0x7ffa6419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 -- 172.21.15.80:0/146262692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6419f500 con 0x7ffa64109af0 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa6259c640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa64102720 0x7ffa6419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa6419ac80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800c9a0 tx=0x7ffa5800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa537fe640 1 -- 172.21.15.80:0/146262692 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58014070 con 0x7ffa64109af0 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa537fe640 1 -- 172.21.15.80:0/146262692 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa58004440 con 0x7ffa64109af0 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6419f7f0 con 0x7ffa64109af0 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa537fe640 1 -- 172.21.15.80:0/146262692 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800f450 con 0x7ffa64109af0 2024-04-25T11:31:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.783+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6419fd40 con 0x7ffa64109af0 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 Processor -- start 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa537fe640 1 -- 172.21.15.80:0/146262692 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ffa58017070 con 0x7ffa64109af0 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 -- start start 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ef390 0x5613f9890810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94c64d0 0x5613f9890d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5613f97f5d80 con 0x5613f94ce6b0 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5613f97afa20 con 0x5613f94ef390 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5613f97f1d40 con 0x5613f94c64d0 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.786+0000 7ffa61d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51024/0 (socket says 172.21.15.80:51024) 2024-04-25T11:31:53.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3590495059 learned_addr learned my addr 172.21.15.80:0/3590495059 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ef390 0x5613f9890810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94c64d0 0x5613f9890d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa537fe640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa4c0afc60 0x7ffa4c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa4c0afc60 0x7ffa4c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa537fe640 1 -- 172.21.15.80:0/146262692 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ffa580dec60 con 0x7ffa64109af0 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3590495059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94c64d0 msgr2=0x5613f9890d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94c64d0 0x5613f9890d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3590495059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ef390 msgr2=0x5613f9890810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ef390 0x5613f9890810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3590495059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613f97bac30 con 0x5613f94ce6b0 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ef390 0x5613f9890810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94c64d0 0x5613f9890d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989d6a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ffa580a4050 tx=0x7ffa5800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c13fd52188c95d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa50ff9640 1 -- 172.21.15.80:0/3590495059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580a6550 con 0x5613f94ce6b0 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa4c0afc60 0x7ffa4c0b2170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5613f988d980 tx=0x7ffa54004ab0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa50ff9640 1 -- 172.21.15.80:0/3590495059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa580a68f0 con 0x5613f94ce6b0 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.787+0000 7ffa50ff9640 1 -- 172.21.15.80:0/3590495059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580a6de0 con 0x5613f94ce6b0 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3590495059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 msgr2=0x5613f989d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989d6a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ffa580a4050 tx=0x7ffa5800cf90 comp rx=0 tx=0).stop 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3590495059 shutdown_connections 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989d6a0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94c64d0 0x5613f9890d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3590495059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ef390 0x5613f9890810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3590495059 >> 172.21.15.80:0/3590495059 conn(0x5613f94e34e0 msgr2=0x5613f988cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3590495059 shutdown_connections 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.788+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3590495059 wait complete. 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 -- start start 2024-04-25T11:31:53.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 Processor -- start 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f989b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5613f989dd30 con 0x5613f94ce6b0 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5613f977cdc0 con 0x5613f94c64d0 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5613f989deb0 con 0x5613f94ef390 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6f9c6740 10 client.0 _ll_register_callbacks cb 0x5613f9798600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51028/0 (socket says 172.21.15.80:51028) 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3352844759 learned_addr learned my addr 172.21.15.80:0/3352844759 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f989b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3352844759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 msgr2=0x5613f98a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 msgr2=0x5613f989b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f989b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa61d9b640 1 -- 172.21.15.80:0/3352844759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613f95073f0 con 0x5613f94ce6b0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.789+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f989b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989b7a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ffa580a6d70 tx=0x7ffa580a32a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a24c9308197aea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3352844759 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580e2040 con 0x5613f94ce6b0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3352844759 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ffa580a2750 con 0x5613f94ce6b0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa580a68f0 con 0x5613f94ce6b0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3352844759 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa580a6550 con 0x5613f94ce6b0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 10 client.17397 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5613f95d17d0 con 0x5613f94ce6b0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3352844759 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa580a68f0 con 0x5613f94ce6b0 2024-04-25T11:31:53.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3352844759 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffa580a2950 con 0x5613f94ce6b0 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 10 client.17397 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 10 client.17397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 20 client.17397 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94adf60 0x5613f98ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 4 client.17397 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.790+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613f9803990 con 0x5613f94adf60 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.791+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94adf60 0x5613f98ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.791+0000 7ffa49ffb640 10 client.17397 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.791+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94adf60 0x5613f98ad490 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22291123e3a4c519 server_cookie=b203a1d450df48b7 in_seq=0 out_seq=0 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3352844759 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5613f9803990 con 0x5613f94adf60 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa49ffb640 10 client.17397 handle_command_reply: tid=0 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 client.17397 shutdown 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 msgr2=0x5613f989b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989b7a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ffa580a6d70 tx=0x7ffa580a32a0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 shutdown_connections 2024-04-25T11:31:53.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94adf60 0x5613f98ad490 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ce6b0 0x5613f989b7a0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3352844759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f989b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa49ffb640 0 client.17397 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:53.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 >> 172.21.15.80:0/3352844759 conn(0x5613f94e34e0 msgr2=0x5613f9892530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 shutdown_connections 2024-04-25T11:31:53.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3352844759 wait complete. 2024-04-25T11:31:53.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.792+0000 7ffa6f9c6740 20 client.17397 trim_cache size 0 max 16384 2024-04-25T11:31:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 Processor -- start 2024-04-25T11:31:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 -- start start 2024-04-25T11:31:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f98a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ce6b0 0x5613f9899f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ef390 0x5613f988cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641b2370 con 0x5613f94ef390 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641afc40 con 0x5613f94c64d0 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641adab0 con 0x5613f94ce6b0 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ef390 0x5613f988cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ef390 0x5613f988cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51038/0 (socket says 172.21.15.80:51038) 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 -- 172.21.15.80:0/2897558790 learned_addr learned my addr 172.21.15.80:0/2897558790 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ce6b0 0x5613f9899f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 -- 172.21.15.80:0/2897558790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ce6b0 msgr2=0x5613f9899f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ce6b0 0x5613f9899f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 -- 172.21.15.80:0/2897558790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 msgr2=0x5613f98a71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f98a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.806+0000 7ffa62d9d640 1 -- 172.21.15.80:0/2897558790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613f98995a0 con 0x5613f94ef390 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.807+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ef390 0x5613f988cf10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ffa54014300 tx=0x7ffa5400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6d1334485d328d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.807+0000 7ffa4bfff640 1 -- 172.21.15.80:0/2897558790 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54023070 con 0x5613f94ef390 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.807+0000 7ffa4bfff640 1 -- 172.21.15.80:0/2897558790 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa54018070 con 0x5613f94ef390 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.807+0000 7ffa4bfff640 1 -- 172.21.15.80:0/2897558790 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54028d70 con 0x5613f94ef390 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.807+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/2897558790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ef390 msgr2=0x5613f988cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.807+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ef390 0x5613f988cf10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ffa54014300 tx=0x7ffa5400b660 comp rx=0 tx=0).stop 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/2897558790 shutdown_connections 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94ef390 0x5613f988cf10 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ce6b0 0x5613f9899f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/2897558790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94c64d0 0x5613f98a71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/2897558790 >> 172.21.15.80:0/2897558790 conn(0x5613f94e34e0 msgr2=0x5613f988c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/2897558790 shutdown_connections 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/2897558790 wait complete. 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- start start 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 Processor -- start 2024-04-25T11:31:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94c64d0 0x5613f9910dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ce6b0 0x5613f9911310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641ae100 con 0x5613f94c64d0 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641af570 con 0x5613f94ce6b0 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641ae7d0 con 0x5613f94ef390 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6f9c6740 10 client.0 _ll_register_callbacks cb 0x7ffa5400b4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94c64d0 0x5613f9910dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94c64d0 0x5613f9910dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51046/0 (socket says 172.21.15.80:51046) 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa6259c640 1 -- 172.21.15.80:0/3357308696 learned_addr learned my addr 172.21.15.80:0/3357308696 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ce6b0 0x5613f9911310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.808+0000 7ffa62d9d640 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6259c640 1 -- 172.21.15.80:0/3357308696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 msgr2=0x5613f98ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6259c640 1 -- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ce6b0 msgr2=0x5613f9911310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ce6b0 0x5613f9911310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6259c640 1 -- 172.21.15.80:0/3357308696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613f98ae030 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6259c640 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94c64d0 0x5613f9910dd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c005ab0 tx=0x7ffa5c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1504499344e41659 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3357308696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c035040 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3357308696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ffa5c004390 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa54018070 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3357308696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa5c053050 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6f9c6740 10 client.17403 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5613f9919440 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3357308696 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa54018070 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3357308696 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffa5c043ce0 con 0x5613f94c64d0 2024-04-25T11:31:53.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6f9c6740 10 client.17403 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6f9c6740 10 client.17403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6f9c6740 20 client.17403 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.809+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94833a0 0x5613f991bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.810+0000 7ffa6f9c6740 4 client.17403 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.810+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613f989bb30 con 0x5613f94833a0 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.810+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94833a0 0x5613f991bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.810+0000 7ffa49ffb640 10 client.17403 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.810+0000 7ffa61d9b640 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94833a0 0x5613f991bc30 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=804010dddb28879f server_cookie=7e175178616fffea in_seq=0 out_seq=0 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.810+0000 7ffa49ffb640 1 -- 172.21.15.80:0/3357308696 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613f989bb30 con 0x5613f94833a0 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa49ffb640 10 client.17403 handle_command_reply: tid=0 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 client.17403 shutdown 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94c64d0 msgr2=0x5613f9910dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94c64d0 0x5613f9910dd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c005ab0 tx=0x7ffa5c005ef0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 shutdown_connections 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5613f94833a0 0x5613f991bc30 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5613f94ef390 0x5613f98ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613f94ce6b0 0x5613f9911310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 --2- 172.21.15.80:0/3357308696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5613f94c64d0 0x5613f9910dd0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa49ffb640 0 client.17403 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 >> 172.21.15.80:0/3357308696 conn(0x5613f94e34e0 msgr2=0x5613f989d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 shutdown_connections 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 1 -- 172.21.15.80:0/3357308696 wait complete. 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa6f9c6740 20 client.17403 trim_cache size 0 max 16384 2024-04-25T11:31:53.806 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:31:53.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa4c0afc60 msgr2=0x7ffa4c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa4c0afc60 0x7ffa4c0b2170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5613f988d980 tx=0x7ffa54004ab0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 msgr2=0x7ffa6419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:53.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa6419ac80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800c9a0 tx=0x7ffa5800ce60 comp rx=0 tx=0).stop 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 shutdown_connections 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa4c0afc60 0x7ffa4c0b2170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa64109af0 0x7ffa6419ac80 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa64109f90 0x7ffa6419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 --2- 172.21.15.80:0/146262692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa64102720 0x7ffa6419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 >> 172.21.15.80:0/146262692 conn(0x7ffa64077880 msgr2=0x7ffa641051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 shutdown_connections 2024-04-25T11:31:53.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:53.811+0000 7ffa68a42640 1 -- 172.21.15.80:0/146262692 wait complete. 2024-04-25T11:31:54.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:54 smithi082 ceph-mon[32440]: pgmap v235: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:54.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:54 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4171226169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:54.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:54 smithi080 ceph-mon[29126]: pgmap v235: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:54.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:54 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4171226169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:54.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:54 smithi196 ceph-mon[32659]: pgmap v235: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:54.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:54 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4171226169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:31:54.812 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:31:54.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:31:54.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:31:54.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 -- 172.21.15.80:0/2461478410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8102b10 msgr2=0x7f6ff8102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 --2- 172.21.15.80:0/2461478410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8102b10 0x7f6ff8102f20 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009900 tx=0x7f6fec02a410 comp rx=0 tx=0).stop 2024-04-25T11:31:54.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 -- 172.21.15.80:0/2461478410 shutdown_connections 2024-04-25T11:31:54.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 --2- 172.21.15.80:0/2461478410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8102b10 0x7f6ff8102f20 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 --2- 172.21.15.80:0/2461478410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff810d3a0 0x7f6ff810f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 --2- 172.21.15.80:0/2461478410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ff8108a40 0x7f6ff81025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 -- 172.21.15.80:0/2461478410 >> 172.21.15.80:0/2461478410 conn(0x7f6ff8078180 msgr2=0x7f6ff80785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:54.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 -- 172.21.15.80:0/2461478410 shutdown_connections 2024-04-25T11:31:54.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.944+0000 7f6ffe500640 1 -- 172.21.15.80:0/2461478410 wait complete. 2024-04-25T11:31:54.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 Processor -- start 2024-04-25T11:31:54.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 -- start start 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff8102b10 0x7f6ff81996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8108a40 0x7f6ff8199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ff810d3a0 0x7f6ff819dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8112c00 con 0x7f6ff8108a40 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8112a80 con 0x7f6ff8102b10 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffe500640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8112d80 con 0x7f6ff810d3a0 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8108a40 0x7f6ff8199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8108a40 0x7f6ff8199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51060/0 (socket says 172.21.15.80:51060) 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1567852621 learned_addr learned my addr 172.21.15.80:0/1567852621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff8102b10 0x7f6ff81996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.945+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ff810d3a0 0x7f6ff819dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1567852621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ff810d3a0 msgr2=0x7f6ff819dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ff810d3a0 0x7f6ff819dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1567852621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff8102b10 msgr2=0x7f6ff81996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff8102b10 0x7f6ff81996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1567852621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff819e500 con 0x7f6ff8108a40 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8108a40 0x7f6ff8199c00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6fec02a930 tx=0x7f6fec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff57fa640 1 -- 172.21.15.80:0/1567852621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec03f030 con 0x7f6ff8108a40 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff57fa640 1 -- 172.21.15.80:0/1567852621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fec003aa0 con 0x7f6ff8108a40 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff819e790 con 0x7f6ff8108a40 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ff57fa640 1 -- 172.21.15.80:0/1567852621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec035070 con 0x7f6ff8108a40 2024-04-25T11:31:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.946+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff819ec80 con 0x7f6ff8108a40 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.948+0000 7f6ff57fa640 1 -- 172.21.15.80:0/1567852621 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f6fec042030 con 0x7f6ff8108a40 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.948+0000 7f70053b3740 1 Processor -- start 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.948+0000 7f70053b3740 1 -- start start 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f70053b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa057b410 0x555fa091b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f70053b3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa0552550 0x555fa091b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f70053b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f70053b3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555fa0881b00 con 0x555fa0552550 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f70053b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555fa081d920 con 0x555fa055a730 2024-04-25T11:31:54.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f70053b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555fa087dac0 con 0x555fa057b410 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa0552550 0x555fa091b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa0552550 0x555fa091b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51074/0 (socket says 172.21.15.80:51074) 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 -- 172.21.15.80:0/186274604 learned_addr learned my addr 172.21.15.80:0/186274604 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff57fa640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6fe00afc60 0x7f6fe00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa057b410 0x555fa091b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 -- 172.21.15.80:0/186274604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa057b410 msgr2=0x555fa091b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa057b410 0x555fa091b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6fe00afc60 0x7f6fe00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 -- 172.21.15.80:0/186274604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 msgr2=0x555fa091bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 -- 172.21.15.80:0/186274604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fa065b7e0 con 0x555fa0552550 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:54.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff57fa640 1 -- 172.21.15.80:0/1567852621 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f6fec0ff4b0 con 0x7f6ff8108a40 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa0552550 0x555fa091b9b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800bc90 tx=0x7f6fe80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7e990ba4ead75b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6fe00afc60 0x7f6fe00b2170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x555fa0919030 tx=0x7f6ff0009600 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.949+0000 7f6fde7fc640 1 -- 172.21.15.80:0/186274604 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8005220 con 0x555fa0552550 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f6fde7fc640 1 -- 172.21.15.80:0/186274604 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fe800be40 con 0x555fa0552550 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f6fde7fc640 1 -- 172.21.15.80:0/186274604 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80116a0 con 0x555fa0552550 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 -- 172.21.15.80:0/186274604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa0552550 msgr2=0x555fa091b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa0552550 0x555fa091b9b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800bc90 tx=0x7f6fe80107a0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 -- 172.21.15.80:0/186274604 shutdown_connections 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa0552550 0x555fa091b9b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 --2- 172.21.15.80:0/186274604 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa057b410 0x555fa091b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 -- 172.21.15.80:0/186274604 >> 172.21.15.80:0/186274604 conn(0x555fa056f560 msgr2=0x555fa0917dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 -- 172.21.15.80:0/186274604 shutdown_connections 2024-04-25T11:31:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.950+0000 7f70053b3740 1 -- 172.21.15.80:0/186274604 wait complete. 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 -- start start 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 Processor -- start 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0927db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa09282f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa057b410 0x555fa0934090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x555fa092abb0 con 0x555fa055a730 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555fa081b5d0 con 0x555fa057b410 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555fa092ad30 con 0x555fa0552550 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f70053b3740 10 client.0 _ll_register_callbacks cb 0x555fa0809080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa09282f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa09282f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51088/0 (socket says 172.21.15.80:51088) 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.951+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1383205763 learned_addr learned my addr 172.21.15.80:0/1383205763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa057b410 0x555fa0934090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0927db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1383205763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 msgr2=0x555fa0927db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0927db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa057b410 msgr2=0x555fa0934090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa057b410 0x555fa0934090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ff77fe640 1 -- 172.21.15.80:0/1383205763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fa06bbf70 con 0x555fa055a730 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa09282f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0fd1e0 tx=0x7f6fec091eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a171dfc9f0717f89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6fd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6fd77fe640 1 -- 172.21.15.80:0/1383205763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec049070 con 0x555fa055a730 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6fd77fe640 1 -- 172.21.15.80:0/1383205763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f6fec003c50 con 0x555fa055a730 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555fa088f710 con 0x555fa055a730 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6fd77fe640 1 -- 172.21.15.80:0/1383205763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6fec0c6e50 con 0x555fa055a730 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f70053b3740 10 client.17415 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555fa0553170 con 0x555fa055a730 2024-04-25T11:31:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.952+0000 7f6fd77fe640 1 -- 172.21.15.80:0/1383205763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555fa088f710 con 0x555fa055a730 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f6fd77fe640 1 -- 172.21.15.80:0/1383205763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6fec0fce60 con 0x555fa055a730 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f70053b3740 10 client.17415 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f70053b3740 10 client.17415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f70053b3740 20 client.17415 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f70053b3740 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa053a1f0 0x555fa093a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f70053b3740 4 client.17415 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fa0889580 con 0x555fa053a1f0 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa053a1f0 0x555fa093a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f6fd77fe640 10 client.17415 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.953+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa053a1f0 0x555fa093a0f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c121c7239cae115b server_cookie=8ab621f74c099039 in_seq=0 out_seq=0 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.954+0000 7f6fd77fe640 1 -- 172.21.15.80:0/1383205763 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555fa0889580 con 0x555fa053a1f0 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.954+0000 7f6fd77fe640 10 client.17415 handle_command_reply: tid=0 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.954+0000 7f70053b3740 1 client.17415 shutdown 2024-04-25T11:31:54.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 msgr2=0x555fa09282f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa09282f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0fd1e0 tx=0x7f6fec091eb0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 shutdown_connections 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa053a1f0 0x555fa093a0f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa09282f0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f6fd77fe640 0 client.17415 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa057b410 0x555fa0934090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 --2- 172.21.15.80:0/1383205763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0927db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 >> 172.21.15.80:0/1383205763 conn(0x555fa056f560 msgr2=0x555fa091bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 shutdown_connections 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 1 -- 172.21.15.80:0/1383205763 wait complete. 2024-04-25T11:31:54.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.955+0000 7f70053b3740 20 client.17415 trim_cache size 0 max 16384 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.972+0000 7f70053b3740 1 Processor -- start 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f70053b3740 1 -- start start 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f70053b3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa053a1f0 0x555fa0921660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f70053b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa091bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f70053b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f70053b3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81b0200 con 0x555fa053a1f0 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f70053b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81adad0 con 0x555fa055a730 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f70053b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81ab940 con 0x555fa0552550 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa053a1f0 0x555fa0921660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa053a1f0 0x555fa0921660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51102/0 (socket says 172.21.15.80:51102) 2024-04-25T11:31:54.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 -- 172.21.15.80:0/4084477877 learned_addr learned my addr 172.21.15.80:0/4084477877 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa091bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 -- 172.21.15.80:0/4084477877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 msgr2=0x555fa091bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa091bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 -- 172.21.15.80:0/4084477877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 msgr2=0x555fa091c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 -- 172.21.15.80:0/4084477877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fa092aa90 con 0x555fa053a1f0 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa053a1f0 0x555fa0921660 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800b6c0 tx=0x7f6fe80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2938cfe47cceb322 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.973+0000 7f6fddffb640 1 -- 172.21.15.80:0/4084477877 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe802c030 con 0x555fa053a1f0 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f6fddffb640 1 -- 172.21.15.80:0/4084477877 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fe8004020 con 0x555fa053a1f0 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f6fddffb640 1 -- 172.21.15.80:0/4084477877 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8028a00 con 0x555fa053a1f0 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 -- 172.21.15.80:0/4084477877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa053a1f0 msgr2=0x555fa0921660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa053a1f0 0x555fa0921660 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800b6c0 tx=0x7f6fe80058a0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 -- 172.21.15.80:0/4084477877 shutdown_connections 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa055a730 0x555fa091c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa091bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 --2- 172.21.15.80:0/4084477877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa053a1f0 0x555fa0921660 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 -- 172.21.15.80:0/4084477877 >> 172.21.15.80:0/4084477877 conn(0x555fa056f560 msgr2=0x555fa091b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 -- 172.21.15.80:0/4084477877 shutdown_connections 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.974+0000 7f70053b3740 1 -- 172.21.15.80:0/4084477877 wait complete. 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 -- start start 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 Processor -- start 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa053a1f0 0x555fa0924620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0924b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa092eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81abf90 con 0x555fa055a730 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81ad400 con 0x555fa053a1f0 2024-04-25T11:31:54.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81ac660 con 0x555fa0552550 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f70053b3740 10 client.0 _ll_register_callbacks cb 0x7f6fec0c2e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f6ffca9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa092eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f6ffca9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa092eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51112/0 (socket says 172.21.15.80:51112) 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f6ffca9d640 1 -- 172.21.15.80:0/2109375119 learned_addr learned my addr 172.21.15.80:0/2109375119 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f6ff77fe640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0924b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.975+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa053a1f0 0x555fa0924620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6ffca9d640 1 -- 172.21.15.80:0/2109375119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 msgr2=0x555fa0924b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0924b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6ffca9d640 1 -- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa053a1f0 msgr2=0x555fa0924620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa053a1f0 0x555fa0924620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6ffca9d640 1 -- 172.21.15.80:0/2109375119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fa092f530 con 0x555fa055a730 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa053a1f0 0x555fa0924620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6ffca9d640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa092eff0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0010ab0 tx=0x7f6ff0009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b64a4d38b729cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:54.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6fd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6fd77fe640 1 -- 172.21.15.80:0/2109375119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0021e20 con 0x555fa055a730 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6fd77fe640 1 -- 172.21.15.80:0/2109375119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7f6ff0004b20 con 0x555fa055a730 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fe8004020 con 0x555fa055a730 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6fd77fe640 1 -- 172.21.15.80:0/2109375119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6ff0004d20 con 0x555fa055a730 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 10 client.17421 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555fa09307f0 con 0x555fa055a730 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6fd77fe640 1 -- 172.21.15.80:0/2109375119 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fe8004020 con 0x555fa055a730 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f6fd77fe640 1 -- 172.21.15.80:0/2109375119 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f6ff0028030 con 0x555fa055a730 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 10 client.17421 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 20 client.17421 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa057b410 0x555fa09a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 4 client.17421 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.976+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555fa0804ac0 con 0x555fa057b410 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.977+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa057b410 0x555fa09a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:54.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.977+0000 7f6ff7fff640 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa057b410 0x555fa09a47c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690aae56544e1ad9 server_cookie=77a07555306e6e2b in_seq=0 out_seq=0 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.977+0000 7f6fd77fe640 10 client.17421 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f6fd77fe640 1 -- 172.21.15.80:0/2109375119 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555fa0804ac0 con 0x555fa057b410 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f6fd77fe640 10 client.17421 handle_command_reply: tid=0 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 client.17421 shutdown 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 msgr2=0x555fa092eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa092eff0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0010ab0 tx=0x7f6ff0009a90 comp rx=0 tx=0).stop 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 shutdown_connections 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x555fa057b410 0x555fa09a47c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fa055a730 0x555fa092eff0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f6fd77fe640 0 client.17421 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555fa0552550 0x555fa0924b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 --2- 172.21.15.80:0/2109375119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fa053a1f0 0x555fa0924620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.978+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 >> 172.21.15.80:0/2109375119 conn(0x555fa056f560 msgr2=0x555fa091bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 shutdown_connections 2024-04-25T11:31:54.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f70053b3740 1 -- 172.21.15.80:0/2109375119 wait complete. 2024-04-25T11:31:54.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f70053b3740 20 client.17421 trim_cache size 0 max 16384 2024-04-25T11:31:54.974 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:31:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "544d836b-f422-4bb8-9be3-f867be94bd5a", 2024-04-25T11:31:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:31:54.974 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6fe00afc60 msgr2=0x7f6fe00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6fe00afc60 0x7f6fe00b2170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x555fa0919030 tx=0x7f6ff0009600 comp rx=0 tx=0).stop 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8108a40 msgr2=0x7f6ff8199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8108a40 0x7f6ff8199c00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6fec02a930 tx=0x7f6fec004270 comp rx=0 tx=0).stop 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 shutdown_connections 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f6fe00afc60 0x7f6fe00b2170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff8108a40 0x7f6ff8199c00 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ff810d3a0 0x7f6ff819dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 --2- 172.21.15.80:0/1567852621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff8102b10 0x7f6ff81996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:54.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 >> 172.21.15.80:0/1567852621 conn(0x7f6ff8078180 msgr2=0x7f6ff81040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:54.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 shutdown_connections 2024-04-25T11:31:54.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:54.979+0000 7f6ffe500640 1 -- 172.21.15.80:0/1567852621 wait complete. 2024-04-25T11:31:54.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:31:54.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:31:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 -- 172.21.15.80:0/4232453955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa2010d380 msgr2=0x7ffa2010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 --2- 172.21.15.80:0/4232453955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa2010d380 0x7ffa2010f7a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009ca0 tx=0x7ffa1802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 -- 172.21.15.80:0/4232453955 shutdown_connections 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 --2- 172.21.15.80:0/4232453955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa2010d380 0x7ffa2010f7a0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 --2- 172.21.15.80:0/4232453955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa20102af0 0x7ffa20102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 --2- 172.21.15.80:0/4232453955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20108a20 0x7ffa201025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 -- 172.21.15.80:0/4232453955 >> 172.21.15.80:0/4232453955 conn(0x7ffa20078100 msgr2=0x7ffa20078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 -- 172.21.15.80:0/4232453955 shutdown_connections 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.099+0000 7ffa25538640 1 -- 172.21.15.80:0/4232453955 wait complete. 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 Processor -- start 2024-04-25T11:31:55.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 -- start start 2024-04-25T11:31:55.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20102af0 0x7ffa201995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20108a20 0x7ffa20199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2010d380 0x7ffa2019dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa20112be0 con 0x7ffa20102af0 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa20112a60 con 0x7ffa20108a20 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa25538640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa20112d60 con 0x7ffa2010d380 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20102af0 0x7ffa201995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20102af0 0x7ffa201995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51130/0 (socket says 172.21.15.80:51130) 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.100+0000 7ffa1effd640 1 -- 172.21.15.80:0/2788668768 learned_addr learned my addr 172.21.15.80:0/2788668768 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20108a20 0x7ffa20199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2010d380 0x7ffa2019dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1effd640 1 -- 172.21.15.80:0/2788668768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2010d380 msgr2=0x7ffa2019dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1effd640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2010d380 0x7ffa2019dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1effd640 1 -- 172.21.15.80:0/2788668768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20108a20 msgr2=0x7ffa20199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1effd640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20108a20 0x7ffa20199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1effd640 1 -- 172.21.15.80:0/2788668768 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2019e3a0 con 0x7ffa20102af0 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2010d380 0x7ffa2019dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20108a20 0x7ffa20199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa1effd640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20102af0 0x7ffa201995c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000d950 tx=0x7ffa1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa07fff640 1 -- 172.21.15.80:0/2788668768 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10017070 con 0x7ffa20102af0 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2019e690 con 0x7ffa20102af0 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa07fff640 1 -- 172.21.15.80:0/2788668768 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa10009c30 con 0x7ffa20102af0 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa07fff640 1 -- 172.21.15.80:0/2788668768 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10003d20 con 0x7ffa20102af0 2024-04-25T11:31:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.101+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2019ebe0 con 0x7ffa20102af0 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 Processor -- start 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa07fff640 1 -- 172.21.15.80:0/2788668768 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ffa10003ec0 con 0x7ffa20102af0 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 -- start start 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a4410930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4410e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a441fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5567a4376d80 con 0x5567a40474d0 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5567a43308b0 con 0x5567a404f6b0 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5567a4372d40 con 0x5567a4070390 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4410e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4410e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51146/0 (socket says 172.21.15.80:51146) 2024-04-25T11:31:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1effd640 1 -- 172.21.15.80:0/309704067 learned_addr learned my addr 172.21.15.80:0/309704067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a4410930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a441fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1effd640 1 -- 172.21.15.80:0/309704067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 msgr2=0x5567a4410930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1effd640 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a4410930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa1effd640 1 -- 172.21.15.80:0/309704067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 msgr2=0x5567a441fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.104+0000 7ffa07fff640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa080afc60 0x7ffa080b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa1effd640 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a441fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa1effd640 1 -- 172.21.15.80:0/309704067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4301a40 con 0x5567a40474d0 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a441fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa080afc60 0x7ffa080b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa07fff640 1 -- 172.21.15.80:0/2788668768 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ffa100deda0 con 0x7ffa20102af0 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa1effd640 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4410e70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ffa100dc440 tx=0x7ffa100b85d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a43eac118c4a618 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa057fa640 1 -- 172.21.15.80:0/309704067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a6cf0 con 0x5567a40474d0 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa057fa640 1 -- 172.21.15.80:0/309704067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa100a6a30 con 0x5567a40474d0 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.105+0000 7ffa057fa640 1 -- 172.21.15.80:0/309704067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a6690 con 0x5567a40474d0 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/309704067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 msgr2=0x5567a4410e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa080afc60 0x7ffa080b2170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa18004af0 tx=0x7ffa18005d80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4410e70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ffa100dc440 tx=0x7ffa100b85d0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/309704067 shutdown_connections 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4410e70 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a441fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/309704067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a4410930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/309704067 >> 172.21.15.80:0/309704067 conn(0x5567a40644e0 msgr2=0x5567a440d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/309704067 shutdown_connections 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/309704067 wait complete. 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 -- start start 2024-04-25T11:31:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.106+0000 7ffa2c3ec740 1 Processor -- start 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a40474d0 0x5567a441d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a404f6b0 0x5567a441dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a44236a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5567a4420220 con 0x5567a404f6b0 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5567a42fdd10 con 0x5567a40474d0 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5567a44203a0 con 0x5567a4070390 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 10 client.0 _ll_register_callbacks cb 0x5567a432a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a404f6b0 0x5567a441dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a404f6b0 0x5567a441dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51156/0 (socket says 172.21.15.80:51156) 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 -- 172.21.15.80:0/3334227244 learned_addr learned my addr 172.21.15.80:0/3334227244 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1effd640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a40474d0 0x5567a441d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a44236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 -- 172.21.15.80:0/3334227244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 msgr2=0x5567a44236a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a44236a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 -- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a40474d0 msgr2=0x5567a441d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a40474d0 0x5567a441d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 -- 172.21.15.80:0/3334227244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a41527d0 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1effd640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a40474d0 0x5567a441d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1f7fe640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a44236a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a404f6b0 0x5567a441dd30 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ffa14010810 tx=0x7ffa14010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d58b6bc413fb25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa02ff5640 1 -- 172.21.15.80:0/3334227244 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400ed40 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa02ff5640 1 -- 172.21.15.80:0/3334227244 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ffa14005020 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa100a6a30 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa02ff5640 1 -- 172.21.15.80:0/3334227244 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa14005220 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 10 client.17433 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.107+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5567a40883f0 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa02ff5640 1 -- 172.21.15.80:0/3334227244 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa100a6a30 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa02ff5640 1 -- 172.21.15.80:0/3334227244 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffa14011440 con 0x5567a404f6b0 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa2c3ec740 10 client.17433 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa2c3ec740 10 client.17433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa2c3ec740 20 client.17433 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a402ef60 0x5567a442f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa2c3ec740 4 client.17433 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567a4384990 con 0x5567a402ef60 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.108+0000 7ffa1effd640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a402ef60 0x5567a442f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.109+0000 7ffa02ff5640 10 client.17433 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.109+0000 7ffa1effd640 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a402ef60 0x5567a442f9a0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73cc1268666a8abb server_cookie=b22698873f383199 in_seq=0 out_seq=0 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.109+0000 7ffa02ff5640 1 -- 172.21.15.80:0/3334227244 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5567a4384990 con 0x5567a402ef60 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.109+0000 7ffa02ff5640 10 client.17433 handle_command_reply: tid=0 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.109+0000 7ffa2c3ec740 1 client.17433 shutdown 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.109+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a404f6b0 msgr2=0x5567a441dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.109+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a404f6b0 0x5567a441dd30 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ffa14010810 tx=0x7ffa14010cd0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 shutdown_connections 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a402ef60 0x5567a442f9a0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a404f6b0 0x5567a441dd30 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa02ff5640 0 client.17433 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a44236a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/3334227244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a40474d0 0x5567a441d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 >> 172.21.15.80:0/3334227244 conn(0x5567a40644e0 msgr2=0x5567a4412750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 shutdown_connections 2024-04-25T11:31:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/3334227244 wait complete. 2024-04-25T11:31:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.110+0000 7ffa2c3ec740 20 client.17433 trim_cache size 0 max 16384 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 Processor -- start 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 -- start start 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4418de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a44107f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a441c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201b01c0 con 0x5567a40474d0 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201ada90 con 0x5567a404f6b0 2024-04-25T11:31:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201ab900 con 0x5567a4070390 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4418de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4418de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51164/0 (socket says 172.21.15.80:51164) 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.127+0000 7ffa1effd640 1 -- 172.21.15.80:0/897700671 learned_addr learned my addr 172.21.15.80:0/897700671 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa1effd640 1 -- 172.21.15.80:0/897700671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 msgr2=0x5567a441c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa1effd640 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a441c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa1effd640 1 -- 172.21.15.80:0/897700671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 msgr2=0x5567a44107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a44107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa1effd640 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a44107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa1effd640 1 -- 172.21.15.80:0/897700671 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a40480f0 con 0x5567a40474d0 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa1effd640 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4418de0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ffa100b8700 tx=0x7ffa100e28f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafa591727f79447 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa04ff9640 1 -- 172.21.15.80:0/897700671 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a6870 con 0x5567a40474d0 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa04ff9640 1 -- 172.21.15.80:0/897700671 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa100a6a30 con 0x5567a40474d0 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.128+0000 7ffa04ff9640 1 -- 172.21.15.80:0/897700671 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a6f20 con 0x5567a40474d0 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/897700671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 msgr2=0x5567a4418de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4418de0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ffa100b8700 tx=0x7ffa100e28f0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/897700671 shutdown_connections 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a441c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a44107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/897700671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4418de0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/897700671 >> 172.21.15.80:0/897700671 conn(0x5567a40644e0 msgr2=0x5567a441bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/897700671 shutdown_connections 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/897700671 wait complete. 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- start start 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 Processor -- start 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4425120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a4425660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a448fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201abf50 con 0x5567a40474d0 2024-04-25T11:31:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201ad3c0 con 0x5567a404f6b0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201ac620 con 0x5567a4070390 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa2c3ec740 10 client.0 _ll_register_callbacks cb 0x7ffa1400c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4425120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa1effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4425120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51166/0 (socket says 172.21.15.80:51166) 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.129+0000 7ffa1effd640 1 -- 172.21.15.80:0/2554645056 learned_addr learned my addr 172.21.15.80:0/2554645056 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a4425660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa1effd640 1 -- 172.21.15.80:0/2554645056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 msgr2=0x5567a448fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa1effd640 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a448fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa1effd640 1 -- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 msgr2=0x5567a4425660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa1effd640 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a4425660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa1effd640 1 -- 172.21.15.80:0/2554645056 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a43374b0 con 0x5567a40474d0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa1effd640 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4425120 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ffa100e2370 tx=0x7ffa10009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50ccf4683c8587e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa02ff5640 1 -- 172.21.15.80:0/2554645056 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1006c060 con 0x5567a40474d0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa02ff5640 1 -- 172.21.15.80:0/2554645056 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8550+0+0 (secure 0 0 0) 0x7ffa100e2a20 con 0x5567a40474d0 2024-04-25T11:31:55.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa100a6a30 con 0x5567a40474d0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa02ff5640 1 -- 172.21.15.80:0/2554645056 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa100a6870 con 0x5567a40474d0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa2c3ec740 10 client.17439 fetch_fsmap learned FSMap version 24 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5567a44973d0 con 0x5567a40474d0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa02ff5640 1 -- 172.21.15.80:0/2554645056 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa100a6a30 con 0x5567a40474d0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa02ff5640 1 -- 172.21.15.80:0/2554645056 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ffa100e1040 con 0x5567a40474d0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.130+0000 7ffa2c3ec740 10 client.17439 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa2c3ec740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa2c3ec740 20 client.17439 populate_metadata read hostname 'smithi080' 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a40043a0 0x5567a44993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa2c3ec740 4 client.17439 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5567a437e800 con 0x5567a40043a0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a40043a0 0x5567a44993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa02ff5640 10 client.17439 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.131+0000 7ffa1e7fc640 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a40043a0 0x5567a44993e0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37e34e1178ab146 server_cookie=138a1e68537c9967 in_seq=0 out_seq=0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa02ff5640 1 -- 172.21.15.80:0/2554645056 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5567a437e800 con 0x5567a40043a0 2024-04-25T11:31:55.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa02ff5640 10 client.17439 handle_command_reply: tid=0 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 client.17439 shutdown 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 msgr2=0x5567a4425120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4425120 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ffa100e2370 tx=0x7ffa10009de0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 shutdown_connections 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5567a40043a0 0x5567a44993e0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5567a4070390 0x5567a448fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567a404f6b0 0x5567a4425660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa02ff5640 0 client.17439 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 --2- 172.21.15.80:0/2554645056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5567a40474d0 0x5567a4425120 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 >> 172.21.15.80:0/2554645056 conn(0x5567a40644e0 msgr2=0x5567a441ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 shutdown_connections 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 1 -- 172.21.15.80:0/2554645056 wait complete. 2024-04-25T11:31:55.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa2c3ec740 20 client.17439 trim_cache size 0 max 16384 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: "544d836b-f422-4bb8-9be3-f867be94bd5a": { 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "544d836b-f422-4bb8-9be3-f867be94bd5a", 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:31:55.127 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa080afc60 msgr2=0x7ffa080b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa080afc60 0x7ffa080b2170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa18004af0 tx=0x7ffa18005d80 comp rx=0 tx=0).stop 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20102af0 msgr2=0x7ffa201995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20102af0 0x7ffa201995c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000d950 tx=0x7ffa1000de10 comp rx=0 tx=0).stop 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 shutdown_connections 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ffa080afc60 0x7ffa080b2170 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2010d380 0x7ffa2019dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa20108a20 0x7ffa20199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 --2- 172.21.15.80:0/2788668768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa20102af0 0x7ffa201995c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:31:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 >> 172.21.15.80:0/2788668768 conn(0x7ffa20078100 msgr2=0x7ffa201040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:31:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 shutdown_connections 2024-04-25T11:31:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:31:55.132+0000 7ffa25538640 1 -- 172.21.15.80:0/2788668768 wait complete. 2024-04-25T11:31:55.132 INFO:tasks.cephfs.filesystem:scrub status for tag:544d836b-f422-4bb8-9be3-f867be94bd5a - {'path': '/', 'tag': '544d836b-f422-4bb8-9be3-f867be94bd5a', 'options': 'recursive,force'} 2024-04-25T11:31:56.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:56 smithi082 ceph-mon[32440]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:56.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:56 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:31:56.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:56 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:56.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:56 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:31:56.490 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:56 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:56.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:56 smithi080 ceph-mon[29126]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:56.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:56 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:31:56.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:56 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:56.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:56 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:31:56.625 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:56 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:56.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:56 smithi196 ceph-mon[32659]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:31:56.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:56 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:31:56.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:56 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:56.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:56 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:31:56.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:56 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:31:58.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:58 smithi082 ceph-mon[32440]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9 op/s 2024-04-25T11:31:58.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:31:58 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:31:58.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:58 smithi080 ceph-mon[29126]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9 op/s 2024-04-25T11:31:58.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:31:58 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:31:58.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:58 smithi196 ceph-mon[32659]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9 op/s 2024-04-25T11:31:58.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:31:58 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:32:00.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:00 smithi080 ceph-mon[29126]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:00.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:00 smithi196 ceph-mon[32659]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:00.740 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:00 smithi082 ceph-mon[32440]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:02.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:02 smithi080 ceph-mon[29126]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9 op/s 2024-04-25T11:32:02.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:02 smithi196 ceph-mon[32659]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9 op/s 2024-04-25T11:32:02.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:02 smithi082 ceph-mon[32440]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9 op/s 2024-04-25T11:32:04.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:04 smithi080 ceph-mon[29126]: pgmap v240: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:04.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:04 smithi196 ceph-mon[32659]: pgmap v240: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:04.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:04 smithi082 ceph-mon[32440]: pgmap v240: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:06.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:06 smithi080 ceph-mon[29126]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:06.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:06 smithi196 ceph-mon[32659]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:06.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:06 smithi082 ceph-mon[32440]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6 op/s 2024-04-25T11:32:08.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:08 smithi080 ceph-mon[29126]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-04-25T11:32:08.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:08 smithi196 ceph-mon[32659]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-04-25T11:32:08.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:08 smithi082 ceph-mon[32440]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-04-25T11:32:09.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:09 smithi080 ceph-mon[29126]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T11:32:09.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:09 smithi196 ceph-mon[32659]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T11:32:09.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:09 smithi082 ceph-mon[32440]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T11:32:10.587 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:10 smithi196 ceph-mon[32659]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:32:10.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:10 smithi080 ceph-mon[29126]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:32:10.640 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:10 smithi082 ceph-mon[32440]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:32:12.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:12 smithi080 ceph-mon[29126]: pgmap v245: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:32:12.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:12 smithi080 ceph-mon[29126]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T11:32:12.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:12 smithi196 ceph-mon[32659]: pgmap v245: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:32:12.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:12 smithi196 ceph-mon[32659]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T11:32:12.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:12 smithi082 ceph-mon[32440]: pgmap v245: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:32:12.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:12 smithi082 ceph-mon[32440]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T11:32:14.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:14 smithi080 ceph-mon[29126]: pgmap v247: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:32:14.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:14 smithi196 ceph-mon[32659]: pgmap v247: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:32:14.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:14 smithi082 ceph-mon[32440]: pgmap v247: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:32:16.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:16 smithi080 ceph-mon[29126]: pgmap v248: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:32:16.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:16 smithi196 ceph-mon[32659]: pgmap v248: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:32:16.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:16 smithi082 ceph-mon[32440]: pgmap v248: 97 pgs: 97 active+clean; 2.3 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:32:18.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:18 smithi080 ceph-mon[29126]: pgmap v249: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 237 B/s wr, 7 op/s 2024-04-25T11:32:18.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:18 smithi196 ceph-mon[32659]: pgmap v249: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 237 B/s wr, 7 op/s 2024-04-25T11:32:18.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:18 smithi082 ceph-mon[32440]: pgmap v249: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 237 B/s wr, 7 op/s 2024-04-25T11:32:20.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:20 smithi080 ceph-mon[29126]: pgmap v250: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:32:20.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:20 smithi196 ceph-mon[32659]: pgmap v250: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:32:20.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:20 smithi082 ceph-mon[32440]: pgmap v250: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:32:22.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:22 smithi080 ceph-mon[29126]: pgmap v251: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:32:22.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:22 smithi196 ceph-mon[32659]: pgmap v251: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:32:22.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:22 smithi082 ceph-mon[32440]: pgmap v251: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:32:24.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:24 smithi080 ceph-mon[29126]: pgmap v252: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:32:24.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:24 smithi196 ceph-mon[32659]: pgmap v252: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:32:24.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:24 smithi082 ceph-mon[32440]: pgmap v252: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:32:25.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:32:25.134 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/4192518579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac10d380 msgr2=0x7f7aac10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/4192518579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac10d380 0x7f7aac10f7a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009ca0 tx=0x7f7aa402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/4192518579 shutdown_connections 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/4192518579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac10d380 0x7f7aac10f7a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/4192518579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7aac102af0 0x7f7aac102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/4192518579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aac108a20 0x7f7aac1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/4192518579 >> 172.21.15.80:0/4192518579 conn(0x7f7aac078100 msgr2=0x7f7aac078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/4192518579 shutdown_connections 2024-04-25T11:32:25.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.274+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/4192518579 wait complete. 2024-04-25T11:32:25.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.275+0000 7f7ab1bb4640 1 Processor -- start 2024-04-25T11:32:25.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.275+0000 7f7ab1bb4640 1 -- start start 2024-04-25T11:32:25.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7ab1bb4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac102af0 0x7f7aac19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7ab1bb4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aac108a20 0x7f7aac19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7ab1bb4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7aac10d380 0x7f7aac19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7ab1bb4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac112c00 con 0x7f7aac102af0 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7ab1bb4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac112a80 con 0x7f7aac108a20 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7ab1bb4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac112d80 con 0x7f7aac10d380 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac102af0 0x7f7aac19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac102af0 0x7f7aac19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44682/0 (socket says 172.21.15.80:44682) 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 -- 172.21.15.80:0/3064763894 learned_addr learned my addr 172.21.15.80:0/3064763894 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aac108a20 0x7f7aac19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aabfff640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7aac10d380 0x7f7aac19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 -- 172.21.15.80:0/3064763894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7aac10d380 msgr2=0x7f7aac19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7aac10d380 0x7f7aac19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 -- 172.21.15.80:0/3064763894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aac108a20 msgr2=0x7f7aac19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aac108a20 0x7f7aac19ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 -- 172.21.15.80:0/3064763894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac1a6850 con 0x7f7aac102af0 2024-04-25T11:32:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aabfff640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7aac10d380 0x7f7aac19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac102af0 0x7f7aac19b540 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0005fd0 tx=0x7f7aa000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.276+0000 7f7aa8ff9640 1 -- 172.21.15.80:0/3064763894 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0017070 con 0x7f7aac102af0 2024-04-25T11:32:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.277+0000 7f7aa8ff9640 1 -- 172.21.15.80:0/3064763894 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa0009c30 con 0x7f7aac102af0 2024-04-25T11:32:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.277+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aac1a6b40 con 0x7f7aac102af0 2024-04-25T11:32:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.277+0000 7f7aa8ff9640 1 -- 172.21.15.80:0/3064763894 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0003d30 con 0x7f7aac102af0 2024-04-25T11:32:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.277+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aac1a7090 con 0x7f7aac102af0 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.279+0000 7f7aa8ff9640 1 -- 172.21.15.80:0/3064763894 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f7aa0003ed0 con 0x7f7aac102af0 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.279+0000 7f7ab8a62740 1 Processor -- start 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.279+0000 7f7ab8a62740 1 -- start start 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb531910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1684d0 0x5617fb531e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb542d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5617fb497d80 con 0x5617fb1684d0 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aa8ff9640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7a940afc60 0x7f7a940b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5617fb4518b0 con 0x5617fb1706b0 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5617fb493d40 con 0x5617fb191390 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1684d0 0x5617fb531e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aabfff640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7a940afc60 0x7f7a940b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1684d0 0x5617fb531e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44684/0 (socket says 172.21.15.80:44684) 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 -- 172.21.15.80:0/804086599 learned_addr learned my addr 172.21.15.80:0/804086599 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aabfff640 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb531910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb542d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aa8ff9640 1 -- 172.21.15.80:0/3064763894 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f7aa00decf0 con 0x7f7aac102af0 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 -- 172.21.15.80:0/804086599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 msgr2=0x5617fb531910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb531910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 -- 172.21.15.80:0/804086599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 msgr2=0x5617fb542d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb542d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aab7fe640 1 -- 172.21.15.80:0/804086599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fb422a40 con 0x5617fb1684d0 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.280+0000 7f7aabfff640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7a940afc60 0x7f7a940b2170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009a60 tx=0x7f7aa402f480 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.281+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1684d0 0x5617fb531e50 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00a6b70 tx=0x7f7aa00a6d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847553ee55f41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.281+0000 7f7a91ffb640 1 -- 172.21.15.80:0/804086599 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00a7570 con 0x5617fb1684d0 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.281+0000 7f7a91ffb640 1 -- 172.21.15.80:0/804086599 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa0009de0 con 0x5617fb1684d0 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.281+0000 7f7a91ffb640 1 -- 172.21.15.80:0/804086599 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00a3100 con 0x5617fb1684d0 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 -- 172.21.15.80:0/804086599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1684d0 msgr2=0x5617fb531e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1684d0 0x5617fb531e50 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00a6b70 tx=0x7f7aa00a6d00 comp rx=0 tx=0).stop 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 -- 172.21.15.80:0/804086599 shutdown_connections 2024-04-25T11:32:25.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1684d0 0x5617fb531e50 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb542d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/804086599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb531910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 -- 172.21.15.80:0/804086599 >> 172.21.15.80:0/804086599 conn(0x5617fb1854e0 msgr2=0x5617fb52e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 -- 172.21.15.80:0/804086599 shutdown_connections 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 -- 172.21.15.80:0/804086599 wait complete. 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 -- start start 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.282+0000 7f7ab8a62740 1 Processor -- start 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1684d0 0x5617fb540950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb540e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb54c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5617fb543330 con 0x5617fb1706b0 2024-04-25T11:32:25.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5617fb41ed10 con 0x5617fb1684d0 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5617fb5434b0 con 0x5617fb191390 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 10 client.0 _ll_register_callbacks cb 0x5617fb44b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb540e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb540e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44686/0 (socket says 172.21.15.80:44686) 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 -- 172.21.15.80:0/378969771 learned_addr learned my addr 172.21.15.80:0/378969771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1684d0 0x5617fb540950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aabfff640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb54c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 -- 172.21.15.80:0/378969771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 msgr2=0x5617fb54c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb54c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 -- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1684d0 msgr2=0x5617fb540950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1684d0 0x5617fb540950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 -- 172.21.15.80:0/378969771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fb2737d0 con 0x5617fb1706b0 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1684d0 0x5617fb540950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aabfff640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb54c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb540e90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00bf00 tx=0x7f7a9c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c634643a1a8916f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7a8affd640 1 -- 172.21.15.80:0/378969771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0108a0 con 0x5617fb1706b0 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7a8affd640 1 -- 172.21.15.80:0/378969771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f7a9c010a40 con 0x5617fb1706b0 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.283+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aa0009de0 con 0x5617fb1706b0 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7a8affd640 1 -- 172.21.15.80:0/378969771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7a9c010c40 con 0x5617fb1706b0 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 10 client.17451 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:25.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5617fb1a93f0 con 0x5617fb1706b0 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7a8affd640 1 -- 172.21.15.80:0/378969771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa0009de0 con 0x5617fb1706b0 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7a8affd640 1 -- 172.21.15.80:0/378969771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7a9c019070 con 0x5617fb1706b0 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 10 client.17451 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 10 client.17451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 20 client.17451 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb14ff60 0x5617fb552b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 4 client.17451 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617fb4a5990 con 0x5617fb14ff60 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.284+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb14ff60 0x5617fb552b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.285+0000 7f7a8affd640 10 client.17451 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:25.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.285+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb14ff60 0x5617fb552b50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a516aad5d1fb58be server_cookie=c854f3a3613e75be in_seq=0 out_seq=0 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7a8affd640 1 -- 172.21.15.80:0/378969771 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5617fb4a5990 con 0x5617fb14ff60 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7a8affd640 10 client.17451 handle_command_reply: tid=0 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 client.17451 shutdown 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 msgr2=0x5617fb540e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb540e90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00bf00 tx=0x7f7a9c012820 comp rx=0 tx=0).stop 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 shutdown_connections 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb14ff60 0x5617fb552b50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb540e90 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb191390 0x5617fb54c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/378969771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1684d0 0x5617fb540950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7a8affd640 0 client.17451 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:25.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 >> 172.21.15.80:0/378969771 conn(0x5617fb1854e0 msgr2=0x5617fb52c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 shutdown_connections 2024-04-25T11:32:25.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 1 -- 172.21.15.80:0/378969771 wait complete. 2024-04-25T11:32:25.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.286+0000 7f7ab8a62740 20 client.17451 trim_cache size 0 max 16384 2024-04-25T11:32:25.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.304+0000 7f7ab8a62740 1 Processor -- start 2024-04-25T11:32:25.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.304+0000 7f7ab8a62740 1 -- start start 2024-04-25T11:32:25.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.304+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb558310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb558850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb191390 0x5617fb54c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1b0220 con 0x5617fb191390 2024-04-25T11:32:25.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1adaf0 con 0x5617fb1706b0 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1ab960 con 0x5617fb1684d0 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb191390 0x5617fb54c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb191390 0x5617fb54c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44696/0 (socket says 172.21.15.80:44696) 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 -- 172.21.15.80:0/2449433495 learned_addr learned my addr 172.21.15.80:0/2449433495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb558850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb558310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 -- 172.21.15.80:0/2449433495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 msgr2=0x5617fb558310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb558310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 -- 172.21.15.80:0/2449433495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 msgr2=0x5617fb558850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb558850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 -- 172.21.15.80:0/2449433495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fb1690f0 con 0x5617fb191390 2024-04-25T11:32:25.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.305+0000 7f7aabfff640 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb191390 0x5617fb54c4b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4035000 tx=0x7f7aa402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5e878d92b23e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.307+0000 7f7a917fa640 1 -- 172.21.15.80:0/2449433495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4031630 con 0x5617fb191390 2024-04-25T11:32:25.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.307+0000 7f7a917fa640 1 -- 172.21.15.80:0/2449433495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa4036070 con 0x5617fb191390 2024-04-25T11:32:25.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.307+0000 7f7a917fa640 1 -- 172.21.15.80:0/2449433495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4004780 con 0x5617fb191390 2024-04-25T11:32:25.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 -- 172.21.15.80:0/2449433495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb191390 msgr2=0x5617fb54c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb191390 0x5617fb54c4b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4035000 tx=0x7f7aa402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 -- 172.21.15.80:0/2449433495 shutdown_connections 2024-04-25T11:32:25.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb191390 0x5617fb54c4b0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb1706b0 0x5617fb558850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/2449433495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb558310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 -- 172.21.15.80:0/2449433495 >> 172.21.15.80:0/2449433495 conn(0x5617fb1854e0 msgr2=0x5617fb52dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 -- 172.21.15.80:0/2449433495 shutdown_connections 2024-04-25T11:32:25.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 -- 172.21.15.80:0/2449433495 wait complete. 2024-04-25T11:32:25.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.308+0000 7f7ab8a62740 1 -- start start 2024-04-25T11:32:25.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 1 Processor -- start 2024-04-25T11:32:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb543e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb544370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb191390 0x5617fb5b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1abfb0 con 0x5617fb1706b0 2024-04-25T11:32:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1ad420 con 0x5617fb191390 2024-04-25T11:32:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac1ac680 con 0x5617fb1684d0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7ab8a62740 10 client.0 _ll_register_callbacks cb 0x7f7a9c00b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb544370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb544370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44704/0 (socket says 172.21.15.80:44704) 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 -- 172.21.15.80:0/3449517598 learned_addr learned my addr 172.21.15.80:0/3449517598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aabfff640 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb191390 0x5617fb5b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb543e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 -- 172.21.15.80:0/3449517598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 msgr2=0x5617fb543e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb543e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 -- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb191390 msgr2=0x5617fb5b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb191390 0x5617fb5b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.309+0000 7f7aaaffd640 1 -- 172.21.15.80:0/3449517598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fb4584b0 con 0x5617fb1706b0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7aaaffd640 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb544370 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5617fb51fc90 tx=0x7f7a9c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6406cb886448e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7a8affd640 1 -- 172.21.15.80:0/3449517598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c005570 con 0x5617fb1706b0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7a8affd640 1 -- 172.21.15.80:0/3449517598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f7a9c0237f0 con 0x5617fb1706b0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aa4036070 con 0x5617fb1706b0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7a8affd640 1 -- 172.21.15.80:0/3449517598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7a9c038050 con 0x5617fb1706b0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 10 client.17457 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5617fb5ba540 con 0x5617fb1706b0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7a8affd640 1 -- 172.21.15.80:0/3449517598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa4036070 con 0x5617fb1706b0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7a8affd640 1 -- 172.21.15.80:0/3449517598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7a9c033030 con 0x5617fb1706b0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 10 client.17457 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 20 client.17457 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb1253a0 0x5617fb5bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 4 client.17457 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.310+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617fb49f800 con 0x5617fb1253a0 2024-04-25T11:32:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb1253a0 0x5617fb5bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7a8affd640 10 client.17457 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7aab7fe640 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb1253a0 0x5617fb5bcd20 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbe6062e25aab4ef server_cookie=d88a6e876e96b846 in_seq=0 out_seq=0 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7a8affd640 1 -- 172.21.15.80:0/3449517598 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5617fb49f800 con 0x5617fb1253a0 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7a8affd640 10 client.17457 handle_command_reply: tid=0 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 client.17457 shutdown 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 msgr2=0x5617fb544370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb544370 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5617fb51fc90 tx=0x7f7a9c005270 comp rx=0 tx=0).stop 2024-04-25T11:32:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 shutdown_connections 2024-04-25T11:32:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5617fb1253a0 0x5617fb5bcd20 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617fb1706b0 0x5617fb544370 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617fb191390 0x5617fb5b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 --2- 172.21.15.80:0/3449517598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5617fb1684d0 0x5617fb543e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7a8affd640 0 client.17457 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.311+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 >> 172.21.15.80:0/3449517598 conn(0x5617fb1854e0 msgr2=0x5617fb53f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 shutdown_connections 2024-04-25T11:32:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab8a62740 1 -- 172.21.15.80:0/3449517598 wait complete. 2024-04-25T11:32:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab8a62740 20 client.17457 trim_cache size 0 max 16384 2024-04-25T11:32:25.311 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:32:25.312 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:32:25.312 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:32:25.312 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:32:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7a940afc60 msgr2=0x7f7a940b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7a940afc60 0x7f7a940b2170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009a60 tx=0x7f7aa402f480 comp rx=0 tx=0).stop 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac102af0 msgr2=0x7f7aac19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac102af0 0x7f7aac19b540 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0005fd0 tx=0x7f7aa000dde0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 shutdown_connections 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f7a940afc60 0x7f7a940b2170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7aac10d380 0x7f7aac19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7aac108a20 0x7f7aac19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 --2- 172.21.15.80:0/3064763894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7aac102af0 0x7f7aac19b540 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 >> 172.21.15.80:0/3064763894 conn(0x7f7aac078100 msgr2=0x7f7aac1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 shutdown_connections 2024-04-25T11:32:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.312+0000 7f7ab1bb4640 1 -- 172.21.15.80:0/3064763894 wait complete. 2024-04-25T11:32:25.315 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:32:25.315 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:32:25.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 -- 172.21.15.80:0/2088955448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624110380 msgr2=0x7f16241127a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 --2- 172.21.15.80:0/2088955448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624110380 0x7f16241127a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f1614009900 tx=0x7f161402a480 comp rx=0 tx=0).stop 2024-04-25T11:32:25.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 -- 172.21.15.80:0/2088955448 shutdown_connections 2024-04-25T11:32:25.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 --2- 172.21.15.80:0/2088955448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624110380 0x7f16241127a0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 --2- 172.21.15.80:0/2088955448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f162410da20 0x7f162410fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 --2- 172.21.15.80:0/2088955448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1624076410 0x7f1624076820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 -- 172.21.15.80:0/2088955448 >> 172.21.15.80:0/2088955448 conn(0x7f16240ff210 msgr2=0x7f1624101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 -- 172.21.15.80:0/2088955448 shutdown_connections 2024-04-25T11:32:25.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 -- 172.21.15.80:0/2088955448 wait complete. 2024-04-25T11:32:25.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.434+0000 7f16299d6640 1 Processor -- start 2024-04-25T11:32:25.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16299d6640 1 -- start start 2024-04-25T11:32:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16299d6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624076410 0x7f16241a2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16299d6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f162410da20 0x7f16241a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16299d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1624110380 0x7f162419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16299d6640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1624115ef0 con 0x7f1624076410 2024-04-25T11:32:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16299d6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1624115d70 con 0x7f1624110380 2024-04-25T11:32:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16299d6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1624116070 con 0x7f162410da20 2024-04-25T11:32:25.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624076410 0x7f16241a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624076410 0x7f16241a2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44708/0 (socket says 172.21.15.80:44708) 2024-04-25T11:32:25.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 -- 172.21.15.80:0/1094698268 learned_addr learned my addr 172.21.15.80:0/1094698268 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16227fc640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f162410da20 0x7f16241a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f16237fe640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1624110380 0x7f162419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 -- 172.21.15.80:0/1094698268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f162410da20 msgr2=0x7f16241a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f162410da20 0x7f16241a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 -- 172.21.15.80:0/1094698268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1624110380 msgr2=0x7f162419c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1624110380 0x7f162419c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.435+0000 7f1622ffd640 1 -- 172.21.15.80:0/1094698268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162419ce00 con 0x7f1624076410 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.436+0000 7f1622ffd640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624076410 0x7f16241a2550 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f161c00eab0 tx=0x7f161c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.436+0000 7f16289d4640 1 -- 172.21.15.80:0/1094698268 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c00ce40 con 0x7f1624076410 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.436+0000 7f16289d4640 1 -- 172.21.15.80:0/1094698268 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f161c011920 con 0x7f1624076410 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.436+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162419d090 con 0x7f1624076410 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.436+0000 7f16289d4640 1 -- 172.21.15.80:0/1094698268 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c010a30 con 0x7f1624076410 2024-04-25T11:32:25.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.436+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16241a92f0 con 0x7f1624076410 2024-04-25T11:32:25.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.437+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1624077730 con 0x7f1624076410 2024-04-25T11:32:25.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.438+0000 7f16289d4640 1 -- 172.21.15.80:0/1094698268 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f161c010bd0 con 0x7f1624076410 2024-04-25T11:32:25.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.439+0000 7f16289d4640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f160c0afc60 0x7f160c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.439+0000 7f16227fc640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f160c0afc60 0x7f160c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.439+0000 7f16289d4640 1 -- 172.21.15.80:0/1094698268 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f161c0df6c0 con 0x7f1624076410 2024-04-25T11:32:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.439+0000 7f16227fc640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f160c0afc60 0x7f160c0b2170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f162419de70 tx=0x7f161800b390 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.443+0000 7f16289d4640 1 -- 172.21.15.80:0/1094698268 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f161c016030 con 0x7f1624076410 2024-04-25T11:32:25.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.658+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16241a9520 con 0x7f1624076410 2024-04-25T11:32:25.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.659+0000 7f16289d4640 1 -- 172.21.15.80:0/1094698268 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f161c0a7ee0 con 0x7f1624076410 2024-04-25T11:32:25.649 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:32:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:32:25.649 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f160c0afc60 msgr2=0x7f160c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f160c0afc60 0x7f160c0b2170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f162419de70 tx=0x7f161800b390 comp rx=0 tx=0).stop 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624076410 msgr2=0x7f16241a2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624076410 0x7f16241a2550 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f161c00eab0 tx=0x7f161c00ef70 comp rx=0 tx=0).stop 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 shutdown_connections 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f160c0afc60 0x7f160c0b2170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1624110380 0x7f162419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f162410da20 0x7f16241a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 --2- 172.21.15.80:0/1094698268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1624076410 0x7f16241a2550 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 >> 172.21.15.80:0/1094698268 conn(0x7f16240ff210 msgr2=0x7f1624110790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 shutdown_connections 2024-04-25T11:32:25.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.661+0000 7f16299d6640 1 -- 172.21.15.80:0/1094698268 wait complete. 2024-04-25T11:32:25.662 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:32:25.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 -- 172.21.15.80:0/355108005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f0108a20 msgr2=0x7ff9f01025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 --2- 172.21.15.80:0/355108005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f0108a20 0x7ff9f01025b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009900 tx=0x7ff9ec02a410 comp rx=0 tx=0).stop 2024-04-25T11:32:25.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 -- 172.21.15.80:0/355108005 shutdown_connections 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 --2- 172.21.15.80:0/355108005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f010d380 0x7ff9f010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 --2- 172.21.15.80:0/355108005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f0102af0 0x7ff9f0102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 --2- 172.21.15.80:0/355108005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f0108a20 0x7ff9f01025b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 -- 172.21.15.80:0/355108005 >> 172.21.15.80:0/355108005 conn(0x7ff9f0078100 msgr2=0x7ff9f0078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 -- 172.21.15.80:0/355108005 shutdown_connections 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.782+0000 7ff9f8338640 1 -- 172.21.15.80:0/355108005 wait complete. 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 Processor -- start 2024-04-25T11:32:25.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 -- start start 2024-04-25T11:32:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f0102af0 0x7ff9f019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f0108a20 0x7ff9f019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f010d380 0x7ff9f019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0112be0 con 0x7ff9f010d380 2024-04-25T11:32:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0112a60 con 0x7ff9f0102af0 2024-04-25T11:32:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.783+0000 7ff9f8338640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0112d60 con 0x7ff9f0108a20 2024-04-25T11:32:25.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f010d380 0x7ff9f019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f010d380 0x7ff9f019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44726/0 (socket says 172.21.15.80:44726) 2024-04-25T11:32:25.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 -- 172.21.15.80:0/1522976686 learned_addr learned my addr 172.21.15.80:0/1522976686 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f0102af0 0x7ff9f019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f0108a20 0x7ff9f019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 -- 172.21.15.80:0/1522976686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f0108a20 msgr2=0x7ff9f019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f0108a20 0x7ff9f019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 -- 172.21.15.80:0/1522976686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f0102af0 msgr2=0x7ff9f019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f0102af0 0x7ff9f019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 -- 172.21.15.80:0/1522976686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f019f550 con 0x7ff9f010d380 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f68d5640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f010d380 0x7ff9f019ef10 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800eaa0 tx=0x7ff9e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9e77fe640 1 -- 172.21.15.80:0/1522976686 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800cdb0 con 0x7ff9f010d380 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f019f840 con 0x7ff9f010d380 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9e77fe640 1 -- 172.21.15.80:0/1522976686 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e8005020 con 0x7ff9f010d380 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9e77fe640 1 -- 172.21.15.80:0/1522976686 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80116d0 con 0x7ff9f010d380 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.784+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f019fd40 con 0x7ff9f010d380 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9e77fe640 1 -- 172.21.15.80:0/1522976686 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff9e80051d0 con 0x7ff9f010d380 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 Processor -- start 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 -- start start 2024-04-25T11:32:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de71c390 0x5564deabd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deabdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de6fb6b0 0x5564deaca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5564dea22d80 con 0x5564de6fb6b0 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5564de9dca20 con 0x5564de6f34d0 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.787+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5564dea1ed40 con 0x5564de71c390 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de6fb6b0 0x5564deaca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9e77fe640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff9dc0afce0 0x7ff9dc0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de6fb6b0 0x5564deaca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44732/0 (socket says 172.21.15.80:44732) 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 -- 172.21.15.80:0/967023601 learned_addr learned my addr 172.21.15.80:0/967023601 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de71c390 0x5564deabd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deabdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f68d5640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff9dc0afce0 0x7ff9dc0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9e77fe640 1 -- 172.21.15.80:0/1522976686 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7ff9e80df260 con 0x7ff9f010d380 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 -- 172.21.15.80:0/967023601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de71c390 msgr2=0x5564deabd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de71c390 0x5564deabd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 -- 172.21.15.80:0/967023601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 msgr2=0x5564deabdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deabdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 -- 172.21.15.80:0/967023601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564de9e7c30 con 0x5564de6fb6b0 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f68d5640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff9dc0afce0 0x7ff9dc0b21f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80a46a0 tx=0x7ff9e8075f30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de6fb6b0 0x5564deaca6a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x5564deabe910 tx=0x7ff9e0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c22608b79580bce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.788+0000 7ff9e4bfe640 1 -- 172.21.15.80:0/967023601 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0004030 con 0x5564de6fb6b0 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9e4bfe640 1 -- 172.21.15.80:0/967023601 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e0005020 con 0x5564de6fb6b0 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9e4bfe640 1 -- 172.21.15.80:0/967023601 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0004b00 con 0x5564de6fb6b0 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/967023601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de6fb6b0 msgr2=0x5564deaca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de6fb6b0 0x5564deaca6a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x5564deabe910 tx=0x7ff9e0005850 comp rx=0 tx=0).stop 2024-04-25T11:32:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/967023601 shutdown_connections 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de6fb6b0 0x5564deaca6a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deabdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/967023601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de71c390 0x5564deabd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/967023601 >> 172.21.15.80:0/967023601 conn(0x5564de7104e0 msgr2=0x5564deab9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/967023601 shutdown_connections 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.789+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/967023601 wait complete. 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 -- start start 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 Processor -- start 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deac8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564dead4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5564deacad90 con 0x5564de71c390 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5564de9a9dc0 con 0x5564de6f34d0 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5564deacaf10 con 0x5564de6fb6b0 2024-04-25T11:32:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9ff1ec740 10 client.0 _ll_register_callbacks cb 0x5564de9c5600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564dead4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564dead4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44738/0 (socket says 172.21.15.80:44738) 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9f58d3640 1 -- 172.21.15.80:0/2250032512 learned_addr learned my addr 172.21.15.80:0/2250032512 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deac8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.790+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9f58d3640 1 -- 172.21.15.80:0/2250032512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 msgr2=0x5564deac8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9f58d3640 1 -- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 msgr2=0x5564deac8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deac8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9f58d3640 1 -- 172.21.15.80:0/2250032512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564de7343f0 con 0x5564de71c390 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564dead4210 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00047e0 tx=0x7ff9e0009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4defe898cb60ddc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/2250032512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0004050 con 0x5564de71c390 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/2250032512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7ff9e0019040 con 0x5564de71c390 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e0005020 con 0x5564de71c390 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/2250032512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9e0035050 con 0x5564de71c390 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9ff1ec740 10 client.17475 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5564de7fe7d0 con 0x5564de71c390 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.791+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/2250032512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e0005020 con 0x5564de71c390 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/2250032512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff9e000f8b0 con 0x5564de71c390 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9ff1ec740 10 client.17475 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9ff1ec740 10 client.17475 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9ff1ec740 20 client.17475 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6daf60 0x5564deada4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9ff1ec740 4 client.17475 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564dea30990 con 0x5564de6daf60 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6daf60 0x5564deada4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9d9ffb640 10 client.17475 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.792+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6daf60 0x5564deada4b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59592cd175b78b4e server_cookie=8ed7108557a17527 in_seq=0 out_seq=0 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/2250032512 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5564dea30990 con 0x5564de6daf60 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9d9ffb640 10 client.17475 handle_command_reply: tid=0 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 client.17475 shutdown 2024-04-25T11:32:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 msgr2=0x5564dead4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564dead4210 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00047e0 tx=0x7ff9e0009f70 comp rx=0 tx=0).stop 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 shutdown_connections 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6daf60 0x5564deada4b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564dead4210 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9d9ffb640 0 client.17475 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/2250032512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564deac8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 >> 172.21.15.80:0/2250032512 conn(0x5564de7104e0 msgr2=0x5564deabf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.793+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 shutdown_connections 2024-04-25T11:32:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.794+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/2250032512 wait complete. 2024-04-25T11:32:25.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.794+0000 7ff9ff1ec740 20 client.17475 trim_cache size 0 max 16384 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 Processor -- start 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 -- start start 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564dead3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deadfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01b2270 con 0x5564de71c390 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01afb40 con 0x5564de6f34d0 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.807+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ad9b0 con 0x5564de6fb6b0 2024-04-25T11:32:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deadfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deadfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44752/0 (socket says 172.21.15.80:44752) 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1386046160 learned_addr learned my addr 172.21.15.80:0/1386046160 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564dead3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1386046160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 msgr2=0x5564deac9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1386046160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 msgr2=0x5564dead3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564dead3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1386046160 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564deab5500 con 0x5564de71c390 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deadfb10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097a0 tx=0x7ff9e0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8345e67eb764262 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9dbfff640 1 -- 172.21.15.80:0/1386046160 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e003e070 con 0x5564de71c390 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9dbfff640 1 -- 172.21.15.80:0/1386046160 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e0005570 con 0x5564de71c390 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.808+0000 7ff9dbfff640 1 -- 172.21.15.80:0/1386046160 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0004810 con 0x5564de71c390 2024-04-25T11:32:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1386046160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 msgr2=0x5564deadfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deadfb10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097a0 tx=0x7ff9e0005f90 comp rx=0 tx=0).stop 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1386046160 shutdown_connections 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deadfb10 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564deac9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1386046160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564dead3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1386046160 >> 172.21.15.80:0/1386046160 conn(0x5564de7104e0 msgr2=0x5564deac9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1386046160 shutdown_connections 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1386046160 wait complete. 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 -- start start 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.809+0000 7ff9ff1ec740 1 Processor -- start 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564dead0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564dead0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deacd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ae000 con 0x5564de71c390 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01af470 con 0x5564de6f34d0 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ae6d0 con 0x5564de6fb6b0 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 10 client.0 _ll_register_callbacks cb 0x7ff9ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deacd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deacd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44762/0 (socket says 172.21.15.80:44762) 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1558029595 learned_addr learned my addr 172.21.15.80:0/1558029595 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564dead0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1558029595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 msgr2=0x5564dead0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564dead0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1558029595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 msgr2=0x5564dead0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564dead0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 -- 172.21.15.80:0/1558029595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564deacdb20 con 0x5564de71c390 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564dead0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9f58d3640 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deacd510 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0000c00 tx=0x7ff9e0005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ddb9626ff86df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/1558029595 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e003e070 con 0x5564de71c390 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/1558029595 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7ff9e000f990 con 0x5564de71c390 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.810+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e0005570 con 0x5564de71c390 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/1558029595 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9e0011020 con 0x5564de71c390 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 10 client.17481 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5564deb41fe0 con 0x5564de71c390 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/1558029595 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e0005570 con 0x5564de71c390 2024-04-25T11:32:25.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/1558029595 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff9e0042020 con 0x5564de71c390 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 10 client.17481 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 10 client.17481 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 20 client.17481 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6b03a0 0x5564deb44620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 4 client.17481 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564deabe0e0 con 0x5564de6b03a0 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.811+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6b03a0 0x5564deb44620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9f60d4640 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6b03a0 0x5564deb44620 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=405c6aede56fb9c4 server_cookie=f14654ddbbc5ebcc in_seq=0 out_seq=0 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9d9ffb640 10 client.17481 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9d9ffb640 1 -- 172.21.15.80:0/1558029595 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564deabe0e0 con 0x5564de6b03a0 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9d9ffb640 10 client.17481 handle_command_reply: tid=0 2024-04-25T11:32:25.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 client.17481 shutdown 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 msgr2=0x5564deacd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deacd510 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0000c00 tx=0x7ff9e0005dc0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 shutdown_connections 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5564de6b03a0 0x5564deb44620 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5564de71c390 0x5564deacd510 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5564de6fb6b0 0x5564dead0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9d9ffb640 0 client.17481 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 --2- 172.21.15.80:0/1558029595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564de6f34d0 0x5564dead0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 >> 172.21.15.80:0/1558029595 conn(0x5564de7104e0 msgr2=0x5564deaca100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 shutdown_connections 2024-04-25T11:32:25.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 1 -- 172.21.15.80:0/1558029595 wait complete. 2024-04-25T11:32:25.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.812+0000 7ff9ff1ec740 20 client.17481 trim_cache size 0 max 16384 2024-04-25T11:32:25.813 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:32:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff9dc0afce0 msgr2=0x7ff9dc0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff9dc0afce0 0x7ff9dc0b21f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80a46a0 tx=0x7ff9e8075f30 comp rx=0 tx=0).stop 2024-04-25T11:32:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f010d380 msgr2=0x7ff9f019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f010d380 0x7ff9f019ef10 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800eaa0 tx=0x7ff9e800ef60 comp rx=0 tx=0).stop 2024-04-25T11:32:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 shutdown_connections 2024-04-25T11:32:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff9dc0afce0 0x7ff9dc0b21f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9f010d380 0x7ff9f019ef10 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f0108a20 0x7ff9f019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 --2- 172.21.15.80:0/1522976686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f0102af0 0x7ff9f019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 >> 172.21.15.80:0/1522976686 conn(0x7ff9f0078100 msgr2=0x7ff9f0069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 shutdown_connections 2024-04-25T11:32:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.813+0000 7ff9f8338640 1 -- 172.21.15.80:0/1522976686 wait complete. 2024-04-25T11:32:25.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:32:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 -- 172.21.15.80:0/4110760224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c103170 msgr2=0x7f564c10f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 --2- 172.21.15.80:0/4110760224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c103170 0x7f564c10f4a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5644009ca0 tx=0x7f564402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 -- 172.21.15.80:0/4110760224 shutdown_connections 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 --2- 172.21.15.80:0/4110760224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c103170 0x7f564c10f4a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 --2- 172.21.15.80:0/4110760224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f564c108eb0 0x7f564c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 --2- 172.21.15.80:0/4110760224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f564c108a10 0x7f564c1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 -- 172.21.15.80:0/4110760224 >> 172.21.15.80:0/4110760224 conn(0x7f564c078150 msgr2=0x7f564c078590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 -- 172.21.15.80:0/4110760224 shutdown_connections 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.936+0000 7f5650892640 1 -- 172.21.15.80:0/4110760224 wait complete. 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.937+0000 7f5650892640 1 Processor -- start 2024-04-25T11:32:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.937+0000 7f5650892640 1 -- start start 2024-04-25T11:32:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.937+0000 7f5650892640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f564c103170 0x7f564c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5650892640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c108a10 0x7f564c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5650892640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f564c108eb0 0x7f564c19de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5650892640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f564c112ca0 con 0x7f564c108a10 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5650892640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f564c112b20 con 0x7f564c103170 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5650892640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f564c112e20 con 0x7f564c108eb0 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c108a10 0x7f564c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c108a10 0x7f564c199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44776/0 (socket says 172.21.15.80:44776) 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 -- 172.21.15.80:0/2023299029 learned_addr learned my addr 172.21.15.80:0/2023299029 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f564ad9d640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f564c108eb0 0x7f564c19de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f564a59c640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f564c103170 0x7f564c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 -- 172.21.15.80:0/2023299029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f564c108eb0 msgr2=0x7f564c19de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f564c108eb0 0x7f564c19de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 -- 172.21.15.80:0/2023299029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f564c103170 msgr2=0x7f564c199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f564c103170 0x7f564c199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 -- 172.21.15.80:0/2023299029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c19e4c0 con 0x7f564c108a10 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f564a59c640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f564c103170 0x7f564c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:25.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5643fff640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c108a10 0x7f564c199bc0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f563400d740 tx=0x7f563400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f56437fe640 1 -- 172.21.15.80:0/2023299029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634017070 con 0x7f564c108a10 2024-04-25T11:32:25.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f56437fe640 1 -- 172.21.15.80:0/2023299029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f563400de50 con 0x7f564c108a10 2024-04-25T11:32:25.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f56437fe640 1 -- 172.21.15.80:0/2023299029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634003c20 con 0x7f564c108a10 2024-04-25T11:32:25.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564c19e7b0 con 0x7f564c108a10 2024-04-25T11:32:25.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.938+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564c1a6130 con 0x7f564c108a10 2024-04-25T11:32:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 Processor -- start 2024-04-25T11:32:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 -- start start 2024-04-25T11:32:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b6d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27a34d0 0x5588b2b6dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27ab6b0 0x5588b2b7c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5588b2ad2d80 con 0x5588b27a34d0 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5588b2a8ca20 con 0x5588b27ab6b0 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f5657816740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5588b2aced40 con 0x5588b27cc390 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f56437fe640 1 -- 172.21.15.80:0/2023299029 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f5634004020 con 0x7f564c108a10 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f564a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27a34d0 0x5588b2b6dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f564a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27a34d0 0x5588b2b6dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44784/0 (socket says 172.21.15.80:44784) 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f564a59c640 1 -- 172.21.15.80:0/1348942280 learned_addr learned my addr 172.21.15.80:0/1348942280 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.941+0000 7f564ad9d640 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b6d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f564a59c640 1 -- 172.21.15.80:0/1348942280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 msgr2=0x5588b2b6d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f564a59c640 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b6d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f564a59c640 1 -- 172.21.15.80:0/1348942280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27ab6b0 msgr2=0x5588b2b7c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f564a59c640 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27ab6b0 0x5588b2b7c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f564a59c640 1 -- 172.21.15.80:0/1348942280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b2a97c30 con 0x5588b27a34d0 2024-04-25T11:32:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f564a59c640 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27a34d0 0x5588b2b6dc20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f563c009bf0 tx=0x7f563c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c18cb83ef686d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f5640ff9640 1 -- 172.21.15.80:0/1348942280 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c016070 con 0x5588b27a34d0 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f56437fe640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56380afc60 0x7f56380b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f5640ff9640 1 -- 172.21.15.80:0/1348942280 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f563c011920 con 0x5588b27a34d0 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f5640ff9640 1 -- 172.21.15.80:0/1348942280 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c0107f0 con 0x5588b27a34d0 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f564ad9d640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56380afc60 0x7f56380b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.942+0000 7f56437fe640 1 -- 172.21.15.80:0/2023299029 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f56340deb30 con 0x7f564c108a10 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 -- 172.21.15.80:0/1348942280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27a34d0 msgr2=0x5588b2b6dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f564ad9d640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56380afc60 0x7f56380b2170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f564402f540 tx=0x7f564402f310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27a34d0 0x5588b2b6dc20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f563c009bf0 tx=0x7f563c00e6c0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 -- 172.21.15.80:0/1348942280 shutdown_connections 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27a34d0 0x5588b2b6dc20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27ab6b0 0x5588b2b7c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 --2- 172.21.15.80:0/1348942280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b6d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 -- 172.21.15.80:0/1348942280 >> 172.21.15.80:0/1348942280 conn(0x5588b27c04e0 msgr2=0x5588b2b69fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 -- 172.21.15.80:0/1348942280 shutdown_connections 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 -- 172.21.15.80:0/1348942280 wait complete. 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 -- start start 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.943+0000 7f5657816740 1 Processor -- start 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27a34d0 0x5588b2b7a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27cc390 0x5588b2b864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5588b2b7d030 con 0x5588b27ab6b0 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5588b2a59dc0 con 0x5588b27cc390 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5588b2b7d1b0 con 0x5588b27a34d0 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 10 client.0 _ll_register_callbacks cb 0x5588b2a75600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44790/0 (socket says 172.21.15.80:44790) 2024-04-25T11:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 -- 172.21.15.80:0/3415985239 learned_addr learned my addr 172.21.15.80:0/3415985239 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f564a59c640 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27a34d0 0x5588b2b7a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 -- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27a34d0 msgr2=0x5588b2b7a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27a34d0 0x5588b2b7a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 -- 172.21.15.80:0/3415985239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27cc390 msgr2=0x5588b2b864e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f564ad9d640 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27cc390 0x5588b2b864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27cc390 0x5588b2b864e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 -- 172.21.15.80:0/3415985239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b27e43f0 con 0x5588b27ab6b0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5643fff640 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7a9b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f56340a6c40 tx=0x7f56340a6520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc2d2944c133c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5631ffb640 1 -- 172.21.15.80:0/3415985239 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634020040 con 0x5588b27ab6b0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5631ffb640 1 -- 172.21.15.80:0/3415985239 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f56340dc4e0 con 0x5588b27ab6b0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.944+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f563c011920 con 0x5588b27ab6b0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5631ffb640 1 -- 172.21.15.80:0/3415985239 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f56340a6cb0 con 0x5588b27ab6b0 2024-04-25T11:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 10 client.17493 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5588b28ae7d0 con 0x5588b27ab6b0 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5631ffb640 1 -- 172.21.15.80:0/3415985239 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f563c011920 con 0x5588b27ab6b0 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5631ffb640 1 -- 172.21.15.80:0/3415985239 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f56340a2620 con 0x5588b27ab6b0 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 10 client.17493 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 10 client.17493 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 20 client.17493 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b278af60 0x5588b2b8c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 4 client.17493 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588b2ae0990 con 0x5588b278af60 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.945+0000 7f564a59c640 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b278af60 0x5588b2b8c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.946+0000 7f5631ffb640 10 client.17493 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.946+0000 7f564a59c640 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b278af60 0x5588b2b8c880 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fb93b514ce5feb43 server_cookie=f855f81ac6d359ac in_seq=0 out_seq=0 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.946+0000 7f5631ffb640 1 -- 172.21.15.80:0/3415985239 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5588b2ae0990 con 0x5588b278af60 2024-04-25T11:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.946+0000 7f5631ffb640 10 client.17493 handle_command_reply: tid=0 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.946+0000 7f5657816740 1 client.17493 shutdown 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 msgr2=0x5588b2b7a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7a9b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f56340a6c40 tx=0x7f56340a6520 comp rx=0 tx=0).stop 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 shutdown_connections 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7a9b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b278af60 0x5588b2b8c880 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27cc390 0x5588b2b864e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5631ffb640 0 client.17493 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 --2- 172.21.15.80:0/3415985239 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27a34d0 0x5588b2b7a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 >> 172.21.15.80:0/3415985239 conn(0x5588b27c04e0 msgr2=0x5588b2b6f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 shutdown_connections 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 1 -- 172.21.15.80:0/3415985239 wait complete. 2024-04-25T11:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.947+0000 7f5657816740 20 client.17493 trim_cache size 0 max 16384 2024-04-25T11:32:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 Processor -- start 2024-04-25T11:32:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 -- start start 2024-04-25T11:32:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b860c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b68d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f564c1b00c0 con 0x5588b27ab6b0 2024-04-25T11:32:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f564c1ad990 con 0x5588b27a34d0 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5657816740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f564c1ab800 con 0x5588b27cc390 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b860c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b860c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44798/0 (socket says 172.21.15.80:44798) 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 -- 172.21.15.80:0/3424035236 learned_addr learned my addr 172.21.15.80:0/3424035236 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f564ad9d640 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b68d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 -- 172.21.15.80:0/3424035236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 msgr2=0x5588b2b68d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f564a59c640 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b7a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b68d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 -- 172.21.15.80:0/3424035236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 msgr2=0x5588b2b7a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b7a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f5643fff640 1 -- 172.21.15.80:0/3424035236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b2b8cbf0 con 0x5588b27ab6b0 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.961+0000 7f564ad9d640 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b68d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5643fff640 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b860c0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5634009610 tx=0x7f56340036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69899c756cd90ef7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5633fff640 1 -- 172.21.15.80:0/3424035236 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634020070 con 0x5588b27ab6b0 2024-04-25T11:32:25.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5633fff640 1 -- 172.21.15.80:0/3424035236 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56340ab060 con 0x5588b27ab6b0 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5633fff640 1 -- 172.21.15.80:0/3424035236 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340dc4e0 con 0x5588b27ab6b0 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 -- 172.21.15.80:0/3424035236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 msgr2=0x5588b2b860c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b860c0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5634009610 tx=0x7f56340036f0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 -- 172.21.15.80:0/3424035236 shutdown_connections 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b860c0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b68d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 --2- 172.21.15.80:0/3424035236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b7a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 -- 172.21.15.80:0/3424035236 >> 172.21.15.80:0/3424035236 conn(0x5588b27c04e0 msgr2=0x5588b2b68610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.962+0000 7f5657816740 1 -- 172.21.15.80:0/3424035236 shutdown_connections 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 -- 172.21.15.80:0/3424035236 wait complete. 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 -- start start 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 Processor -- start 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b82970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b7e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f564c1abe50 con 0x5588b27ab6b0 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f564c1ad2c0 con 0x5588b27a34d0 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f564c1ac520 con 0x5588b27cc390 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5657816740 10 client.0 _ll_register_callbacks cb 0x7f5634009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5643fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44804/0 (socket says 172.21.15.80:44804) 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f5643fff640 1 -- 172.21.15.80:0/271553880 learned_addr learned my addr 172.21.15.80:0/271553880 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f564a59c640 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b82970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.963+0000 7f564ad9d640 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b7e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5643fff640 1 -- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 msgr2=0x5588b2b7e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5643fff640 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b7e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5643fff640 1 -- 172.21.15.80:0/271553880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 msgr2=0x5588b2b82970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5643fff640 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b82970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5643fff640 1 -- 172.21.15.80:0/271553880 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b2b7e8f0 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5643fff640 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7dcc0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f56340a9040 tx=0x7f56340dc6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac2ed075ba8037 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5631ffb640 1 -- 172.21.15.80:0/271553880 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563406c070 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5631ffb640 1 -- 172.21.15.80:0/271553880 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f56340a2040 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56340ab060 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5631ffb640 1 -- 172.21.15.80:0/271553880 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5634020030 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 10 client.17499 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5588b2bf49b0 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5631ffb640 1 -- 172.21.15.80:0/271553880 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56340ab060 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5631ffb640 1 -- 172.21.15.80:0/271553880 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f563406d270 con 0x5588b27ab6b0 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 10 client.17499 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 10 client.17499 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 20 client.17499 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b27603a0 0x5588b2bf6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 4 client.17499 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.964+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588b2ada800 con 0x5588b27603a0 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f564a59c640 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b27603a0 0x5588b2bf6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5631ffb640 10 client.17499 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f564a59c640 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b27603a0 0x5588b2bf6e40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0698658de43d768 server_cookie=4e757de4cd63ea46 in_seq=0 out_seq=0 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5631ffb640 1 -- 172.21.15.80:0/271553880 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588b2ada800 con 0x5588b27603a0 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5631ffb640 10 client.17499 handle_command_reply: tid=0 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 client.17499 shutdown 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 msgr2=0x5588b2b7dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7dcc0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f56340a9040 tx=0x7f56340dc6f0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 shutdown_connections 2024-04-25T11:32:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5588b27ab6b0 0x5588b2b7dcc0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x5588b27603a0 0x5588b2bf6e40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5588b27cc390 0x5588b2b7e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 --2- 172.21.15.80:0/271553880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5588b27a34d0 0x5588b2b82970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5631ffb640 0 client.17499 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.965+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 >> 172.21.15.80:0/271553880 conn(0x5588b27c04e0 msgr2=0x5588b2b68610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 shutdown_connections 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5657816740 1 -- 172.21.15.80:0/271553880 wait complete. 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5657816740 20 client.17499 trim_cache size 0 max 16384 2024-04-25T11:32:25.962 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:32:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56380afc60 msgr2=0x7f56380b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56380afc60 0x7f56380b2170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f564402f540 tx=0x7f564402f310 comp rx=0 tx=0).stop 2024-04-25T11:32:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c108a10 msgr2=0x7f564c199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c108a10 0x7f564c199bc0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f563400d740 tx=0x7f563400dc00 comp rx=0 tx=0).stop 2024-04-25T11:32:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 shutdown_connections 2024-04-25T11:32:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56380afc60 0x7f56380b2170 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f564c108a10 0x7f564c199bc0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f564c108eb0 0x7f564c19de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 --2- 172.21.15.80:0/2023299029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f564c103170 0x7f564c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 >> 172.21.15.80:0/2023299029 conn(0x7f564c078150 msgr2=0x7f564c100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 shutdown_connections 2024-04-25T11:32:25.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:25.966+0000 7f5650892640 1 -- 172.21.15.80:0/2023299029 wait complete. 2024-04-25T11:32:25.967 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:32:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 -- 172.21.15.80:0/1989577457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf01028b0 msgr2=0x7fdcf0102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 --2- 172.21.15.80:0/1989577457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf01028b0 0x7fdcf0102cc0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009900 tx=0x7fdce002a410 comp rx=0 tx=0).stop 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 -- 172.21.15.80:0/1989577457 shutdown_connections 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 --2- 172.21.15.80:0/1989577457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf0110450 0x7fdcf0112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 --2- 172.21.15.80:0/1989577457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcf010daf0 0x7fdcf010ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 --2- 172.21.15.80:0/1989577457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf01028b0 0x7fdcf0102cc0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 -- 172.21.15.80:0/1989577457 >> 172.21.15.80:0/1989577457 conn(0x7fdcf0078150 msgr2=0x7fdcf0078590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 -- 172.21.15.80:0/1989577457 shutdown_connections 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.086+0000 7fdcf6596640 1 -- 172.21.15.80:0/1989577457 wait complete. 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 Processor -- start 2024-04-25T11:32:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 -- start start 2024-04-25T11:32:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcf01028b0 0x7fdcf01a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf010daf0 0x7fdcf01a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf0110450 0x7fdcf019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf0115ef0 con 0x7fdcf010daf0 2024-04-25T11:32:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf0115d70 con 0x7fdcf0110450 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.087+0000 7fdcf6596640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf0116070 con 0x7fdcf01028b0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf010daf0 0x7fdcf01a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf010daf0 0x7fdcf01a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44832/0 (socket says 172.21.15.80:44832) 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 -- 172.21.15.80:0/202679584 learned_addr learned my addr 172.21.15.80:0/202679584 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdceffff640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcf01028b0 0x7fdcf01a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf0110450 0x7fdcf019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 -- 172.21.15.80:0/202679584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcf01028b0 msgr2=0x7fdcf01a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcf01028b0 0x7fdcf01a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 -- 172.21.15.80:0/202679584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf0110450 msgr2=0x7fdcf019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf0110450 0x7fdcf019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 -- 172.21.15.80:0/202679584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf019cf30 con 0x7fdcf010daf0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf010daf0 0x7fdcf01a2b60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e9f0 tx=0x7fdce400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdced7fa640 1 -- 172.21.15.80:0/202679584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce400ccc0 con 0x7fdcf010daf0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf019d220 con 0x7fdcf010daf0 2024-04-25T11:32:26.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdced7fa640 1 -- 172.21.15.80:0/202679584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce40035f0 con 0x7fdcf010daf0 2024-04-25T11:32:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdced7fa640 1 -- 172.21.15.80:0/202679584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce400ce60 con 0x7fdcf010daf0 2024-04-25T11:32:26.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.088+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf01a9470 con 0x7fdcf010daf0 2024-04-25T11:32:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 Processor -- start 2024-04-25T11:32:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 -- start start 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5254810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e8a4d0 0x55bda5254d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e926b0 0x55bda52616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bda51b9d80 con 0x55bda4eb3390 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bda5173a20 con 0x55bda4e8a4d0 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bda51b5d40 con 0x55bda4e926b0 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdced7fa640 1 -- 172.21.15.80:0/202679584 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fdce4004030 con 0x7fdcf010daf0 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5254810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5254810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44840/0 (socket says 172.21.15.80:44840) 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 -- 172.21.15.80:0/2198654132 learned_addr learned my addr 172.21.15.80:0/2198654132 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdceffff640 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e8a4d0 0x55bda5254d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 -- 172.21.15.80:0/2198654132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e926b0 msgr2=0x55bda52616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e926b0 0x55bda52616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 -- 172.21.15.80:0/2198654132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e8a4d0 msgr2=0x55bda5254d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e8a4d0 0x55bda5254d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.091+0000 7fdcf4b33640 1 -- 172.21.15.80:0/2198654132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bda517ec30 con 0x55bda4eb3390 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.092+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5254810 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009f20 tx=0x7fdce800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61d8d5ae3e3875d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.092+0000 7fdcd67fc640 1 -- 172.21.15.80:0/2198654132 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8015070 con 0x55bda4eb3390 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.092+0000 7fdcd67fc640 1 -- 172.21.15.80:0/2198654132 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce801ab10 con 0x55bda4eb3390 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.092+0000 7fdcd67fc640 1 -- 172.21.15.80:0/2198654132 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8011b60 con 0x55bda4eb3390 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.092+0000 7fdced7fa640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdcd80afc60 0x7fdcd80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.092+0000 7fdceffff640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdcd80afc60 0x7fdcd80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.092+0000 7fdced7fa640 1 -- 172.21.15.80:0/202679584 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fdce40df4d0 con 0x7fdcf010daf0 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 -- 172.21.15.80:0/2198654132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 msgr2=0x55bda5254810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdceffff640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdcd80afc60 0x7fdcd80b2170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdce0000c00 tx=0x7fdce0031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5254810 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009f20 tx=0x7fdce800f7f0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 -- 172.21.15.80:0/2198654132 shutdown_connections 2024-04-25T11:32:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e926b0 0x55bda52616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e8a4d0 0x55bda5254d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/2198654132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5254810 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 -- 172.21.15.80:0/2198654132 >> 172.21.15.80:0/2198654132 conn(0x55bda4ea74e0 msgr2=0x55bda5250fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 -- 172.21.15.80:0/2198654132 shutdown_connections 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 -- 172.21.15.80:0/2198654132 wait complete. 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 -- start start 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.093+0000 7fdcfd44a740 1 Processor -- start 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 0x55bda525f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e926b0 0x55bda525f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4eb3390 0x55bda526b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bda5261d90 con 0x55bda4e926b0 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bda5140dc0 con 0x55bda4eb3390 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bda5261f10 con 0x55bda4e8a4d0 2024-04-25T11:32:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 10 client.0 _ll_register_callbacks cb 0x55bda515c600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e926b0 0x55bda525f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e926b0 0x55bda525f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44844/0 (socket says 172.21.15.80:44844) 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 -- 172.21.15.80:0/3255722352 learned_addr learned my addr 172.21.15.80:0/3255722352 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdceffff640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 0x55bda525f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4eb3390 0x55bda526b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 -- 172.21.15.80:0/3255722352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 msgr2=0x55bda525f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 0x55bda525f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 -- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4eb3390 msgr2=0x55bda526b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4eb3390 0x55bda526b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 -- 172.21.15.80:0/3255722352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bda4ecb3f0 con 0x55bda4e926b0 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4eb3390 0x55bda526b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e926b0 0x55bda525f810 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdce40a36d0 tx=0x7fdce40a6e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f30e2cc08430d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdccf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdccf7fe640 1 -- 172.21.15.80:0/3255722352 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce40a7d50 con 0x55bda4e926b0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdccf7fe640 1 -- 172.21.15.80:0/3255722352 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fdce40a38e0 con 0x55bda4e926b0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.094+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce801ab10 con 0x55bda4e926b0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdccf7fe640 1 -- 172.21.15.80:0/3255722352 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdce40a7650 con 0x55bda4e926b0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 10 client.17511 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bda4f957d0 con 0x55bda4e926b0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdccf7fe640 1 -- 172.21.15.80:0/3255722352 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce801ab10 con 0x55bda4e926b0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdccf7fe640 1 -- 172.21.15.80:0/3255722352 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fdce40b0020 con 0x55bda4e926b0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 10 client.17511 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 20 client.17511 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e71f60 0x55bda52717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 4 client.17511 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bda51c7990 con 0x55bda4e71f60 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.095+0000 7fdceffff640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e71f60 0x55bda52717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.096+0000 7fdceffff640 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e71f60 0x55bda52717c0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae31a7d7c343e02 server_cookie=29ac28552467d59d in_seq=0 out_seq=0 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.096+0000 7fdccf7fe640 10 client.17511 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.096+0000 7fdccf7fe640 1 -- 172.21.15.80:0/3255722352 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bda51c7990 con 0x55bda4e71f60 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.096+0000 7fdccf7fe640 10 client.17511 handle_command_reply: tid=0 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.096+0000 7fdcfd44a740 1 client.17511 shutdown 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e926b0 msgr2=0x55bda525f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e926b0 0x55bda525f810 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdce40a36d0 tx=0x7fdce40a6e80 comp rx=0 tx=0).stop 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 shutdown_connections 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e71f60 0x55bda52717c0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e926b0 0x55bda525f810 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdccf7fe640 0 client.17511 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4eb3390 0x55bda526b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/3255722352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 0x55bda525f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 >> 172.21.15.80:0/3255722352 conn(0x55bda4ea74e0 msgr2=0x55bda5256530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:26.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 shutdown_connections 2024-04-25T11:32:26.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 1 -- 172.21.15.80:0/3255722352 wait complete. 2024-04-25T11:32:26.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.097+0000 7fdcfd44a740 20 client.17511 trim_cache size 0 max 16384 2024-04-25T11:32:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.110+0000 7fdcfd44a740 1 Processor -- start 2024-04-25T11:32:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.110+0000 7fdcfd44a740 1 -- start start 2024-04-25T11:32:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 0x55bda5259430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5259970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5276f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf01b4580 con 0x55bda4eb3390 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf01b1e50 con 0x55bda4e926b0 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf01afcc0 con 0x55bda4e8a4d0 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5276f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5276f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44856/0 (socket says 172.21.15.80:44856) 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 -- 172.21.15.80:0/487262863 learned_addr learned my addr 172.21.15.80:0/487262863 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 -- 172.21.15.80:0/487262863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 msgr2=0x55bda5259430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/487262863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 0x55bda5259430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 -- 172.21.15.80:0/487262863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 msgr2=0x55bda5259970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/487262863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5259970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 -- 172.21.15.80:0/487262863 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bda525fbe0 con 0x55bda4eb3390 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/487262863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5276f80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdce8000f80 tx=0x7fdce8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d367b90f2fca32f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcd5ffb640 1 -- 172.21.15.80:0/487262863 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8015030 con 0x55bda4eb3390 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcd5ffb640 1 -- 172.21.15.80:0/487262863 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce8003e20 con 0x55bda4eb3390 2024-04-25T11:32:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.111+0000 7fdcd5ffb640 1 -- 172.21.15.80:0/487262863 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce801a460 con 0x55bda4eb3390 2024-04-25T11:32:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 -- 172.21.15.80:0/487262863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 msgr2=0x55bda5276f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/487262863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5276f80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdce8000f80 tx=0x7fdce8009ca0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 -- 172.21.15.80:0/487262863 shutdown_connections 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/487262863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4eb3390 0x55bda5276f80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/487262863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5259970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/487262863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4e8a4d0 0x55bda5259430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 -- 172.21.15.80:0/487262863 >> 172.21.15.80:0/487262863 conn(0x55bda4ea74e0 msgr2=0x55bda5250040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 -- 172.21.15.80:0/487262863 shutdown_connections 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.112+0000 7fdcfd44a740 1 -- 172.21.15.80:0/487262863 wait complete. 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 -- start start 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 Processor -- start 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e8a4d0 0x55bda5267520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5264890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4eb3390 0x55bda5264dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf01b0310 con 0x55bda4e8a4d0 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf01b1780 con 0x55bda4e926b0 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf01b09e0 con 0x55bda4eb3390 2024-04-25T11:32:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcfd44a740 10 client.0 _ll_register_callbacks cb 0x7fdce40045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e8a4d0 0x55bda5267520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e8a4d0 0x55bda5267520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44868/0 (socket says 172.21.15.80:44868) 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 -- 172.21.15.80:0/1697245309 learned_addr learned my addr 172.21.15.80:0/1697245309 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5264890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcf4b33640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4eb3390 0x55bda5264dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 -- 172.21.15.80:0/1697245309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4eb3390 msgr2=0x55bda5264dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4eb3390 0x55bda5264dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 -- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 msgr2=0x55bda5264890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5264890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdceffff640 1 -- 172.21.15.80:0/1697245309 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bda5265310 con 0x55bda4e8a4d0 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.113+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5264890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdceffff640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e8a4d0 0x55bda5267520 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009900 tx=0x7fdce002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d31cd2f8c7a98c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdccf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdccf7fe640 1 -- 172.21.15.80:0/1697245309 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0035040 con 0x55bda4e8a4d0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdccf7fe640 1 -- 172.21.15.80:0/1697245309 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fdce0004310 con 0x55bda4e8a4d0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce8003e20 con 0x55bda4e8a4d0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdccf7fe640 1 -- 172.21.15.80:0/1697245309 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdce0005030 con 0x55bda4e8a4d0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 10 client.17517 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bda52d97d0 con 0x55bda4e8a4d0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdccf7fe640 1 -- 172.21.15.80:0/1697245309 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce8003e20 con 0x55bda4e8a4d0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdccf7fe640 1 -- 172.21.15.80:0/1697245309 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fdce0004c80 con 0x55bda4e8a4d0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 10 client.17517 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 20 client.17517 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e473a0 0x55bda52dbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 4 client.17517 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.114+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bda51c1800 con 0x55bda4e473a0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e473a0 0x55bda52dbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdccf7fe640 10 client.17517 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcef7fe640 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e473a0 0x55bda52dbfc0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1968be77f1f3e7b server_cookie=72fee38b2c1fa561 in_seq=0 out_seq=0 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdccf7fe640 1 -- 172.21.15.80:0/1697245309 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bda51c1800 con 0x55bda4e473a0 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdccf7fe640 10 client.17517 handle_command_reply: tid=0 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 client.17517 shutdown 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e8a4d0 msgr2=0x55bda5267520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e8a4d0 0x55bda5267520 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009900 tx=0x7fdce002a410 comp rx=0 tx=0).stop 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 shutdown_connections 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55bda4e473a0 0x55bda52dbfc0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bda4eb3390 0x55bda5264dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bda4e926b0 0x55bda5264890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 --2- 172.21.15.80:0/1697245309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bda4e8a4d0 0x55bda5267520 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdccf7fe640 0 client.17517 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 >> 172.21.15.80:0/1697245309 conn(0x55bda4ea74e0 msgr2=0x55bda524fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 shutdown_connections 2024-04-25T11:32:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.115+0000 7fdcfd44a740 1 -- 172.21.15.80:0/1697245309 wait complete. 2024-04-25T11:32:26.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcfd44a740 20 client.17517 trim_cache size 0 max 16384 2024-04-25T11:32:26.112 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdcd80afc60 msgr2=0x7fdcd80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdcd80afc60 0x7fdcd80b2170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdce0000c00 tx=0x7fdce0031400 comp rx=0 tx=0).stop 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf010daf0 msgr2=0x7fdcf01a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf010daf0 0x7fdcf01a2b60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e9f0 tx=0x7fdce400eeb0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 shutdown_connections 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fdcd80afc60 0x7fdcd80b2170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcf010daf0 0x7fdcf01a2b60 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf0110450 0x7fdcf019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 --2- 172.21.15.80:0/202679584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdcf01028b0 0x7fdcf01a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 >> 172.21.15.80:0/202679584 conn(0x7fdcf0078150 msgr2=0x7fdcf0101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 shutdown_connections 2024-04-25T11:32:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:26.116+0000 7fdcf6596640 1 -- 172.21.15.80:0/202679584 wait complete. 2024-04-25T11:32:26.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:26 smithi080 ceph-mon[29126]: pgmap v253: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:32:26.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:26 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1094698268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:32:26.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:26 smithi196 ceph-mon[32659]: pgmap v253: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:32:26.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:26 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1094698268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:32:26.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:26 smithi082 ceph-mon[32440]: pgmap v253: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:32:26.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:26 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1094698268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:32:27.117 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:32:27.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:32:27.118 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 -- 172.21.15.80:0/2455685717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f8104c60 msgr2=0x7f72f8105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/2455685717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f8104c60 0x7f72f8105070 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009900 tx=0x7f72ec02a480 comp rx=0 tx=0).stop 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 -- 172.21.15.80:0/2455685717 shutdown_connections 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/2455685717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72f810e070 0x7f72f8110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/2455685717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f810b6c0 0x7f72f810dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/2455685717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f8104c60 0x7f72f8105070 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 -- 172.21.15.80:0/2455685717 >> 172.21.15.80:0/2455685717 conn(0x7f72f80fe260 msgr2=0x7f72f8100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 -- 172.21.15.80:0/2455685717 shutdown_connections 2024-04-25T11:32:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.243+0000 7f72fcb0d640 1 -- 172.21.15.80:0/2455685717 wait complete. 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 Processor -- start 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 -- start start 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72f8104c60 0x7f72f819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f810b6c0 0x7f72f819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f810e070 0x7f72f819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72f8113cd0 con 0x7f72f810e070 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72f8113b50 con 0x7f72f810b6c0 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72fcb0d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f72f8113e50 con 0x7f72f8104c60 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f810e070 0x7f72f819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f810e070 0x7f72f819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52040/0 (socket says 172.21.15.80:52040) 2024-04-25T11:32:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72f6d9d640 1 -- 172.21.15.80:0/1819934338 learned_addr learned my addr 172.21.15.80:0/1819934338 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f810b6c0 0x7f72f819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.244+0000 7f72f659c640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72f8104c60 0x7f72f819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72f6d9d640 1 -- 172.21.15.80:0/1819934338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72f8104c60 msgr2=0x7f72f819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72f6d9d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72f8104c60 0x7f72f819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72f6d9d640 1 -- 172.21.15.80:0/1819934338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f810b6c0 msgr2=0x7f72f819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72f6d9d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f810b6c0 0x7f72f819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72f6d9d640 1 -- 172.21.15.80:0/1819934338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f819f530 con 0x7f72f810e070 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f810b6c0 0x7f72f819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72f6d9d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f810e070 0x7f72f819eef0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f72f000eb10 tx=0x7f72f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72e77fe640 1 -- 172.21.15.80:0/1819934338 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0004b20 con 0x7f72f810e070 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f819f820 con 0x7f72f810e070 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72e77fe640 1 -- 172.21.15.80:0/1819934338 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72f0004cc0 con 0x7f72f810e070 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72e77fe640 1 -- 172.21.15.80:0/1819934338 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0010670 con 0x7f72f810e070 2024-04-25T11:32:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.245+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f819fd20 con 0x7f72f810e070 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72e77fe640 1 -- 172.21.15.80:0/1819934338 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f72f0005020 con 0x7f72f810e070 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 Processor -- start 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 -- start start 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f98109620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98109b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f9810a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560f9806fb00 con 0x560f97d69410 2024-04-25T11:32:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560f9800b920 con 0x560f97d48730 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f73039c0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f9806bac0 con 0x560f97d40550 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f98109620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72f659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72e77fe640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f72e00afc60 0x7f72e00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f98109620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52046/0 (socket says 172.21.15.80:52046) 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72f659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98109b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.80:55304/0 (socket says 172.21.15.80:55304) 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72f5d9b640 1 -- 172.21.15.80:0/2601596481 learned_addr learned my addr 172.21.15.80:0/2601596481 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.248+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f9810a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f6d9d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f72e00afc60 0x7f72e00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f659c640 1 -- 172.21.15.80:0/2601596481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 msgr2=0x560f9810a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f659c640 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f9810a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f659c640 1 -- 172.21.15.80:0/2601596481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 msgr2=0x560f98109620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f659c640 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f98109620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f659c640 1 -- 172.21.15.80:0/2601596481 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f97e497e0 con 0x560f97d40550 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72e77fe640 1 -- 172.21.15.80:0/1819934338 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f72f00df5d0 con 0x7f72f810e070 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f659c640 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98109b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009230 tx=0x7f72ec032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21bcbf7b56c6685 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72f6d9d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f72e00afc60 0x7f72e00b2170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72f00dcdb0 tx=0x7f72f000cee0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72e4ff9640 1 -- 172.21.15.80:0/2601596481 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec040070 con 0x560f97d40550 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72e4ff9640 1 -- 172.21.15.80:0/2601596481 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72ec004030 con 0x560f97d40550 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.249+0000 7f72e4ff9640 1 -- 172.21.15.80:0/2601596481 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec035040 con 0x560f97d40550 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 -- 172.21.15.80:0/2601596481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 msgr2=0x560f98109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98109b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009230 tx=0x7f72ec032b90 comp rx=0 tx=0).stop 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 -- 172.21.15.80:0/2601596481 shutdown_connections 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f9810a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98109b60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 --2- 172.21.15.80:0/2601596481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f98109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 -- 172.21.15.80:0/2601596481 >> 172.21.15.80:0/2601596481 conn(0x560f97d5d560 msgr2=0x560f98105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 -- 172.21.15.80:0/2601596481 shutdown_connections 2024-04-25T11:32:27.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.250+0000 7f73039c0740 1 -- 172.21.15.80:0/2601596481 wait complete. 2024-04-25T11:32:27.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 -- start start 2024-04-25T11:32:27.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 Processor -- start 2024-04-25T11:32:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f98114130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x560f98116910 con 0x560f97d69410 2024-04-25T11:32:27.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560f980095d0 con 0x560f97d48730 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f98116a90 con 0x560f97d40550 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f73039c0740 10 client.0 _ll_register_callbacks cb 0x560f97ff7080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52060/0 (socket says 172.21.15.80:52060) 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1581104155 learned_addr learned my addr 172.21.15.80:0/1581104155 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f659c640 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f98114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1581104155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 msgr2=0x560f98113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 msgr2=0x560f98114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f98114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.251+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1581104155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f97ea9f70 con 0x560f97d69410 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811fdc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f72e8013da0 tx=0x7f72e8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980bad356d04d978 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72ddffb640 1 -- 172.21.15.80:0/1581104155 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800fe60 con 0x560f97d69410 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72ddffb640 1 -- 172.21.15.80:0/1581104155 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f72e8004030 con 0x560f97d69410 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72ec004030 con 0x560f97d69410 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72ddffb640 1 -- 172.21.15.80:0/1581104155 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f72e8004230 con 0x560f97d69410 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 10 client.17529 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560f97d41170 con 0x560f97d69410 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72ddffb640 1 -- 172.21.15.80:0/1581104155 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72ec004030 con 0x560f97d69410 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72ddffb640 1 -- 172.21.15.80:0/1581104155 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f72e8004910 con 0x560f97d69410 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 10 client.17529 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 10 client.17529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 20 client.17529 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97d281f0 0x560f98125ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 4 client.17529 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f9807d710 con 0x560f97d281f0 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.252+0000 7f72f659c640 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97d281f0 0x560f98125ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.253+0000 7f72ddffb640 10 client.17529 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.253+0000 7f72f659c640 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97d281f0 0x560f98125ef0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5ddb6366671b06 server_cookie=8bfca34abe98ae2b in_seq=0 out_seq=0 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.253+0000 7f72ddffb640 1 -- 172.21.15.80:0/1581104155 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560f9807d710 con 0x560f97d281f0 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.253+0000 7f72ddffb640 10 client.17529 handle_command_reply: tid=0 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.253+0000 7f73039c0740 1 client.17529 shutdown 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 msgr2=0x560f9811fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811fdc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f72e8013da0 tx=0x7f72e8005f90 comp rx=0 tx=0).stop 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 shutdown_connections 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97d281f0 0x560f98125ef0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811fdc0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f72ddffb640 0 client.17529 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d48730 0x560f98114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 --2- 172.21.15.80:0/1581104155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d40550 0x560f98113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 >> 172.21.15.80:0/1581104155 conn(0x560f97d5d560 msgr2=0x560f9810b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 shutdown_connections 2024-04-25T11:32:27.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 1 -- 172.21.15.80:0/1581104155 wait complete. 2024-04-25T11:32:27.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.254+0000 7f73039c0740 20 client.17529 trim_cache size 0 max 16384 2024-04-25T11:32:27.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 Processor -- start 2024-04-25T11:32:27.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 -- start start 2024-04-25T11:32:27.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d40550 0x560f981132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f9812b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d69410 0x560f9812bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81b22e0 con 0x560f97d40550 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81afbb0 con 0x560f97d69410 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.291+0000 7f73039c0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81ada20 con 0x560f97d48730 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d40550 0x560f981132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d40550 0x560f981132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52062/0 (socket says 172.21.15.80:52062) 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 -- 172.21.15.80:0/2568100086 learned_addr learned my addr 172.21.15.80:0/2568100086 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f659c640 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f9812b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d69410 0x560f9812bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 -- 172.21.15.80:0/2568100086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 msgr2=0x560f9812b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f9812b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 -- 172.21.15.80:0/2568100086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d69410 msgr2=0x560f9812bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d69410 0x560f9812bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 -- 172.21.15.80:0/2568100086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f98100160 con 0x560f97d40550 2024-04-25T11:32:27.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d40550 0x560f981132c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009db0 tx=0x7f72e8009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1c8b33cf7e46d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72dffff640 1 -- 172.21.15.80:0/2568100086 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80043d0 con 0x560f97d40550 2024-04-25T11:32:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72dffff640 1 -- 172.21.15.80:0/2568100086 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72e8003670 con 0x560f97d40550 2024-04-25T11:32:27.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.292+0000 7f72dffff640 1 -- 172.21.15.80:0/2568100086 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8005410 con 0x560f97d40550 2024-04-25T11:32:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 -- 172.21.15.80:0/2568100086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d40550 msgr2=0x560f981132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d40550 0x560f981132c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009db0 tx=0x7f72e8009d20 comp rx=0 tx=0).stop 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 -- 172.21.15.80:0/2568100086 shutdown_connections 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d69410 0x560f9812bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f9812b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 --2- 172.21.15.80:0/2568100086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d40550 0x560f981132c0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 -- 172.21.15.80:0/2568100086 >> 172.21.15.80:0/2568100086 conn(0x560f97d5d560 msgr2=0x560f98115b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 -- 172.21.15.80:0/2568100086 shutdown_connections 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.293+0000 7f73039c0740 1 -- 172.21.15.80:0/2568100086 wait complete. 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 -- start start 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 Processor -- start 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d40550 0x560f98117510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f98117a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81ae070 con 0x560f97d69410 2024-04-25T11:32:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81af4e0 con 0x560f97d40550 2024-04-25T11:32:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f72f81ae740 con 0x560f97d48730 2024-04-25T11:32:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f73039c0740 10 client.0 _ll_register_callbacks cb 0x7f72e8013bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52070/0 (socket says 172.21.15.80:52070) 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1045402631 learned_addr learned my addr 172.21.15.80:0/1045402631 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d40550 0x560f98117510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f659c640 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f98117a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1045402631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 msgr2=0x560f98117a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f98117a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d40550 msgr2=0x560f98117510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d40550 0x560f98117510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.294+0000 7f72f5d9b640 1 -- 172.21.15.80:0/1045402631 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f9811bea0 con 0x560f97d69410 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f72f5d9b640 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811b910 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x560f98118380 tx=0x7f72e8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6837371662d04a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f72ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f72ddffb640 1 -- 172.21.15.80:0/1045402631 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8013980 con 0x560f97d69410 2024-04-25T11:32:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f72ddffb640 1 -- 172.21.15.80:0/1045402631 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f72e8004890 con 0x560f97d69410 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e8003670 con 0x560f97d69410 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f72ddffb640 1 -- 172.21.15.80:0/1045402631 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f72e8004a90 con 0x560f97d69410 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 10 client.17535 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560f9818dca0 con 0x560f97d69410 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f72ddffb640 1 -- 172.21.15.80:0/1045402631 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72e8003670 con 0x560f97d69410 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f72ddffb640 1 -- 172.21.15.80:0/1045402631 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f72e8005170 con 0x560f97d69410 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 10 client.17535 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 20 client.17535 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97cfd630 0x560f98190380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 4 client.17535 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.295+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560f98077580 con 0x560f97cfd630 2024-04-25T11:32:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.296+0000 7f72f659c640 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97cfd630 0x560f98190380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.296+0000 7f72ddffb640 10 client.17535 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.296+0000 7f72f659c640 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97cfd630 0x560f98190380 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ac9b075739a8630 server_cookie=f38a45bea7ac7083 in_seq=0 out_seq=0 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.297+0000 7f72ddffb640 1 -- 172.21.15.80:0/1045402631 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f98077580 con 0x560f97cfd630 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.297+0000 7f72ddffb640 10 client.17535 handle_command_reply: tid=0 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.297+0000 7f73039c0740 1 client.17535 shutdown 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 msgr2=0x560f9811b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811b910 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x560f98118380 tx=0x7f72e8001e50 comp rx=0 tx=0).stop 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 shutdown_connections 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560f97cfd630 0x560f98190380 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72ddffb640 0 client.17535 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560f97d69410 0x560f9811b910 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f97d48730 0x560f98117a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 --2- 172.21.15.80:0/1045402631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560f97d40550 0x560f98117510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 >> 172.21.15.80:0/1045402631 conn(0x560f97d5d560 msgr2=0x560f98115090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 shutdown_connections 2024-04-25T11:32:27.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 1 -- 172.21.15.80:0/1045402631 wait complete. 2024-04-25T11:32:27.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f73039c0740 20 client.17535 trim_cache size 0 max 16384 2024-04-25T11:32:27.294 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:32:27.294 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:32:27.294 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "5137bd6e-02de-4592-8074-b7b01c3e5996", 2024-04-25T11:32:27.294 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:32:27.294 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:32:27.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f72e00afc60 msgr2=0x7f72e00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f72e00afc60 0x7f72e00b2170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72f00dcdb0 tx=0x7f72f000cee0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f810e070 msgr2=0x7f72f819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f810e070 0x7f72f819eef0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f72f000eb10 tx=0x7f72f000c2d0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 shutdown_connections 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f72e00afc60 0x7f72e00b2170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72f810e070 0x7f72f819eef0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f810b6c0 0x7f72f819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 --2- 172.21.15.80:0/1819934338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72f8104c60 0x7f72f819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.298+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 >> 172.21.15.80:0/1819934338 conn(0x7f72f80fe260 msgr2=0x7f72f810e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.299+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 shutdown_connections 2024-04-25T11:32:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.299+0000 7f72fcb0d640 1 -- 172.21.15.80:0/1819934338 wait complete. 2024-04-25T11:32:27.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:32:27.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:32:27.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 -- 172.21.15.80:0/1276536904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c102af0 msgr2=0x7f4c3c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1276536904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c102af0 0x7f4c3c102f00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009900 tx=0x7f4c2c02a410 comp rx=0 tx=0).stop 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 -- 172.21.15.80:0/1276536904 shutdown_connections 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1276536904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c102af0 0x7f4c3c102f00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1276536904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c3c10d380 0x7f4c3c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1276536904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c3c108a20 0x7f4c3c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 -- 172.21.15.80:0/1276536904 >> 172.21.15.80:0/1276536904 conn(0x7f4c3c078100 msgr2=0x7f4c3c078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 -- 172.21.15.80:0/1276536904 shutdown_connections 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.423+0000 7f4c436fa640 1 -- 172.21.15.80:0/1276536904 wait complete. 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 Processor -- start 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 -- start start 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c3c102af0 0x7f4c3c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c108a20 0x7f4c3c19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c3c10d380 0x7f4c3c19bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c112be0 con 0x7f4c3c108a20 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c112a60 con 0x7f4c3c102af0 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c436fa640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c112d60 con 0x7f4c3c10d380 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c40c95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c108a20 0x7f4c3c19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c41496640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c3c102af0 0x7f4c3c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c40c95640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c108a20 0x7f4c3c19baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52086/0 (socket says 172.21.15.80:52086) 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c40c95640 1 -- 172.21.15.80:0/1874300936 learned_addr learned my addr 172.21.15.80:0/1874300936 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.424+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c3c10d380 0x7f4c3c19bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c41496640 1 -- 172.21.15.80:0/1874300936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c3c10d380 msgr2=0x7f4c3c19bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c41496640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c3c10d380 0x7f4c3c19bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c41496640 1 -- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c108a20 msgr2=0x7f4c3c19baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c41496640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c108a20 0x7f4c3c19baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c41496640 1 -- 172.21.15.80:0/1874300936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3c1a6870 con 0x7f4c3c102af0 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c40c95640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c108a20 0x7f4c3c19baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:32:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c41496640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c3c102af0 0x7f4c3c19b560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800e9c0 tx=0x7f4c3800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c327fc640 1 -- 172.21.15.80:0/1874300936 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800ccc0 con 0x7f4c3c102af0 2024-04-25T11:32:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3c1a6b60 con 0x7f4c3c102af0 2024-04-25T11:32:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3c1a7100 con 0x7f4c3c102af0 2024-04-25T11:32:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c327fc640 1 -- 172.21.15.80:0/1874300936 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c380108e0 con 0x7f4c3c102af0 2024-04-25T11:32:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.425+0000 7f4c327fc640 1 -- 172.21.15.80:0/1874300936 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38018660 con 0x7f4c3c102af0 2024-04-25T11:32:27.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 Processor -- start 2024-04-25T11:32:27.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 -- start start 2024-04-25T11:32:27.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c327fc640 1 -- 172.21.15.80:0/1874300936 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f4c38010430 con 0x7f4c3c102af0 2024-04-25T11:32:27.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83657c390 0x55d83691ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83691cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d8369298f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d836882d80 con 0x55d83657c390 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d83683c8b0 con 0x55d8365534d0 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d83687ed40 con 0x55d83655b6b0 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83657c390 0x55d83691ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41496640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83691cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83657c390 0x55d83691ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52100/0 (socket says 172.21.15.80:52100) 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 -- 172.21.15.80:0/1719161521 learned_addr learned my addr 172.21.15.80:0/1719161521 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c40c95640 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d8369298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 -- 172.21.15.80:0/1719161521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 msgr2=0x55d8369298f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d8369298f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 -- 172.21.15.80:0/1719161521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 msgr2=0x55d83691cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83691cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41c97640 1 -- 172.21.15.80:0/1719161521 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d83680da40 con 0x55d83657c390 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c41496640 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83691cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.428+0000 7f4c327fc640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4c280afc60 0x7f4c280b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.429+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83657c390 0x55d83691ca60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009f30 tx=0x7f4c340118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81914c0acdecb1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.429+0000 7f4c41496640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4c280afc60 0x7f4c280b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.429+0000 7f4c327fc640 1 -- 172.21.15.80:0/1874300936 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f4c380df270 con 0x7f4c3c102af0 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.429+0000 7f4c277fe640 1 -- 172.21.15.80:0/1719161521 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34004d20 con 0x55d83657c390 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.429+0000 7f4c277fe640 1 -- 172.21.15.80:0/1719161521 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c34004050 con 0x55d83657c390 2024-04-25T11:32:27.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.429+0000 7f4c277fe640 1 -- 172.21.15.80:0/1719161521 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34005260 con 0x55d83657c390 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1719161521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83657c390 msgr2=0x55d83691ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83657c390 0x55d83691ca60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009f30 tx=0x7f4c340118d0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c41496640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4c280afc60 0x7f4c280b2170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c380dca50 tx=0x7f4c380e2dc0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1719161521 shutdown_connections 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d8369298f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83691cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1719161521 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83657c390 0x55d83691ca60 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1719161521 >> 172.21.15.80:0/1719161521 conn(0x55d8365704e0 msgr2=0x55d836919210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1719161521 shutdown_connections 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1719161521 wait complete. 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 -- start start 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.430+0000 7f4c4a5a8740 1 Processor -- start 2024-04-25T11:32:27.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d8365534d0 0x55d8369274e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d836927a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83657c390 0x55d836933520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d836929fe0 con 0x55d8365534d0 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d836809d10 con 0x55d83657c390 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d83692a160 con 0x55d83655b6b0 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c4a5a8740 10 client.0 _ll_register_callbacks cb 0x55d836836210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d8365534d0 0x55d8369274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d8365534d0 0x55d8369274e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52106/0 (socket says 172.21.15.80:52106) 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c41c97640 1 -- 172.21.15.80:0/1007809227 learned_addr learned my addr 172.21.15.80:0/1007809227 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c40c95640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d836927a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83657c390 0x55d836933520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c40c95640 1 -- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83657c390 msgr2=0x55d836933520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c40c95640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83657c390 0x55d836933520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c40c95640 1 -- 172.21.15.80:0/1007809227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d8365534d0 msgr2=0x55d8369274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c40c95640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d8365534d0 0x55d8369274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c40c95640 1 -- 172.21.15.80:0/1007809227 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d83665e7d0 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d8365534d0 0x55d8369274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c40c95640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d836927a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c031440 tx=0x7f4c2c031740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8ef6b273947d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.431+0000 7f4c24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c24ff9640 1 -- 172.21.15.80:0/1007809227 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c035040 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c34004050 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c24ff9640 1 -- 172.21.15.80:0/1007809227 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f4c2c004450 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c24ff9640 1 -- 172.21.15.80:0/1007809227 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4c2c005020 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 10 client.26680 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d8365943f0 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c24ff9640 1 -- 172.21.15.80:0/1007809227 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c34004050 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c24ff9640 1 -- 172.21.15.80:0/1007809227 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4c2c0035f0 con 0x55d83655b6b0 2024-04-25T11:32:27.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 10 client.26680 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 10 client.26680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 20 client.26680 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83653af60 0x55d8369395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 4 client.26680 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.432+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d836890990 con 0x55d83653af60 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.433+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83653af60 0x55d8369395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.433+0000 7f4c24ff9640 10 client.26680 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.433+0000 7f4c41c97640 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83653af60 0x55d8369395f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe7f27b8a240bd3 server_cookie=2e3600057d9f84ca in_seq=0 out_seq=0 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.433+0000 7f4c24ff9640 1 -- 172.21.15.80:0/1007809227 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d836890990 con 0x55d83653af60 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.433+0000 7f4c24ff9640 10 client.26680 handle_command_reply: tid=0 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 client.26680 shutdown 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 msgr2=0x55d836927a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d836927a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c031440 tx=0x7f4c2c031740 comp rx=0 tx=0).stop 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 shutdown_connections 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83653af60 0x55d8369395f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83657c390 0x55d836933520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c24ff9640 0 client.26680 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83655b6b0 0x55d836927a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/1007809227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d8365534d0 0x55d8369274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 >> 172.21.15.80:0/1007809227 conn(0x55d8365704e0 msgr2=0x55d83691e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 shutdown_connections 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/1007809227 wait complete. 2024-04-25T11:32:27.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.434+0000 7f4c4a5a8740 20 client.26680 trim_cache size 0 max 16384 2024-04-25T11:32:27.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 Processor -- start 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 -- start start 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83653af60 0x55d83692f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83692f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83655b6b0 0x55d83691c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4c200110a0 con 0x55d83655b6b0 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2000e970 con 0x55d8365534d0 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2000c7e0 con 0x55d83653af60 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83655b6b0 0x55d83691c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83655b6b0 0x55d83691c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52110/0 (socket says 172.21.15.80:52110) 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 -- 172.21.15.80:0/3831416094 learned_addr learned my addr 172.21.15.80:0/3831416094 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83653af60 0x55d83692f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c40c95640 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83692f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 -- 172.21.15.80:0/3831416094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83653af60 msgr2=0x55d83692f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83653af60 0x55d83692f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 -- 172.21.15.80:0/3831416094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 msgr2=0x55d83692f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83692f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.452+0000 7f4c41c97640 1 -- 172.21.15.80:0/3831416094 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8365540f0 con 0x55d83655b6b0 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.453+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83655b6b0 0x55d83691c7f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4c34014040 tx=0x7f4c340096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabe6a0fab54497e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.453+0000 7f4c26ffd640 1 -- 172.21.15.80:0/3831416094 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34003e60 con 0x55d83655b6b0 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.453+0000 7f4c26ffd640 1 -- 172.21.15.80:0/3831416094 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c3402e670 con 0x55d83655b6b0 2024-04-25T11:32:27.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.453+0000 7f4c26ffd640 1 -- 172.21.15.80:0/3831416094 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c340286b0 con 0x55d83655b6b0 2024-04-25T11:32:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3831416094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83655b6b0 msgr2=0x55d83691c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83655b6b0 0x55d83691c7f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4c34014040 tx=0x7f4c340096c0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3831416094 shutdown_connections 2024-04-25T11:32:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83655b6b0 0x55d83691c7f0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8365534d0 0x55d83692f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3831416094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d83653af60 0x55d83692f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3831416094 >> 172.21.15.80:0/3831416094 conn(0x55d8365704e0 msgr2=0x55d836925ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3831416094 shutdown_connections 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3831416094 wait complete. 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 -- start start 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.454+0000 7f4c4a5a8740 1 Processor -- start 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83653af60 0x55d83692a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d8365534d0 0x55d83692a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c4a5a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83655b6b0 0x55d83692ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2000ce30 con 0x55d83653af60 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2000e2a0 con 0x55d83655b6b0 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c4a5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2000d500 con 0x55d8365534d0 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c4a5a8740 10 client.0 _ll_register_callbacks cb 0x7f4c2c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83653af60 0x55d83692a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c41c97640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83653af60 0x55d83692a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52122/0 (socket says 172.21.15.80:52122) 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c41c97640 1 -- 172.21.15.80:0/3449172844 learned_addr learned my addr 172.21.15.80:0/3449172844 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c40c95640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d8365534d0 0x55d83692a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.455+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83655b6b0 0x55d83692ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c40c95640 1 -- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83655b6b0 msgr2=0x55d83692ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c40c95640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83655b6b0 0x55d83692ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c40c95640 1 -- 172.21.15.80:0/3449172844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83653af60 msgr2=0x55d83692a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c40c95640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83653af60 0x55d83692a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c40c95640 1 -- 172.21.15.80:0/3449172844 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8368434b0 con 0x55d8365534d0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83653af60 0x55d83692a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c40c95640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d8365534d0 0x55d83692a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c003990 tx=0x7f4c2c003800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6d3a8adc88ce76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c24ff9640 1 -- 172.21.15.80:0/3449172844 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c035070 con 0x55d8365534d0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c24ff9640 1 -- 172.21.15.80:0/3449172844 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f4c2c004250 con 0x55d8365534d0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c3402e670 con 0x55d8365534d0 2024-04-25T11:32:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c24ff9640 1 -- 172.21.15.80:0/3449172844 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4c2c054040 con 0x55d8365534d0 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c4a5a8740 10 client.26686 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d8369a0b40 con 0x55d8365534d0 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.456+0000 7f4c24ff9640 1 -- 172.21.15.80:0/3449172844 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c3402e670 con 0x55d8365534d0 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c24ff9640 1 -- 172.21.15.80:0/3449172844 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4c2c057070 con 0x55d8365534d0 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c4a5a8740 10 client.26686 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c4a5a8740 10 client.26686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c4a5a8740 20 client.26686 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83657c390 0x55d8369a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c4a5a8740 4 client.26686 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d83688a800 con 0x55d83657c390 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83657c390 0x55d8369a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c24ff9640 10 client.26686 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c41c97640 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83657c390 0x55d8369a32c0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d624076c568c69 server_cookie=cb5ab31c31e27b2c in_seq=0 out_seq=0 2024-04-25T11:32:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c24ff9640 1 -- 172.21.15.80:0/3449172844 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d83688a800 con 0x55d83657c390 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c24ff9640 10 client.26686 handle_command_reply: tid=0 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.457+0000 7f4c4a5a8740 1 client.26686 shutdown 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d8365534d0 msgr2=0x55d83692a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d8365534d0 0x55d83692a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c003990 tx=0x7f4c2c003800 comp rx=0 tx=0).stop 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 shutdown_connections 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55d83657c390 0x55d8369a32c0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83655b6b0 0x55d83692ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d8365534d0 0x55d83692a940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c24ff9640 0 client.26686 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 --2- 172.21.15.80:0/3449172844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d83653af60 0x55d83692a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 >> 172.21.15.80:0/3449172844 conn(0x55d8365704e0 msgr2=0x55d83691c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 shutdown_connections 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 1 -- 172.21.15.80:0/3449172844 wait complete. 2024-04-25T11:32:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c4a5a8740 20 client.26686 trim_cache size 0 max 16384 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "5137bd6e-02de-4592-8074-b7b01c3e5996": { 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "5137bd6e-02de-4592-8074-b7b01c3e5996", 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:32:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:32:27.455 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4c280afc60 msgr2=0x7f4c280b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4c280afc60 0x7f4c280b2170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c380dca50 tx=0x7f4c380e2dc0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c3c102af0 msgr2=0x7f4c3c19b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c3c102af0 0x7f4c3c19b560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800e9c0 tx=0x7f4c3800ee80 comp rx=0 tx=0).stop 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 shutdown_connections 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4c280afc60 0x7f4c280b2170 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c3c108a20 0x7f4c3c19baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c3c10d380 0x7f4c3c19bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 --2- 172.21.15.80:0/1874300936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c3c102af0 0x7f4c3c19b560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.458+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 >> 172.21.15.80:0/1874300936 conn(0x7f4c3c078100 msgr2=0x7f4c3c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.459+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 shutdown_connections 2024-04-25T11:32:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:27.459+0000 7f4c436fa640 1 -- 172.21.15.80:0/1874300936 wait complete. 2024-04-25T11:32:27.458 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:27 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:32:27.459 INFO:tasks.cephfs.filesystem:scrub status for tag:5137bd6e-02de-4592-8074-b7b01c3e5996 - {'path': '/', 'tag': '5137bd6e-02de-4592-8074-b7b01c3e5996', 'options': 'recursive,force'} 2024-04-25T11:32:27.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:27 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:32:27.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:27 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: pgmap v254: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:32:28.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:28 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:32:28.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: pgmap v254: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T11:32:28.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:32:28.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:32:28.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:32:28.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:32:28.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:32:28.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:32:28.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:32:28.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:28 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:32:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: pgmap v254: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T11:32:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:32:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:32:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:32:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:32:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:32:28.740 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:32:28.740 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:32:28.740 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:28 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:32:30.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:30 smithi080 ceph-mon[29126]: pgmap v255: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:30.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:30 smithi196 ceph-mon[32659]: pgmap v255: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:30.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:30 smithi082 ceph-mon[32440]: pgmap v255: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:32.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:32 smithi080 ceph-mon[29126]: pgmap v256: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:32.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:32 smithi196 ceph-mon[32659]: pgmap v256: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:32.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:32 smithi082 ceph-mon[32440]: pgmap v256: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:34.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:34 smithi080 ceph-mon[29126]: pgmap v257: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:34.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:34 smithi196 ceph-mon[32659]: pgmap v257: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:34.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:34 smithi082 ceph-mon[32440]: pgmap v257: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:36.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:36 smithi080 ceph-mon[29126]: pgmap v258: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:36.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:36 smithi196 ceph-mon[32659]: pgmap v258: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:36.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:36 smithi082 ceph-mon[32440]: pgmap v258: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:38.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:38 smithi080 ceph-mon[29126]: pgmap v259: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:38.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:38 smithi196 ceph-mon[32659]: pgmap v259: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:38.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:38 smithi082 ceph-mon[32440]: pgmap v259: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:40.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:40 smithi080 ceph-mon[29126]: pgmap v260: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:40.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:40 smithi196 ceph-mon[32659]: pgmap v260: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:40.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:40 smithi082 ceph-mon[32440]: pgmap v260: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:32:42.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:42 smithi080 ceph-mon[29126]: pgmap v261: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:42.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:42 smithi196 ceph-mon[32659]: pgmap v261: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:42.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:42 smithi082 ceph-mon[32440]: pgmap v261: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:32:44.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:44 smithi080 ceph-mon[29126]: pgmap v262: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:44.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:44 smithi196 ceph-mon[32659]: pgmap v262: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:44.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:44 smithi082 ceph-mon[32440]: pgmap v262: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:46.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:46 smithi080 ceph-mon[29126]: pgmap v263: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:46.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:46 smithi196 ceph-mon[32659]: pgmap v263: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:46.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:46 smithi082 ceph-mon[32440]: pgmap v263: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:32:48.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:48 smithi080 ceph-mon[29126]: pgmap v264: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:48.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:48 smithi196 ceph-mon[32659]: pgmap v264: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:48.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:48 smithi082 ceph-mon[32440]: pgmap v264: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:50.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:50 smithi080 ceph-mon[29126]: pgmap v265: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:50.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:50 smithi196 ceph-mon[32659]: pgmap v265: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:50.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:50 smithi082 ceph-mon[32440]: pgmap v265: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:52.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:52 smithi080 ceph-mon[29126]: pgmap v266: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:52.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:52 smithi196 ceph-mon[32659]: pgmap v266: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:52.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:52 smithi082 ceph-mon[32440]: pgmap v266: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:54.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:54 smithi080 ceph-mon[29126]: pgmap v267: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:54.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:54 smithi196 ceph-mon[32659]: pgmap v267: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:54.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:54 smithi082 ceph-mon[32440]: pgmap v267: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:56.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:56 smithi080 ceph-mon[29126]: pgmap v268: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:56.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:56 smithi196 ceph-mon[32659]: pgmap v268: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:56.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:56 smithi082 ceph-mon[32440]: pgmap v268: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T11:32:57.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:32:57.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:32:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 -- 172.21.15.80:0/3279016128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b41069b0 msgr2=0x7f22b4106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 --2- 172.21.15.80:0/3279016128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b41069b0 0x7f22b4106de0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f229c009900 tx=0x7f229c02a410 comp rx=0 tx=0).stop 2024-04-25T11:32:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 -- 172.21.15.80:0/3279016128 shutdown_connections 2024-04-25T11:32:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 --2- 172.21.15.80:0/3279016128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b41069b0 0x7f22b4106de0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 --2- 172.21.15.80:0/3279016128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b4107470 0x7f22b410ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 --2- 172.21.15.80:0/3279016128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b4102420 0x7f22b4102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 -- 172.21.15.80:0/3279016128 >> 172.21.15.80:0/3279016128 conn(0x7f22b4077920 msgr2=0x7f22b4077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 -- 172.21.15.80:0/3279016128 shutdown_connections 2024-04-25T11:32:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.592+0000 7f22b9034640 1 -- 172.21.15.80:0/3279016128 wait complete. 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.593+0000 7f22b9034640 1 Processor -- start 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.593+0000 7f22b9034640 1 -- start start 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b4102420 0x7f22b41996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b41069b0 0x7f22b4199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b4107470 0x7f22b419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f22b4112c00 con 0x7f22b4102420 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22b4112a80 con 0x7f22b41069b0 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f22b4112d80 con 0x7f22b4107470 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b4102420 0x7f22b41996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b4102420 0x7f22b41996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58644/0 (socket says 172.21.15.80:58644) 2024-04-25T11:32:57.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1793809705 learned_addr learned my addr 172.21.15.80:0/1793809705 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22abfff640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b41069b0 0x7f22b4199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b359e640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b4107470 0x7f22b419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1793809705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b4107470 msgr2=0x7f22b419df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b4107470 0x7f22b419df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1793809705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b41069b0 msgr2=0x7f22b4199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b41069b0 0x7f22b4199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1793809705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b419e540 con 0x7f22b4102420 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b4102420 0x7f22b41996e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f22a400d950 tx=0x7f22a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b0d99640 1 -- 172.21.15.80:0/1793809705 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4017070 con 0x7f22b4102420 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b419e830 con 0x7f22b4102420 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b0d99640 1 -- 172.21.15.80:0/1793809705 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a4009c30 con 0x7f22b4102420 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b0d99640 1 -- 172.21.15.80:0/1793809705 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a400f620 con 0x7f22b4102420 2024-04-25T11:32:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.594+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b41a61b0 con 0x7f22b4102420 2024-04-25T11:32:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.597+0000 7f22b0d99640 1 -- 172.21.15.80:0/1793809705 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f22a4010460 con 0x7f22b4102420 2024-04-25T11:32:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.597+0000 7f22bffbf740 1 Processor -- start 2024-04-25T11:32:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.597+0000 7f22bffbf740 1 -- start start 2024-04-25T11:32:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22bffbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a39510dd80 con 0x55a394e07390 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22bffbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a3950c78b0 con 0x55a394dde4d0 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22bffbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a395109d40 con 0x55a394de66b0 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951a9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58648/0 (socket says 172.21.15.80:58648) 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 -- 172.21.15.80:0/4114682954 learned_addr learned my addr 172.21.15.80:0/4114682954 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b0d99640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f22a00afc60 0x7f22a00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f22a00afc60 0x7f22a00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22abfff640 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b0d99640 1 -- 172.21.15.80:0/1793809705 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f22a40ded60 con 0x7f22b4102420 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 -- 172.21.15.80:0/4114682954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 msgr2=0x55a3951b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 -- 172.21.15.80:0/4114682954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 msgr2=0x55a3951aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 -- 172.21.15.80:0/4114682954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a395098a40 con 0x55a394e07390 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.598+0000 7f22b359e640 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951a9c70 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0094d0 tx=0x7f22ac013dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed8595f804a611 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.599+0000 7f22a97fa640 1 -- 172.21.15.80:0/4114682954 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac023020 con 0x55a394e07390 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.599+0000 7f22b359e640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f22a00afc60 0x7f22a00b2170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22ac021000 tx=0x7f22ac020000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.599+0000 7f22a97fa640 1 -- 172.21.15.80:0/4114682954 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac013250 con 0x55a394e07390 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.599+0000 7f22a97fa640 1 -- 172.21.15.80:0/4114682954 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac01f690 con 0x55a394e07390 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.599+0000 7f22bffbf740 1 -- 172.21.15.80:0/4114682954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 msgr2=0x55a3951a9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.599+0000 7f22bffbf740 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951a9c70 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0094d0 tx=0x7f22ac013dc0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- 172.21.15.80:0/4114682954 shutdown_connections 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 --2- 172.21.15.80:0/4114682954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951a9c70 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- 172.21.15.80:0/4114682954 >> 172.21.15.80:0/4114682954 conn(0x55a394dfb4e0 msgr2=0x55a3951a6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- 172.21.15.80:0/4114682954 shutdown_connections 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- 172.21.15.80:0/4114682954 wait complete. 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- start start 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 Processor -- start 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394dde4d0 0x55a3951b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394e07390 0x55a3951ba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a3951b71f0 con 0x55a394dde4d0 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a395094d10 con 0x55a394de66b0 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a3951b7370 con 0x55a394e07390 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.600+0000 7f22bffbf740 10 client.0 _ll_register_callbacks cb 0x55a3950c1210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394dde4d0 0x55a3951b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394dde4d0 0x55a3951b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58650/0 (socket says 172.21.15.80:58650) 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1881029331 learned_addr learned my addr 172.21.15.80:0/1881029331 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22abfff640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1881029331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394e07390 msgr2=0x55a3951ba700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b359e640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394e07390 0x55a3951ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394e07390 0x55a3951ba700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 msgr2=0x55a3951b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 -- 172.21.15.80:0/1881029331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a394ee97d0 con 0x55a394dde4d0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22abfff640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394dde4d0 0x55a3951b4800 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f22a40a2f60 tx=0x7f22a4020eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2341bc2ad5ee96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f229a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f229a7fc640 1 -- 172.21.15.80:0/1881029331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4020070 con 0x55a394dde4d0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f229a7fc640 1 -- 172.21.15.80:0/1881029331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f22a40a3170 con 0x55a394dde4d0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ac013250 con 0x55a394dde4d0 2024-04-25T11:32:57.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f229a7fc640 1 -- 172.21.15.80:0/1881029331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f22a4009de0 con 0x55a394dde4d0 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22bffbf740 10 client.17565 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a394e1f3f0 con 0x55a394dde4d0 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.601+0000 7f229a7fc640 1 -- 172.21.15.80:0/1881029331 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac013250 con 0x55a394dde4d0 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f229a7fc640 1 -- 172.21.15.80:0/1881029331 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f22a40dcbe0 con 0x55a394dde4d0 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22bffbf740 10 client.17565 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22bffbf740 10 client.17565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22bffbf740 20 client.17565 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22bffbf740 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394dc5f60 0x55a3951c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22bffbf740 4 client.17565 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a39511b990 con 0x55a394dc5f60 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22abfff640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394dc5f60 0x55a3951c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f229a7fc640 10 client.17565 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.602+0000 7f22abfff640 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394dc5f60 0x55a3951c6960 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51bc2937697caafb server_cookie=967ad794dbd5f5f8 in_seq=0 out_seq=0 2024-04-25T11:32:57.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.603+0000 7f229a7fc640 1 -- 172.21.15.80:0/1881029331 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a39511b990 con 0x55a394dc5f60 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.603+0000 7f229a7fc640 10 client.17565 handle_command_reply: tid=0 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.603+0000 7f22bffbf740 1 client.17565 shutdown 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394dde4d0 msgr2=0x55a3951b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394dde4d0 0x55a3951b4800 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f22a40a2f60 tx=0x7f22a4020eb0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 shutdown_connections 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394dc5f60 0x55a3951c6960 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394e07390 0x55a3951ba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 --2- 172.21.15.80:0/1881029331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394dde4d0 0x55a3951b4800 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f229a7fc640 0 client.17565 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 >> 172.21.15.80:0/1881029331 conn(0x55a394dfb4e0 msgr2=0x55a3951a29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 shutdown_connections 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 1 -- 172.21.15.80:0/1881029331 wait complete. 2024-04-25T11:32:57.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.604+0000 7f22bffbf740 20 client.17565 trim_cache size 0 max 16384 2024-04-25T11:32:57.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 Processor -- start 2024-04-25T11:32:57.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 -- start start 2024-04-25T11:32:57.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394dde4d0 0x55a3951b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951ba670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951babb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41b01d0 con 0x55a394e07390 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41adaa0 con 0x55a394de66b0 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22bffbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41ab910 con 0x55a394dde4d0 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951babb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58656/0 (socket says 172.21.15.80:58656) 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b359e640 1 -- 172.21.15.80:0/423810542 learned_addr learned my addr 172.21.15.80:0/423810542 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394dde4d0 0x55a3951b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22abfff640 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b359e640 1 -- 172.21.15.80:0/423810542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394dde4d0 msgr2=0x55a3951b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b359e640 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394dde4d0 0x55a3951b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b359e640 1 -- 172.21.15.80:0/423810542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 msgr2=0x55a3951ba670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.622+0000 7f22b359e640 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951ba670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.623+0000 7f22b359e640 1 -- 172.21.15.80:0/423810542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a394ddf0f0 con 0x55a394e07390 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.623+0000 7f22b359e640 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951babb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009540 tx=0x7f22ac009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75edbf57bfa518a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.623+0000 7f22a8ff9640 1 -- 172.21.15.80:0/423810542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac023040 con 0x55a394e07390 2024-04-25T11:32:57.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.623+0000 7f22a8ff9640 1 -- 172.21.15.80:0/423810542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac003970 con 0x55a394e07390 2024-04-25T11:32:57.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.623+0000 7f22a8ff9640 1 -- 172.21.15.80:0/423810542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac004530 con 0x55a394e07390 2024-04-25T11:32:57.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- 172.21.15.80:0/423810542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 msgr2=0x55a3951babb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951babb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009540 tx=0x7f22ac009f30 comp rx=0 tx=0).stop 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- 172.21.15.80:0/423810542 shutdown_connections 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a3951babb0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394de66b0 0x55a3951ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 --2- 172.21.15.80:0/423810542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394dde4d0 0x55a3951b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- 172.21.15.80:0/423810542 >> 172.21.15.80:0/423810542 conn(0x55a394dfb4e0 msgr2=0x55a3951b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- 172.21.15.80:0/423810542 shutdown_connections 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- 172.21.15.80:0/423810542 wait complete. 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- start start 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 Processor -- start 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951bbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951bc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a395226ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41abf60 con 0x55a394e07390 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41ad3d0 con 0x55a394dde4d0 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.624+0000 7f22bffbf740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41ac630 con 0x55a394de66b0 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22bffbf740 10 client.0 _ll_register_callbacks cb 0x7f22a400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a395226ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a395226ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58672/0 (socket says 172.21.15.80:58672) 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 -- 172.21.15.80:0/2871429952 learned_addr learned my addr 172.21.15.80:0/2871429952 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951bbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22abfff640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 -- 172.21.15.80:0/2871429952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 msgr2=0x55a3951bc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951bc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 -- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 msgr2=0x55a3951bbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951bbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 -- 172.21.15.80:0/2871429952 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3950ce4b0 con 0x55a394e07390 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22abfff640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951bc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22b359e640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a395226ce0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f22ac011750 tx=0x7f22ac013220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14b693836c9a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f229a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f229a7fc640 1 -- 172.21.15.80:0/2871429952 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac023070 con 0x55a394e07390 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f229a7fc640 1 -- 172.21.15.80:0/2871429952 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f22ac005210 con 0x55a394e07390 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ac003970 con 0x55a394e07390 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f229a7fc640 1 -- 172.21.15.80:0/2871429952 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f22ac044050 con 0x55a394e07390 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22bffbf740 10 client.17571 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.625+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a39522e360 con 0x55a394e07390 2024-04-25T11:32:57.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f229a7fc640 1 -- 172.21.15.80:0/2871429952 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac003970 con 0x55a394e07390 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f229a7fc640 1 -- 172.21.15.80:0/2871429952 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f22ac01f8e0 con 0x55a394e07390 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f22bffbf740 10 client.17571 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f22bffbf740 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f22bffbf740 20 client.17571 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f22bffbf740 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394d9b3a0 0x55a395230790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f22bffbf740 4 client.17571 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3951a68d0 con 0x55a394d9b3a0 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.626+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394d9b3a0 0x55a395230790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f229a7fc640 10 client.17571 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22b2d9d640 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394d9b3a0 0x55a395230790 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52543fcfe9033d2c server_cookie=56b2c6c98b67f246 in_seq=0 out_seq=0 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f229a7fc640 1 -- 172.21.15.80:0/2871429952 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a3951a68d0 con 0x55a394d9b3a0 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f229a7fc640 10 client.17571 handle_command_reply: tid=0 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 client.17571 shutdown 2024-04-25T11:32:57.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 msgr2=0x55a395226ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a395226ce0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f22ac011750 tx=0x7f22ac013220 comp rx=0 tx=0).stop 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 shutdown_connections 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a394d9b3a0 0x55a395230790 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a394e07390 0x55a395226ce0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a394de66b0 0x55a3951bc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f229a7fc640 0 client.17571 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 --2- 172.21.15.80:0/2871429952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a394dde4d0 0x55a3951bbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 >> 172.21.15.80:0/2871429952 conn(0x55a394dfb4e0 msgr2=0x55a3951ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 shutdown_connections 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 1 -- 172.21.15.80:0/2871429952 wait complete. 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.627+0000 7f22bffbf740 20 client.17571 trim_cache size 0 max 16384 2024-04-25T11:32:57.624 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:32:57.625 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:32:57.625 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:32:57.625 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f22a00afc60 msgr2=0x7f22a00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f22a00afc60 0x7f22a00b2170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22ac021000 tx=0x7f22ac020000 comp rx=0 tx=0).stop 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b4102420 msgr2=0x7f22b41996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b4102420 0x7f22b41996e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f22a400d950 tx=0x7f22a400de10 comp rx=0 tx=0).stop 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 shutdown_connections 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f22a00afc60 0x7f22a00b2170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22b4107470 0x7f22b419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b41069b0 0x7f22b4199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 --2- 172.21.15.80:0/1793809705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22b4102420 0x7f22b41996e0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 >> 172.21.15.80:0/1793809705 conn(0x7f22b4077920 msgr2=0x7f22b41008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 shutdown_connections 2024-04-25T11:32:57.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.628+0000 7f22b9034640 1 -- 172.21.15.80:0/1793809705 wait complete. 2024-04-25T11:32:57.628 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:32:57.628 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:32:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 -- 172.21.15.80:0/1501836809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c4102410 msgr2=0x7f07c4102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 --2- 172.21.15.80:0/1501836809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c4102410 0x7f07c4102820 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009900 tx=0x7f07b802a410 comp rx=0 tx=0).stop 2024-04-25T11:32:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 -- 172.21.15.80:0/1501836809 shutdown_connections 2024-04-25T11:32:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 --2- 172.21.15.80:0/1501836809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c4107460 0x7f07c410ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 --2- 172.21.15.80:0/1501836809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c41069a0 0x7f07c4106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 --2- 172.21.15.80:0/1501836809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c4102410 0x7f07c4102820 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 -- 172.21.15.80:0/1501836809 >> 172.21.15.80:0/1501836809 conn(0x7f07c40fd850 msgr2=0x7f07c40ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 -- 172.21.15.80:0/1501836809 shutdown_connections 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.747+0000 7f07caf6b640 1 -- 172.21.15.80:0/1501836809 wait complete. 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 Processor -- start 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 -- start start 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c4102410 0x7f07c419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c41069a0 0x7f07c419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c4107460 0x7f07c419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4111b40 con 0x7f07c41069a0 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41119c0 con 0x7f07c4107460 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07caf6b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4111cc0 con 0x7f07c4102410 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c41069a0 0x7f07c419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c41069a0 0x7f07c419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58678/0 (socket says 172.21.15.80:58678) 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 -- 172.21.15.80:0/2990912924 learned_addr learned my addr 172.21.15.80:0/2990912924 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c8d07640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c4102410 0x7f07c419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c9508640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c4107460 0x7f07c419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 -- 172.21.15.80:0/2990912924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c4102410 msgr2=0x7f07c419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c4102410 0x7f07c419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 -- 172.21.15.80:0/2990912924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c4107460 msgr2=0x7f07c419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c4107460 0x7f07c419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c3fff640 1 -- 172.21.15.80:0/2990912924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c419f4f0 con 0x7f07c41069a0 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c8d07640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c4102410 0x7f07c419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.748+0000 7f07c9508640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c4107460 0x7f07c419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.749+0000 7f07c3fff640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c41069a0 0x7f07c419ac70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c9a0 tx=0x7f07b000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.749+0000 7f07c1ffb640 1 -- 172.21.15.80:0/2990912924 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0014070 con 0x7f07c41069a0 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.749+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c419f7e0 con 0x7f07c41069a0 2024-04-25T11:32:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.749+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c41a71e0 con 0x7f07c41069a0 2024-04-25T11:32:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.749+0000 7f07c1ffb640 1 -- 172.21.15.80:0/2990912924 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b0004440 con 0x7f07c41069a0 2024-04-25T11:32:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.749+0000 7f07c1ffb640 1 -- 172.21.15.80:0/2990912924 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b000f450 con 0x7f07c41069a0 2024-04-25T11:32:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.750+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a8005290 con 0x7f07c41069a0 2024-04-25T11:32:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.751+0000 7f07c1ffb640 1 -- 172.21.15.80:0/2990912924 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f07b0017070 con 0x7f07c41069a0 2024-04-25T11:32:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.752+0000 7f07c1ffb640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07b40afc60 0x7f07b40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.752+0000 7f07c8d07640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07b40afc60 0x7f07b40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.753+0000 7f07c1ffb640 1 -- 172.21.15.80:0/2990912924 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f07b00df280 con 0x7f07c41069a0 2024-04-25T11:32:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.753+0000 7f07c8d07640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07b40afc60 0x7f07b40b2170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000c00 tx=0x7f07b8031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.756+0000 7f07c1ffb640 1 -- 172.21.15.80:0/2990912924 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f07b001e030 con 0x7f07c41069a0 2024-04-25T11:32:57.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.972+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07a8005580 con 0x7f07c41069a0 2024-04-25T11:32:57.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.973+0000 7f07c1ffb640 1 -- 172.21.15.80:0/2990912924 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f07b00a7b00 con 0x7f07c41069a0 2024-04-25T11:32:57.963 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:32:57.963 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:32:57.963 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07b40afc60 msgr2=0x7f07b40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07b40afc60 0x7f07b40b2170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000c00 tx=0x7f07b8031400 comp rx=0 tx=0).stop 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c41069a0 msgr2=0x7f07c419ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c41069a0 0x7f07c419ac70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c9a0 tx=0x7f07b000ce60 comp rx=0 tx=0).stop 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 shutdown_connections 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f07b40afc60 0x7f07b40b2170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07c41069a0 0x7f07c419ac70 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c4107460 0x7f07c419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 --2- 172.21.15.80:0/2990912924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c4102410 0x7f07c419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 >> 172.21.15.80:0/2990912924 conn(0x7f07c40fd850 msgr2=0x7f07c410dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 shutdown_connections 2024-04-25T11:32:57.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:57.975+0000 7f07caf6b640 1 -- 172.21.15.80:0/2990912924 wait complete. 2024-04-25T11:32:57.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:32:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.095+0000 7fa229dc7640 1 -- 172.21.15.80:0/776731378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109fb0 msgr2=0x7fa224103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.095+0000 7fa229dc7640 1 --2- 172.21.15.80:0/776731378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109fb0 0x7fa224103bf0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa218009900 tx=0x7fa21802a410 comp rx=0 tx=0).stop 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 -- 172.21.15.80:0/776731378 shutdown_connections 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 --2- 172.21.15.80:0/776731378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109fb0 0x7fa224103bf0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 --2- 172.21.15.80:0/776731378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa224104260 0x7fa224110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 --2- 172.21.15.80:0/776731378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa224109b10 0x7fa2241036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 -- 172.21.15.80:0/776731378 >> 172.21.15.80:0/776731378 conn(0x7fa2240ff210 msgr2=0x7fa224101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 -- 172.21.15.80:0/776731378 shutdown_connections 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 -- 172.21.15.80:0/776731378 wait complete. 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 Processor -- start 2024-04-25T11:32:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.096+0000 7fa229dc7640 1 -- start start 2024-04-25T11:32:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa229dc7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa224104260 0x7fa22419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa229dc7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109b10 0x7fa22419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa229dc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa224109fb0 0x7fa22419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa229dc7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa224113d00 con 0x7fa224109b10 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa229dc7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa224113b80 con 0x7fa224109fb0 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa229dc7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa224113e80 con 0x7fa224104260 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109b10 0x7fa22419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109b10 0x7fa22419ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58706/0 (socket says 172.21.15.80:58706) 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 -- 172.21.15.80:0/3482083538 learned_addr learned my addr 172.21.15.80:0/3482083538 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa2237fe640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa224104260 0x7fa22419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa223fff640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa224109fb0 0x7fa22419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 -- 172.21.15.80:0/3482083538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa224104260 msgr2=0x7fa22419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa224104260 0x7fa22419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 -- 172.21.15.80:0/3482083538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa224109fb0 msgr2=0x7fa22419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa224109fb0 0x7fa22419efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 -- 172.21.15.80:0/3482083538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22419f620 con 0x7fa224109b10 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa222ffd640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109b10 0x7fa22419ad20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fa21802a930 tx=0x7fa218004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.097+0000 7fa220ff9640 1 -- 172.21.15.80:0/3482083538 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21803f030 con 0x7fa224109b10 2024-04-25T11:32:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.098+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22419f8b0 con 0x7fa224109b10 2024-04-25T11:32:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.098+0000 7fa220ff9640 1 -- 172.21.15.80:0/3482083538 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa218003aa0 con 0x7fa224109b10 2024-04-25T11:32:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.098+0000 7fa220ff9640 1 -- 172.21.15.80:0/3482083538 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218035070 con 0x7fa224109b10 2024-04-25T11:32:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.098+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22419fdf0 con 0x7fa224109b10 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa220ff9640 1 -- 172.21.15.80:0/3482083538 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fa218042030 con 0x7fa224109b10 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 Processor -- start 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 -- start start 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11d7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11d7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 0x5602e11e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5602e113cd80 con 0x5602e0e0d4d0 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5602e10f6a20 con 0x5602e0e36390 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.100+0000 7fa230c73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5602e1138d40 con 0x5602e0e156b0 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11d7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa220ff9640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa20c0afc60 0x7fa20c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11d7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58718/0 (socket says 172.21.15.80:58718) 2024-04-25T11:32:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 -- 172.21.15.80:0/1969824131 learned_addr learned my addr 172.21.15.80:0/1969824131 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa223fff640 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11d7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa223fff640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa20c0afc60 0x7fa20c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa220ff9640 1 -- 172.21.15.80:0/3482083538 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fa2180ff6b0 con 0x7fa224109b10 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa222ffd640 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 0x5602e11e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 -- 172.21.15.80:0/1969824131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 msgr2=0x5602e11e46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 0x5602e11e46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 -- 172.21.15.80:0/1969824131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 msgr2=0x5602e11d7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11d7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 -- 172.21.15.80:0/1969824131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e1101c30 con 0x5602e0e0d4d0 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa2237fe640 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11d7d50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa21400b690 tx=0x7fa21400bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cb655f4dab8210 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa223fff640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa20c0afc60 0x7fa20c0b2170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5602e11d4980 tx=0x7fa21c009600 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa209ffb640 1 -- 172.21.15.80:0/1969824131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214003bd0 con 0x5602e0e0d4d0 2024-04-25T11:32:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa209ffb640 1 -- 172.21.15.80:0/1969824131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa214015070 con 0x5602e0e0d4d0 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.101+0000 7fa209ffb640 1 -- 172.21.15.80:0/1969824131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214004d40 con 0x5602e0e0d4d0 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 -- 172.21.15.80:0/1969824131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 msgr2=0x5602e11d7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11d7d50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa21400b690 tx=0x7fa21400bb50 comp rx=0 tx=0).stop 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 -- 172.21.15.80:0/1969824131 shutdown_connections 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11d7d50 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 0x5602e11e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 --2- 172.21.15.80:0/1969824131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11d7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 -- 172.21.15.80:0/1969824131 >> 172.21.15.80:0/1969824131 conn(0x5602e0e2a4e0 msgr2=0x5602e11d3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 -- 172.21.15.80:0/1969824131 shutdown_connections 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.102+0000 7fa230c73740 1 -- 172.21.15.80:0/1969824131 wait complete. 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 -- start start 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 Processor -- start 2024-04-25T11:32:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e0d4d0 0x5602e11e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e156b0 0x5602e11e2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11ee210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5602e11e4d90 con 0x5602e0e156b0 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5602e10c3dc0 con 0x5602e0e36390 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5602e11e4f10 con 0x5602e0e0d4d0 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa230c73740 10 client.0 _ll_register_callbacks cb 0x5602e10df600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e156b0 0x5602e11e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e156b0 0x5602e11e2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58728/0 (socket says 172.21.15.80:58728) 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 -- 172.21.15.80:0/4042786337 learned_addr learned my addr 172.21.15.80:0/4042786337 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa2237fe640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e0d4d0 0x5602e11e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa223fff640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 -- 172.21.15.80:0/4042786337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e0d4d0 msgr2=0x5602e11e22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e0d4d0 0x5602e11e22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 -- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 msgr2=0x5602e11ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.103+0000 7fa222ffd640 1 -- 172.21.15.80:0/4042786337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e0e4e3f0 con 0x5602e0e156b0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa223fff640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa222ffd640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e156b0 0x5602e11e2810 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c4b50 tx=0x7fa218000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30dd808d78fd275 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa202ffd640 1 -- 172.21.15.80:0/4042786337 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218049070 con 0x5602e0e156b0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa202ffd640 1 -- 172.21.15.80:0/4042786337 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fa218003c50 con 0x5602e0e156b0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa214015070 con 0x5602e0e156b0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa202ffd640 1 -- 172.21.15.80:0/4042786337 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa2180e4050 con 0x5602e0e156b0 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 10 client.17589 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5602e0f187d0 con 0x5602e0e156b0 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa202ffd640 1 -- 172.21.15.80:0/4042786337 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa214015070 con 0x5602e0e156b0 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa202ffd640 1 -- 172.21.15.80:0/4042786337 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fa2180fd060 con 0x5602e0e156b0 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 10 client.17589 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 10 client.17589 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 20 client.17589 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0df4f60 0x5602e11f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 4 client.17589 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.104+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602e114a990 con 0x5602e0df4f60 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.105+0000 7fa2237fe640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0df4f60 0x5602e11f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.105+0000 7fa202ffd640 10 client.17589 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.105+0000 7fa2237fe640 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0df4f60 0x5602e11f45e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45c373612e8b4b32 server_cookie=ba9646dad5b558e3 in_seq=0 out_seq=0 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa202ffd640 1 -- 172.21.15.80:0/4042786337 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5602e114a990 con 0x5602e0df4f60 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa202ffd640 10 client.17589 handle_command_reply: tid=0 2024-04-25T11:32:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 client.17589 shutdown 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e156b0 msgr2=0x5602e11e2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e156b0 0x5602e11e2810 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c4b50 tx=0x7fa218000bc0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 shutdown_connections 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0df4f60 0x5602e11f45e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e156b0 0x5602e11e2810 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e36390 0x5602e11ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa202ffd640 0 client.17589 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 --2- 172.21.15.80:0/4042786337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e0d4d0 0x5602e11e22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 >> 172.21.15.80:0/4042786337 conn(0x5602e0e2a4e0 msgr2=0x5602e11d9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 shutdown_connections 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 1 -- 172.21.15.80:0/4042786337 wait complete. 2024-04-25T11:32:58.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.106+0000 7fa230c73740 20 client.17589 trim_cache size 0 max 16384 2024-04-25T11:32:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 Processor -- start 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 -- start start 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0df4f60 0x5602e11ede70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 0x5602e11fa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa2241b2250 con 0x5602e0e0d4d0 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2241afb20 con 0x5602e0df4f60 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa230c73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa2241ad990 con 0x5602e0e156b0 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11f9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58742/0 (socket says 172.21.15.80:58742) 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 -- 172.21.15.80:0/860031440 learned_addr learned my addr 172.21.15.80:0/860031440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa2237fe640 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0df4f60 0x5602e11ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 -- 172.21.15.80:0/860031440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 msgr2=0x5602e11fa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 0x5602e11fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 -- 172.21.15.80:0/860031440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0df4f60 msgr2=0x5602e11ede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0df4f60 0x5602e11ede70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 -- 172.21.15.80:0/860031440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e11e3030 con 0x5602e0e0d4d0 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa222ffd640 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11f9de0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c75e0 tx=0x7fa218003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8383caa876c4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.120+0000 7fa2097fa640 1 -- 172.21.15.80:0/860031440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218049070 con 0x5602e0e0d4d0 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa2097fa640 1 -- 172.21.15.80:0/860031440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2180cbbe0 con 0x5602e0e0d4d0 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa2097fa640 1 -- 172.21.15.80:0/860031440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2180fd060 con 0x5602e0e0d4d0 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 -- 172.21.15.80:0/860031440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 msgr2=0x5602e11f9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11f9de0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c75e0 tx=0x7fa218003f50 comp rx=0 tx=0).stop 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 -- 172.21.15.80:0/860031440 shutdown_connections 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11f9de0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0e156b0 0x5602e11fa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 --2- 172.21.15.80:0/860031440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0df4f60 0x5602e11ede70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 -- 172.21.15.80:0/860031440 >> 172.21.15.80:0/860031440 conn(0x5602e0e2a4e0 msgr2=0x5602e11e0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 -- 172.21.15.80:0/860031440 shutdown_connections 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.121+0000 7fa230c73740 1 -- 172.21.15.80:0/860031440 wait complete. 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 -- start start 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 Processor -- start 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0df4f60 0x5602e11e6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e156b0 0x5602e125b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa2241adfe0 con 0x5602e0e0d4d0 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2241af450 con 0x5602e0e156b0 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa2241ae6b0 con 0x5602e0df4f60 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa230c73740 10 client.0 _ll_register_callbacks cb 0x7fa218005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa222ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11e66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58750/0 (socket says 172.21.15.80:58750) 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa222ffd640 1 -- 172.21.15.80:0/1210006249 learned_addr learned my addr 172.21.15.80:0/1210006249 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa2237fe640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0df4f60 0x5602e11e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa223fff640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e156b0 0x5602e125b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.122+0000 7fa222ffd640 1 -- 172.21.15.80:0/1210006249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0df4f60 msgr2=0x5602e11e6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa222ffd640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0df4f60 0x5602e11e6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa222ffd640 1 -- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e156b0 msgr2=0x5602e125b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa222ffd640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e156b0 0x5602e125b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa222ffd640 1 -- 172.21.15.80:0/1210006249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e11e6f50 con 0x5602e0e0d4d0 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa2237fe640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0df4f60 0x5602e11e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa222ffd640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11e66b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c7590 tx=0x7fa218000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b8907c414a8a0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa202ffd640 1 -- 172.21.15.80:0/1210006249 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a6030 con 0x5602e0e0d4d0 2024-04-25T11:32:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa202ffd640 1 -- 172.21.15.80:0/1210006249 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fa2180c3ed0 con 0x5602e0e0d4d0 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2180cbbe0 con 0x5602e0e0d4d0 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa202ffd640 1 -- 172.21.15.80:0/1210006249 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa218049070 con 0x5602e0e0d4d0 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 10 client.17595 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5602e11e6f50 con 0x5602e0e0d4d0 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa202ffd640 1 -- 172.21.15.80:0/1210006249 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2180cbbe0 con 0x5602e0e0d4d0 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa202ffd640 1 -- 172.21.15.80:0/1210006249 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fa2180e7020 con 0x5602e0e0d4d0 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 10 client.17595 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 10 client.17595 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 20 client.17595 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0e36390 0x5602e125f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 4 client.17595 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.123+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5602e1144800 con 0x5602e0e36390 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa2237fe640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0e36390 0x5602e125f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa202ffd640 10 client.17595 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa2237fe640 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0e36390 0x5602e125f230 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84af05156a338ab6 server_cookie=9d10b4e7f3696fb7 in_seq=0 out_seq=0 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa202ffd640 1 -- 172.21.15.80:0/1210006249 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5602e1144800 con 0x5602e0e36390 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa202ffd640 10 client.17595 handle_command_reply: tid=0 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 client.17595 shutdown 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 msgr2=0x5602e11e66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11e66b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c7590 tx=0x7fa218000bc0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 shutdown_connections 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x5602e0e36390 0x5602e125f230 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602e0e0d4d0 0x5602e11e66b0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602e0e156b0 0x5602e125b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 --2- 172.21.15.80:0/1210006249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5602e0df4f60 0x5602e11e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa202ffd640 0 client.17595 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 >> 172.21.15.80:0/1210006249 conn(0x5602e0e2a4e0 msgr2=0x5602e11e0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 shutdown_connections 2024-04-25T11:32:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.124+0000 7fa230c73740 1 -- 172.21.15.80:0/1210006249 wait complete. 2024-04-25T11:32:58.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa230c73740 20 client.17595 trim_cache size 0 max 16384 2024-04-25T11:32:58.121 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa20c0afc60 msgr2=0x7fa20c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa20c0afc60 0x7fa20c0b2170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5602e11d4980 tx=0x7fa21c009600 comp rx=0 tx=0).stop 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109b10 msgr2=0x7fa22419ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109b10 0x7fa22419ad20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fa21802a930 tx=0x7fa218004270 comp rx=0 tx=0).stop 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 shutdown_connections 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa20c0afc60 0x7fa20c0b2170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa224109b10 0x7fa22419ad20 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa224109fb0 0x7fa22419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 --2- 172.21.15.80:0/3482083538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa224104260 0x7fa22419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 >> 172.21.15.80:0/3482083538 conn(0x7fa2240ff210 msgr2=0x7fa22410f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 shutdown_connections 2024-04-25T11:32:58.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.125+0000 7fa229dc7640 1 -- 172.21.15.80:0/3482083538 wait complete. 2024-04-25T11:32:58.125 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:32:58.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 -- 172.21.15.80:0/950715499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 msgr2=0x7fea201025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 --2- 172.21.15.80:0/950715499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea201025c0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ca0 tx=0x7fea1002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 -- 172.21.15.80:0/950715499 shutdown_connections 2024-04-25T11:32:58.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 --2- 172.21.15.80:0/950715499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2010d390 0x7fea2010f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 --2- 172.21.15.80:0/950715499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea20102b00 0x7fea20102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 --2- 172.21.15.80:0/950715499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea201025c0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 -- 172.21.15.80:0/950715499 >> 172.21.15.80:0/950715499 conn(0x7fea200fe260 msgr2=0x7fea20100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 -- 172.21.15.80:0/950715499 shutdown_connections 2024-04-25T11:32:58.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 -- 172.21.15.80:0/950715499 wait complete. 2024-04-25T11:32:58.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.246+0000 7fea249a8640 1 Processor -- start 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea249a8640 1 -- start start 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea249a8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea20102b00 0x7fea2019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea249a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea2019bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea249a8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2010d390 0x7fea2019c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea249a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea20112bf0 con 0x7fea20108a30 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea249a8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea20112a70 con 0x7fea2010d390 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea249a8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fea20112d70 con 0x7fea20102b00 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea2019bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea2019bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58776/0 (socket says 172.21.15.80:58776) 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 -- 172.21.15.80:0/2490394230 learned_addr learned my addr 172.21.15.80:0/2490394230 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2010d390 0x7fea2019c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea20102b00 0x7fea2019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 -- 172.21.15.80:0/2490394230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea20102b00 msgr2=0x7fea2019b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea20102b00 0x7fea2019b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 -- 172.21.15.80:0/2490394230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2010d390 msgr2=0x7fea2019c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2010d390 0x7fea2019c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 -- 172.21.15.80:0/2490394230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea201a68e0 con 0x7fea20108a30 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea20102b00 0x7fea2019b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.247+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea2019bb10 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fea1400e9f0 tx=0x7fea1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.248+0000 7fea0f7fe640 1 -- 172.21.15.80:0/2490394230 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1400ccc0 con 0x7fea20108a30 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.248+0000 7fea0f7fe640 1 -- 172.21.15.80:0/2490394230 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea140035f0 con 0x7fea20108a30 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.248+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea201a6bd0 con 0x7fea20108a30 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.248+0000 7fea0f7fe640 1 -- 172.21.15.80:0/2490394230 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1400ce60 con 0x7fea20108a30 2024-04-25T11:32:58.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.248+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201a70d0 con 0x7fea20108a30 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.250+0000 7fea2b85b740 1 Processor -- start 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.250+0000 7fea2b85b740 1 -- start start 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.250+0000 7fea0f7fe640 1 -- 172.21.15.80:0/2490394230 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fea14003aa0 con 0x7fea20108a30 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.250+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe09326810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09326d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f646b0 0x55fe093336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea2b85b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fe0928bd80 con 0x55fe08f646b0 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea2b85b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fe09245a20 con 0x55fe08f5c4d0 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea2b85b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fe09287d40 con 0x55fe08f85390 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f646b0 0x55fe093336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe09326810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f646b0 0x55fe093336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58788/0 (socket says 172.21.15.80:58788) 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1dd9b640 1 -- 172.21.15.80:0/3599705621 learned_addr learned my addr 172.21.15.80:0/3599705621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1e59c640 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09326d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1ed9d640 1 -- 172.21.15.80:0/3599705621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 msgr2=0x55fe09326d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09326d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1ed9d640 1 -- 172.21.15.80:0/3599705621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f646b0 msgr2=0x55fe093336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f646b0 0x55fe093336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1ed9d640 1 -- 172.21.15.80:0/3599705621 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe09250c30 con 0x55fe08f85390 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f646b0 0x55fe093336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea0f7fe640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fea080afc60 0x7fea080b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe09326810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea18004590 tx=0x7fea1800b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3852d8402c9c4138 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fea080afc60 0x7fea080b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea0f7fe640 1 -- 172.21.15.80:0/2490394230 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fea140df4d0 con 0x7fea20108a30 2024-04-25T11:32:58.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.251+0000 7fea0cff9640 1 -- 172.21.15.80:0/3599705621 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea180039f0 con 0x55fe08f85390 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea0cff9640 1 -- 172.21.15.80:0/3599705621 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea18015070 con 0x55fe08f85390 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea0cff9640 1 -- 172.21.15.80:0/3599705621 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18011440 con 0x55fe08f85390 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea2b85b740 1 -- 172.21.15.80:0/3599705621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 msgr2=0x55fe09326810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fea080afc60 0x7fea080b2170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea10005e30 tx=0x7fea10005d80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea2b85b740 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe09326810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea18004590 tx=0x7fea1800b9d0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea2b85b740 1 -- 172.21.15.80:0/3599705621 shutdown_connections 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea2b85b740 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f646b0 0x55fe093336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea2b85b740 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09326d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.252+0000 7fea2b85b740 1 --2- 172.21.15.80:0/3599705621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe09326810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 -- 172.21.15.80:0/3599705621 >> 172.21.15.80:0/3599705621 conn(0x55fe08f794e0 msgr2=0x55fe09322fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 -- 172.21.15.80:0/3599705621 shutdown_connections 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 -- 172.21.15.80:0/3599705621 wait complete. 2024-04-25T11:32:58.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 -- start start 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 Processor -- start 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09331280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 0x55fe093317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0933d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55fe09333d90 con 0x55fe08f85390 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fe09212dc0 con 0x55fe08f5c4d0 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fe09333f10 con 0x55fe08f646b0 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea2b85b740 10 client.0 _ll_register_callbacks cb 0x55fe0922e600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0933d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09331280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0933d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58796/0 (socket says 172.21.15.80:58796) 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.253+0000 7fea1ed9d640 1 -- 172.21.15.80:0/2687186280 learned_addr learned my addr 172.21.15.80:0/2687186280 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 0x55fe093317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea1ed9d640 1 -- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 msgr2=0x55fe093317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 0x55fe093317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea1ed9d640 1 -- 172.21.15.80:0/2687186280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 msgr2=0x55fe09331280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09331280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea1ed9d640 1 -- 172.21.15.80:0/2687186280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe08f9d3f0 con 0x55fe08f85390 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0933d210 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fea1801ab00 tx=0x7fea1801a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6742c4f706db01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea05ffb640 1 -- 172.21.15.80:0/2687186280 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1801a8c0 con 0x55fe08f85390 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea05ffb640 1 -- 172.21.15.80:0/2687186280 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fea18005240 con 0x55fe08f85390 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea18015070 con 0x55fe08f85390 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea05ffb640 1 -- 172.21.15.80:0/2687186280 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea18005440 con 0x55fe08f85390 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea2b85b740 10 client.17607 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fe090677d0 con 0x55fe08f85390 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.254+0000 7fea05ffb640 1 -- 172.21.15.80:0/2687186280 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea18015070 con 0x55fe08f85390 2024-04-25T11:32:58.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea05ffb640 1 -- 172.21.15.80:0/2687186280 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fea18004bb0 con 0x55fe08f85390 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea2b85b740 10 client.17607 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea2b85b740 10 client.17607 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea2b85b740 20 client.17607 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f43f60 0x55fe093435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea2b85b740 4 client.17607 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe09299990 con 0x55fe08f43f60 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f43f60 0x55fe093435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea05ffb640 10 client.17607 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:58.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.255+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f43f60 0x55fe093435c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c2de338608b5f74 server_cookie=b3adf4a1747a20ae in_seq=0 out_seq=0 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea05ffb640 1 -- 172.21.15.80:0/2687186280 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fe09299990 con 0x55fe08f43f60 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea05ffb640 10 client.17607 handle_command_reply: tid=0 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 client.17607 shutdown 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 msgr2=0x55fe0933d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0933d210 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fea1801ab00 tx=0x7fea1801a6a0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 shutdown_connections 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0933d210 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f43f60 0x55fe093435c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 0x55fe093317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2687186280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09331280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 >> 172.21.15.80:0/2687186280 conn(0x55fe08f794e0 msgr2=0x55fe09328530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea05ffb640 0 client.17607 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:58.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 shutdown_connections 2024-04-25T11:32:58.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 1 -- 172.21.15.80:0/2687186280 wait complete. 2024-04-25T11:32:58.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.256+0000 7fea2b85b740 20 client.17607 trim_cache size 0 max 16384 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 Processor -- start 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 -- start start 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09330cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 0x55fe0933ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0932b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea201b2410 con 0x55fe08f85390 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea201afce0 con 0x55fe08f5c4d0 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea2b85b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fea201adb50 con 0x55fe08f646b0 2024-04-25T11:32:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0932b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0932b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58802/0 (socket says 172.21.15.80:58802) 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 -- 172.21.15.80:0/829491617 learned_addr learned my addr 172.21.15.80:0/829491617 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 -- 172.21.15.80:0/829491617 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 msgr2=0x55fe0933ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/829491617 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 0x55fe0933ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 -- 172.21.15.80:0/829491617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 msgr2=0x55fe09330cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/829491617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09330cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 -- 172.21.15.80:0/829491617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe09322620 con 0x55fe08f85390 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.270+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/829491617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0932b430 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fea1800ba10 tx=0x7fea18003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3936d75b9d9120 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea07fff640 1 -- 172.21.15.80:0/829491617 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1801ab30 con 0x55fe08f85390 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea07fff640 1 -- 172.21.15.80:0/829491617 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea18015040 con 0x55fe08f85390 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea07fff640 1 -- 172.21.15.80:0/829491617 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea180037f0 con 0x55fe08f85390 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 -- 172.21.15.80:0/829491617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 msgr2=0x55fe0932b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 --2- 172.21.15.80:0/829491617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0932b430 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fea1800ba10 tx=0x7fea18003660 comp rx=0 tx=0).stop 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 -- 172.21.15.80:0/829491617 shutdown_connections 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 --2- 172.21.15.80:0/829491617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f85390 0x55fe0932b430 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 --2- 172.21.15.80:0/829491617 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f646b0 0x55fe0933ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 --2- 172.21.15.80:0/829491617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f5c4d0 0x55fe09330cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 -- 172.21.15.80:0/829491617 >> 172.21.15.80:0/829491617 conn(0x55fe08f794e0 msgr2=0x55fe093305b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 -- 172.21.15.80:0/829491617 shutdown_connections 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.271+0000 7fea2b85b740 1 -- 172.21.15.80:0/829491617 wait complete. 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 -- start start 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 Processor -- start 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f5c4d0 0x55fe09334830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f646b0 0x55fe09334d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe093a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fea201ae1a0 con 0x55fe08f5c4d0 2024-04-25T11:32:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea201af610 con 0x55fe08f646b0 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fea201ae870 con 0x55fe08f85390 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea2b85b740 10 client.0 _ll_register_callbacks cb 0x7fea140e2e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f5c4d0 0x55fe09334830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f5c4d0 0x55fe09334830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58816/0 (socket says 172.21.15.80:58816) 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 -- 172.21.15.80:0/2024839979 learned_addr learned my addr 172.21.15.80:0/2024839979 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f646b0 0x55fe09334d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe093a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 -- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 msgr2=0x55fe093a37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe093a37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 -- 172.21.15.80:0/2024839979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f646b0 msgr2=0x55fe09334d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f646b0 0x55fe09334d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 -- 172.21.15.80:0/2024839979 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe093a3d80 con 0x55fe08f5c4d0 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1ed9d640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe093a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea1e59c640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f5c4d0 0x55fe09334830 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ca0 tx=0x7fea1002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ec74323dd02cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.272+0000 7fea05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea05ffb640 1 -- 172.21.15.80:0/2024839979 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10031690 con 0x55fe08f5c4d0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea05ffb640 1 -- 172.21.15.80:0/2024839979 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7fea10031830 con 0x55fe08f5c4d0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea18015040 con 0x55fe08f5c4d0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea05ffb640 1 -- 172.21.15.80:0/2024839979 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea10004b40 con 0x55fe08f5c4d0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 10 client.17613 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fe093ab030 con 0x55fe08f5c4d0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea05ffb640 1 -- 172.21.15.80:0/2024839979 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea18015040 con 0x55fe08f5c4d0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea05ffb640 1 -- 172.21.15.80:0/2024839979 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fea100557b0 con 0x55fe08f5c4d0 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 10 client.17613 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 10 client.17613 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 20 client.17613 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f193a0 0x55fe093ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 4 client.17613 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe09293800 con 0x55fe08f193a0 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.273+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f193a0 0x55fe093ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea05ffb640 10 client.17613 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea1dd9b640 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f193a0 0x55fe093ad7f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fad46fd9b6a8b671 server_cookie=28e65f1bb5433db3 in_seq=0 out_seq=0 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea05ffb640 1 -- 172.21.15.80:0/2024839979 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe09293800 con 0x55fe08f193a0 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea05ffb640 10 client.17613 handle_command_reply: tid=0 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 client.17613 shutdown 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f5c4d0 msgr2=0x55fe09334830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f5c4d0 0x55fe09334830 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ca0 tx=0x7fea1002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 shutdown_connections 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55fe08f193a0 0x55fe093ad7f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fe08f85390 0x55fe093a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe08f646b0 0x55fe09334d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea05ffb640 0 client.17613 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:32:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 --2- 172.21.15.80:0/2024839979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fe08f5c4d0 0x55fe09334830 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 >> 172.21.15.80:0/2024839979 conn(0x55fe08f794e0 msgr2=0x55fe093229a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 shutdown_connections 2024-04-25T11:32:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 1 -- 172.21.15.80:0/2024839979 wait complete. 2024-04-25T11:32:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.274+0000 7fea2b85b740 20 client.17613 trim_cache size 0 max 16384 2024-04-25T11:32:58.271 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:32:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fea080afc60 msgr2=0x7fea080b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fea080afc60 0x7fea080b2170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea10005e30 tx=0x7fea10005d80 comp rx=0 tx=0).stop 2024-04-25T11:32:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 msgr2=0x7fea2019bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea2019bb10 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fea1400e9f0 tx=0x7fea1400eeb0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 shutdown_connections 2024-04-25T11:32:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fea080afc60 0x7fea080b2170 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea20108a30 0x7fea2019bb10 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea2010d390 0x7fea2019c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 --2- 172.21.15.80:0/2490394230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea20102b00 0x7fea2019b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 >> 172.21.15.80:0/2490394230 conn(0x7fea200fe260 msgr2=0x7fea200fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 shutdown_connections 2024-04-25T11:32:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.275+0000 7fea249a8640 1 -- 172.21.15.80:0/2490394230 wait complete. 2024-04-25T11:32:58.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:32:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 -- 172.21.15.80:0/850425795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 msgr2=0x7f57141050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 --2- 172.21.15.80:0/850425795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f57141050d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f5710009900 tx=0x7f571002a480 comp rx=0 tx=0).stop 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 -- 172.21.15.80:0/850425795 shutdown_connections 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 --2- 172.21.15.80:0/850425795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f571410e080 0x7f5714110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 --2- 172.21.15.80:0/850425795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f571410b720 0x7f571410db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 --2- 172.21.15.80:0/850425795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f57141050d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 -- 172.21.15.80:0/850425795 >> 172.21.15.80:0/850425795 conn(0x7f5714078150 msgr2=0x7f5714078590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 -- 172.21.15.80:0/850425795 shutdown_connections 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.396+0000 7f571aa96640 1 -- 172.21.15.80:0/850425795 wait complete. 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 Processor -- start 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 -- start start 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f571419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f571410b720 0x7f571419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f571410e080 0x7f571419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5714113ce0 con 0x7f5714104cc0 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5714113b60 con 0x7f571410e080 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f571aa96640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5714113e60 con 0x7f571410b720 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f5718832640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f571419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.397+0000 7f5718832640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f571419a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58822/0 (socket says 172.21.15.80:58822) 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5718832640 1 -- 172.21.15.80:0/548612865 learned_addr learned my addr 172.21.15.80:0/548612865 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5719033640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f571410e080 0x7f571419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f570bfff640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f571410b720 0x7f571419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5718832640 1 -- 172.21.15.80:0/548612865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f571410b720 msgr2=0x7f571419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5718832640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f571410b720 0x7f571419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5718832640 1 -- 172.21.15.80:0/548612865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f571410e080 msgr2=0x7f571419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5718832640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f571410e080 0x7f571419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5718832640 1 -- 172.21.15.80:0/548612865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571419f580 con 0x7f5714104cc0 2024-04-25T11:32:58.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5718832640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f571419a720 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f5710005940 tx=0x7f5710004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5709ffb640 1 -- 172.21.15.80:0/548612865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571003f030 con 0x7f5714104cc0 2024-04-25T11:32:58.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571419f810 con 0x7f5714104cc0 2024-04-25T11:32:58.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5709ffb640 1 -- 172.21.15.80:0/548612865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5710003aa0 con 0x7f5714104cc0 2024-04-25T11:32:58.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f5709ffb640 1 -- 172.21.15.80:0/548612865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710035070 con 0x7f5714104cc0 2024-04-25T11:32:58.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.398+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571419fd00 con 0x7f5714104cc0 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 Processor -- start 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 -- start start 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fc4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910bfa4d0 0x55b910fc4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910c026b0 0x55b910fd16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b910f29d80 con 0x55b910c23390 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b910ee3a20 con 0x55b910c026b0 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5709ffb640 1 -- 172.21.15.80:0/548612865 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f5710042030 con 0x7f5714104cc0 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5721a23740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b910f25d40 con 0x55b910bfa4d0 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fc4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fc4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58836/0 (socket says 172.21.15.80:58836) 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 -- 172.21.15.80:0/2159150777 learned_addr learned my addr 172.21.15.80:0/2159150777 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5718832640 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910bfa4d0 0x55b910fc4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f570bfff640 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910c026b0 0x55b910fd16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 -- 172.21.15.80:0/2159150777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910bfa4d0 msgr2=0x55b910fc4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910bfa4d0 0x55b910fc4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 -- 172.21.15.80:0/2159150777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910c026b0 msgr2=0x55b910fd16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910c026b0 0x55b910fd16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.401+0000 7f5719033640 1 -- 172.21.15.80:0/2159150777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b910eeec30 con 0x55b910c23390 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.402+0000 7f5719033640 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fc4810 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f570c009f70 tx=0x7f570c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b12b87227d5609 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.402+0000 7f5709ffb640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56fc0afc60 0x7f56fc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.402+0000 7f56faffd640 1 -- 172.21.15.80:0/2159150777 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c016070 con 0x55b910c23390 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.402+0000 7f56faffd640 1 -- 172.21.15.80:0/2159150777 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c004d20 con 0x55b910c23390 2024-04-25T11:32:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.402+0000 7f56faffd640 1 -- 172.21.15.80:0/2159150777 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c012790 con 0x55b910c23390 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.402+0000 7f5718832640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56fc0afc60 0x7f56fc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.402+0000 7f5709ffb640 1 -- 172.21.15.80:0/548612865 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f57100ff7e0 con 0x7f5714104cc0 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 -- 172.21.15.80:0/2159150777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 msgr2=0x55b910fc4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fc4810 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f570c009f70 tx=0x7f570c010800 comp rx=0 tx=0).stop 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5718832640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56fc0afc60 0x7f56fc0b2170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f57100fcfc0 tx=0x7f571002a480 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 -- 172.21.15.80:0/2159150777 shutdown_connections 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910c026b0 0x55b910fd16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910bfa4d0 0x55b910fc4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 --2- 172.21.15.80:0/2159150777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fc4810 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 -- 172.21.15.80:0/2159150777 >> 172.21.15.80:0/2159150777 conn(0x55b910c174e0 msgr2=0x55b910fc0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 -- 172.21.15.80:0/2159150777 shutdown_connections 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 -- 172.21.15.80:0/2159150777 wait complete. 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 -- start start 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.403+0000 7f5721a23740 1 Processor -- start 2024-04-25T11:32:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c026b0 0x55b910fcf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fdb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b910fd1d90 con 0x55b910c23390 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b910eb0dc0 con 0x55b910bfa4d0 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b910fd1f10 con 0x55b910c026b0 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 10 client.0 _ll_register_callbacks cb 0x55b910ecc600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fdb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fdb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58842/0 (socket says 172.21.15.80:58842) 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 -- 172.21.15.80:0/2027797581 learned_addr learned my addr 172.21.15.80:0/2027797581 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f570bfff640 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c026b0 0x55b910fcf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 -- 172.21.15.80:0/2027797581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c026b0 msgr2=0x55b910fcf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c026b0 0x55b910fcf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 -- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 msgr2=0x55b910fcf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 -- 172.21.15.80:0/2027797581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b910c3b3f0 con 0x55b910c23390 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5719033640 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fdb210 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f570c009d30 tx=0x7f570c012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476aced5ccb85a11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f56f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f56f3fff640 1 -- 172.21.15.80:0/2027797581 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c01e030 con 0x55b910c23390 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f56f3fff640 1 -- 172.21.15.80:0/2027797581 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f570c023030 con 0x55b910c23390 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.404+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570c004d20 con 0x55b910c23390 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f56f3fff640 1 -- 172.21.15.80:0/2027797581 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f570c016070 con 0x55b910c23390 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 10 client.17625 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b910d057d0 con 0x55b910c23390 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f56f3fff640 1 -- 172.21.15.80:0/2027797581 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c004d20 con 0x55b910c23390 2024-04-25T11:32:58.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f56f3fff640 1 -- 172.21.15.80:0/2027797581 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f570c00f040 con 0x55b910c23390 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 10 client.17625 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 10 client.17625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 20 client.17625 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910be1f60 0x55b910fe15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 4 client.17625 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b910f37990 con 0x55b910be1f60 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.405+0000 7f570bfff640 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910be1f60 0x55b910fe15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f56f3fff640 10 client.17625 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f570bfff640 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910be1f60 0x55b910fe15d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2591d8b17e0c21a5 server_cookie=48163a41b63dabf9 in_seq=0 out_seq=0 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f56f3fff640 1 -- 172.21.15.80:0/2027797581 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b910f37990 con 0x55b910be1f60 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f56f3fff640 10 client.17625 handle_command_reply: tid=0 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f5721a23740 1 client.17625 shutdown 2024-04-25T11:32:58.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 msgr2=0x55b910fdb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f5721a23740 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fdb210 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f570c009d30 tx=0x7f570c012450 comp rx=0 tx=0).stop 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.406+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 shutdown_connections 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910be1f60 0x55b910fe15d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c23390 0x55b910fdb210 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f56f3fff640 0 client.17625 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c026b0 0x55b910fcf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 1 --2- 172.21.15.80:0/2027797581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 >> 172.21.15.80:0/2027797581 conn(0x55b910c174e0 msgr2=0x55b910fc6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 shutdown_connections 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 1 -- 172.21.15.80:0/2027797581 wait complete. 2024-04-25T11:32:58.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.407+0000 7f5721a23740 20 client.17625 trim_cache size 0 max 16384 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 Processor -- start 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 -- start start 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fdae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fc9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57141b2350 con 0x55b910c026b0 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57141afc20 con 0x55b910bfa4d0 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f5721a23740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57141ada90 con 0x55b910c23390 2024-04-25T11:32:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f570bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fdae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f570bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fdae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58844/0 (socket says 172.21.15.80:58844) 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.420+0000 7f570bfff640 1 -- 172.21.15.80:0/485665132 learned_addr learned my addr 172.21.15.80:0/485665132 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f5719033640 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fc9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f5719033640 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f570bfff640 1 -- 172.21.15.80:0/485665132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 msgr2=0x55b910fc9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f570bfff640 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fc9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f570bfff640 1 -- 172.21.15.80:0/485665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 msgr2=0x55b910fcece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f570bfff640 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f570bfff640 1 -- 172.21.15.80:0/485665132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b910fc0620 con 0x55b910c026b0 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f5719033640 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f570bfff640 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fdae70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5704009c70 tx=0x7f57040128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8338b34372216c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f56fa7fc640 1 -- 172.21.15.80:0/485665132 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704004110 con 0x55b910c026b0 2024-04-25T11:32:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f56fa7fc640 1 -- 172.21.15.80:0/485665132 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57040054d0 con 0x55b910c026b0 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.421+0000 7f56fa7fc640 1 -- 172.21.15.80:0/485665132 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570401e9a0 con 0x55b910c026b0 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 -- 172.21.15.80:0/485665132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 msgr2=0x55b910fdae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fdae70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5704009c70 tx=0x7f57040128e0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 -- 172.21.15.80:0/485665132 shutdown_connections 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fdae70 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fc9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 --2- 172.21.15.80:0/485665132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fcece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 -- 172.21.15.80:0/485665132 >> 172.21.15.80:0/485665132 conn(0x55b910c174e0 msgr2=0x55b910fce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 -- 172.21.15.80:0/485665132 shutdown_connections 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 -- 172.21.15.80:0/485665132 wait complete. 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 -- start start 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.422+0000 7f5721a23740 1 Processor -- start 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fd7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fd77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fd27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f57141ae0e0 con 0x55b910c026b0 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57141af550 con 0x55b910bfa4d0 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57141ae7b0 con 0x55b910c23390 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 10 client.0 _ll_register_callbacks cb 0x7f570c009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fd77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fd77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58850/0 (socket says 172.21.15.80:58850) 2024-04-25T11:32:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 -- 172.21.15.80:0/2072920508 learned_addr learned my addr 172.21.15.80:0/2072920508 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5719033640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fd7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5719033640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fd27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 -- 172.21.15.80:0/2072920508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 msgr2=0x55b910fd27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fd27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 -- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 msgr2=0x55b910fd7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fd7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 -- 172.21.15.80:0/2072920508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b910fd2f80 con 0x55b910c026b0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5719033640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fd7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f570bfff640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fd77c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5704000c00 tx=0x7f5704009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b4c0938ecc84ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f56f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f56f3fff640 1 -- 172.21.15.80:0/2072920508 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570402c070 con 0x55b910c026b0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f56f3fff640 1 -- 172.21.15.80:0/2072920508 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f5704004320 con 0x55b910c026b0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.423+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57040054d0 con 0x55b910c026b0 2024-04-25T11:32:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f56f3fff640 1 -- 172.21.15.80:0/2072920508 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5704038050 con 0x55b910c026b0 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 10 client.17631 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b911049190 con 0x55b910c026b0 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f56f3fff640 1 -- 172.21.15.80:0/2072920508 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57040054d0 con 0x55b910c026b0 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f56f3fff640 1 -- 172.21.15.80:0/2072920508 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5704004a10 con 0x55b910c026b0 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 10 client.17631 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 10 client.17631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 20 client.17631 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910bb73a0 0x55b91104b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 4 client.17631 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b910f31800 con 0x55b910bb73a0 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.424+0000 7f5719033640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910bb73a0 0x55b91104b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5719033640 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910bb73a0 0x55b91104b840 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e8534ee9c99120d server_cookie=b6b55a049d7f1b67 in_seq=0 out_seq=0 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f56f3fff640 10 client.17631 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f56f3fff640 1 -- 172.21.15.80:0/2072920508 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b910f31800 con 0x55b910bb73a0 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f56f3fff640 10 client.17631 handle_command_reply: tid=0 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 client.17631 shutdown 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 msgr2=0x55b910fd77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fd77c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5704000c00 tx=0x7f5704009ea0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 shutdown_connections 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b910bb73a0 0x55b91104b840 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b910c026b0 0x55b910fd77c0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b910c23390 0x55b910fd27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f56f3fff640 0 client.17631 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 --2- 172.21.15.80:0/2072920508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b910bfa4d0 0x55b910fd7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 >> 172.21.15.80:0/2072920508 conn(0x55b910c174e0 msgr2=0x55b910fc0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 shutdown_connections 2024-04-25T11:32:58.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 1 -- 172.21.15.80:0/2072920508 wait complete. 2024-04-25T11:32:58.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.425+0000 7f5721a23740 20 client.17631 trim_cache size 0 max 16384 2024-04-25T11:32:58.423 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56fc0afc60 msgr2=0x7f56fc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56fc0afc60 0x7f56fc0b2170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f57100fcfc0 tx=0x7f571002a480 comp rx=0 tx=0).stop 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 msgr2=0x7f571419a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f571419a720 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f5710005940 tx=0x7f5710004270 comp rx=0 tx=0).stop 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 shutdown_connections 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f56fc0afc60 0x7f56fc0b2170 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f571410e080 0x7f571419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f571410b720 0x7f571419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 --2- 172.21.15.80:0/548612865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5714104cc0 0x7f571419a720 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 >> 172.21.15.80:0/548612865 conn(0x7f5714078150 msgr2=0x7f5714101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 shutdown_connections 2024-04-25T11:32:58.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:58.426+0000 7f571aa96640 1 -- 172.21.15.80:0/548612865 wait complete. 2024-04-25T11:32:58.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:58 smithi080 ceph-mon[29126]: pgmap v269: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:58.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:32:58 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2990912924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:32:58.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:58 smithi196 ceph-mon[32659]: pgmap v269: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:58.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:32:58 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2990912924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:32:58.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:58 smithi082 ceph-mon[32440]: pgmap v269: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:32:58.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:32:58 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2990912924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:32:59.427 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:32:59.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:32:59.428 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 -- 172.21.15.80:0/1967843630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1033c0 msgr2=0x7f00ec1037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 --2- 172.21.15.80:0/1967843630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1033c0 0x7f00ec1037d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009ca0 tx=0x7f00e402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 -- 172.21.15.80:0/1967843630 shutdown_connections 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 --2- 172.21.15.80:0/1967843630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec107d00 0x7f00ec10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 --2- 172.21.15.80:0/1967843630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec107280 0x7f00ec107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 --2- 172.21.15.80:0/1967843630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec1033c0 0x7f00ec1037d0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 -- 172.21.15.80:0/1967843630 >> 172.21.15.80:0/1967843630 conn(0x7f00ec077920 msgr2=0x7f00ec077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 -- 172.21.15.80:0/1967843630 shutdown_connections 2024-04-25T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.572+0000 7f00f1372640 1 -- 172.21.15.80:0/1967843630 wait complete. 2024-04-25T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 Processor -- start 2024-04-25T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 -- start start 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec1033c0 0x7f00ec199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec107280 0x7f00ec199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec107d00 0x7f00ec19de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec112c00 con 0x7f00ec107d00 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec112a80 con 0x7f00ec1033c0 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00f1372640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec112d80 con 0x7f00ec107280 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec107d00 0x7f00ec19de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec107d00 0x7f00ec19de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58878/0 (socket says 172.21.15.80:58878) 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00eb7fe640 1 -- 172.21.15.80:0/1640538372 learned_addr learned my addr 172.21.15.80:0/1640538372 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00eaffd640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec1033c0 0x7f00ec199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.573+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec107280 0x7f00ec199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00eb7fe640 1 -- 172.21.15.80:0/1640538372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec107280 msgr2=0x7f00ec199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec107280 0x7f00ec199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00eb7fe640 1 -- 172.21.15.80:0/1640538372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec1033c0 msgr2=0x7f00ec199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec1033c0 0x7f00ec199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00eb7fe640 1 -- 172.21.15.80:0/1640538372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec19e480 con 0x7f00ec107d00 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00eaffd640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec1033c0 0x7f00ec199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec107d00 0x7f00ec19de40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00e970 tx=0x7f00dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00e3fff640 1 -- 172.21.15.80:0/1640538372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00ccc0 con 0x7f00ec107d00 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec19e770 con 0x7f00ec107d00 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00e3fff640 1 -- 172.21.15.80:0/1640538372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00dc00ce60 con 0x7f00ec107d00 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00e3fff640 1 -- 172.21.15.80:0/1640538372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc010430 con 0x7f00ec107d00 2024-04-25T11:32:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.574+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec1a60f0 con 0x7f00ec107d00 2024-04-25T11:32:59.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.577+0000 7f00f821e740 1 Processor -- start 2024-04-25T11:32:59.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.577+0000 7f00e3fff640 1 -- 172.21.15.80:0/1640538372 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f00dc004f90 con 0x7f00ec107d00 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.577+0000 7f00f821e740 1 -- start start 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00f821e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c55410 0x55b0f4ff5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00f821e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c2c550 0x55b0f4ff5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00f821e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c34730 0x55b0f4ff5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00f821e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b0f4f5bb00 con 0x55b0f4c55410 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00f821e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b0f4ef7920 con 0x55b0f4c34730 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00f821e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b0f4f57ac0 con 0x55b0f4c2c550 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c55410 0x55b0f4ff5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c55410 0x55b0f4ff5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58892/0 (socket says 172.21.15.80:58892) 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 -- 172.21.15.80:0/2432380243 learned_addr learned my addr 172.21.15.80:0/2432380243 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00eaffd640 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c2c550 0x55b0f4ff5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00e3fff640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f00d80afc60 0x7f00d80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c34730 0x55b0f4ff5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 -- 172.21.15.80:0/2432380243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c2c550 msgr2=0x55b0f4ff5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c2c550 0x55b0f4ff5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 -- 172.21.15.80:0/2432380243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c34730 msgr2=0x55b0f4ff5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c34730 0x55b0f4ff5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.578+0000 7f00ea7fc640 1 -- 172.21.15.80:0/2432380243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f4d357e0 con 0x55b0f4c55410 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.579+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f00d80afc60 0x7f00d80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.579+0000 7f00e3fff640 1 -- 172.21.15.80:0/1640538372 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f00dc0df4d0 con 0x7f00ec107d00 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.579+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c55410 0x55b0f4ff5430 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e20 tx=0x7f00d4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c39f7af92a71c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.579+0000 7f00e17fa640 1 -- 172.21.15.80:0/2432380243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4004030 con 0x55b0f4c55410 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.579+0000 7f00e17fa640 1 -- 172.21.15.80:0/2432380243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d40035f0 con 0x55b0f4c55410 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.579+0000 7f00e17fa640 1 -- 172.21.15.80:0/2432380243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4010630 con 0x55b0f4c55410 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 -- 172.21.15.80:0/2432380243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c55410 msgr2=0x55b0f4ff5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c55410 0x55b0f4ff5430 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e20 tx=0x7f00d4005850 comp rx=0 tx=0).stop 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00eb7fe640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f00d80afc60 0x7f00d80b2170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0dd200 tx=0x7f00dc09bf40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 -- 172.21.15.80:0/2432380243 shutdown_connections 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c34730 0x55b0f4ff5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c2c550 0x55b0f4ff5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 --2- 172.21.15.80:0/2432380243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c55410 0x55b0f4ff5430 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 -- 172.21.15.80:0/2432380243 >> 172.21.15.80:0/2432380243 conn(0x55b0f4c49560 msgr2=0x55b0f4ff1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 -- 172.21.15.80:0/2432380243 shutdown_connections 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 -- 172.21.15.80:0/2432380243 wait complete. 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 -- start start 2024-04-25T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.580+0000 7f00f821e740 1 Processor -- start 2024-04-25T11:32:59.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00f821e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5001de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00f821e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5002320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00f821e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c55410 0x55b0f500e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00f821e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b0f5004b80 con 0x55b0f4c34730 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00f821e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b0f4ef55d0 con 0x55b0f4c2c550 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00f821e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b0f5004d00 con 0x55b0f4c55410 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00f821e740 10 client.0 _ll_register_callbacks cb 0x55b0f4ee3080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5002320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5002320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58894/0 (socket says 172.21.15.80:58894) 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 -- 172.21.15.80:0/1935290086 learned_addr learned my addr 172.21.15.80:0/1935290086 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c55410 0x55b0f500e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5001de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 -- 172.21.15.80:0/1935290086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c55410 msgr2=0x55b0f500e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c55410 0x55b0f500e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 -- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 msgr2=0x55b0f5001de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5001de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 -- 172.21.15.80:0/1935290086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f4d95f70 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5001de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00eaffd640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5002320 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009ca0 tx=0x7f00e4009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd047a0b2df8b8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.581+0000 7f00d27fc640 1 -- 172.21.15.80:0/1935290086 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4031660 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00d27fc640 1 -- 172.21.15.80:0/1935290086 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f00e4031800 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00d40035f0 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00d27fc640 1 -- 172.21.15.80:0/1935290086 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f00e4004b40 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 10 client.17643 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b0f4c2d170 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00d27fc640 1 -- 172.21.15.80:0/1935290086 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d40035f0 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00d27fc640 1 -- 172.21.15.80:0/1935290086 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f00e4004480 con 0x55b0f4c34730 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 10 client.17643 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:59.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 10 client.17643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 20 client.17643 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c141f0 0x55b0f50141f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 4 client.17643 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0f4f69710 con 0x55b0f4c141f0 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.582+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c141f0 0x55b0f50141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.583+0000 7f00d27fc640 10 client.17643 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.583+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c141f0 0x55b0f50141f0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a152e76a0e71247 server_cookie=8a6b9aff136da43d in_seq=0 out_seq=0 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00d27fc640 1 -- 172.21.15.80:0/1935290086 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b0f4f69710 con 0x55b0f4c141f0 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00d27fc640 10 client.17643 handle_command_reply: tid=0 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 client.17643 shutdown 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 msgr2=0x55b0f5002320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5002320 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009ca0 tx=0x7f00e4009800 comp rx=0 tx=0).stop 2024-04-25T11:32:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 shutdown_connections 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c141f0 0x55b0f50141f0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5002320 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00d27fc640 0 client.17643 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c55410 0x55b0f500e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 --2- 172.21.15.80:0/1935290086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5001de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 >> 172.21.15.80:0/1935290086 conn(0x55b0f4c49560 msgr2=0x55b0f4ff72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 shutdown_connections 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 1 -- 172.21.15.80:0/1935290086 wait complete. 2024-04-25T11:32:59.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.584+0000 7f00f821e740 20 client.17643 trim_cache size 0 max 16384 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.602+0000 7f00f821e740 1 Processor -- start 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.602+0000 7f00f821e740 1 -- start start 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.602+0000 7f00f821e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f4ff1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00f821e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f50199b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00f821e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5019ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00f821e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec1b0100 con 0x55b0f4c34730 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00f821e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec1ad9d0 con 0x55b0f4c2c550 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00f821e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec1ab840 con 0x55b0f4c141f0 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5019ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5019ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58910/0 (socket says 172.21.15.80:58910) 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 -- 172.21.15.80:0/943285707 learned_addr learned my addr 172.21.15.80:0/943285707 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00eaffd640 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f50199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f4ff1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 -- 172.21.15.80:0/943285707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 msgr2=0x55b0f4ff1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f4ff1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 -- 172.21.15.80:0/943285707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 msgr2=0x55b0f50199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f50199b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 -- 172.21.15.80:0/943285707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f5000b80 con 0x55b0f4c34730 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00eaffd640 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f50199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5019ef0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f00d40058c0 tx=0x7f00d4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da63c2e42d9a16b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00e0ff9640 1 -- 172.21.15.80:0/943285707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4032070 con 0x55b0f4c34730 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00e0ff9640 1 -- 172.21.15.80:0/943285707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d4005040 con 0x55b0f4c34730 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.603+0000 7f00e0ff9640 1 -- 172.21.15.80:0/943285707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d402d7d0 con 0x55b0f4c34730 2024-04-25T11:32:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 -- 172.21.15.80:0/943285707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 msgr2=0x55b0f5019ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5019ef0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f00d40058c0 tx=0x7f00d4005f90 comp rx=0 tx=0).stop 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 -- 172.21.15.80:0/943285707 shutdown_connections 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5019ef0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f50199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 --2- 172.21.15.80:0/943285707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f4ff1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 -- 172.21.15.80:0/943285707 >> 172.21.15.80:0/943285707 conn(0x55b0f4c49560 msgr2=0x55b0f4ff1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 -- 172.21.15.80:0/943285707 shutdown_connections 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.604+0000 7f00f821e740 1 -- 172.21.15.80:0/943285707 wait complete. 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 -- start start 2024-04-25T11:32:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 Processor -- start 2024-04-25T11:32:59.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f5005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5006590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec1abe90 con 0x55b0f4c34730 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec1ad300 con 0x55b0f4c2c550 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec1ac560 con 0x55b0f4c141f0 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00f821e740 10 client.0 _ll_register_callbacks cb 0x7f00e4031f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5006590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5006590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58916/0 (socket says 172.21.15.80:58916) 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 -- 172.21.15.80:0/484525743 learned_addr learned my addr 172.21.15.80:0/484525743 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f5005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00eaffd640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 -- 172.21.15.80:0/484525743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 msgr2=0x55b0f5005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f5005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 -- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 msgr2=0x55b0f5006050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5006050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 -- 172.21.15.80:0/484525743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f507b560 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00eaffd640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5006050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.605+0000 7f00ea7fc640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5006590 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f00d4013310 tx=0x7f00d401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9037d9aec48bd910 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00d27fc640 1 -- 172.21.15.80:0/484525743 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4032040 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00d27fc640 1 -- 172.21.15.80:0/484525743 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f00d402d550 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00d4005040 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00d27fc640 1 -- 172.21.15.80:0/484525743 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f00d402d750 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 10 client.17649 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b0f507c6e0 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00d27fc640 1 -- 172.21.15.80:0/484525743 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d4005040 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00d27fc640 1 -- 172.21.15.80:0/484525743 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f00d401d670 con 0x55b0f4c34730 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 10 client.17649 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:59.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 10 client.17649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 20 client.17649 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c55410 0x55b0f507eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 4 client.17649 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.606+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b0f4f63580 con 0x55b0f4c55410 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.607+0000 7f00eaffd640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c55410 0x55b0f507eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.607+0000 7f00d27fc640 10 client.17649 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.607+0000 7f00eaffd640 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c55410 0x55b0f507eb70 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f4c4bd4f703b9d server_cookie=d5aceebbc22aa203 in_seq=0 out_seq=0 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00d27fc640 1 -- 172.21.15.80:0/484525743 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b0f4f63580 con 0x55b0f4c55410 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00d27fc640 10 client.17649 handle_command_reply: tid=0 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 client.17649 shutdown 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 msgr2=0x55b0f5006590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5006590 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f00d4013310 tx=0x7f00d401f040 comp rx=0 tx=0).stop 2024-04-25T11:32:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 shutdown_connections 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55b0f4c55410 0x55b0f507eb70 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b0f4c34730 0x55b0f5006590 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0f4c2c550 0x55b0f5006050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 --2- 172.21.15.80:0/484525743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b0f4c141f0 0x55b0f5005b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 >> 172.21.15.80:0/484525743 conn(0x55b0f4c49560 msgr2=0x55b0f4ff04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00d27fc640 0 client.17649 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 shutdown_connections 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.608+0000 7f00f821e740 1 -- 172.21.15.80:0/484525743 wait complete. 2024-04-25T11:32:59.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f821e740 20 client.17649 trim_cache size 0 max 16384 2024-04-25T11:32:59.605 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:32:59.605 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:32:59.605 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "afa71ba9-b079-440a-ae3b-2af888c7a86b", 2024-04-25T11:32:59.605 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:32:59.605 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f00d80afc60 msgr2=0x7f00d80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f00d80afc60 0x7f00d80b2170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0dd200 tx=0x7f00dc09bf40 comp rx=0 tx=0).stop 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec107d00 msgr2=0x7f00ec19de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec107d00 0x7f00ec19de40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00e970 tx=0x7f00dc00ed70 comp rx=0 tx=0).stop 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 shutdown_connections 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f00d80afc60 0x7f00d80b2170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00ec107d00 0x7f00ec19de40 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00ec107280 0x7f00ec199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 --2- 172.21.15.80:0/1640538372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec1033c0 0x7f00ec199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 >> 172.21.15.80:0/1640538372 conn(0x7f00ec077920 msgr2=0x7f00ec0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 shutdown_connections 2024-04-25T11:32:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.609+0000 7f00f1372640 1 -- 172.21.15.80:0/1640538372 wait complete. 2024-04-25T11:32:59.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:32:59.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:32:59.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 -- 172.21.15.80:0/1314552818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b18107d00 msgr2=0x7f2b1810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 --2- 172.21.15.80:0/1314552818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b18107d00 0x7f2b1810f530 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009ca0 tx=0x7f2b1002a8e0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 -- 172.21.15.80:0/1314552818 shutdown_connections 2024-04-25T11:32:59.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 --2- 172.21.15.80:0/1314552818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b18107d00 0x7f2b1810f530 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 --2- 172.21.15.80:0/1314552818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18107280 0x7f2b18107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 --2- 172.21.15.80:0/1314552818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b181033c0 0x7f2b181037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 -- 172.21.15.80:0/1314552818 >> 172.21.15.80:0/1314552818 conn(0x7f2b18077920 msgr2=0x7f2b18077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 -- 172.21.15.80:0/1314552818 shutdown_connections 2024-04-25T11:32:59.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.731+0000 7f2b20230640 1 -- 172.21.15.80:0/1314552818 wait complete. 2024-04-25T11:32:59.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 Processor -- start 2024-04-25T11:32:59.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 -- start start 2024-04-25T11:32:59.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b181033c0 0x7f2b1819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18107280 0x7f2b1819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b18107d00 0x7f2b1819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2b18112c80 con 0x7f2b181033c0 2024-04-25T11:32:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b18112b00 con 0x7f2b18107280 2024-04-25T11:32:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b20230640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2b18112e00 con 0x7f2b18107d00 2024-04-25T11:32:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b181033c0 0x7f2b1819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b181033c0 0x7f2b1819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58926/0 (socket says 172.21.15.80:58926) 2024-04-25T11:32:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 -- 172.21.15.80:0/2835672508 learned_addr learned my addr 172.21.15.80:0/2835672508 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b18107d00 0x7f2b1819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18107280 0x7f2b1819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 -- 172.21.15.80:0/2835672508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b18107d00 msgr2=0x7f2b1819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b18107d00 0x7f2b1819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 -- 172.21.15.80:0/2835672508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18107280 msgr2=0x7f2b1819ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18107280 0x7f2b1819ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1dfcc640 1 -- 172.21.15.80:0/2835672508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1819f570 con 0x7f2b181033c0 2024-04-25T11:32:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b18107d00 0x7f2b1819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.732+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18107280 0x7f2b1819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.733+0000 7f2b1dfcc640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b181033c0 0x7f2b1819a710 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400c970 tx=0x7f2b1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.733+0000 7f2b0effd640 1 -- 172.21.15.80:0/2835672508 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14007bb0 con 0x7f2b181033c0 2024-04-25T11:32:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.733+0000 7f2b0effd640 1 -- 172.21.15.80:0/2835672508 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b14007d50 con 0x7f2b181033c0 2024-04-25T11:32:59.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.733+0000 7f2b0effd640 1 -- 172.21.15.80:0/2835672508 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400f450 con 0x7f2b181033c0 2024-04-25T11:32:59.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.733+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1819f860 con 0x7f2b181033c0 2024-04-25T11:32:59.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.733+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b181a71e0 con 0x7f2b181033c0 2024-04-25T11:32:59.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.735+0000 7f2b271b6740 1 Processor -- start 2024-04-25T11:32:59.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b271b6740 1 -- start start 2024-04-25T11:32:59.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b0effd640 1 -- 172.21.15.80:0/2835672508 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f2b14004f20 con 0x7f2b181033c0 2024-04-25T11:32:59.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ecd390 0x56069a26da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a27a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b271b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56069a1d3d80 con 0x560699ecd390 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b271b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56069a18d8b0 con 0x560699eac6b0 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b271b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56069a1cfd40 con 0x560699ea44d0 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ecd390 0x56069a26da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b1dfcc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ecd390 0x56069a26da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58930/0 (socket says 172.21.15.80:58930) 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1219823621 learned_addr learned my addr 172.21.15.80:0/1219823621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.736+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a27a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1219823621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 msgr2=0x56069a26dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1219823621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 msgr2=0x56069a27a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a27a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1219823621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069a15ea40 con 0x560699ecd390 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a27a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:32:59.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ecd390 0x56069a26da60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2b100315b0 tx=0x7f2b100315e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fbdedf07dae2b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b0effd640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2b040afc60 0x7f2b040b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b03fff640 1 -- 172.21.15.80:0/1219823621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10031ad0 con 0x560699ecd390 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b1dfcc640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2b040afc60 0x7f2b040b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b03fff640 1 -- 172.21.15.80:0/1219823621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b10036040 con 0x560699ecd390 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b03fff640 1 -- 172.21.15.80:0/1219823621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b100045f0 con 0x560699ecd390 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.737+0000 7f2b0effd640 1 -- 172.21.15.80:0/2835672508 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f2b140df0e0 con 0x7f2b181033c0 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 -- 172.21.15.80:0/1219823621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ecd390 msgr2=0x56069a26da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b1dfcc640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2b040afc60 0x7f2b040b2170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b140dc960 tx=0x7f2b140e4040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ecd390 0x56069a26da60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2b100315b0 tx=0x7f2b100315e0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 -- 172.21.15.80:0/1219823621 shutdown_connections 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a27a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1219823621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ecd390 0x56069a26da60 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 -- 172.21.15.80:0/1219823621 >> 172.21.15.80:0/1219823621 conn(0x560699ec14e0 msgr2=0x56069a26a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 -- 172.21.15.80:0/1219823621 shutdown_connections 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.738+0000 7f2b271b6740 1 -- 172.21.15.80:0/1219823621 wait complete. 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 -- start start 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 Processor -- start 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ea44d0 0x56069a278590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699eac6b0 0x56069a278ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ecd390 0x56069a284400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56069a27af80 con 0x560699ea44d0 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56069a15ad10 con 0x560699ecd390 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56069a27b100 con 0x560699eac6b0 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b271b6740 10 client.0 _ll_register_callbacks cb 0x56069a187210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ea44d0 0x56069a278590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ea44d0 0x56069a278590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58944/0 (socket says 172.21.15.80:58944) 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1311605454 learned_addr learned my addr 172.21.15.80:0/1311605454 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699eac6b0 0x56069a278ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ecd390 0x56069a284400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1311605454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699eac6b0 msgr2=0x56069a278ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699eac6b0 0x56069a278ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ecd390 msgr2=0x56069a284400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ecd390 0x56069a284400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.739+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/1311605454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560699faf7d0 con 0x560699ea44d0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ea44d0 0x56069a278590 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2b10031840 tx=0x7f2b100041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb44d7603c202536 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b017fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b017fa640 1 -- 172.21.15.80:0/1311605454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10057060 con 0x560699ea44d0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b017fa640 1 -- 172.21.15.80:0/1311605454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f2b10004570 con 0x560699ea44d0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b10036040 con 0x560699ea44d0 2024-04-25T11:32:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b017fa640 1 -- 172.21.15.80:0/1311605454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2b10004770 con 0x560699ea44d0 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 10 client.17661 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560699ee53f0 con 0x560699ea44d0 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b017fa640 1 -- 172.21.15.80:0/1311605454 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b10036040 con 0x560699ea44d0 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b017fa640 1 -- 172.21.15.80:0/1311605454 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2b10030a20 con 0x560699ea44d0 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 10 client.17661 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 10 client.17661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 20 client.17661 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699e8bf60 0x56069a28a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 4 client.17661 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.740+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56069a1e1990 con 0x560699e8bf60 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.741+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699e8bf60 0x56069a28a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.741+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699e8bf60 0x56069a28a420 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46431064a0c77938 server_cookie=7d6b5e6f325e23a0 in_seq=0 out_seq=0 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.741+0000 7f2b017fa640 10 client.17661 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b017fa640 1 -- 172.21.15.80:0/1311605454 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56069a1e1990 con 0x560699e8bf60 2024-04-25T11:32:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b017fa640 10 client.17661 handle_command_reply: tid=0 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 client.17661 shutdown 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ea44d0 msgr2=0x56069a278590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ea44d0 0x56069a278590 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2b10031840 tx=0x7f2b100041f0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 shutdown_connections 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699e8bf60 0x56069a28a420 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ecd390 0x56069a284400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b017fa640 0 client.17661 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699eac6b0 0x56069a278ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 --2- 172.21.15.80:0/1311605454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699ea44d0 0x56069a278590 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 >> 172.21.15.80:0/1311605454 conn(0x560699ec14e0 msgr2=0x56069a26f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 shutdown_connections 2024-04-25T11:32:59.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 1 -- 172.21.15.80:0/1311605454 wait complete. 2024-04-25T11:32:59.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.742+0000 7f2b271b6740 20 client.17661 trim_cache size 0 max 16384 2024-04-25T11:32:59.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 Processor -- start 2024-04-25T11:32:59.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 -- start start 2024-04-25T11:32:59.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699e8bf60 0x56069a277680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a2843f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2b181b2410 con 0x560699e8bf60 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b181afce0 con 0x560699eac6b0 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b271b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2b181adb50 con 0x560699ea44d0 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699e8bf60 0x56069a277680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699e8bf60 0x56069a277680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58950/0 (socket says 172.21.15.80:58950) 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/2852616347 learned_addr learned my addr 172.21.15.80:0/2852616347 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/2852616347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 msgr2=0x56069a26dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/2852616347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 msgr2=0x56069a2843f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.761+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a2843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.762+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/2852616347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560699ea50f0 con 0x560699e8bf60 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.762+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699e8bf60 0x56069a277680 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2b10004260 tx=0x7f2b10000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87195ec108d47ce9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.762+0000 7f2b037fe640 1 -- 172.21.15.80:0/2852616347 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10057040 con 0x560699e8bf60 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.762+0000 7f2b037fe640 1 -- 172.21.15.80:0/2852616347 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b10036070 con 0x560699e8bf60 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.762+0000 7f2b037fe640 1 -- 172.21.15.80:0/2852616347 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b100305e0 con 0x560699e8bf60 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 -- 172.21.15.80:0/2852616347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699e8bf60 msgr2=0x56069a277680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699e8bf60 0x56069a277680 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2b10004260 tx=0x7f2b10000f40 comp rx=0 tx=0).stop 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 -- 172.21.15.80:0/2852616347 shutdown_connections 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699eac6b0 0x56069a2843f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699ea44d0 0x56069a26dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 --2- 172.21.15.80:0/2852616347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699e8bf60 0x56069a277680 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 -- 172.21.15.80:0/2852616347 >> 172.21.15.80:0/2852616347 conn(0x560699ec14e0 msgr2=0x56069a26fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 -- 172.21.15.80:0/2852616347 shutdown_connections 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 -- 172.21.15.80:0/2852616347 wait complete. 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 -- start start 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.763+0000 7f2b271b6740 1 Processor -- start 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699e8bf60 0x56069a28a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ea44d0 0x56069a28a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699eac6b0 0x56069a28ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2b181ae1a0 con 0x560699eac6b0 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b181af610 con 0x560699ea44d0 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2b181ae870 con 0x560699e8bf60 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 10 client.0 _ll_register_callbacks cb 0x7f2b140e2b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699eac6b0 0x56069a28ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699eac6b0 0x56069a28ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58960/0 (socket says 172.21.15.80:58960) 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/237620219 learned_addr learned my addr 172.21.15.80:0/237620219 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:32:59.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699e8bf60 0x56069a28a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ea44d0 0x56069a28a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/237620219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699e8bf60 msgr2=0x56069a28a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699e8bf60 0x56069a28a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ea44d0 msgr2=0x56069a28a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ea44d0 0x56069a28a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 -- 172.21.15.80:0/237620219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069a1944b0 con 0x560699eac6b0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b1e7cd640 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699eac6b0 0x56069a28ac60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009620 tx=0x7f2b10030fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575518a34a3629f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b017fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b017fa640 1 -- 172.21.15.80:0/237620219 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10057070 con 0x560699eac6b0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b10036070 con 0x560699eac6b0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.764+0000 7f2b017fa640 1 -- 172.21.15.80:0/237620219 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8550+0+0 (secure 0 0 0) 0x7f2b100044a0 con 0x560699eac6b0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b017fa640 1 -- 172.21.15.80:0/237620219 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2b100305e0 con 0x560699eac6b0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 10 client.17667 fetch_fsmap learned FSMap version 24 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56069a2f1710 con 0x560699eac6b0 2024-04-25T11:32:59.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b017fa640 1 -- 172.21.15.80:0/237620219 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b10036070 con 0x560699eac6b0 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b017fa640 1 -- 172.21.15.80:0/237620219 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2b10063070 con 0x560699eac6b0 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 10 client.17667 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 10 client.17667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 20 client.17667 populate_metadata read hostname 'smithi080' 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699ecd390 0x56069a2f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 4 client.17667 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56069a1db800 con 0x560699ecd390 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.765+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699ecd390 0x56069a2f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b017fa640 10 client.17667 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b1d7cb640 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699ecd390 0x56069a2f3ba0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9743ea58fa8faf6e server_cookie=15ba2655896d2d27 in_seq=0 out_seq=0 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b017fa640 1 -- 172.21.15.80:0/237620219 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56069a1db800 con 0x560699ecd390 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b017fa640 10 client.17667 handle_command_reply: tid=0 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 client.17667 shutdown 2024-04-25T11:32:59.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699eac6b0 msgr2=0x56069a28ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699eac6b0 0x56069a28ac60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009620 tx=0x7f2b10030fc0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 shutdown_connections 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x560699ecd390 0x56069a2f3ba0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560699eac6b0 0x56069a28ac60 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560699ea44d0 0x56069a28a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 --2- 172.21.15.80:0/237620219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560699e8bf60 0x56069a28a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b017fa640 0 client.17667 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 >> 172.21.15.80:0/237620219 conn(0x560699ec14e0 msgr2=0x56069a26fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 shutdown_connections 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 1 -- 172.21.15.80:0/237620219 wait complete. 2024-04-25T11:32:59.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.766+0000 7f2b271b6740 20 client.17667 trim_cache size 0 max 16384 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: "afa71ba9-b079-440a-ae3b-2af888c7a86b": { 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "afa71ba9-b079-440a-ae3b-2af888c7a86b", 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:32:59.763 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:32:59.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2b040afc60 msgr2=0x7f2b040b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2b040afc60 0x7f2b040b2170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b140dc960 tx=0x7f2b140e4040 comp rx=0 tx=0).stop 2024-04-25T11:32:59.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b181033c0 msgr2=0x7f2b1819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:32:59.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b181033c0 0x7f2b1819a710 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400c970 tx=0x7f2b1400ce30 comp rx=0 tx=0).stop 2024-04-25T11:32:59.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 shutdown_connections 2024-04-25T11:32:59.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f2b040afc60 0x7f2b040b2170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b18107d00 0x7f2b1819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18107280 0x7f2b1819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 --2- 172.21.15.80:0/2835672508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b181033c0 0x7f2b1819a710 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:32:59.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 >> 172.21.15.80:0/2835672508 conn(0x7f2b18077920 msgr2=0x7f2b18101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:32:59.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 shutdown_connections 2024-04-25T11:32:59.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:32:59.767+0000 7f2b20230640 1 -- 172.21.15.80:0/2835672508 wait complete. 2024-04-25T11:32:59.767 INFO:tasks.cephfs.filesystem:scrub status for tag:afa71ba9-b079-440a-ae3b-2af888c7a86b - {'path': '/', 'tag': 'afa71ba9-b079-440a-ae3b-2af888c7a86b', 'options': 'recursive,force'} 2024-04-25T11:33:00.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:00 smithi080 ceph-mon[29126]: pgmap v270: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:00.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:00 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:33:00.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:00 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:00.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:00 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:33:00.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:00 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:00.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:00 smithi196 ceph-mon[32659]: pgmap v270: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:00.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:00 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:33:00.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:00 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:00.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:00 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:33:00.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:00 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:00.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:00 smithi082 ceph-mon[32440]: pgmap v270: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:00.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:00 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:33:00.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:00 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:00.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:00 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:33:00.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:00 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:02.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:02 smithi080 ceph-mon[29126]: pgmap v271: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:02.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:02 smithi196 ceph-mon[32659]: pgmap v271: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:02.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:02 smithi082 ceph-mon[32440]: pgmap v271: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:03.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:03 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:33:03.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:03 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:33:03.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:03 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:33:04.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:04 smithi080 ceph-mon[29126]: pgmap v272: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:04.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:04 smithi196 ceph-mon[32659]: pgmap v272: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:04.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:04 smithi082 ceph-mon[32440]: pgmap v272: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:06.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:06 smithi080 ceph-mon[29126]: pgmap v273: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:06.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:06 smithi196 ceph-mon[32659]: pgmap v273: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:06.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:06 smithi082 ceph-mon[32440]: pgmap v273: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:08.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:08 smithi080 ceph-mon[29126]: pgmap v274: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-04-25T11:33:08.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:08 smithi196 ceph-mon[32659]: pgmap v274: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-04-25T11:33:08.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:08 smithi082 ceph-mon[32440]: pgmap v274: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-04-25T11:33:09.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:09 smithi196 ceph-mon[32659]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T11:33:09.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:09 smithi082 ceph-mon[32440]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T11:33:09.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:09 smithi080 ceph-mon[29126]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T11:33:10.640 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:10 smithi082 ceph-mon[32440]: pgmap v276: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-04-25T11:33:10.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:10 smithi196 ceph-mon[32659]: pgmap v276: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-04-25T11:33:10.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:10 smithi080 ceph-mon[29126]: pgmap v276: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-04-25T11:33:12.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:12 smithi196 ceph-mon[32659]: pgmap v277: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:33:12.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:12 smithi196 ceph-mon[32659]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T11:33:12.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:12 smithi082 ceph-mon[32440]: pgmap v277: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:33:12.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:12 smithi082 ceph-mon[32440]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T11:33:12.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:12 smithi080 ceph-mon[29126]: pgmap v277: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:33:12.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:12 smithi080 ceph-mon[29126]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T11:33:14.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:14 smithi196 ceph-mon[32659]: pgmap v279: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:33:14.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:14 smithi082 ceph-mon[32440]: pgmap v279: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:33:14.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:14 smithi080 ceph-mon[29126]: pgmap v279: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:33:16.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:16 smithi196 ceph-mon[32659]: pgmap v280: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:33:16.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:16 smithi082 ceph-mon[32440]: pgmap v280: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:33:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:16 smithi080 ceph-mon[29126]: pgmap v280: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:33:18.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:18 smithi196 ceph-mon[32659]: pgmap v281: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 240 B/s wr, 7 op/s 2024-04-25T11:33:18.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:18 smithi082 ceph-mon[32440]: pgmap v281: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 240 B/s wr, 7 op/s 2024-04-25T11:33:18.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:18 smithi080 ceph-mon[29126]: pgmap v281: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 240 B/s wr, 7 op/s 2024-04-25T11:33:20.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:20 smithi196 ceph-mon[32659]: pgmap v282: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:33:20.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:20 smithi082 ceph-mon[32440]: pgmap v282: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:33:20.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:20 smithi080 ceph-mon[29126]: pgmap v282: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:33:22.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:22 smithi196 ceph-mon[32659]: pgmap v283: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:33:22.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:22 smithi082 ceph-mon[32440]: pgmap v283: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:33:22.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:22 smithi080 ceph-mon[29126]: pgmap v283: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:33:24.676 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:24 smithi080 ceph-mon[29126]: pgmap v284: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:33:24.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:24 smithi196 ceph-mon[32659]: pgmap v284: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:33:24.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:24 smithi082 ceph-mon[32440]: pgmap v284: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:33:26.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:26 smithi196 ceph-mon[32659]: pgmap v285: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:33:26.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:26 smithi082 ceph-mon[32440]: pgmap v285: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:33:26.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:26 smithi080 ceph-mon[29126]: pgmap v285: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:33:28.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:28 smithi196 ceph-mon[32659]: pgmap v286: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T11:33:28.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:33:28.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:33:28.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:33:28.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:33:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:28 smithi082 ceph-mon[32440]: pgmap v286: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T11:33:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:33:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:33:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:33:28.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:33:28.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:28 smithi080 ceph-mon[29126]: pgmap v286: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T11:33:28.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:33:28.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:33:28.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:33:28.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:33:29.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:33:29.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 -- 172.21.15.80:0/4163631739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54109fb0 msgr2=0x7f0d54103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/4163631739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54109fb0 0x7f0d54103bf0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009900 tx=0x7f0d5002a410 comp rx=0 tx=0).stop 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 -- 172.21.15.80:0/4163631739 shutdown_connections 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/4163631739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54109fb0 0x7f0d54103bf0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/4163631739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d54104260 0x7f0d54110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/4163631739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d54109b10 0x7f0d541036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 -- 172.21.15.80:0/4163631739 >> 172.21.15.80:0/4163631739 conn(0x7f0d540ff210 msgr2=0x7f0d54101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 -- 172.21.15.80:0/4163631739 shutdown_connections 2024-04-25T11:33:29.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.904+0000 7f0d5c13c640 1 -- 172.21.15.80:0/4163631739 wait complete. 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 Processor -- start 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 -- start start 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54104260 0x7f0d541a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d54109b10 0x7f0d541a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d54109fb0 0x7f0d5419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54113d00 con 0x7f0d54104260 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54113b80 con 0x7f0d54109fb0 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d5c13c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54113e80 con 0x7f0d54109b10 2024-04-25T11:33:29.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.905+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54104260 0x7f0d541a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54104260 0x7f0d541a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36454/0 (socket says 172.21.15.80:36454) 2024-04-25T11:33:29.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 -- 172.21.15.80:0/2570854533 learned_addr learned my addr 172.21.15.80:0/2570854533 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d5a6d9640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d54109fb0 0x7f0d5419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d596d7640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d54109b10 0x7f0d541a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 -- 172.21.15.80:0/2570854533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d54109b10 msgr2=0x7f0d541a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d54109b10 0x7f0d541a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 -- 172.21.15.80:0/2570854533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d54109fb0 msgr2=0x7f0d5419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d54109fb0 0x7f0d5419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 -- 172.21.15.80:0/2570854533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5419add0 con 0x7f0d54104260 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54104260 0x7f0d541a0520 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d770 tx=0x7f0d4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d46ffd640 1 -- 172.21.15.80:0/2570854533 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48017070 con 0x7f0d54104260 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d46ffd640 1 -- 172.21.15.80:0/2570854533 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d48009c30 con 0x7f0d54104260 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5419b060 con 0x7f0d54104260 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d46ffd640 1 -- 172.21.15.80:0/2570854533 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800f620 con 0x7f0d54104260 2024-04-25T11:33:29.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.906+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d541a72c0 con 0x7f0d54104260 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d46ffd640 1 -- 172.21.15.80:0/2570854533 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f0d4801a070 con 0x7f0d54104260 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 Processor -- start 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 -- start start 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdee74d0 0x55afbe2b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55afbe216d80 con 0x55afbdeef6b0 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55afbe1d08b0 con 0x55afbdf10390 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d62fea740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55afbe212d40 con 0x55afbdee74d0 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d596d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d596d7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36466/0 (socket says 172.21.15.80:36466) 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d596d7640 1 -- 172.21.15.80:0/2504510445 learned_addr learned my addr 172.21.15.80:0/2504510445 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.909+0000 7f0d5a6d9640 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d46ffd640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0d400afc60 0x7f0d400b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdee74d0 0x55afbe2b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d5a6d9640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0d400afc60 0x7f0d400b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d596d7640 1 -- 172.21.15.80:0/2504510445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdee74d0 msgr2=0x55afbe2b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d596d7640 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdee74d0 0x55afbe2b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d596d7640 1 -- 172.21.15.80:0/2504510445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 msgr2=0x55afbe2b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d596d7640 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d596d7640 1 -- 172.21.15.80:0/2504510445 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbe1a1a40 con 0x55afbdeef6b0 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdee74d0 0x55afbe2b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d46ffd640 1 -- 172.21.15.80:0/2570854533 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f0d480deb20 con 0x7f0d54104260 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d596d7640 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd8f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f0d50000c00 tx=0x7f0d50032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b75e9c866e26f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:29.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d5a6d9640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0d400afc60 0x7f0d400b2170 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55afbe2adbd0 tx=0x7f0d4c004ab0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d3ffff640 1 -- 172.21.15.80:0/2504510445 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5003f070 con 0x55afbdeef6b0 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d3ffff640 1 -- 172.21.15.80:0/2504510445 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d50032e40 con 0x55afbdeef6b0 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.910+0000 7f0d3ffff640 1 -- 172.21.15.80:0/2504510445 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50035070 con 0x55afbdeef6b0 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 -- 172.21.15.80:0/2504510445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdeef6b0 msgr2=0x55afbe2bd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd8f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f0d50000c00 tx=0x7f0d50032c50 comp rx=0 tx=0).stop 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 -- 172.21.15.80:0/2504510445 shutdown_connections 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd8f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdee74d0 0x55afbe2b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 --2- 172.21.15.80:0/2504510445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 -- 172.21.15.80:0/2504510445 >> 172.21.15.80:0/2504510445 conn(0x55afbdf044e0 msgr2=0x55afbe2ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:29.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 -- 172.21.15.80:0/2504510445 shutdown_connections 2024-04-25T11:33:29.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.911+0000 7f0d62fea740 1 -- 172.21.15.80:0/2504510445 wait complete. 2024-04-25T11:33:29.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 -- start start 2024-04-25T11:33:29.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 Processor -- start 2024-04-25T11:33:29.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdeef6b0 0x55afbe2bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55afbe2bdf80 con 0x55afbdee74d0 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55afbe19dd10 con 0x55afbdf10390 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55afbe2be100 con 0x55afbdeef6b0 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d62fea740 10 client.0 _ll_register_callbacks cb 0x55afbe1ca210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2bb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36478/0 (socket says 172.21.15.80:36478) 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d59ed8640 1 -- 172.21.15.80:0/861079122 learned_addr learned my addr 172.21.15.80:0/861079122 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d5a6d9640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.912+0000 7f0d596d7640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdeef6b0 0x55afbe2bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d59ed8640 1 -- 172.21.15.80:0/861079122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdeef6b0 msgr2=0x55afbe2bbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdeef6b0 0x55afbe2bbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d59ed8640 1 -- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 msgr2=0x55afbe2c13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2c13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d59ed8640 1 -- 172.21.15.80:0/861079122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbdff27d0 con 0x55afbdee74d0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d596d7640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdeef6b0 0x55afbe2bbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2bb5e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f0d480a2d20 tx=0x7f0d480a31e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b3a3c3f4bcd38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/861079122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48021030 con 0x55afbdee74d0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/861079122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f0d480a5f00 con 0x55afbdee74d0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55afbe224990 con 0x55afbdee74d0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/861079122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0d480a2b60 con 0x55afbdee74d0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d62fea740 10 client.17679 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55afbdf283f0 con 0x55afbdee74d0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/861079122 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55afbe224990 con 0x55afbdee74d0 2024-04-25T11:33:29.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/861079122 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0d480a5970 con 0x55afbdee74d0 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d62fea740 10 client.17679 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d62fea740 10 client.17679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.913+0000 7f0d62fea740 20 client.17679 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.914+0000 7f0d62fea740 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdecef60 0x55afbe2cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.914+0000 7f0d62fea740 4 client.17679 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.914+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afbe21e800 con 0x55afbdecef60 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.914+0000 7f0d596d7640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdecef60 0x55afbe2cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.914+0000 7f0d3d7fa640 10 client.17679 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.914+0000 7f0d596d7640 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdecef60 0x55afbe2cd710 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154d747bcaff7759 server_cookie=7471111d04728911 in_seq=0 out_seq=0 2024-04-25T11:33:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/861079122 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55afbe21e800 con 0x55afbdecef60 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d3d7fa640 10 client.17679 handle_command_reply: tid=0 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 client.17679 shutdown 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 msgr2=0x55afbe2bb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2bb5e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f0d480a2d20 tx=0x7f0d480a31e0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 shutdown_connections 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdecef60 0x55afbe2cd710 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdf10390 0x55afbe2c13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdeef6b0 0x55afbe2bbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 --2- 172.21.15.80:0/861079122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2bb5e0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d3d7fa640 0 client.17679 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 >> 172.21.15.80:0/861079122 conn(0x55afbdf044e0 msgr2=0x55afbe2b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 shutdown_connections 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.915+0000 7f0d62fea740 1 -- 172.21.15.80:0/861079122 wait complete. 2024-04-25T11:33:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.916+0000 7f0d62fea740 20 client.17679 trim_cache size 0 max 16384 2024-04-25T11:33:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 Processor -- start 2024-04-25T11:33:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 -- start start 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2ba6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe2d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541b22a0 con 0x55afbdee74d0 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541afb70 con 0x55afbdeef6b0 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d62fea740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541ad9e0 con 0x55afbdf10390 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2ba6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2ba6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36486/0 (socket says 172.21.15.80:36486) 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.933+0000 7f0d59ed8640 1 -- 172.21.15.80:0/1939211419 learned_addr learned my addr 172.21.15.80:0/1939211419 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d596d7640 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d5a6d9640 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe2d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d59ed8640 1 -- 172.21.15.80:0/1939211419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 msgr2=0x55afbe2d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe2d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d59ed8640 1 -- 172.21.15.80:0/1939211419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 msgr2=0x55afbe2bd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d59ed8640 1 -- 172.21.15.80:0/1939211419 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbdee80f0 con 0x55afbdee74d0 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d5a6d9640 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe2d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2ba6d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f0d480a6c30 tx=0x7f0d480dc720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9887552457b2b20d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d3f7fe640 1 -- 172.21.15.80:0/1939211419 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48021070 con 0x55afbdee74d0 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d3f7fe640 1 -- 172.21.15.80:0/1939211419 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d480a67b0 con 0x55afbdee74d0 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.934+0000 7f0d3f7fe640 1 -- 172.21.15.80:0/1939211419 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d480a6ca0 con 0x55afbdee74d0 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 -- 172.21.15.80:0/1939211419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 msgr2=0x55afbe2ba6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2ba6d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f0d480a6c30 tx=0x7f0d480dc720 comp rx=0 tx=0).stop 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 -- 172.21.15.80:0/1939211419 shutdown_connections 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe2d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2bd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 --2- 172.21.15.80:0/1939211419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2ba6d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 -- 172.21.15.80:0/1939211419 >> 172.21.15.80:0/1939211419 conn(0x55afbdf044e0 msgr2=0x55afbe2bcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 -- 172.21.15.80:0/1939211419 shutdown_connections 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 -- 172.21.15.80:0/1939211419 wait complete. 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 -- start start 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.935+0000 7f0d62fea740 1 Processor -- start 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe333a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541ae030 con 0x55afbdee74d0 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541af4a0 con 0x55afbdeef6b0 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541ae700 con 0x55afbdf10390 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 10 client.0 _ll_register_callbacks cb 0x7f0d480a33c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36498/0 (socket says 172.21.15.80:36498) 2024-04-25T11:33:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 -- 172.21.15.80:0/45610 learned_addr learned my addr 172.21.15.80:0/45610 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d596d7640 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 -- 172.21.15.80:0/45610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 msgr2=0x55afbe333a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe333a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 -- 172.21.15.80:0/45610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 msgr2=0x55afbe2c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 -- 172.21.15.80:0/45610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbe1d74b0 con 0x55afbdee74d0 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d596d7640 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d59ed8640 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2c2ce0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d740 tx=0x7f0d480af440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8945ce6a6708ed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/45610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48021070 con 0x55afbdee74d0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/45610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f0d480ac1e0 con 0x55afbdee74d0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.936+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d480a67b0 con 0x55afbdee74d0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/45610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0d480a73a0 con 0x55afbdee74d0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 10 client.17685 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55afbe334f20 con 0x55afbdee74d0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/45610 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d480a67b0 con 0x55afbdee74d0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/45610 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0d480ac3e0 con 0x55afbdee74d0 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 10 client.17685 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 20 client.17685 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdea43a0 0x55afbe337540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 4 client.17685 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55afbe1994a0 con 0x55afbdea43a0 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.937+0000 7f0d596d7640 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdea43a0 0x55afbe337540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d3d7fa640 10 client.17685 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d596d7640 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdea43a0 0x55afbe337540 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e038c65fddf27ec server_cookie=50d9116cf2ab2a09 in_seq=0 out_seq=0 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d3d7fa640 1 -- 172.21.15.80:0/45610 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55afbe1994a0 con 0x55afbdea43a0 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d3d7fa640 10 client.17685 handle_command_reply: tid=0 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 client.17685 shutdown 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 msgr2=0x55afbe2c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2c2ce0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d740 tx=0x7f0d480af440 comp rx=0 tx=0).stop 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 shutdown_connections 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55afbdea43a0 0x55afbe337540 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afbdf10390 0x55afbe333a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55afbdeef6b0 0x55afbe2c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 --2- 172.21.15.80:0/45610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55afbdee74d0 0x55afbe2c2ce0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d3d7fa640 0 client.17685 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:29.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 >> 172.21.15.80:0/45610 conn(0x55afbdf044e0 msgr2=0x55afbe2d1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:29.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 shutdown_connections 2024-04-25T11:33:29.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 1 -- 172.21.15.80:0/45610 wait complete. 2024-04-25T11:33:29.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.938+0000 7f0d62fea740 20 client.17685 trim_cache size 0 max 16384 2024-04-25T11:33:29.934 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:33:29.934 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:33:29.934 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:33:29.935 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:33:29.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0d400afc60 msgr2=0x7f0d400b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0d400afc60 0x7f0d400b2170 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55afbe2adbd0 tx=0x7f0d4c004ab0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54104260 msgr2=0x7f0d541a0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54104260 0x7f0d541a0520 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d770 tx=0x7f0d4800dc30 comp rx=0 tx=0).stop 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 shutdown_connections 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f0d400afc60 0x7f0d400b2170 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d54109fb0 0x7f0d5419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d54109b10 0x7f0d541a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 --2- 172.21.15.80:0/2570854533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d54104260 0x7f0d541a0520 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 >> 172.21.15.80:0/2570854533 conn(0x7f0d540ff210 msgr2=0x7f0d5410f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 shutdown_connections 2024-04-25T11:33:29.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:29.939+0000 7f0d5c13c640 1 -- 172.21.15.80:0/2570854533 wait complete. 2024-04-25T11:33:29.938 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:33:29.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:33:30.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 -- 172.21.15.80:0/3551986751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 msgr2=0x7f3688102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 --2- 172.21.15.80:0/3551986751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f3688102090 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f3678009900 tx=0x7f367802a480 comp rx=0 tx=0).stop 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 -- 172.21.15.80:0/3551986751 shutdown_connections 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 --2- 172.21.15.80:0/3551986751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f3688102090 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 --2- 172.21.15.80:0/3551986751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36881072a0 0x7f36881076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 --2- 172.21.15.80:0/3551986751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3688108a00 0x7f3688101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 -- 172.21.15.80:0/3551986751 >> 172.21.15.80:0/3551986751 conn(0x7f36880fd860 msgr2=0x7f36880ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 -- 172.21.15.80:0/3551986751 shutdown_connections 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.056+0000 7f368fd0d640 1 -- 172.21.15.80:0/3551986751 wait complete. 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 Processor -- start 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 -- start start 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36881072a0 0x7f36881a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3688108a00 0x7f36881a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f36881a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f368811a2e0 con 0x7f3688108e10 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f368811a160 con 0x7f36881072a0 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368fd0d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f368811a460 con 0x7f3688108a00 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.057+0000 7f368e2aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f36881a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f36881a0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36518/0 (socket says 172.21.15.80:36518) 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 -- 172.21.15.80:0/236622026 learned_addr learned my addr 172.21.15.80:0/236622026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368daa9640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36881072a0 0x7f36881a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368d2a8640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3688108a00 0x7f36881a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 -- 172.21.15.80:0/236622026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3688108a00 msgr2=0x7f36881a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3688108a00 0x7f36881a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 -- 172.21.15.80:0/236622026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36881072a0 msgr2=0x7f36881a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36881072a0 0x7f36881a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 -- 172.21.15.80:0/236622026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36881a1270 con 0x7f3688108e10 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368d2a8640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3688108a00 0x7f36881a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368e2aa640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f36881a0b40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f368000eaa0 tx=0x7f368000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f367effd640 1 -- 172.21.15.80:0/236622026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368000cdb0 con 0x7f3688108e10 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f367effd640 1 -- 172.21.15.80:0/236622026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3680005020 con 0x7f3688108e10 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36881a1500 con 0x7f3688108e10 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f367effd640 1 -- 172.21.15.80:0/236622026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36800116d0 con 0x7f3688108e10 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.058+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36881ad760 con 0x7f3688108e10 2024-04-25T11:33:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.059+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3688102d30 con 0x7f3688108e10 2024-04-25T11:33:30.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.061+0000 7f367effd640 1 -- 172.21.15.80:0/236622026 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f36800051d0 con 0x7f3688108e10 2024-04-25T11:33:30.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.061+0000 7f367effd640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36740afc60 0x7f36740b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.061+0000 7f368daa9640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36740afc60 0x7f36740b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.061+0000 7f367effd640 1 -- 172.21.15.80:0/236622026 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f36800df650 con 0x7f3688108e10 2024-04-25T11:33:30.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.062+0000 7f368daa9640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36740afc60 0x7f36740b2170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f368806b2c0 tx=0x7f3684005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.065+0000 7f367effd640 1 -- 172.21.15.80:0/236622026 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3680016030 con 0x7f3688108e10 2024-04-25T11:33:30.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.281+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36881ada00 con 0x7f3688108e10 2024-04-25T11:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.282+0000 7f367effd640 1 -- 172.21.15.80:0/236622026 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f36800a7ed0 con 0x7f3688108e10 2024-04-25T11:33:30.270 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:33:30.271 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36740afc60 msgr2=0x7f36740b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36740afc60 0x7f36740b2170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f368806b2c0 tx=0x7f3684005f90 comp rx=0 tx=0).stop 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 msgr2=0x7f36881a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f36881a0b40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f368000eaa0 tx=0x7f368000ef60 comp rx=0 tx=0).stop 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 shutdown_connections 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f36740afc60 0x7f36740b2170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3688108e10 0x7f36881a0b40 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3688108a00 0x7f36881a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 --2- 172.21.15.80:0/236622026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36881072a0 0x7f36881a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 >> 172.21.15.80:0/236622026 conn(0x7f36880fd860 msgr2=0x7f3688105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 shutdown_connections 2024-04-25T11:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.284+0000 7f368fd0d640 1 -- 172.21.15.80:0/236622026 wait complete. 2024-04-25T11:33:30.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 -- 172.21.15.80:0/592381713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c102af0 msgr2=0x7f896c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 --2- 172.21.15.80:0/592381713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c102af0 0x7f896c102f00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f895c009900 tx=0x7f895c02a410 comp rx=0 tx=0).stop 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 -- 172.21.15.80:0/592381713 shutdown_connections 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 --2- 172.21.15.80:0/592381713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c102af0 0x7f896c102f00 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 --2- 172.21.15.80:0/592381713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c10d380 0x7f896c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 --2- 172.21.15.80:0/592381713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f896c108a20 0x7f896c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 -- 172.21.15.80:0/592381713 >> 172.21.15.80:0/592381713 conn(0x7f896c078100 msgr2=0x7f896c078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 -- 172.21.15.80:0/592381713 shutdown_connections 2024-04-25T11:33:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.404+0000 7f8973dc5640 1 -- 172.21.15.80:0/592381713 wait complete. 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 Processor -- start 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 -- start start 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c102af0 0x7f896c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c108a20 0x7f896c199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f896c10d380 0x7f896c19de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f896c112be0 con 0x7f896c108a20 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f896c112a60 con 0x7f896c102af0 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8973dc5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f896c112d60 con 0x7f896c10d380 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8971360640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c108a20 0x7f896c199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8971360640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c108a20 0x7f896c199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36542/0 (socket says 172.21.15.80:36542) 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8971360640 1 -- 172.21.15.80:0/2772275806 learned_addr learned my addr 172.21.15.80:0/2772275806 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.405+0000 7f8971b61640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c102af0 0x7f896c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8972362640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f896c10d380 0x7f896c19de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8971360640 1 -- 172.21.15.80:0/2772275806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f896c10d380 msgr2=0x7f896c19de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8971360640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f896c10d380 0x7f896c19de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8971360640 1 -- 172.21.15.80:0/2772275806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c102af0 msgr2=0x7f896c199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8971360640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c102af0 0x7f896c199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8971360640 1 -- 172.21.15.80:0/2772275806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896c19e460 con 0x7f896c108a20 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8971360640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c108a20 0x7f896c199b60 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f895c006010 tx=0x7f895c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8962ffd640 1 -- 172.21.15.80:0/2772275806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c03f030 con 0x7f896c108a20 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8962ffd640 1 -- 172.21.15.80:0/2772275806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f895c003aa0 con 0x7f896c108a20 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8962ffd640 1 -- 172.21.15.80:0/2772275806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c035070 con 0x7f896c108a20 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896c19e6f0 con 0x7f896c108a20 2024-04-25T11:33:30.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.406+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f896c19ebe0 con 0x7f896c108a20 2024-04-25T11:33:30.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 Processor -- start 2024-04-25T11:33:30.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 -- start start 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f8962ffd640 1 -- 172.21.15.80:0/2772275806 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f895c042030 con 0x7f896c108a20 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55687020ad80 con 0x55686fee36b0 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5568701c4a20 con 0x55686fedb4d0 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f897ac76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556870206d40 con 0x55686ff04390 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f8971360640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f8971360640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36546/0 (socket says 172.21.15.80:36546) 2024-04-25T11:33:30.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f8971360640 1 -- 172.21.15.80:0/4062925797 learned_addr learned my addr 172.21.15.80:0/4062925797 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.409+0000 7f8972362640 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8971b61640 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8971360640 1 -- 172.21.15.80:0/4062925797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 msgr2=0x5568702a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8971360640 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8971360640 1 -- 172.21.15.80:0/4062925797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 msgr2=0x5568702a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8971360640 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8971360640 1 -- 172.21.15.80:0/4062925797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568701cfc30 con 0x55686fee36b0 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8962ffd640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f89580afc60 0x7f89580b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8972362640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f89580afc60 0x7f89580b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8971360640 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b26a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f895c0fcbe0 tx=0x7f895c105650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99caf57bd04bd324 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8962ffd640 1 -- 172.21.15.80:0/2772275806 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f895c0ff540 con 0x7f896c108a20 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8957fff640 1 -- 172.21.15.80:0/4062925797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0c3580 con 0x55686fee36b0 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8957fff640 1 -- 172.21.15.80:0/4062925797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f895c0c1e50 con 0x55686fee36b0 2024-04-25T11:33:30.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.410+0000 7f8957fff640 1 -- 172.21.15.80:0/4062925797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0c6e30 con 0x55686fee36b0 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 -- 172.21.15.80:0/4062925797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 msgr2=0x5568702b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b26a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f895c0fcbe0 tx=0x7f895c105650 comp rx=0 tx=0).stop 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f8972362640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f89580afc60 0x7f89580b2170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5568702a2980 tx=0x7f8964009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 -- 172.21.15.80:0/4062925797 shutdown_connections 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b26a0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 --2- 172.21.15.80:0/4062925797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 -- 172.21.15.80:0/4062925797 >> 172.21.15.80:0/4062925797 conn(0x55686fef84e0 msgr2=0x5568702a1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 -- 172.21.15.80:0/4062925797 shutdown_connections 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.411+0000 7f897ac76740 1 -- 172.21.15.80:0/4062925797 wait complete. 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 -- start start 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 Processor -- start 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5568702b4e50 con 0x55686fee36b0 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556870191dc0 con 0x55686fedb4d0 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5568702b4fd0 con 0x55686ff04390 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f897ac76740 10 client.0 _ll_register_callbacks cb 0x5568701ad600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f8971360640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f8971360640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36560/0 (socket says 172.21.15.80:36560) 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f8971360640 1 -- 172.21.15.80:0/3880528755 learned_addr learned my addr 172.21.15.80:0/3880528755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f8972362640 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.412+0000 7f8971b61640 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f8971360640 1 -- 172.21.15.80:0/3880528755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 msgr2=0x5568702be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f8971360640 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f8971360640 1 -- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 msgr2=0x5568702b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f8971360640 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f8971360640 1 -- 172.21.15.80:0/3880528755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55686ff1c3f0 con 0x55686fee36b0 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f8971360640 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b0740 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f895c0c4930 tx=0x7f895c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904800ad0d2b188c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f89557fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f89557fa640 1 -- 172.21.15.80:0/3880528755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c102e60 con 0x55686fee36b0 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f89557fa640 1 -- 172.21.15.80:0/3880528755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f895c0c3950 con 0x55686fee36b0 2024-04-25T11:33:30.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f895c0c1e50 con 0x55686fee36b0 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f89557fa640 1 -- 172.21.15.80:0/3880528755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f895c049040 con 0x55686fee36b0 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f897ac76740 10 client.17703 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55686ffe67d0 con 0x55686fee36b0 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f89557fa640 1 -- 172.21.15.80:0/3880528755 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f895c0c1e50 con 0x55686fee36b0 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.413+0000 7f89557fa640 1 -- 172.21.15.80:0/3880528755 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f895c0c7920 con 0x55686fee36b0 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f897ac76740 10 client.17703 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f897ac76740 10 client.17703 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f897ac76740 20 client.17703 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f897ac76740 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fec2f60 0x5568702c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f897ac76740 4 client.17703 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556870218990 con 0x55686fec2f60 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f8971b61640 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fec2f60 0x5568702c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f8971b61640 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fec2f60 0x5568702c4610 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f5d46d3ac37123c server_cookie=f7bdff44d68fe934 in_seq=0 out_seq=0 2024-04-25T11:33:30.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.414+0000 7f89557fa640 10 client.17703 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f89557fa640 1 -- 172.21.15.80:0/3880528755 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556870218990 con 0x55686fec2f60 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f89557fa640 10 client.17703 handle_command_reply: tid=0 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 client.17703 shutdown 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 msgr2=0x5568702b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b0740 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f895c0c4930 tx=0x7f895c02a410 comp rx=0 tx=0).stop 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 shutdown_connections 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fec2f60 0x5568702c4610 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fee36b0 0x5568702b0740 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686ff04390 0x5568702be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f89557fa640 0 client.17703 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 --2- 172.21.15.80:0/3880528755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fedb4d0 0x5568702b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 >> 172.21.15.80:0/3880528755 conn(0x55686fef84e0 msgr2=0x5568702a7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 shutdown_connections 2024-04-25T11:33:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.415+0000 7f897ac76740 1 -- 172.21.15.80:0/3880528755 wait complete. 2024-04-25T11:33:30.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.416+0000 7f897ac76740 20 client.17703 trim_cache size 0 max 16384 2024-04-25T11:33:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 Processor -- start 2024-04-25T11:33:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 -- start start 2024-04-25T11:33:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fedb4d0 0x5568702afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fee36b0 0x5568702be300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686ff04390 0x5568702c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1aff30 con 0x55686ff04390 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1ad800 con 0x55686fee36b0 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f897ac76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1ab670 con 0x55686fedb4d0 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f8972362640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686ff04390 0x5568702c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f8972362640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686ff04390 0x5568702c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36576/0 (socket says 172.21.15.80:36576) 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f8972362640 1 -- 172.21.15.80:0/2403422913 learned_addr learned my addr 172.21.15.80:0/2403422913 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f8971b61640 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fedb4d0 0x5568702afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.429+0000 7f8971360640 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fee36b0 0x5568702be300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f8972362640 1 -- 172.21.15.80:0/2403422913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fedb4d0 msgr2=0x5568702afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f8972362640 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fedb4d0 0x5568702afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f8972362640 1 -- 172.21.15.80:0/2403422913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fee36b0 msgr2=0x5568702be300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f8972362640 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fee36b0 0x5568702be300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f8972362640 1 -- 172.21.15.80:0/2403422913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568702a29b0 con 0x55686ff04390 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f8972362640 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686ff04390 0x5568702c7630 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f8964005fd0 tx=0x7f8964019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb7399a85727d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f89577fe640 1 -- 172.21.15.80:0/2403422913 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964029430 con 0x55686ff04390 2024-04-25T11:33:30.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f89577fe640 1 -- 172.21.15.80:0/2403422913 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89640118f0 con 0x55686ff04390 2024-04-25T11:33:30.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.430+0000 7f89577fe640 1 -- 172.21.15.80:0/2403422913 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896401c8f0 con 0x55686ff04390 2024-04-25T11:33:30.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 -- 172.21.15.80:0/2403422913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686ff04390 msgr2=0x5568702c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686ff04390 0x5568702c7630 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f8964005fd0 tx=0x7f8964019000 comp rx=0 tx=0).stop 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 -- 172.21.15.80:0/2403422913 shutdown_connections 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686ff04390 0x5568702c7630 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686fee36b0 0x5568702be300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 --2- 172.21.15.80:0/2403422913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fedb4d0 0x5568702afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 -- 172.21.15.80:0/2403422913 >> 172.21.15.80:0/2403422913 conn(0x55686fef84e0 msgr2=0x5568702af530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 -- 172.21.15.80:0/2403422913 shutdown_connections 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 -- 172.21.15.80:0/2403422913 wait complete. 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 -- start start 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.431+0000 7f897ac76740 1 Processor -- start 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f897ac76740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fedb4d0 0x5568702c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f897ac76740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fee36b0 0x5568702c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f897ac76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686ff04390 0x5568702c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f897ac76740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1abcc0 con 0x55686fedb4d0 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f897ac76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1ad130 con 0x55686ff04390 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f897ac76740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1ac390 con 0x55686fee36b0 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f897ac76740 10 client.0 _ll_register_callbacks cb 0x7f8968004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fedb4d0 0x5568702c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fedb4d0 0x5568702c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36592/0 (socket says 172.21.15.80:36592) 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 -- 172.21.15.80:0/2607497152 learned_addr learned my addr 172.21.15.80:0/2607497152 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8972362640 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686ff04390 0x5568702c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971360640 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fee36b0 0x5568702c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 -- 172.21.15.80:0/2607497152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fee36b0 msgr2=0x5568702c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fee36b0 0x5568702c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 -- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686ff04390 msgr2=0x5568702c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686ff04390 0x5568702c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 -- 172.21.15.80:0/2607497152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687032b740 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f8971b61640 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fedb4d0 0x5568702c5180 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x5568702a2f50 tx=0x7f89680035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e6bbb0a6c160e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.432+0000 7f89557fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f89557fa640 1 -- 172.21.15.80:0/2607497152 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968005220 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f89557fa640 1 -- 172.21.15.80:0/2607497152 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f89680053c0 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89640118f0 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f89557fa640 1 -- 172.21.15.80:0/2607497152 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8968030050 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 10 client.17709 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55687032c880 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f89557fa640 1 -- 172.21.15.80:0/2607497152 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89640118f0 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f89557fa640 1 -- 172.21.15.80:0/2607497152 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f89680202e0 con 0x55686fedb4d0 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 10 client.17709 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 10 client.17709 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 20 client.17709 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fe983a0 0x55687032eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 4 client.17709 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5568702befd0 con 0x55686fe983a0 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.434+0000 7f8971360640 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fe983a0 0x55687032eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f89557fa640 10 client.17709 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f8971360640 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fe983a0 0x55687032eff0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a293d6f6a5c8fb0 server_cookie=8b398eda32bf335e in_seq=0 out_seq=0 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f89557fa640 1 -- 172.21.15.80:0/2607497152 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5568702befd0 con 0x55686fe983a0 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f89557fa640 10 client.17709 handle_command_reply: tid=0 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 client.17709 shutdown 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fedb4d0 msgr2=0x5568702c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fedb4d0 0x5568702c5180 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x5568702a2f50 tx=0x7f89680035f0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 shutdown_connections 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55686fe983a0 0x55687032eff0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55686ff04390 0x5568702c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55686fee36b0 0x5568702c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 --2- 172.21.15.80:0/2607497152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55686fedb4d0 0x5568702c5180 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f89557fa640 0 client.17709 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:33:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 >> 172.21.15.80:0/2607497152 conn(0x55686fef84e0 msgr2=0x5568702a1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 shutdown_connections 2024-04-25T11:33:30.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 1 -- 172.21.15.80:0/2607497152 wait complete. 2024-04-25T11:33:30.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.435+0000 7f897ac76740 20 client.17709 trim_cache size 0 max 16384 2024-04-25T11:33:30.430 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f89580afc60 msgr2=0x7f89580b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f89580afc60 0x7f89580b2170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5568702a2980 tx=0x7f8964009500 comp rx=0 tx=0).stop 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c108a20 msgr2=0x7f896c199b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c108a20 0x7f896c199b60 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f895c006010 tx=0x7f895c004060 comp rx=0 tx=0).stop 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 shutdown_connections 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f89580afc60 0x7f89580b2170 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f896c108a20 0x7f896c199b60 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f896c10d380 0x7f896c19de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 --2- 172.21.15.80:0/2772275806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896c102af0 0x7f896c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 >> 172.21.15.80:0/2772275806 conn(0x7f896c078100 msgr2=0x7f896c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 shutdown_connections 2024-04-25T11:33:30.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.436+0000 7f8973dc5640 1 -- 172.21.15.80:0/2772275806 wait complete. 2024-04-25T11:33:30.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:33:30.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 -- 172.21.15.80:0/3380316697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7904108a20 msgr2=0x7f79041025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3380316697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7904108a20 0x7f79041025b0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7900009ca0 tx=0x7f790002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 -- 172.21.15.80:0/3380316697 shutdown_connections 2024-04-25T11:33:30.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3380316697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f790410d380 0x7f790410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3380316697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7904102af0 0x7f7904102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3380316697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7904108a20 0x7f79041025b0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 -- 172.21.15.80:0/3380316697 >> 172.21.15.80:0/3380316697 conn(0x7f7904078100 msgr2=0x7f7904078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 -- 172.21.15.80:0/3380316697 shutdown_connections 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 -- 172.21.15.80:0/3380316697 wait complete. 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.557+0000 7f790b8d1640 1 Processor -- start 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790b8d1640 1 -- start start 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790b8d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7904102af0 0x7f790419b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790b8d1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7904108a20 0x7f790419baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790b8d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f790410d380 0x7f790419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790b8d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7904112be0 con 0x7f790410d380 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790b8d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7904112a60 con 0x7f7904102af0 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790b8d1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7904112d60 con 0x7f7904108a20 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f790410d380 0x7f790419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f790410d380 0x7f790419bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36614/0 (socket says 172.21.15.80:36614) 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 -- 172.21.15.80:0/3583502221 learned_addr learned my addr 172.21.15.80:0/3583502221 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790966d640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7904102af0 0x7f790419b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7908e6c640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7904108a20 0x7f790419baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 -- 172.21.15.80:0/3583502221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7904108a20 msgr2=0x7f790419baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7904108a20 0x7f790419baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 -- 172.21.15.80:0/3583502221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7904102af0 msgr2=0x7f790419b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7904102af0 0x7f790419b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 -- 172.21.15.80:0/3583502221 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79041a6870 con 0x7f790410d380 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f790966d640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7904102af0 0x7f790419b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f7909e6e640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f790410d380 0x7f790419bfe0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00d750 tx=0x7f78fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.558+0000 7f78fa7fc640 1 -- 172.21.15.80:0/3583502221 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc017070 con 0x7f790410d380 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.559+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79041a6b60 con 0x7f790410d380 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.559+0000 7f78fa7fc640 1 -- 172.21.15.80:0/3583502221 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc0054d0 con 0x7f790410d380 2024-04-25T11:33:30.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.559+0000 7f78fa7fc640 1 -- 172.21.15.80:0/3583502221 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc004c60 con 0x7f790410d380 2024-04-25T11:33:30.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.559+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79041a7060 con 0x7f790410d380 2024-04-25T11:33:30.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f791277f740 1 Processor -- start 2024-04-25T11:33:30.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f78fa7fc640 1 -- 172.21.15.80:0/3583502221 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f78fc009bd0 con 0x7f790410d380 2024-04-25T11:33:30.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f791277f740 1 -- start start 2024-04-25T11:33:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f791277f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c305390 0x55d54c6a6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f791277f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c2dc4d0 0x55d54c6a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f791277f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2e46b0 0x55d54c6b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f791277f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d54c60bd80 con 0x55d54c2dc4d0 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.561+0000 7f791277f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d54c5c5a20 con 0x55d54c305390 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f791277f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d54c607d40 con 0x55d54c2e46b0 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c2dc4d0 0x55d54c6a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c2dc4d0 0x55d54c6a6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36622/0 (socket says 172.21.15.80:36622) 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 -- 172.21.15.80:0/67091628 learned_addr learned my addr 172.21.15.80:0/67091628 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f7908e6c640 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c305390 0x55d54c6a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f78fa7fc640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f78f00afc60 0x7f78f00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f7908e6c640 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2e46b0 0x55d54c6b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f7909e6e640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f78f00afc60 0x7f78f00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 -- 172.21.15.80:0/67091628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2e46b0 msgr2=0x55d54c6b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2e46b0 0x55d54c6b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 -- 172.21.15.80:0/67091628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c305390 msgr2=0x55d54c6a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c305390 0x55d54c6a6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f78fa7fc640 1 -- 172.21.15.80:0/3583502221 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f78fc0deab0 con 0x7f790410d380 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 -- 172.21.15.80:0/67091628 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c5d0c30 con 0x55d54c2dc4d0 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f790966d640 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c2dc4d0 0x55d54c6a6d50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7900009ca0 tx=0x7f79000094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7ee90a63f120fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f78ef7fe640 1 -- 172.21.15.80:0/67091628 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900031cf0 con 0x55d54c2dc4d0 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f7909e6e640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f78f00afc60 0x7f78f00b2170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0dc240 tx=0x7f78fc00df60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f78ef7fe640 1 -- 172.21.15.80:0/67091628 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7900036040 con 0x55d54c2dc4d0 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.562+0000 7f78ef7fe640 1 -- 172.21.15.80:0/67091628 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900004040 con 0x55d54c2dc4d0 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 -- 172.21.15.80:0/67091628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c2dc4d0 msgr2=0x55d54c6a6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c2dc4d0 0x55d54c6a6d50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7900009ca0 tx=0x7f79000094a0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 -- 172.21.15.80:0/67091628 shutdown_connections 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c2dc4d0 0x55d54c6a6d50 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2e46b0 0x55d54c6b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 --2- 172.21.15.80:0/67091628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c305390 0x55d54c6a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 -- 172.21.15.80:0/67091628 >> 172.21.15.80:0/67091628 conn(0x55d54c2f94e0 msgr2=0x55d54c6a2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 -- 172.21.15.80:0/67091628 shutdown_connections 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.563+0000 7f791277f740 1 -- 172.21.15.80:0/67091628 wait complete. 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 -- start start 2024-04-25T11:33:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 Processor -- start 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d54c6b3d30 con 0x55d54c305390 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d54c592dc0 con 0x55d54c2e46b0 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d54c6b3eb0 con 0x55d54c2dc4d0 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f791277f740 10 client.0 _ll_register_callbacks cb 0x55d54c5ae600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f7908e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f7908e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6bd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36626/0 (socket says 172.21.15.80:36626) 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f7908e6c640 1 -- 172.21.15.80:0/3608456870 learned_addr learned my addr 172.21.15.80:0/3608456870 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.564+0000 7f790966d640 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f7908e6c640 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f7908e6c640 1 -- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 msgr2=0x55d54c6b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f7908e6c640 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f7908e6c640 1 -- 172.21.15.80:0/3608456870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 msgr2=0x55d54c6b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f7908e6c640 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f7908e6c640 1 -- 172.21.15.80:0/3608456870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54c31d3f0 con 0x55d54c305390 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f7908e6c640 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6bd1b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f790410e980 tx=0x7f78f4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73dba426e2a9776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f78ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f78ecff9640 1 -- 172.21.15.80:0/3608456870 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4005020 con 0x55d54c305390 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7900036040 con 0x55d54c305390 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f78ecff9640 1 -- 172.21.15.80:0/3608456870 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f78f40051c0 con 0x55d54c305390 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f78ecff9640 1 -- 172.21.15.80:0/3608456870 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f78f40053c0 con 0x55d54c305390 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f791277f740 10 client.17721 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d54c3e77d0 con 0x55d54c305390 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.565+0000 7f78ecff9640 1 -- 172.21.15.80:0/3608456870 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7900036040 con 0x55d54c305390 2024-04-25T11:33:30.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f78ecff9640 1 -- 172.21.15.80:0/3608456870 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f78f400f040 con 0x55d54c305390 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f791277f740 10 client.17721 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f791277f740 10 client.17721 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f791277f740 20 client.17721 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f791277f740 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2c3f60 0x55d54c6c3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f791277f740 4 client.17721 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d54c619990 con 0x55d54c2c3f60 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f790966d640 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2c3f60 0x55d54c6c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f78ecff9640 10 client.17721 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.566+0000 7f790966d640 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2c3f60 0x55d54c6c3610 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75ee601192127ac5 server_cookie=3f74bd1314806687 in_seq=0 out_seq=0 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f78ecff9640 1 -- 172.21.15.80:0/3608456870 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d54c619990 con 0x55d54c2c3f60 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f78ecff9640 10 client.17721 handle_command_reply: tid=0 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 client.17721 shutdown 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 msgr2=0x55d54c6bd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6bd1b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f790410e980 tx=0x7f78f4015040 comp rx=0 tx=0).stop 2024-04-25T11:33:30.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 shutdown_connections 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6bd1b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2c3f60 0x55d54c6c3610 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.567+0000 7f791277f740 1 --2- 172.21.15.80:0/3608456870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.568+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 >> 172.21.15.80:0/3608456870 conn(0x55d54c2f94e0 msgr2=0x55d54c6a8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.568+0000 7f78ecff9640 0 client.17721 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.568+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 shutdown_connections 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.568+0000 7f791277f740 1 -- 172.21.15.80:0/3608456870 wait complete. 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.568+0000 7f791277f740 20 client.17721 trim_cache size 0 max 16384 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 Processor -- start 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 -- start start 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6bce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f79041b2180 con 0x55d54c305390 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79041afa50 con 0x55d54c2e46b0 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f791277f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79041ad8c0 con 0x55d54c2dc4d0 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f7908e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f7908e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36642/0 (socket says 172.21.15.80:36642) 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f7908e6c640 1 -- 172.21.15.80:0/1479026002 learned_addr learned my addr 172.21.15.80:0/1479026002 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.581+0000 7f7908e6c640 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f790966d640 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f7908e6c640 1 -- 172.21.15.80:0/1479026002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 msgr2=0x55d54c6bce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f7908e6c640 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6bce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f7908e6c640 1 -- 172.21.15.80:0/1479026002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 msgr2=0x55d54c6c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f7908e6c640 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f7908e6c640 1 -- 172.21.15.80:0/1479026002 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c6a7080 con 0x55d54c305390 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f7908e6c640 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6c9310 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x55d54c6a3fa0 tx=0x7f78f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be168074766020c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f78eeffd640 1 -- 172.21.15.80:0/1479026002 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f403a070 con 0x55d54c305390 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f78eeffd640 1 -- 172.21.15.80:0/1479026002 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4005560 con 0x55d54c305390 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.582+0000 7f78eeffd640 1 -- 172.21.15.80:0/1479026002 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f402a030 con 0x55d54c305390 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 -- 172.21.15.80:0/1479026002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 msgr2=0x55d54c6c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6c9310 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x55d54c6a3fa0 tx=0x7f78f40046c0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 -- 172.21.15.80:0/1479026002 shutdown_connections 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c6c9310 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 --2- 172.21.15.80:0/1479026002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6bce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 -- 172.21.15.80:0/1479026002 >> 172.21.15.80:0/1479026002 conn(0x55d54c2f94e0 msgr2=0x55d54c6b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 -- 172.21.15.80:0/1479026002 shutdown_connections 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 -- 172.21.15.80:0/1479026002 wait complete. 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 -- start start 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.583+0000 7f791277f740 1 Processor -- start 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f791277f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f791277f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f791277f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c729970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f791277f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f79041adf10 con 0x55d54c305390 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f791277f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79041af380 con 0x55d54c2e46b0 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f791277f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79041ae5e0 con 0x55d54c2dc4d0 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f791277f740 10 client.0 _ll_register_callbacks cb 0x7f78f4013920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c729970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c729970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36644/0 (socket says 172.21.15.80:36644) 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 -- 172.21.15.80:0/4194406376 learned_addr learned my addr 172.21.15.80:0/4194406376 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f790966d640 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 -- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 msgr2=0x55d54c6b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 -- 172.21.15.80:0/4194406376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 msgr2=0x55d54c6b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 -- 172.21.15.80:0/4194406376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54c729eb0 con 0x55d54c305390 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f7908e6c640 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c729970 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f78f4038040 tx=0x7f78f4013c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a282ea81fba147 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.584+0000 7f78ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f78ecff9640 1 -- 172.21.15.80:0/4194406376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f403a020 con 0x55d54c305390 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f78ecff9640 1 -- 172.21.15.80:0/4194406376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f78f4026450 con 0x55d54c305390 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f4005560 con 0x55d54c305390 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f78ecff9640 1 -- 172.21.15.80:0/4194406376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f78f402a040 con 0x55d54c305390 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 10 client.17727 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:30.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d54c72b060 con 0x55d54c305390 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f78ecff9640 1 -- 172.21.15.80:0/4194406376 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4005560 con 0x55d54c305390 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f78ecff9640 1 -- 172.21.15.80:0/4194406376 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f78f404a4e0 con 0x55d54c305390 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 10 client.17727 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 10 client.17727 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 20 client.17727 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2993a0 0x55d54c72d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 4 client.17727 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d54c613800 con 0x55d54c2993a0 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.585+0000 7f790966d640 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2993a0 0x55d54c72d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f78ecff9640 10 client.17727 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f790966d640 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2993a0 0x55d54c72d760 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5dd7360fc0e1377b server_cookie=429828c49cd9a135 in_seq=0 out_seq=0 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f78ecff9640 1 -- 172.21.15.80:0/4194406376 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d54c613800 con 0x55d54c2993a0 2024-04-25T11:33:30.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f78ecff9640 10 client.17727 handle_command_reply: tid=0 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 client.17727 shutdown 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 msgr2=0x55d54c729970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c729970 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f78f4038040 tx=0x7f78f4013c70 comp rx=0 tx=0).stop 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 shutdown_connections 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d54c305390 0x55d54c729970 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55d54c2993a0 0x55d54c72d760 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d54c2e46b0 0x55d54c6b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 --2- 172.21.15.80:0/4194406376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d54c2dc4d0 0x55d54c6b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f78ecff9640 0 client.17727 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 >> 172.21.15.80:0/4194406376 conn(0x55d54c2f94e0 msgr2=0x55d54c6b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 shutdown_connections 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 1 -- 172.21.15.80:0/4194406376 wait complete. 2024-04-25T11:33:30.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.586+0000 7f791277f740 20 client.17727 trim_cache size 0 max 16384 2024-04-25T11:33:30.596 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f78f00afc60 msgr2=0x7f78f00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f78f00afc60 0x7f78f00b2170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0dc240 tx=0x7f78fc00df60 comp rx=0 tx=0).stop 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f790410d380 msgr2=0x7f790419bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f790410d380 0x7f790419bfe0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00d750 tx=0x7f78fc00dc10 comp rx=0 tx=0).stop 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 shutdown_connections 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f78f00afc60 0x7f78f00b2170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f790410d380 0x7f790419bfe0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7904108a20 0x7f790419baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 --2- 172.21.15.80:0/3583502221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7904102af0 0x7f790419b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 >> 172.21.15.80:0/3583502221 conn(0x7f7904078100 msgr2=0x7f79041040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 shutdown_connections 2024-04-25T11:33:30.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.587+0000 7f790b8d1640 1 -- 172.21.15.80:0/3583502221 wait complete. 2024-04-25T11:33:30.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:30 smithi080 ceph-mon[29126]: pgmap v287: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:30.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:30 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/236622026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:33:30.599 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:33:30.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:30 smithi196 ceph-mon[32659]: pgmap v287: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:30.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:30 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/236622026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.720+0000 7f0380ed8640 1 -- 172.21.15.80:0/72608892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 msgr2=0x7f037c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.720+0000 7f0380ed8640 1 --2- 172.21.15.80:0/72608892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c110630 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f036c009ca0 tx=0x7f036c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.720+0000 7f0380ed8640 1 -- 172.21.15.80:0/72608892 shutdown_connections 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 --2- 172.21.15.80:0/72608892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c110630 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 --2- 172.21.15.80:0/72608892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f037c109fb0 0x7f037c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 --2- 172.21.15.80:0/72608892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f037c109b10 0x7f037c1036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 -- 172.21.15.80:0/72608892 >> 172.21.15.80:0/72608892 conn(0x7f037c0ff1d0 msgr2=0x7f037c101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 -- 172.21.15.80:0/72608892 shutdown_connections 2024-04-25T11:33:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 -- 172.21.15.80:0/72608892 wait complete. 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 Processor -- start 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.721+0000 7f0380ed8640 1 -- start start 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f037c109b10 0x7f037c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f037c109fb0 0x7f037c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f037c113d00 con 0x7f037c104260 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f037c113b80 con 0x7f037c109fb0 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f037c113e80 con 0x7f037c109b10 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36648/0 (socket says 172.21.15.80:36648) 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 -- 172.21.15.80:0/3603114966 learned_addr learned my addr 172.21.15.80:0/3603114966 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037ad9d640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f037c109fb0 0x7f037c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0379d9b640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f037c109b10 0x7f037c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 -- 172.21.15.80:0/3603114966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f037c109b10 msgr2=0x7f037c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f037c109b10 0x7f037c19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 -- 172.21.15.80:0/3603114966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f037c109fb0 msgr2=0x7f037c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f037c109fb0 0x7f037c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 -- 172.21.15.80:0/3603114966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c19f540 con 0x7f037c104260 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0379d9b640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f037c109b10 0x7f037c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037ad9d640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f037c109fb0 0x7f037c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f037a59c640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c19a6e0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f037400d770 tx=0x7f037400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f03737fe640 1 -- 172.21.15.80:0/3603114966 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374017070 con 0x7f037c104260 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037c19f830 con 0x7f037c104260 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f03737fe640 1 -- 172.21.15.80:0/3603114966 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0374009c30 con 0x7f037c104260 2024-04-25T11:33:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f03737fe640 1 -- 172.21.15.80:0/3603114966 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037400f620 con 0x7f037c104260 2024-04-25T11:33:30.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.722+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037c1a71b0 con 0x7f037c104260 2024-04-25T11:33:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.725+0000 7f03737fe640 1 -- 172.21.15.80:0/3603114966 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f037401a070 con 0x7f037c104260 2024-04-25T11:33:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.725+0000 7f0387d84740 1 Processor -- start 2024-04-25T11:33:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.725+0000 7f0387d84740 1 -- start start 2024-04-25T11:33:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.725+0000 7f03737fe640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03680afc60 0x7f03680b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.725+0000 7f0387d84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0387d84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0387d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0387d84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd617d80 con 0x55f3cd311390 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0387d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd5d1a20 con 0x55f3cd2f06b0 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0387d84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd613d40 con 0x55f3cd2e84d0 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037ad9d640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03680afc60 0x7f03680b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36654/0 (socket says 172.21.15.80:36654) 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 -- 172.21.15.80:0/1949903566 learned_addr learned my addr 172.21.15.80:0/1949903566 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f03737fe640 1 -- 172.21.15.80:0/3603114966 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f03740dec50 con 0x7f037c104260 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037ad9d640 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0379d9b640 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 -- 172.21.15.80:0/1949903566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 msgr2=0x55f3cd6b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 -- 172.21.15.80:0/1949903566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 msgr2=0x55f3cd6bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 -- 172.21.15.80:0/1949903566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cd5dcc30 con 0x55f3cd311390 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037ad9d640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03680afc60 0x7f03680b2170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c031cb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f037a59c640 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b2810 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f03740a4040 tx=0x7f037400de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b3e96262704ad7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0370ff9640 1 -- 172.21.15.80:0/1949903566 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740a68e0 con 0x55f3cd311390 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0370ff9640 1 -- 172.21.15.80:0/1949903566 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03740a74d0 con 0x55f3cd311390 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.726+0000 7f0370ff9640 1 -- 172.21.15.80:0/1949903566 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374064b10 con 0x55f3cd311390 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 -- 172.21.15.80:0/1949903566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 msgr2=0x55f3cd6b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b2810 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f03740a4040 tx=0x7f037400de80 comp rx=0 tx=0).stop 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 -- 172.21.15.80:0/1949903566 shutdown_connections 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 --2- 172.21.15.80:0/1949903566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b2810 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 -- 172.21.15.80:0/1949903566 >> 172.21.15.80:0/1949903566 conn(0x55f3cd3054e0 msgr2=0x55f3cd6aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 -- 172.21.15.80:0/1949903566 shutdown_connections 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.727+0000 7f0387d84740 1 -- 172.21.15.80:0/1949903566 wait complete. 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 -- start start 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 Processor -- start 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd6bfd30 con 0x55f3cd311390 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd59edc0 con 0x55f3cd2e84d0 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f3cd6bfeb0 con 0x55f3cd2f06b0 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0387d84740 10 client.0 _ll_register_callbacks cb 0x55f3cd5ba600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f037ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f037ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36670/0 (socket says 172.21.15.80:36670) 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f037ad9d640 1 -- 172.21.15.80:0/4182089083 learned_addr learned my addr 172.21.15.80:0/4182089083 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f037a59c640 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.728+0000 7f0379d9b640 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f037ad9d640 1 -- 172.21.15.80:0/4182089083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 msgr2=0x55f3cd6bd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f037ad9d640 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f037ad9d640 1 -- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 msgr2=0x55f3cd6bd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f037ad9d640 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f037ad9d640 1 -- 172.21.15.80:0/4182089083 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cd3293f0 con 0x55f3cd311390 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f037ad9d640 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c91b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f036c031950 tx=0x7f036c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351e1cf9c389080d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0361ffb640 1 -- 172.21.15.80:0/4182089083 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c04f070 con 0x55f3cd311390 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0361ffb640 1 -- 172.21.15.80:0/4182089083 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f036c0047b0 con 0x55f3cd311390 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03740a74d0 con 0x55f3cd311390 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0361ffb640 1 -- 172.21.15.80:0/4182089083 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f036c05b050 con 0x55f3cd311390 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0387d84740 10 client.17739 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f3cd3f37d0 con 0x55f3cd311390 2024-04-25T11:33:30.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0361ffb640 1 -- 172.21.15.80:0/4182089083 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03740a74d0 con 0x55f3cd311390 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0361ffb640 1 -- 172.21.15.80:0/4182089083 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f036c030820 con 0x55f3cd311390 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0387d84740 10 client.17739 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0387d84740 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0387d84740 20 client.17739 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.729+0000 7f0387d84740 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2cff60 0x55f3cd6cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.730+0000 7f0387d84740 4 client.17739 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.730+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3cd625990 con 0x55f3cd2cff60 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.730+0000 7f037a59c640 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2cff60 0x55f3cd6cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.730+0000 7f0361ffb640 10 client.17739 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.730+0000 7f037a59c640 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2cff60 0x55f3cd6cf6b0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=657d9d681ddd6869 server_cookie=73262baad162deca in_seq=0 out_seq=0 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0361ffb640 1 -- 172.21.15.80:0/4182089083 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f3cd625990 con 0x55f3cd2cff60 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0361ffb640 10 client.17739 handle_command_reply: tid=0 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 client.17739 shutdown 2024-04-25T11:33:30.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 msgr2=0x55f3cd6c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c91b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f036c031950 tx=0x7f036c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 shutdown_connections 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2cff60 0x55f3cd6cf6b0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c91b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 --2- 172.21.15.80:0/4182089083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0361ffb640 0 client.17739 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 >> 172.21.15.80:0/4182089083 conn(0x55f3cd3054e0 msgr2=0x55f3cd6b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 shutdown_connections 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 1 -- 172.21.15.80:0/4182089083 wait complete. 2024-04-25T11:33:30.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.731+0000 7f0387d84740 20 client.17739 trim_cache size 0 max 16384 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.744+0000 7f0387d84740 1 Processor -- start 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0387d84740 1 -- start start 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0387d84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0387d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0387d84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0387d84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f037c1b2340 con 0x55f3cd311390 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0387d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f037c1afc10 con 0x55f3cd2f06b0 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0387d84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f037c1ada80 con 0x55f3cd2e84d0 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36676/0 (socket says 172.21.15.80:36676) 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 -- 172.21.15.80:0/3644038191 learned_addr learned my addr 172.21.15.80:0/3644038191 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0379d9b640 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037a59c640 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 -- 172.21.15.80:0/3644038191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 msgr2=0x55f3cd6bc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 -- 172.21.15.80:0/3644038191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 msgr2=0x55f3cd6c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 -- 172.21.15.80:0/3644038191 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cd6b4010 con 0x55f3cd311390 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f0379d9b640 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.745+0000 7f037ad9d640 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b74f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f036c02ade0 tx=0x7f036c02f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b7d0a02ee588ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0363fff640 1 -- 172.21.15.80:0/3644038191 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c058070 con 0x55f3cd311390 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0363fff640 1 -- 172.21.15.80:0/3644038191 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f036c036040 con 0x55f3cd311390 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0363fff640 1 -- 172.21.15.80:0/3644038191 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c04f050 con 0x55f3cd311390 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 -- 172.21.15.80:0/3644038191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 msgr2=0x55f3cd6b74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b74f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f036c02ade0 tx=0x7f036c02f4b0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 -- 172.21.15.80:0/3644038191 shutdown_connections 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6b74f0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 --2- 172.21.15.80:0/3644038191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6bc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 -- 172.21.15.80:0/3644038191 >> 172.21.15.80:0/3644038191 conn(0x55f3cd3054e0 msgr2=0x55f3cd6aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 -- 172.21.15.80:0/3644038191 shutdown_connections 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.746+0000 7f0387d84740 1 -- 172.21.15.80:0/3644038191 wait complete. 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 -- start start 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 Processor -- start 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f037c1ae0d0 con 0x55f3cd311390 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f037c1af540 con 0x55f3cd2e84d0 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f037c1ae7a0 con 0x55f3cd2f06b0 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0387d84740 10 client.0 _ll_register_callbacks cb 0x7f036c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36682/0 (socket says 172.21.15.80:36682) 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 -- 172.21.15.80:0/766047057 learned_addr learned my addr 172.21.15.80:0/766047057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037a59c640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 -- 172.21.15.80:0/766047057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 msgr2=0x55f3cd6c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f0379d9b640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 -- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 msgr2=0x55f3cd6c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037ad9d640 1 -- 172.21.15.80:0/766047057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cd6c1a00 con 0x55f3cd311390 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.747+0000 7f037a59c640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f037ad9d640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c1290 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f036c031040 tx=0x7f036c031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5887d63d1fbb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0361ffb640 1 -- 172.21.15.80:0/766047057 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c04f070 con 0x55f3cd311390 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0361ffb640 1 -- 172.21.15.80:0/766047057 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f036c004600 con 0x55f3cd311390 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f036c036040 con 0x55f3cd311390 2024-04-25T11:33:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0361ffb640 1 -- 172.21.15.80:0/766047057 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f036c058040 con 0x55f3cd311390 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 10 client.17745 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f3cd737aa0 con 0x55f3cd311390 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0361ffb640 1 -- 172.21.15.80:0/766047057 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f036c036040 con 0x55f3cd311390 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0361ffb640 1 -- 172.21.15.80:0/766047057 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f036c067030 con 0x55f3cd311390 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 10 client.17745 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 10 client.17745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 20 client.17745 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2a53a0 0x55f3cd73a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 4 client.17745 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3cd61f800 con 0x55f3cd2a53a0 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.748+0000 7f037a59c640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2a53a0 0x55f3cd73a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0361ffb640 10 client.17745 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f037a59c640 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2a53a0 0x55f3cd73a120 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710f55f7876e3c42 server_cookie=7229b57e57efef6a in_seq=0 out_seq=0 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0361ffb640 1 -- 172.21.15.80:0/766047057 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3cd61f800 con 0x55f3cd2a53a0 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0361ffb640 10 client.17745 handle_command_reply: tid=0 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 client.17745 shutdown 2024-04-25T11:33:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 msgr2=0x55f3cd6c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c1290 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f036c031040 tx=0x7f036c031dc0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 shutdown_connections 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55f3cd2a53a0 0x55f3cd73a120 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f3cd311390 0x55f3cd6c1290 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0361ffb640 0 client.17745 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f3cd2f06b0 0x55f3cd6c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 --2- 172.21.15.80:0/766047057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3cd2e84d0 0x55f3cd6c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 >> 172.21.15.80:0/766047057 conn(0x55f3cd3054e0 msgr2=0x55f3cd6aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 shutdown_connections 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 1 -- 172.21.15.80:0/766047057 wait complete. 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.749+0000 7f0387d84740 20 client.17745 trim_cache size 0 max 16384 2024-04-25T11:33:30.744 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:33:30.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03680afc60 msgr2=0x7f03680b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03680afc60 0x7f03680b2170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c031cb0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 msgr2=0x7f037c19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:30.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c19a6e0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f037400d770 tx=0x7f037400dc30 comp rx=0 tx=0).stop 2024-04-25T11:33:30.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 shutdown_connections 2024-04-25T11:33:30.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f03680afc60 0x7f03680b2170 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f037c109fb0 0x7f037c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f037c109b10 0x7f037c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 --2- 172.21.15.80:0/3603114966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037c104260 0x7f037c19a6e0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 >> 172.21.15.80:0/3603114966 conn(0x7f037c0ff1d0 msgr2=0x7f037c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 shutdown_connections 2024-04-25T11:33:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:30.750+0000 7f0380ed8640 1 -- 172.21.15.80:0/3603114966 wait complete. 2024-04-25T11:33:30.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:30 smithi082 ceph-mon[32440]: pgmap v287: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:30.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:30 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/236622026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:33:31.749 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:33:31.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:33:31.750 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:33:31.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 -- 172.21.15.80:0/3284074078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 msgr2=0x7fa21c108320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 --2- 172.21.15.80:0/3284074078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c108320 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa214009ca0 tx=0x7fa21402a8c0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 -- 172.21.15.80:0/3284074078 shutdown_connections 2024-04-25T11:33:31.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 --2- 172.21.15.80:0/3284074078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c108320 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 --2- 172.21.15.80:0/3284074078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21c107440 0x7fa21c107850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 --2- 172.21.15.80:0/3284074078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21c1029f0 0x7fa21c102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 -- 172.21.15.80:0/3284074078 >> 172.21.15.80:0/3284074078 conn(0x7fa21c0fe260 msgr2=0x7fa21c100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.889+0000 7fa2236ca640 1 -- 172.21.15.80:0/3284074078 shutdown_connections 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 -- 172.21.15.80:0/3284074078 wait complete. 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 Processor -- start 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 -- start start 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21c1029f0 0x7fa21c1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21c107440 0x7fa21c1a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c1a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c11a300 con 0x7fa21c107e20 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c11a180 con 0x7fa21c1029f0 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.890+0000 7fa2236ca640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c11a480 con 0x7fa21c107440 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c1a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c1a5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36690/0 (socket says 172.21.15.80:36690) 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 -- 172.21.15.80:0/1186980183 learned_addr learned my addr 172.21.15.80:0/1186980183 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221466640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21c1029f0 0x7fa21c1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa220c65640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21c107440 0x7fa21c1a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 -- 172.21.15.80:0/1186980183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21c107440 msgr2=0x7fa21c1a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21c107440 0x7fa21c1a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 -- 172.21.15.80:0/1186980183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21c1029f0 msgr2=0x7fa21c1a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21c1029f0 0x7fa21c1a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 -- 172.21.15.80:0/1186980183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c1a5ba0 con 0x7fa21c107e20 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa221c67640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c1a5560 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa214005cc0 tx=0x7fa21402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa2127fc640 1 -- 172.21.15.80:0/1186980183 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214003bf0 con 0x7fa21c107e20 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21c1a5e30 con 0x7fa21c107e20 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa2127fc640 1 -- 172.21.15.80:0/1186980183 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa214003d90 con 0x7fa21c107e20 2024-04-25T11:33:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa2127fc640 1 -- 172.21.15.80:0/1186980183 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21402fbc0 con 0x7fa21c107e20 2024-04-25T11:33:31.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.891+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21c1a6380 con 0x7fa21c107e20 2024-04-25T11:33:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 Processor -- start 2024-04-25T11:33:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa2127fc640 1 -- 172.21.15.80:0/1186980183 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fa21402fd60 con 0x7fa21c107e20 2024-04-25T11:33:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 -- start start 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d3d410 0x5642080dd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ddb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d1c730 0x5642080de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564208043b00 con 0x564207d1c730 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564207fdf920 con 0x564207d3d410 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.894+0000 7fa22a57a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56420803fac0 con 0x564207d14550 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d1c730 0x5642080de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d1c730 0x5642080de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36706/0 (socket says 172.21.15.80:36706) 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 -- 172.21.15.80:0/4292552910 learned_addr learned my addr 172.21.15.80:0/4292552910 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d3d410 0x5642080dd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa221466640 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa2127fc640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa2080afc60 0x7fa2080b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 -- 172.21.15.80:0/4292552910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 msgr2=0x5642080ddb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ddb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa221c67640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa2080afc60 0x7fa2080b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 -- 172.21.15.80:0/4292552910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d3d410 msgr2=0x5642080dd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d3d410 0x5642080dd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 -- 172.21.15.80:0/4292552910 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564207e1d7e0 con 0x564207d1c730 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa2127fc640 1 -- 172.21.15.80:0/1186980183 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7fa2141004b0 con 0x7fa21c107e20 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa220c65640 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d1c730 0x5642080de0a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa20c012690 tx=0x7fa20c00b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22198bc6ee20405 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa2077fe640 1 -- 172.21.15.80:0/4292552910 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c005020 con 0x564207d1c730 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa2077fe640 1 -- 172.21.15.80:0/4292552910 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20c0047a0 con 0x564207d1c730 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa221c67640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa2080afc60 0x7fa2080b2170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa2140fdda0 tx=0x7fa2140bd030 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.895+0000 7fa2077fe640 1 -- 172.21.15.80:0/4292552910 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c01f6b0 con 0x564207d1c730 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 -- 172.21.15.80:0/4292552910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d1c730 msgr2=0x5642080de0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d1c730 0x5642080de0a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa20c012690 tx=0x7fa20c00b6e0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 -- 172.21.15.80:0/4292552910 shutdown_connections 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d1c730 0x5642080de0a0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 --2- 172.21.15.80:0/4292552910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d3d410 0x5642080dd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 -- 172.21.15.80:0/4292552910 >> 172.21.15.80:0/4292552910 conn(0x564207d31560 msgr2=0x5642080d9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 -- 172.21.15.80:0/4292552910 shutdown_connections 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.896+0000 7fa22a57a740 1 -- 172.21.15.80:0/4292552910 wait complete. 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 -- start start 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 Processor -- start 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d14550 0x5642080e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d3d410 0x5642080f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5642080ea970 con 0x564207d14550 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564207fdd5d0 con 0x564207d1c730 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5642080eaaf0 con 0x564207d3d410 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa22a57a740 10 client.0 _ll_register_callbacks cb 0x564207fcb080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d14550 0x5642080e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d14550 0x5642080e7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36710/0 (socket says 172.21.15.80:36710) 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa220c65640 1 -- 172.21.15.80:0/570581333 learned_addr learned my addr 172.21.15.80:0/570581333 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:31.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.897+0000 7fa221466640 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa220c65640 1 -- 172.21.15.80:0/570581333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d3d410 msgr2=0x5642080f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa220c65640 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d3d410 0x5642080f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa220c65640 1 -- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 msgr2=0x5642080e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa220c65640 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa220c65640 1 -- 172.21.15.80:0/570581333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564207e7df70 con 0x564207d14550 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa221466640 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa220c65640 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d14550 0x5642080e7c40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa20c005750 tx=0x7fa20c004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dfb8522ffdf52f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa204ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa204ff9640 1 -- 172.21.15.80:0/570581333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0053b0 con 0x564207d14550 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa204ff9640 1 -- 172.21.15.80:0/570581333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7fa20c01f470 con 0x564207d14550 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa20c0047a0 con 0x564207d14550 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa204ff9640 1 -- 172.21.15.80:0/570581333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa20c01f670 con 0x564207d14550 2024-04-25T11:33:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa22a57a740 10 client.17757 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564207d15170 con 0x564207d14550 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa204ff9640 1 -- 172.21.15.80:0/570581333 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20c0047a0 con 0x564207d14550 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa204ff9640 1 -- 172.21.15.80:0/570581333 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fa20c027750 con 0x564207d14550 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa22a57a740 10 client.17757 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa22a57a740 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.898+0000 7fa22a57a740 20 client.17757 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.899+0000 7fa22a57a740 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cfc1f0 0x5642080f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.899+0000 7fa22a57a740 4 client.17757 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.899+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564208051710 con 0x564207cfc1f0 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.899+0000 7fa221466640 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cfc1f0 0x5642080f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.899+0000 7fa204ff9640 10 client.17757 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.899+0000 7fa221466640 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cfc1f0 0x5642080f9e70 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17f02cc2d2551393 server_cookie=c7a04560b7e565 in_seq=0 out_seq=0 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa204ff9640 1 -- 172.21.15.80:0/570581333 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564208051710 con 0x564207cfc1f0 2024-04-25T11:33:31.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa204ff9640 10 client.17757 handle_command_reply: tid=0 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 client.17757 shutdown 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d14550 msgr2=0x5642080e7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d14550 0x5642080e7c40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa20c005750 tx=0x7fa20c004f30 comp rx=0 tx=0).stop 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 shutdown_connections 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cfc1f0 0x5642080f9e70 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d3d410 0x5642080f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 --2- 172.21.15.80:0/570581333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d14550 0x5642080e7c40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa204ff9640 0 client.17757 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 >> 172.21.15.80:0/570581333 conn(0x564207d31560 msgr2=0x5642080df340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 shutdown_connections 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.900+0000 7fa22a57a740 1 -- 172.21.15.80:0/570581333 wait complete. 2024-04-25T11:33:31.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.901+0000 7fa22a57a740 20 client.17757 trim_cache size 0 max 16384 2024-04-25T11:33:31.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 Processor -- start 2024-04-25T11:33:31.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 -- start start 2024-04-25T11:33:31.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080e2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x5642080ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1b88d0 con 0x564207d3d410 2024-04-25T11:33:31.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1b61a0 con 0x564207d1c730 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa22a57a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1b4010 con 0x564207d14550 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x5642080ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x5642080ffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36712/0 (socket says 172.21.15.80:36712) 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 -- 172.21.15.80:0/342499271 learned_addr learned my addr 172.21.15.80:0/342499271 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa221466640 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080e2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 -- 172.21.15.80:0/342499271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 msgr2=0x5642080e2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080e2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 -- 172.21.15.80:0/342499271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 msgr2=0x5642080ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.919+0000 7fa220c65640 1 -- 172.21.15.80:0/342499271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642080e26b0 con 0x564207d3d410 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.920+0000 7fa220c65640 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x5642080ffa10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa20c015040 tx=0x7fa20c00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d45893dab92200 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.920+0000 7fa206ffd640 1 -- 172.21.15.80:0/342499271 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c034070 con 0x564207d3d410 2024-04-25T11:33:31.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.920+0000 7fa206ffd640 1 -- 172.21.15.80:0/342499271 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20c016070 con 0x564207d3d410 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.920+0000 7fa206ffd640 1 -- 172.21.15.80:0/342499271 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c01f810 con 0x564207d3d410 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.920+0000 7fa22a57a740 1 -- 172.21.15.80:0/342499271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 msgr2=0x5642080ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.920+0000 7fa22a57a740 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x5642080ffa10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa20c015040 tx=0x7fa20c00b4c0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- 172.21.15.80:0/342499271 shutdown_connections 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x5642080ffa10 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 --2- 172.21.15.80:0/342499271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- 172.21.15.80:0/342499271 >> 172.21.15.80:0/342499271 conn(0x564207d31560 msgr2=0x5642080e9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- 172.21.15.80:0/342499271 shutdown_connections 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- 172.21.15.80:0/342499271 wait complete. 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- start start 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 Processor -- start 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ead40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080eb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x564208160070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1b4660 con 0x564207d3d410 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1b5ad0 con 0x564207d1c730 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1b4d30 con 0x564207d14550 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.921+0000 7fa22a57a740 10 client.0 _ll_register_callbacks cb 0x7fa20c012590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x564208160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x564208160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36726/0 (socket says 172.21.15.80:36726) 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 -- 172.21.15.80:0/3086029544 learned_addr learned my addr 172.21.15.80:0/3086029544 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa221466640 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080eb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 -- 172.21.15.80:0/3086029544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 msgr2=0x5642080ead40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ead40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 -- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 msgr2=0x5642080eb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080eb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 -- 172.21.15.80:0/3086029544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642080ebad0 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa220c65640 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x564208160070 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa20c027c90 tx=0x7fa20c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf5fc2fbf27d53c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa204ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa204ff9640 1 -- 172.21.15.80:0/3086029544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c034040 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa20c016070 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa204ff9640 1 -- 172.21.15.80:0/3086029544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7fa20c02a2d0 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa204ff9640 1 -- 172.21.15.80:0/3086029544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa20c0051b0 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa22a57a740 10 client.17763 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564208161600 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.922+0000 7fa204ff9640 1 -- 172.21.15.80:0/3086029544 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20c016070 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa204ff9640 1 -- 172.21.15.80:0/3086029544 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fa20c0275d0 con 0x564207d3d410 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa22a57a740 10 client.17763 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa22a57a740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa22a57a740 20 client.17763 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa22a57a740 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cd1630 0x564208163c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa22a57a740 4 client.17763 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:33:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56420804b580 con 0x564207cd1630 2024-04-25T11:33:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa221466640 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cd1630 0x564208163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa221466640 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cd1630 0x564208163c70 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea9d305441437ca server_cookie=2b2ae390ecd9aa7e in_seq=0 out_seq=0 2024-04-25T11:33:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.923+0000 7fa204ff9640 10 client.17763 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa204ff9640 1 -- 172.21.15.80:0/3086029544 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56420804b580 con 0x564207cd1630 2024-04-25T11:33:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa204ff9640 10 client.17763 handle_command_reply: tid=0 2024-04-25T11:33:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 client.17763 shutdown 2024-04-25T11:33:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 msgr2=0x564208160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x564208160070 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa20c027c90 tx=0x7fa20c000bc0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 shutdown_connections 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x564207cd1630 0x564208163c70 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa204ff9640 0 client.17763 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564207d3d410 0x564208160070 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564207d1c730 0x5642080eb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 --2- 172.21.15.80:0/3086029544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564207d14550 0x5642080ead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 >> 172.21.15.80:0/3086029544 conn(0x564207d31560 msgr2=0x5642080e1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 shutdown_connections 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 1 -- 172.21.15.80:0/3086029544 wait complete. 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa22a57a740 20 client.17763 trim_cache size 0 max 16384 2024-04-25T11:33:31.920 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:33:31.921 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:33:31.921 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "4a7fc048-e2f4-4905-a47a-63fc2d46c465", 2024-04-25T11:33:31.921 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:33:31.921 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa2080afc60 msgr2=0x7fa2080b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.925+0000 7fa2236ca640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa2080afc60 0x7fa2080b2170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa2140fdda0 tx=0x7fa2140bd030 comp rx=0 tx=0).stop 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 msgr2=0x7fa21c1a5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c1a5560 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa214005cc0 tx=0x7fa21402f380 comp rx=0 tx=0).stop 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 shutdown_connections 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fa2080afc60 0x7fa2080b2170 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa21c107e20 0x7fa21c1a5560 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21c107440 0x7fa21c1a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 --2- 172.21.15.80:0/1186980183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21c1029f0 0x7fa21c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 >> 172.21.15.80:0/1186980183 conn(0x7fa21c0fe260 msgr2=0x7fa21c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 shutdown_connections 2024-04-25T11:33:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:31.926+0000 7fa2236ca640 1 -- 172.21.15.80:0/1186980183 wait complete. 2024-04-25T11:33:31.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:33:31.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:33:32.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 -- 172.21.15.80:0/1852638130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3410d380 msgr2=0x7fde3410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 --2- 172.21.15.80:0/1852638130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3410d380 0x7fde3410f7a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009ca0 tx=0x7fde2c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 -- 172.21.15.80:0/1852638130 shutdown_connections 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 --2- 172.21.15.80:0/1852638130 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3410d380 0x7fde3410f7a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 --2- 172.21.15.80:0/1852638130 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde34102af0 0x7fde34102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 --2- 172.21.15.80:0/1852638130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34108a20 0x7fde341025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 -- 172.21.15.80:0/1852638130 >> 172.21.15.80:0/1852638130 conn(0x7fde34078100 msgr2=0x7fde34078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 -- 172.21.15.80:0/1852638130 shutdown_connections 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.046+0000 7fde38e49640 1 -- 172.21.15.80:0/1852638130 wait complete. 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 Processor -- start 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 -- start start 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34102af0 0x7fde3419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34108a20 0x7fde3419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde3410d380 0x7fde3419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fde34112c00 con 0x7fde34108a20 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde34112a80 con 0x7fde34102af0 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde38e49640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fde34112d80 con 0x7fde3410d380 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde31d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34108a20 0x7fde3419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde31d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34108a20 0x7fde3419ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36736/0 (socket says 172.21.15.80:36736) 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde31d9b640 1 -- 172.21.15.80:0/1756202063 learned_addr learned my addr 172.21.15.80:0/1756202063 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde3259c640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34102af0 0x7fde3419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.047+0000 7fde32d9d640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde3410d380 0x7fde3419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde31d9b640 1 -- 172.21.15.80:0/1756202063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde3410d380 msgr2=0x7fde3419bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde31d9b640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde3410d380 0x7fde3419bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde31d9b640 1 -- 172.21.15.80:0/1756202063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34102af0 msgr2=0x7fde3419b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde31d9b640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34102af0 0x7fde3419b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde31d9b640 1 -- 172.21.15.80:0/1756202063 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde341a67c0 con 0x7fde34108a20 2024-04-25T11:33:32.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde3259c640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34102af0 0x7fde3419b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:32.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde31d9b640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34108a20 0x7fde3419ba80 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fde24005d00 tx=0x7fde2400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:32.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde237fe640 1 -- 172.21.15.80:0/1756202063 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24017070 con 0x7fde34108a20 2024-04-25T11:33:32.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde341a6ab0 con 0x7fde34108a20 2024-04-25T11:33:32.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde237fe640 1 -- 172.21.15.80:0/1756202063 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde24009c30 con 0x7fde34108a20 2024-04-25T11:33:32.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde237fe640 1 -- 172.21.15.80:0/1756202063 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2400f620 con 0x7fde34108a20 2024-04-25T11:33:32.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.048+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde341a6fb0 con 0x7fde34108a20 2024-04-25T11:33:32.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 Processor -- start 2024-04-25T11:33:32.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 -- start start 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde237fe640 1 -- 172.21.15.80:0/1756202063 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fde2401a070 con 0x7fde34108a20 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3c8390 0x55e67a768a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a39f4d0 0x55e67a768fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a3a76b0 0x55e67a7758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e67a6ced80 con 0x55e67a39f4d0 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e67a6888b0 con 0x55e67a3c8390 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e67a6cad40 con 0x55e67a3a76b0 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a39f4d0 0x55e67a768fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a39f4d0 0x55e67a768fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36750/0 (socket says 172.21.15.80:36750) 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde3259c640 1 -- 172.21.15.80:0/3273372814 learned_addr learned my addr 172.21.15.80:0/3273372814 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde32d9d640 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3c8390 0x55e67a768a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.051+0000 7fde31d9b640 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a3a76b0 0x55e67a7758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde3259c640 1 -- 172.21.15.80:0/3273372814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a3a76b0 msgr2=0x55e67a7758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde3259c640 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a3a76b0 0x55e67a7758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde3259c640 1 -- 172.21.15.80:0/3273372814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3c8390 msgr2=0x55e67a768a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde3259c640 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3c8390 0x55e67a768a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde3259c640 1 -- 172.21.15.80:0/3273372814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67a659a40 con 0x55e67a39f4d0 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde237fe640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fde1c0afc60 0x7fde1c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde32d9d640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fde1c0afc60 0x7fde1c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde3259c640 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a39f4d0 0x55e67a768fa0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fde28008ba0 tx=0x7fde2800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be32e2d904e68f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde237fe640 1 -- 172.21.15.80:0/1756202063 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7fde240deba0 con 0x7fde34108a20 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde20ff9640 1 -- 172.21.15.80:0/3273372814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28014070 con 0x55e67a39f4d0 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde20ff9640 1 -- 172.21.15.80:0/3273372814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde280047a0 con 0x55e67a39f4d0 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.052+0000 7fde20ff9640 1 -- 172.21.15.80:0/3273372814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28010690 con 0x55e67a39f4d0 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3273372814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a39f4d0 msgr2=0x55e67a768fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde32d9d640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fde1c0afc60 0x7fde1c0b2170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55e67a769b60 tx=0x7fde2c005c30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a39f4d0 0x55e67a768fa0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fde28008ba0 tx=0x7fde2800e720 comp rx=0 tx=0).stop 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3273372814 shutdown_connections 2024-04-25T11:33:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a39f4d0 0x55e67a768fa0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a3a76b0 0x55e67a7758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3273372814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3c8390 0x55e67a768a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3273372814 >> 172.21.15.80:0/3273372814 conn(0x55e67a3bc4e0 msgr2=0x55e67a765210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3273372814 shutdown_connections 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.053+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3273372814 wait complete. 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 -- start start 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 Processor -- start 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a7735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a773af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3c8390 0x55e67a77f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e67a775fe0 con 0x55e67a3c8390 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e67a655d10 con 0x55e67a3a76b0 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e67a776160 con 0x55e67a39f4d0 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3fdd1740 10 client.0 _ll_register_callbacks cb 0x55e67a682210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3c8390 0x55e67a77f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3c8390 0x55e67a77f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36754/0 (socket says 172.21.15.80:36754) 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 -- 172.21.15.80:0/592108340 learned_addr learned my addr 172.21.15.80:0/592108340 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3259c640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a7735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde31d9b640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a773af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 -- 172.21.15.80:0/592108340 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 msgr2=0x55e67a7735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a7735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 -- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 msgr2=0x55e67a773af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a773af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 -- 172.21.15.80:0/592108340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67a4aa7d0 con 0x55e67a3c8390 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde31d9b640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a773af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde3259c640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a7735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde32d9d640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3c8390 0x55e67a77f460 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009ca0 tx=0x7fde2c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44adf076dc91b63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.054+0000 7fde19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde19ffb640 1 -- 172.21.15.80:0/592108340 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c003c40 con 0x55e67a3c8390 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde19ffb640 1 -- 172.21.15.80:0/592108340 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7fde2c003de0 con 0x55e67a3c8390 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde280047a0 con 0x55e67a3c8390 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde19ffb640 1 -- 172.21.15.80:0/592108340 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fde2c004040 con 0x55e67a3c8390 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 10 client.17775 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e67a3e03f0 con 0x55e67a3c8390 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde19ffb640 1 -- 172.21.15.80:0/592108340 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde280047a0 con 0x55e67a3c8390 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde19ffb640 1 -- 172.21.15.80:0/592108340 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fde2c051070 con 0x55e67a3c8390 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 10 client.17775 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 10 client.17775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 20 client.17775 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a386f60 0x55e67a785650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 4 client.17775 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e67a6dc990 con 0x55e67a386f60 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.055+0000 7fde3259c640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a386f60 0x55e67a785650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.056+0000 7fde19ffb640 10 client.17775 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.056+0000 7fde3259c640 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a386f60 0x55e67a785650 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8868f6bd249c1f8 server_cookie=82667b53a2bdb1f0 in_seq=0 out_seq=0 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde19ffb640 1 -- 172.21.15.80:0/592108340 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e67a6dc990 con 0x55e67a386f60 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde19ffb640 10 client.17775 handle_command_reply: tid=0 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 client.17775 shutdown 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3c8390 msgr2=0x55e67a77f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3c8390 0x55e67a77f460 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009ca0 tx=0x7fde2c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 shutdown_connections 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a386f60 0x55e67a785650 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3c8390 0x55e67a77f460 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a773af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde19ffb640 0 client.17775 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/592108340 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a7735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 >> 172.21.15.80:0/592108340 conn(0x55e67a3bc4e0 msgr2=0x55e67a76a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 shutdown_connections 2024-04-25T11:33:32.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 1 -- 172.21.15.80:0/592108340 wait complete. 2024-04-25T11:33:32.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.057+0000 7fde3fdd1740 20 client.17775 trim_cache size 0 max 16384 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 Processor -- start 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 -- start start 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a772ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a77b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fde341b22f0 con 0x55e67a3bc4e0 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde341afbc0 con 0x55e67a3a76b0 2024-04-25T11:33:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fde341ada30 con 0x55e67a39f4d0 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a772ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a772ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36770/0 (socket says 172.21.15.80:36770) 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 -- 172.21.15.80:0/3143944117 learned_addr learned my addr 172.21.15.80:0/3143944117 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 -- 172.21.15.80:0/3143944117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 msgr2=0x55e67a77b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 --2- 172.21.15.80:0/3143944117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 -- 172.21.15.80:0/3143944117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 msgr2=0x55e67a77b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 --2- 172.21.15.80:0/3143944117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a77b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 -- 172.21.15.80:0/3143944117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67a3a00f0 con 0x55e67a3bc4e0 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde3259c640 1 --2- 172.21.15.80:0/3143944117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a772ff0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fde2800f010 tx=0x7fde280084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda7e8999e938ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.075+0000 7fde1bfff640 1 -- 172.21.15.80:0/3143944117 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28014030 con 0x55e67a3bc4e0 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde1bfff640 1 -- 172.21.15.80:0/3143944117 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde28025e50 con 0x55e67a3bc4e0 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde1bfff640 1 -- 172.21.15.80:0/3143944117 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde280035f0 con 0x55e67a3bc4e0 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3143944117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 msgr2=0x55e67a772ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3143944117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a772ff0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fde2800f010 tx=0x7fde280084c0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3143944117 shutdown_connections 2024-04-25T11:33:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3143944117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a77b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3143944117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/3143944117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a772ff0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3143944117 >> 172.21.15.80:0/3143944117 conn(0x55e67a768fc0 msgr2=0x55e67a7728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3143944117 shutdown_connections 2024-04-25T11:33:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.076+0000 7fde3fdd1740 1 -- 172.21.15.80:0/3143944117 wait complete. 2024-04-25T11:33:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 -- start start 2024-04-25T11:33:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 Processor -- start 2024-04-25T11:33:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a776a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a776f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fde341ae080 con 0x55e67a3bc4e0 2024-04-25T11:33:32.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde341af4f0 con 0x55e67a3a76b0 2024-04-25T11:33:32.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fde341ae750 con 0x55e67a39f4d0 2024-04-25T11:33:32.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3fdd1740 10 client.0 _ll_register_callbacks cb 0x7fde2c009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:33:32.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a776f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a776f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36784/0 (socket says 172.21.15.80:36784) 2024-04-25T11:33:32.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 -- 172.21.15.80:0/2480095391 learned_addr learned my addr 172.21.15.80:0/2480095391 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3259c640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde31d9b640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a776a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 -- 172.21.15.80:0/2480095391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 msgr2=0x55e67a77b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 -- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 msgr2=0x55e67a776a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a776a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 -- 172.21.15.80:0/2480095391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67a68f4b0 con 0x55e67a3bc4e0 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde3259c640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde31d9b640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a776a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde32d9d640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a776f60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fde2c005cc0 tx=0x7fde2c032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9932c49d45981d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:33:32.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.077+0000 7fde19ffb640 1 -- 172.21.15.80:0/2480095391 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0041e0 con 0x55e67a3bc4e0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde19ffb640 1 -- 172.21.15.80:0/2480095391 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7fde2c004380 con 0x55e67a3bc4e0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde28025e50 con 0x55e67a3bc4e0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde19ffb640 1 -- 172.21.15.80:0/2480095391 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fde2c06a050 con 0x55e67a3bc4e0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 10 client.17781 fetch_fsmap learned FSMap version 24 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e67a7ed3f0 con 0x55e67a3bc4e0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde19ffb640 1 -- 172.21.15.80:0/2480095391 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde28025e50 con 0x55e67a3bc4e0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde19ffb640 1 -- 172.21.15.80:0/2480095391 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fde2c062020 con 0x55e67a3bc4e0 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 10 client.17781 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:33:32.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 10 client.17781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 20 client.17781 populate_metadata read hostname 'smithi080' 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a3c8390 0x55e67a7efb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 4 client.17781 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e67a6d6800 con 0x55e67a3c8390 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.078+0000 7fde3259c640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a3c8390 0x55e67a7efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde19ffb640 10 client.17781 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3259c640 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a3c8390 0x55e67a7efb70 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20daf8398c51d21f server_cookie=5175fbd96bfc7387 in_seq=0 out_seq=0 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde19ffb640 1 -- 172.21.15.80:0/2480095391 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e67a6d6800 con 0x55e67a3c8390 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde19ffb640 10 client.17781 handle_command_reply: tid=0 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 client.17781 shutdown 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 msgr2=0x55e67a776f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a776f60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fde2c005cc0 tx=0x7fde2c032fe0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 shutdown_connections 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e67a3c8390 0x55e67a7efb70 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e67a3bc4e0 0x55e67a776f60 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e67a3a76b0 0x55e67a776a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde19ffb640 0 client.17781 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 --2- 172.21.15.80:0/2480095391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67a39f4d0 0x55e67a77b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 >> 172.21.15.80:0/2480095391 conn(0x55e67a768fc0 msgr2=0x55e67a76a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 shutdown_connections 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 1 -- 172.21.15.80:0/2480095391 wait complete. 2024-04-25T11:33:32.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.079+0000 7fde3fdd1740 20 client.17781 trim_cache size 0 max 16384 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "4a7fc048-e2f4-4905-a47a-63fc2d46c465": { 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "4a7fc048-e2f4-4905-a47a-63fc2d46c465", 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:33:32.078 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:33:32.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fde1c0afc60 msgr2=0x7fde1c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fde1c0afc60 0x7fde1c0b2170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55e67a769b60 tx=0x7fde2c005c30 comp rx=0 tx=0).stop 2024-04-25T11:33:32.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34108a20 msgr2=0x7fde3419ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:33:32.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34108a20 0x7fde3419ba80 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fde24005d00 tx=0x7fde2400dde0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 shutdown_connections 2024-04-25T11:33:32.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fde1c0afc60 0x7fde1c0b2170 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde34108a20 0x7fde3419ba80 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde3410d380 0x7fde3419bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 --2- 172.21.15.80:0/1756202063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde34102af0 0x7fde3419b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:33:32.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 >> 172.21.15.80:0/1756202063 conn(0x7fde34078100 msgr2=0x7fde341040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:33:32.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 shutdown_connections 2024-04-25T11:33:32.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:33:32.080+0000 7fde38e49640 1 -- 172.21.15.80:0/1756202063 wait complete. 2024-04-25T11:33:32.081 INFO:tasks.cephfs.filesystem:scrub status for tag:4a7fc048-e2f4-4905-a47a-63fc2d46c465 - {'path': '/', 'tag': '4a7fc048-e2f4-4905-a47a-63fc2d46c465', 'options': 'recursive,force'} 2024-04-25T11:33:32.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:32 smithi196 ceph-mon[32659]: pgmap v288: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:32.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:32 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:33:32.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:32 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:32.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:32 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:33:32.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:32 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:32.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:32 smithi082 ceph-mon[32440]: pgmap v288: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:32.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:32 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:33:32.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:32 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:32.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:32 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:33:32.740 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:32 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:32 smithi080 ceph-mon[29126]: pgmap v288: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:32 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:33:32.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:32 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:32.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:32 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:33:32.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:32 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:33:33.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:33 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:33:33.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:33 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:33:33.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:33 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:33:34.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:34 smithi196 ceph-mon[32659]: pgmap v289: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:34.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:34 smithi082 ceph-mon[32440]: pgmap v289: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:34.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:34 smithi080 ceph-mon[29126]: pgmap v289: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:36.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:36 smithi196 ceph-mon[32659]: pgmap v290: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:36.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:36 smithi082 ceph-mon[32440]: pgmap v290: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:36.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:36 smithi080 ceph-mon[29126]: pgmap v290: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:38.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:38 smithi082 ceph-mon[32440]: pgmap v291: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:38.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:38 smithi080 ceph-mon[29126]: pgmap v291: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:38.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:38 smithi196 ceph-mon[32659]: pgmap v291: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:40.737 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:40 smithi196 ceph-mon[32659]: pgmap v292: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:40.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:40 smithi082 ceph-mon[32440]: pgmap v292: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:40.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:40 smithi080 ceph-mon[29126]: pgmap v292: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:42.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:42 smithi082 ceph-mon[32440]: pgmap v293: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:42.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:42 smithi080 ceph-mon[29126]: pgmap v293: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:42.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:42 smithi196 ceph-mon[32659]: pgmap v293: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:44.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:44 smithi082 ceph-mon[32440]: pgmap v294: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:44.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:44 smithi080 ceph-mon[29126]: pgmap v294: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:44.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:44 smithi196 ceph-mon[32659]: pgmap v294: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:46.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:46 smithi082 ceph-mon[32440]: pgmap v295: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:46.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:46 smithi080 ceph-mon[29126]: pgmap v295: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:46.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:46 smithi196 ceph-mon[32659]: pgmap v295: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-04-25T11:33:48.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:48 smithi082 ceph-mon[32440]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:48.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:48 smithi080 ceph-mon[29126]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:48.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:48 smithi196 ceph-mon[32659]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-04-25T11:33:50.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:50 smithi082 ceph-mon[32440]: pgmap v297: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:50.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:50 smithi080 ceph-mon[29126]: pgmap v297: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:50.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:50 smithi196 ceph-mon[32659]: pgmap v297: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:52.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:52 smithi082 ceph-mon[32440]: pgmap v298: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:52.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:52 smithi080 ceph-mon[29126]: pgmap v298: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:52.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:52 smithi196 ceph-mon[32659]: pgmap v298: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:54.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:54 smithi082 ceph-mon[32440]: pgmap v299: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:54.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:54 smithi080 ceph-mon[29126]: pgmap v299: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:54.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:54 smithi196 ceph-mon[32659]: pgmap v299: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:56.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:56 smithi082 ceph-mon[32440]: pgmap v300: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:56.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:56 smithi080 ceph-mon[29126]: pgmap v300: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:56.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:56 smithi196 ceph-mon[32659]: pgmap v300: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:33:58.739 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:33:58 smithi082 ceph-mon[32440]: pgmap v301: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:58.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:33:58 smithi080 ceph-mon[29126]: pgmap v301: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:33:58.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:33:58 smithi196 ceph-mon[32659]: pgmap v301: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:00.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:00 smithi082 ceph-mon[32440]: pgmap v302: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:00.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:00 smithi080 ceph-mon[29126]: pgmap v302: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:00.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:00 smithi196 ceph-mon[32659]: pgmap v302: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:02.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:34:02.082 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:34:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 -- 172.21.15.80:0/890563927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 msgr2=0x7ff4d4110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/890563927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d4110990 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009ca0 tx=0x7ff4cc02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 -- 172.21.15.80:0/890563927 shutdown_connections 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/890563927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d4110990 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/890563927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d4102070 0x7ff4d4102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/890563927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4109bc0 0x7ff4d4101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 -- 172.21.15.80:0/890563927 >> 172.21.15.80:0/890563927 conn(0x7ff4d4077920 msgr2=0x7ff4d4077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 -- 172.21.15.80:0/890563927 shutdown_connections 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.214+0000 7ff4dc06e640 1 -- 172.21.15.80:0/890563927 wait complete. 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 Processor -- start 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 -- start start 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4102070 0x7ff4d419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d4109bc0 0x7ff4d419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d4113d30 con 0x7ff4d410e570 2024-04-25T11:34:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d4113bb0 con 0x7ff4d4102070 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4dc06e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d4113eb0 con 0x7ff4d4109bc0 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4da60b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4da60b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d419ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39952/0 (socket says 172.21.15.80:39952) 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4da60b640 1 -- 172.21.15.80:0/131400799 learned_addr learned my addr 172.21.15.80:0/131400799 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.215+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4102070 0x7ff4d419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4d9609640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d4109bc0 0x7ff4d419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4da60b640 1 -- 172.21.15.80:0/131400799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d4109bc0 msgr2=0x7ff4d419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4da60b640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d4109bc0 0x7ff4d419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4da60b640 1 -- 172.21.15.80:0/131400799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4102070 msgr2=0x7ff4d419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4da60b640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4102070 0x7ff4d419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4da60b640 1 -- 172.21.15.80:0/131400799 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d419f590 con 0x7ff4d410e570 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4d9609640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d4109bc0 0x7ff4d419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4da60b640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d419ef50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009430 tx=0x7ff4cc0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4caffd640 1 -- 172.21.15.80:0/131400799 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003b70 con 0x7ff4d410e570 2024-04-25T11:34:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4caffd640 1 -- 172.21.15.80:0/131400799 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4cc003d10 con 0x7ff4d410e570 2024-04-25T11:34:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d419f820 con 0x7ff4d410e570 2024-04-25T11:34:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4caffd640 1 -- 172.21.15.80:0/131400799 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc02fb20 con 0x7ff4d410e570 2024-04-25T11:34:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.216+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d419fd70 con 0x7ff4d410e570 2024-04-25T11:34:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 Processor -- start 2024-04-25T11:34:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4caffd640 1 -- 172.21.15.80:0/131400799 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff4cc004580 con 0x7ff4d410e570 2024-04-25T11:34:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 -- start start 2024-04-25T11:34:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfee390 0x5604dd38e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfc54d0 0x5604dd38ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5604dd2f4d80 con 0x5604dcfcd6b0 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5604dd2ae8b0 con 0x5604dcfee390 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4e3001740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5604dd2f0d40 con 0x5604dcfc54d0 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4d9609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4caffd640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4c00afc60 0x7ff4c00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4d9609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39964/0 (socket says 172.21.15.80:39964) 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4d9609640 1 -- 172.21.15.80:0/1801918772 learned_addr learned my addr 172.21.15.80:0/1801918772 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4d9609640 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfee390 0x5604dd38e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.219+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfc54d0 0x5604dd38ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4da60b640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4c00afc60 0x7ff4c00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4caffd640 1 -- 172.21.15.80:0/131400799 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7ff4cc1003a0 con 0x7ff4d410e570 2024-04-25T11:34:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4d9609640 1 -- 172.21.15.80:0/1801918772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfc54d0 msgr2=0x5604dd38ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4d9609640 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfc54d0 0x5604dd38ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4d9609640 1 -- 172.21.15.80:0/1801918772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfee390 msgr2=0x5604dd38e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4d9609640 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfee390 0x5604dd38e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4d9609640 1 -- 172.21.15.80:0/1801918772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604dd27fa40 con 0x5604dcfcd6b0 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4d9609640 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fd00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000cfd0 tx=0x7ff4d000c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eb2bb8f95da7ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4da60b640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4c00afc60 0x7ff4c00b2170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0fdc90 tx=0x7ff4cc0bcf20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4bffff640 1 -- 172.21.15.80:0/1801918772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0005220 con 0x5604dcfcd6b0 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4bffff640 1 -- 172.21.15.80:0/1801918772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d0004c50 con 0x5604dcfcd6b0 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.220+0000 7ff4bffff640 1 -- 172.21.15.80:0/1801918772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000fa50 con 0x5604dcfcd6b0 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 -- 172.21.15.80:0/1801918772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 msgr2=0x5604dd39fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fd00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000cfd0 tx=0x7ff4d000c540 comp rx=0 tx=0).stop 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 -- 172.21.15.80:0/1801918772 shutdown_connections 2024-04-25T11:34:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fd00 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfc54d0 0x5604dd38ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 --2- 172.21.15.80:0/1801918772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfee390 0x5604dd38e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 -- 172.21.15.80:0/1801918772 >> 172.21.15.80:0/1801918772 conn(0x5604dcfe24e0 msgr2=0x5604dd38b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 -- 172.21.15.80:0/1801918772 shutdown_connections 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.221+0000 7ff4e3001740 1 -- 172.21.15.80:0/1801918772 wait complete. 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 -- start start 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 Processor -- start 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd3a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5604dd3a03f0 con 0x5604dcfc54d0 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5604dd27bd10 con 0x5604dcfcd6b0 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5604dd3a0570 con 0x5604dcfee390 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4e3001740 10 client.0 _ll_register_callbacks cb 0x5604dd2a8210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4d9609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4d9609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39972/0 (socket says 172.21.15.80:39972) 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4d9609640 1 -- 172.21.15.80:0/3763908945 learned_addr learned my addr 172.21.15.80:0/3763908945 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.222+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4d9609640 1 -- 172.21.15.80:0/3763908945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 msgr2=0x5604dd3a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4d9609640 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd3a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4d9609640 1 -- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 msgr2=0x5604dd39df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4d9609640 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4d9609640 1 -- 172.21.15.80:0/3763908945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604dd0d07d0 con 0x5604dcfc54d0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4d9609640 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39d9c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0005790 tx=0x7ff4d000ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c53e7e3ffec08cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/3763908945 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0005450 con 0x5604dcfc54d0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/3763908945 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7ff4d000f7d0 con 0x5604dcfc54d0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4d0004c50 con 0x5604dcfc54d0 2024-04-25T11:34:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/3763908945 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff4d000f9d0 con 0x5604dcfc54d0 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4e3001740 10 client.17793 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604dd0063f0 con 0x5604dcfc54d0 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/3763908945 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d0004c50 con 0x5604dcfc54d0 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/3763908945 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff4d001d020 con 0x5604dcfc54d0 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4e3001740 10 client.17793 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4e3001740 10 client.17793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.223+0000 7ff4e3001740 20 client.17793 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.224+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcfacf60 0x5604dd3af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.224+0000 7ff4e3001740 4 client.17793 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.224+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604dd302990 con 0x5604dcfacf60 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.224+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcfacf60 0x5604dd3af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.224+0000 7ff4bd7fa640 10 client.17793 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.224+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcfacf60 0x5604dd3af980 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b8209cdbe9bffe3 server_cookie=635d9fb4a1cb35d8 in_seq=0 out_seq=0 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.225+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/3763908945 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5604dd302990 con 0x5604dcfacf60 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.225+0000 7ff4bd7fa640 10 client.17793 handle_command_reply: tid=0 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.225+0000 7ff4e3001740 1 client.17793 shutdown 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.225+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 msgr2=0x5604dd39d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.225+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39d9c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0005790 tx=0x7ff4d000ca00 comp rx=0 tx=0).stop 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 shutdown_connections 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcfacf60 0x5604dd3af980 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd3a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3763908945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39d9c0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4bd7fa640 0 client.17793 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 >> 172.21.15.80:0/3763908945 conn(0x5604dcfe24e0 msgr2=0x5604dd390780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 shutdown_connections 2024-04-25T11:34:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 1 -- 172.21.15.80:0/3763908945 wait complete. 2024-04-25T11:34:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.226+0000 7ff4e3001740 20 client.17793 trim_cache size 0 max 16384 2024-04-25T11:34:02.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.243+0000 7ff4e3001740 1 Processor -- start 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.243+0000 7ff4e3001740 1 -- start start 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd3a5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4e3001740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d41b0140 con 0x5604dcfc54d0 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4e3001740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d41ada10 con 0x5604dcfcd6b0 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4e3001740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d41ab880 con 0x5604dcfee390 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39982/0 (socket says 172.21.15.80:39982) 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 -- 172.21.15.80:0/3935643104 learned_addr learned my addr 172.21.15.80:0/3935643104 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 -- 172.21.15.80:0/3935643104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 msgr2=0x5604dd3a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd3a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 -- 172.21.15.80:0/3935643104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 msgr2=0x5604dd39fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 -- 172.21.15.80:0/3935643104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604dcfc60f0 con 0x5604dcfc54d0 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4d9609640 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39f5e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0000c00 tx=0x7ff4d0013960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2178c9cc7f1795 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4bf7fe640 1 -- 172.21.15.80:0/3935643104 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0038030 con 0x5604dcfc54d0 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4bf7fe640 1 -- 172.21.15.80:0/3935643104 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d0027030 con 0x5604dcfc54d0 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.244+0000 7ff4bf7fe640 1 -- 172.21.15.80:0/3935643104 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0005230 con 0x5604dcfc54d0 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 -- 172.21.15.80:0/3935643104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 msgr2=0x5604dd39f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39f5e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0000c00 tx=0x7ff4d0013960 comp rx=0 tx=0).stop 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 -- 172.21.15.80:0/3935643104 shutdown_connections 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd3a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfcd6b0 0x5604dd39fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 --2- 172.21.15.80:0/3935643104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfc54d0 0x5604dd39f5e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 -- 172.21.15.80:0/3935643104 >> 172.21.15.80:0/3935643104 conn(0x5604dcfe24e0 msgr2=0x5604dd39eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 -- 172.21.15.80:0/3935643104 shutdown_connections 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 -- 172.21.15.80:0/3935643104 wait complete. 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 -- start start 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.245+0000 7ff4e3001740 1 Processor -- start 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfc54d0 0x5604dd3a0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd3a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4e3001740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd415bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4e3001740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d41abed0 con 0x5604dcfcd6b0 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4e3001740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d41ad340 con 0x5604dcfc54d0 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4e3001740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d41ac5a0 con 0x5604dcfee390 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4e3001740 10 client.0 _ll_register_callbacks cb 0x7ff4d000cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd3a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd3a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39998/0 (socket says 172.21.15.80:39998) 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 -- 172.21.15.80:0/758799205 learned_addr learned my addr 172.21.15.80:0/758799205 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9609640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfc54d0 0x5604dd3a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9609640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd415bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 -- 172.21.15.80:0/758799205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 msgr2=0x5604dd415bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd415bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 -- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfc54d0 msgr2=0x5604dd3a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfc54d0 0x5604dd3a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 -- 172.21.15.80:0/758799205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604dd2b54b0 con 0x5604dcfcd6b0 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9609640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfc54d0 0x5604dd3a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4d9e0a640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd3a0d90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4000c00 tx=0x7ff4c4012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d391a532b34693 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.246+0000 7ff4bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/758799205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4004230 con 0x5604dcfcd6b0 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/758799205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7ff4c40043d0 con 0x5604dcfcd6b0 2024-04-25T11:34:02.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4d0027030 con 0x5604dcfcd6b0 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/758799205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff4c402f050 con 0x5604dcfcd6b0 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 10 client.17799 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604dd416f10 con 0x5604dcfcd6b0 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/758799205 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d0027030 con 0x5604dcfcd6b0 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/758799205 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff4c40202d0 con 0x5604dcfcd6b0 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 10 client.17799 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 10 client.17799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 20 client.17799 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcf823a0 0x5604dd419700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 4 client.17799 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:34:02.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5604dd39ce60 con 0x5604dcf823a0 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.247+0000 7ff4d9609640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcf823a0 0x5604dd419700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4bd7fa640 10 client.17799 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4d9609640 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcf823a0 0x5604dd419700 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b44e76284715d0 server_cookie=389123ef9f58f0b3 in_seq=0 out_seq=0 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4bd7fa640 1 -- 172.21.15.80:0/758799205 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5604dd39ce60 con 0x5604dcf823a0 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4bd7fa640 10 client.17799 handle_command_reply: tid=0 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 client.17799 shutdown 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 msgr2=0x5604dd3a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd3a0d90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4000c00 tx=0x7ff4c4012820 comp rx=0 tx=0).stop 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 shutdown_connections 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5604dcf823a0 0x5604dd419700 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5604dcfcd6b0 0x5604dd3a0d90 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604dcfee390 0x5604dd415bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4bd7fa640 0 client.17799 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 --2- 172.21.15.80:0/758799205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604dcfc54d0 0x5604dd3a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 >> 172.21.15.80:0/758799205 conn(0x5604dcfe24e0 msgr2=0x5604dd39c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 shutdown_connections 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 1 -- 172.21.15.80:0/758799205 wait complete. 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.248+0000 7ff4e3001740 20 client.17799 trim_cache size 0 max 16384 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:02.245 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:34:02.246 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:34:02.246 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4c00afc60 msgr2=0x7ff4c00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4c00afc60 0x7ff4c00b2170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0fdc90 tx=0x7ff4cc0bcf20 comp rx=0 tx=0).stop 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 msgr2=0x7ff4d419ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d419ef50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009430 tx=0x7ff4cc0316f0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 shutdown_connections 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff4c00afc60 0x7ff4c00b2170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4d410e570 0x7ff4d419ef50 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4d4109bc0 0x7ff4d419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 --2- 172.21.15.80:0/131400799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d4102070 0x7ff4d419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 >> 172.21.15.80:0/131400799 conn(0x7ff4d4077920 msgr2=0x7ff4d4105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 shutdown_connections 2024-04-25T11:34:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.249+0000 7ff4dc06e640 1 -- 172.21.15.80:0/131400799 wait complete. 2024-04-25T11:34:02.249 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:34:02.249 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:34:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 -- 172.21.15.80:0/2837311046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 msgr2=0x7f3da410f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/2837311046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da410f7c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009ca0 tx=0x7f3d9c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 -- 172.21.15.80:0/2837311046 shutdown_connections 2024-04-25T11:34:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/2837311046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da410f7c0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/2837311046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da4102b60 0x7f3da4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/2837311046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da4108a40 0x7f3da4102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 -- 172.21.15.80:0/2837311046 >> 172.21.15.80:0/2837311046 conn(0x7f3da4078040 msgr2=0x7f3da4078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 -- 172.21.15.80:0/2837311046 shutdown_connections 2024-04-25T11:34:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.368+0000 7f3da8f9d640 1 -- 172.21.15.80:0/2837311046 wait complete. 2024-04-25T11:34:02.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 Processor -- start 2024-04-25T11:34:02.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 -- start start 2024-04-25T11:34:02.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da4102b60 0x7f3da419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da4108a40 0x7f3da419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4113d20 con 0x7f3da410d3a0 2024-04-25T11:34:02.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4113ba0 con 0x7f3da4102b60 2024-04-25T11:34:02.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da8f9d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4113ea0 con 0x7f3da4108a40 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da419eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40024/0 (socket says 172.21.15.80:40024) 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 -- 172.21.15.80:0/1602617473 learned_addr learned my addr 172.21.15.80:0/1602617473 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da259c640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da4102b60 0x7f3da419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da1d9b640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da4108a40 0x7f3da419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 -- 172.21.15.80:0/1602617473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da4108a40 msgr2=0x7f3da419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da4108a40 0x7f3da419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 -- 172.21.15.80:0/1602617473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da4102b60 msgr2=0x7f3da419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da4102b60 0x7f3da419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 -- 172.21.15.80:0/1602617473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da419f4e0 con 0x7f3da410d3a0 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.369+0000 7f3da2d9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da419eea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0098d0 tx=0x7f3d9c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.370+0000 7f3d937fe640 1 -- 172.21.15.80:0/1602617473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c003b70 con 0x7f3da410d3a0 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.370+0000 7f3d937fe640 1 -- 172.21.15.80:0/1602617473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d9c003d10 con 0x7f3da410d3a0 2024-04-25T11:34:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.370+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da419f770 con 0x7f3da410d3a0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.370+0000 7f3d937fe640 1 -- 172.21.15.80:0/1602617473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c02fa20 con 0x7f3da410d3a0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.370+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da41a7150 con 0x7f3da410d3a0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.371+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da406a190 con 0x7f3da410d3a0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.372+0000 7f3d937fe640 1 -- 172.21.15.80:0/1602617473 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f3d9c02fbe0 con 0x7f3da410d3a0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.373+0000 7f3d937fe640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3d8c0afce0 0x7f3d8c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.373+0000 7f3da259c640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3d8c0afce0 0x7f3d8c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.373+0000 7f3d937fe640 1 -- 172.21.15.80:0/1602617473 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f3d9c1005f0 con 0x7f3da410d3a0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.373+0000 7f3da259c640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3d8c0afce0 0x7f3d8c0b21f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d94005fd0 tx=0x7f3d9400b390 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.376+0000 7f3d937fe640 1 -- 172.21.15.80:0/1602617473 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3d9c0c8f80 con 0x7f3da410d3a0 2024-04-25T11:34:02.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.594+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3da419b9d0 con 0x7f3da410d3a0 2024-04-25T11:34:02.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.594+0000 7f3d937fe640 1 -- 172.21.15.80:0/1602617473 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f3d9c0c8880 con 0x7f3da410d3a0 2024-04-25T11:34:02.584 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:34:02.584 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:34:02.584 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3d8c0afce0 msgr2=0x7f3d8c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3d8c0afce0 0x7f3d8c0b21f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d94005fd0 tx=0x7f3d9400b390 comp rx=0 tx=0).stop 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 msgr2=0x7f3da419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da419eea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0098d0 tx=0x7f3d9c0317b0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 shutdown_connections 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3d8c0afce0 0x7f3d8c0b21f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da410d3a0 0x7f3da419eea0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da4108a40 0x7f3da419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 --2- 172.21.15.80:0/1602617473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da4102b60 0x7f3da419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 >> 172.21.15.80:0/1602617473 conn(0x7f3da4078040 msgr2=0x7f3da41040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 shutdown_connections 2024-04-25T11:34:02.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.597+0000 7f3da8f9d640 1 -- 172.21.15.80:0/1602617473 wait complete. 2024-04-25T11:34:02.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.718+0000 7f1bc8197640 1 -- 172.21.15.80:0/2447628041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0103280 msgr2=0x7f1bc0103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 --2- 172.21.15.80:0/2447628041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0103280 0x7f1bc0103690 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009900 tx=0x7f1bb402a410 comp rx=0 tx=0).stop 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 -- 172.21.15.80:0/2447628041 shutdown_connections 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 --2- 172.21.15.80:0/2447628041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0103280 0x7f1bc0103690 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 --2- 172.21.15.80:0/2447628041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc010d3a0 0x7f1bc010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 --2- 172.21.15.80:0/2447628041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bc0108a40 0x7f1bc0102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 -- 172.21.15.80:0/2447628041 >> 172.21.15.80:0/2447628041 conn(0x7f1bc0077880 msgr2=0x7f1bc0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 -- 172.21.15.80:0/2447628041 shutdown_connections 2024-04-25T11:34:02.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 -- 172.21.15.80:0/2447628041 wait complete. 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 Processor -- start 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.719+0000 7f1bc8197640 1 -- start start 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc0103280 0x7f1bc019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0108a40 0x7f1bc019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bc010d3a0 0x7f1bc019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0112c00 con 0x7f1bc0108a40 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0112a80 con 0x7f1bc010d3a0 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0112d80 con 0x7f1bc0103280 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0108a40 0x7f1bc019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0108a40 0x7f1bc019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40046/0 (socket says 172.21.15.80:40046) 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 -- 172.21.15.80:0/1049175518 learned_addr learned my addr 172.21.15.80:0/1049175518 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc6734640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bc010d3a0 0x7f1bc019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc0103280 0x7f1bc019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 -- 172.21.15.80:0/1049175518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc0103280 msgr2=0x7f1bc019b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc0103280 0x7f1bc019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 -- 172.21.15.80:0/1049175518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bc010d3a0 msgr2=0x7f1bc019c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bc010d3a0 0x7f1bc019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 -- 172.21.15.80:0/1049175518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc01a6970 con 0x7f1bc0108a40 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc5732640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0108a40 0x7f1bc019bba0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4006010 tx=0x7f1bb4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bbeffd640 1 -- 172.21.15.80:0/1049175518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb403f030 con 0x7f1bc0108a40 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bbeffd640 1 -- 172.21.15.80:0/1049175518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bb4003aa0 con 0x7f1bc0108a40 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc01a6c00 con 0x7f1bc0108a40 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bbeffd640 1 -- 172.21.15.80:0/1049175518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4035070 con 0x7f1bc0108a40 2024-04-25T11:34:02.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.720+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc01a70f0 con 0x7f1bc0108a40 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 Processor -- start 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 -- start start 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bbeffd640 1 -- 172.21.15.80:0/1049175518 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f1bb4042030 con 0x7f1bc0108a40 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36108810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da36108d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55da3606dd80 con 0x55da35d3e4d0 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da36027a20 con 0x55da35d466b0 2024-04-25T11:34:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.723+0000 7f1bcf045740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55da36069d40 con 0x55da35d67390 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da36108d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da36108d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40062/0 (socket says 172.21.15.80:40062) 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 -- 172.21.15.80:0/3550842980 learned_addr learned my addr 172.21.15.80:0/3550842980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc6734640 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36108810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5732640 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 -- 172.21.15.80:0/3550842980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 msgr2=0x55da36108810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36108810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 -- 172.21.15.80:0/3550842980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 msgr2=0x55da361156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 -- 172.21.15.80:0/3550842980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da36032c30 con 0x55da35d3e4d0 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5732640 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da36108d50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009c00 tx=0x7f1bb8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1439b4c16062f1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bbeffd640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1ba80afc60 0x7f1ba80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1ba7fff640 1 -- 172.21.15.80:0/3550842980 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8004020 con 0x55da35d3e4d0 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bc6734640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1ba80afc60 0x7f1ba80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1ba7fff640 1 -- 172.21.15.80:0/3550842980 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bb80041c0 con 0x55da35d3e4d0 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1bbeffd640 1 -- 172.21.15.80:0/1049175518 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f1bb40ff5e0 con 0x7f1bc0108a40 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.724+0000 7f1ba7fff640 1 -- 172.21.15.80:0/3550842980 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80126b0 con 0x55da35d3e4d0 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 -- 172.21.15.80:0/3550842980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 msgr2=0x55da36108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bc6734640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1ba80afc60 0x7f1ba80b2170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55da36105980 tx=0x7f1bb00093c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da36108d50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009c00 tx=0x7f1bb8010740 comp rx=0 tx=0).stop 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 -- 172.21.15.80:0/3550842980 shutdown_connections 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da36108d50 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 --2- 172.21.15.80:0/3550842980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 -- 172.21.15.80:0/3550842980 >> 172.21.15.80:0/3550842980 conn(0x55da35d5b4e0 msgr2=0x55da36104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 -- 172.21.15.80:0/3550842980 shutdown_connections 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.725+0000 7f1bcf045740 1 -- 172.21.15.80:0/3550842980 wait complete. 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 -- start start 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 Processor -- start 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d3e4d0 0x55da361132b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d67390 0x55da3611f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55da36115d90 con 0x55da35d67390 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da35ff4dc0 con 0x55da35d466b0 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55da36115f10 con 0x55da35d3e4d0 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bcf045740 10 client.0 _ll_register_callbacks cb 0x55da36010600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.726+0000 7f1bc6734640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d67390 0x55da3611f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d67390 0x55da3611f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40074/0 (socket says 172.21.15.80:40074) 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 -- 172.21.15.80:0/4023224661 learned_addr learned my addr 172.21.15.80:0/4023224661 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d3e4d0 0x55da361132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc5732640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 -- 172.21.15.80:0/4023224661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d3e4d0 msgr2=0x55da361132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d3e4d0 0x55da361132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 -- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 msgr2=0x55da361137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 -- 172.21.15.80:0/4023224661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da35d7f3f0 con 0x55da35d67390 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d3e4d0 0x55da361132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc5732640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bc6734640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d67390 0x55da3611f210 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0012010 tx=0x7f1bb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc7747f00456e6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1ba57fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1ba57fa640 1 -- 172.21.15.80:0/4023224661 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000f9a0 con 0x55da35d67390 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1ba57fa640 1 -- 172.21.15.80:0/4023224661 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f1bb000fb40 con 0x55da35d67390 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bb80041c0 con 0x55da35d67390 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1ba57fa640 1 -- 172.21.15.80:0/4023224661 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bb000fd40 con 0x55da35d67390 2024-04-25T11:34:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bcf045740 10 client.17817 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da35e497d0 con 0x55da35d67390 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.727+0000 7f1ba57fa640 1 -- 172.21.15.80:0/4023224661 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bb80041c0 con 0x55da35d67390 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1ba57fa640 1 -- 172.21.15.80:0/4023224661 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1bb0027500 con 0x55da35d67390 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bcf045740 10 client.17817 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bcf045740 10 client.17817 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bcf045740 20 client.17817 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35d25f60 0x55da36125750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bcf045740 4 client.17817 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da3607b990 con 0x55da35d25f60 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35d25f60 0x55da36125750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1ba57fa640 10 client.17817 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.728+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35d25f60 0x55da36125750 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53af1161c68188c4 server_cookie=c9505f2dd1f32aa3 in_seq=0 out_seq=0 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1ba57fa640 1 -- 172.21.15.80:0/4023224661 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55da3607b990 con 0x55da35d25f60 2024-04-25T11:34:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1ba57fa640 10 client.17817 handle_command_reply: tid=0 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1bcf045740 1 client.17817 shutdown 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d67390 msgr2=0x55da3611f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d67390 0x55da3611f210 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0012010 tx=0x7f1bb0004a40 comp rx=0 tx=0).stop 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 shutdown_connections 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35d25f60 0x55da36125750 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.729+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d67390 0x55da3611f210 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.730+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d466b0 0x55da361137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.730+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4023224661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d3e4d0 0x55da361132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.730+0000 7f1ba57fa640 0 client.17817 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.730+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 >> 172.21.15.80:0/4023224661 conn(0x55da35d5b4e0 msgr2=0x55da3610a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.730+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 shutdown_connections 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.730+0000 7f1bcf045740 1 -- 172.21.15.80:0/4023224661 wait complete. 2024-04-25T11:34:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.730+0000 7f1bcf045740 20 client.17817 trim_cache size 0 max 16384 2024-04-25T11:34:02.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 Processor -- start 2024-04-25T11:34:02.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 -- start start 2024-04-25T11:34:02.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d3e4d0 0x55da3610d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d466b0 0x55da36112850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36103d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01b23b0 con 0x55da35d466b0 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01afc80 con 0x55da35d3e4d0 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.743+0000 7f1bcf045740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01adaf0 con 0x55da35d67390 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d466b0 0x55da36112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d466b0 0x55da36112850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40078/0 (socket says 172.21.15.80:40078) 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 -- 172.21.15.80:0/4088440570 learned_addr learned my addr 172.21.15.80:0/4088440570 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d3e4d0 0x55da3610d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc6734640 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36103d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 -- 172.21.15.80:0/4088440570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 msgr2=0x55da36103d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36103d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 -- 172.21.15.80:0/4088440570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d3e4d0 msgr2=0x55da3610d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d3e4d0 0x55da3610d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 -- 172.21.15.80:0/4088440570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da361115f0 con 0x55da35d466b0 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d3e4d0 0x55da3610d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1bc5732640 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d466b0 0x55da36112850 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40c7460 tx=0x7f1bb402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7b84ca26ab73a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1ba77fe640 1 -- 172.21.15.80:0/4088440570 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4049070 con 0x55da35d466b0 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1ba77fe640 1 -- 172.21.15.80:0/4088440570 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bb40c7270 con 0x55da35d466b0 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.744+0000 7f1ba77fe640 1 -- 172.21.15.80:0/4088440570 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40cbb10 con 0x55da35d466b0 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 -- 172.21.15.80:0/4088440570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d466b0 msgr2=0x55da36112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d466b0 0x55da36112850 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40c7460 tx=0x7f1bb402a410 comp rx=0 tx=0).stop 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 -- 172.21.15.80:0/4088440570 shutdown_connections 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d466b0 0x55da36112850 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d67390 0x55da36103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 --2- 172.21.15.80:0/4088440570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d3e4d0 0x55da3610d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 -- 172.21.15.80:0/4088440570 >> 172.21.15.80:0/4088440570 conn(0x55da35d5b4e0 msgr2=0x55da36103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 -- 172.21.15.80:0/4088440570 shutdown_connections 2024-04-25T11:34:02.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 -- 172.21.15.80:0/4088440570 wait complete. 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 -- start start 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.745+0000 7f1bcf045740 1 Processor -- start 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da3611b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d466b0 0x55da3611b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bcf045740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d67390 0x55da361168c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bcf045740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ae140 con 0x55da35d3e4d0 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bcf045740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01af5b0 con 0x55da35d67390 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bcf045740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ae810 con 0x55da35d466b0 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da3611b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bcf045740 10 client.0 _ll_register_callbacks cb 0x7f1bb00099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da3611b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40086/0 (socket says 172.21.15.80:40086) 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 -- 172.21.15.80:0/2586499631 learned_addr learned my addr 172.21.15.80:0/2586499631 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 -- 172.21.15.80:0/2586499631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d466b0 msgr2=0x55da3611b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d466b0 0x55da3611b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 -- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d67390 msgr2=0x55da361168c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc6734640 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d67390 0x55da361168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d67390 0x55da361168c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 -- 172.21.15.80:0/2586499631 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da36117050 con 0x55da35d3e4d0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc6734640 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d67390 0x55da361168c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1bc5f33640 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da3611b3a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8000c00 tx=0x7f1bb8009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce93229e814281b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.746+0000 7f1ba57fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1ba57fa640 1 -- 172.21.15.80:0/2586499631 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb802d060 con 0x55da35d3e4d0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1ba57fa640 1 -- 172.21.15.80:0/2586499631 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f1bb8003d80 con 0x55da35d3e4d0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bb40c7270 con 0x55da35d3e4d0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1ba57fa640 1 -- 172.21.15.80:0/2586499631 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bb8003fa0 con 0x55da35d3e4d0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 10 client.17823 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da3618d5e0 con 0x55da35d3e4d0 2024-04-25T11:34:02.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1ba57fa640 1 -- 172.21.15.80:0/2586499631 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bb40c7270 con 0x55da35d3e4d0 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1ba57fa640 1 -- 172.21.15.80:0/2586499631 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1bb800f040 con 0x55da35d3e4d0 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 10 client.17823 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 10 client.17823 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 20 client.17823 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35cfb3a0 0x55da3618fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 4 client.17823 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da36075800 con 0x55da35cfb3a0 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.747+0000 7f1bc5732640 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35cfb3a0 0x55da3618fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1ba57fa640 10 client.17823 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bc5732640 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35cfb3a0 0x55da3618fab0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf50245acfc7e4bc server_cookie=7a4d47f3662a2c95 in_seq=0 out_seq=0 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1ba57fa640 1 -- 172.21.15.80:0/2586499631 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da36075800 con 0x55da35cfb3a0 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1ba57fa640 10 client.17823 handle_command_reply: tid=0 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 client.17823 shutdown 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 msgr2=0x55da3611b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da3611b3a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8000c00 tx=0x7f1bb8009370 comp rx=0 tx=0).stop 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 shutdown_connections 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x55da35cfb3a0 0x55da3618fab0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da35d67390 0x55da361168c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da35d466b0 0x55da3611b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1ba57fa640 0 client.17823 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 --2- 172.21.15.80:0/2586499631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55da35d3e4d0 0x55da3611b3a0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 >> 172.21.15.80:0/2586499631 conn(0x55da35d5b4e0 msgr2=0x55da36114ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 shutdown_connections 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 1 -- 172.21.15.80:0/2586499631 wait complete. 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.748+0000 7f1bcf045740 20 client.17823 trim_cache size 0 max 16384 2024-04-25T11:34:02.744 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:34:02.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1ba80afc60 msgr2=0x7f1ba80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1ba80afc60 0x7f1ba80b2170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55da36105980 tx=0x7f1bb00093c0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0108a40 msgr2=0x7f1bc019bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0108a40 0x7f1bc019bba0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4006010 tx=0x7f1bb4004060 comp rx=0 tx=0).stop 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 shutdown_connections 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f1ba80afc60 0x7f1ba80b2170 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc0108a40 0x7f1bc019bba0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bc010d3a0 0x7f1bc019c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 --2- 172.21.15.80:0/1049175518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc0103280 0x7f1bc019b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 >> 172.21.15.80:0/1049175518 conn(0x7f1bc0077880 msgr2=0x7f1bc01040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 shutdown_connections 2024-04-25T11:34:02.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.749+0000 7f1bc8197640 1 -- 172.21.15.80:0/1049175518 wait complete. 2024-04-25T11:34:02.746 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:02 smithi082 ceph-mon[32440]: pgmap v303: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:02.748 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:02 smithi080 ceph-mon[29126]: pgmap v303: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:02.749 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:34:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 -- 172.21.15.80:0/1134834119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c102af0 msgr2=0x7ff67c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 --2- 172.21.15.80:0/1134834119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c102af0 0x7ff67c102f00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009900 tx=0x7ff66c02a410 comp rx=0 tx=0).stop 2024-04-25T11:34:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 -- 172.21.15.80:0/1134834119 shutdown_connections 2024-04-25T11:34:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 --2- 172.21.15.80:0/1134834119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c102af0 0x7ff67c102f00 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 --2- 172.21.15.80:0/1134834119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c10d380 0x7ff67c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 --2- 172.21.15.80:0/1134834119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c108a20 0x7ff67c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 -- 172.21.15.80:0/1134834119 >> 172.21.15.80:0/1134834119 conn(0x7ff67c078100 msgr2=0x7ff67c078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 -- 172.21.15.80:0/1134834119 shutdown_connections 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.869+0000 7ff683db2640 1 -- 172.21.15.80:0/1134834119 wait complete. 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 Processor -- start 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 -- start start 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c102af0 0x7ff67c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c108a20 0x7ff67c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c10d380 0x7ff67c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c111ae0 con 0x7ff67c10d380 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c111960 con 0x7ff67c108a20 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff683db2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c111c60 con 0x7ff67c102af0 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c10d380 0x7ff67c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c10d380 0x7ff67c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40102/0 (socket says 172.21.15.80:40102) 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 -- 172.21.15.80:0/3465396596 learned_addr learned my addr 172.21.15.80:0/3465396596 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff681b4e640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c102af0 0x7ff67c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68134d640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c108a20 0x7ff67c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 -- 172.21.15.80:0/3465396596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c102af0 msgr2=0x7ff67c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c102af0 0x7ff67c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 -- 172.21.15.80:0/3465396596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c108a20 msgr2=0x7ff67c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c108a20 0x7ff67c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.870+0000 7ff68234f640 1 -- 172.21.15.80:0/3465396596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c19d3a0 con 0x7ff67c10d380 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.871+0000 7ff68234f640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c10d380 0x7ff67c19cd60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ff674010f90 tx=0x7ff67400e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.871+0000 7ff672ffd640 1 -- 172.21.15.80:0/3465396596 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67401a030 con 0x7ff67c10d380 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.871+0000 7ff672ffd640 1 -- 172.21.15.80:0/3465396596 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff67400ed30 con 0x7ff67c10d380 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.871+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c19d690 con 0x7ff67c10d380 2024-04-25T11:34:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.871+0000 7ff672ffd640 1 -- 172.21.15.80:0/3465396596 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674005920 con 0x7ff67c10d380 2024-04-25T11:34:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.871+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c19db60 con 0x7ff67c10d380 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.874+0000 7ff68ac66740 1 Processor -- start 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.874+0000 7ff672ffd640 1 -- 172.21.15.80:0/3465396596 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff67401d070 con 0x7ff67c10d380 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.874+0000 7ff68ac66740 1 -- start start 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.874+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0888e390 0x55bf08c2f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.874+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c2fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0886d6b0 0x55bf08c3c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68ac66740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bf08b94d80 con 0x55bf0888e390 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68ac66740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf08b4ea20 con 0x55bf088654d0 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68ac66740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bf08b90d40 con 0x55bf0886d6b0 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0888e390 0x55bf08c2f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0888e390 0x55bf08c2f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40114/0 (socket says 172.21.15.80:40114) 2024-04-25T11:34:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 -- 172.21.15.80:0/2430374567 learned_addr learned my addr 172.21.15.80:0/2430374567 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff672ffd640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff6680afc60 0x7ff6680b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0886d6b0 0x55bf08c3c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff681b4e640 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c2fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68234f640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff6680afc60 0x7ff6680b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 -- 172.21.15.80:0/2430374567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0886d6b0 msgr2=0x55bf08c3c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0886d6b0 0x55bf08c3c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 -- 172.21.15.80:0/2430374567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 msgr2=0x55bf08c2fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c2fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 -- 172.21.15.80:0/2430374567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf08b59c30 con 0x55bf0888e390 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff681b4e640 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c2fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff672ffd640 1 -- 172.21.15.80:0/3465396596 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7ff6740e1400 con 0x7ff67c10d380 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff68134d640 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0888e390 0x55bf08c2f810 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009900 tx=0x7ff66c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ff080674d5628e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.875+0000 7ff667fff640 1 -- 172.21.15.80:0/2430374567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c044020 con 0x55bf0888e390 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff667fff640 1 -- 172.21.15.80:0/2430374567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff66c0314a0 con 0x55bf0888e390 2024-04-25T11:34:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68234f640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff6680afc60 0x7ff6680b2170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff6740a9510 tx=0x7ff67406fef0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff667fff640 1 -- 172.21.15.80:0/2430374567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c035040 con 0x55bf0888e390 2024-04-25T11:34:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68ac66740 1 -- 172.21.15.80:0/2430374567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0888e390 msgr2=0x55bf08c2f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0888e390 0x55bf08c2f810 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009900 tx=0x7ff66c000bc0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68ac66740 1 -- 172.21.15.80:0/2430374567 shutdown_connections 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0886d6b0 0x55bf08c3c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c2fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2430374567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0888e390 0x55bf08c2f810 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.876+0000 7ff68ac66740 1 -- 172.21.15.80:0/2430374567 >> 172.21.15.80:0/2430374567 conn(0x55bf088824e0 msgr2=0x55bf08c2bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 -- 172.21.15.80:0/2430374567 shutdown_connections 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 -- 172.21.15.80:0/2430374567 wait complete. 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 -- start start 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 Processor -- start 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c3a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c3a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c461b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bf08c3cd30 con 0x55bf088654d0 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf08b1bdc0 con 0x55bf0886d6b0 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bf08c3ceb0 con 0x55bf0888e390 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.877+0000 7ff68ac66740 10 client.0 _ll_register_callbacks cb 0x55bf08b37600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c3a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c3a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40130/0 (socket says 172.21.15.80:40130) 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 -- 172.21.15.80:0/3142653595 learned_addr learned my addr 172.21.15.80:0/3142653595 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff681b4e640 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c3a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 -- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 msgr2=0x55bf08c461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 -- 172.21.15.80:0/3142653595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 msgr2=0x55bf08c3a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c3a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 -- 172.21.15.80:0/3142653595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf088a63f0 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68134d640 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c3a310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff66c032fa0 tx=0x7ff66c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8141d5928d5403fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff6657fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff6657fa640 1 -- 172.21.15.80:0/3142653595 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c050060 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff6657fa640 1 -- 172.21.15.80:0/3142653595 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7ff66c031d10 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff66c0314a0 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff6657fa640 1 -- 172.21.15.80:0/3142653595 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff66c035040 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68ac66740 10 client.17835 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.878+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bf089707d0 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff6657fa640 1 -- 172.21.15.80:0/3142653595 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff66c0314a0 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff6657fa640 1 -- 172.21.15.80:0/3142653595 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff66c004b90 con 0x55bf088654d0 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff68ac66740 10 client.17835 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff68ac66740 10 client.17835 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff68ac66740 20 client.17835 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff68ac66740 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf0884cf60 0x55bf08c4c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff68ac66740 4 client.17835 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf08ba2990 con 0x55bf0884cf60 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.879+0000 7ff681b4e640 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf0884cf60 0x55bf08c4c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.880+0000 7ff6657fa640 10 client.17835 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.880+0000 7ff681b4e640 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf0884cf60 0x55bf08c4c520 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dde3584bf9e9de0f server_cookie=f6971c481b2ad3e3 in_seq=0 out_seq=0 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff6657fa640 1 -- 172.21.15.80:0/3142653595 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bf08ba2990 con 0x55bf0884cf60 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff6657fa640 10 client.17835 handle_command_reply: tid=0 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 client.17835 shutdown 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 msgr2=0x55bf08c3a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c3a310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff66c032fa0 tx=0x7ff66c005850 comp rx=0 tx=0).stop 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 shutdown_connections 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf0884cf60 0x55bf08c4c520 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c3a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 --2- 172.21.15.80:0/3142653595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c3a310 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff6657fa640 0 client.17835 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:02.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 >> 172.21.15.80:0/3142653595 conn(0x55bf088824e0 msgr2=0x55bf08c31530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 shutdown_connections 2024-04-25T11:34:02.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 1 -- 172.21.15.80:0/3142653595 wait complete. 2024-04-25T11:34:02.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.881+0000 7ff68ac66740 20 client.17835 trim_cache size 0 max 16384 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 Processor -- start 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 -- start start 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0886d6b0 0x55bf08c34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c34970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c1afe80 con 0x55bf0886d6b0 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c1ad750 con 0x55bf088654d0 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68ac66740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c1ab5c0 con 0x55bf0888e390 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0886d6b0 0x55bf08c34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0886d6b0 0x55bf08c34430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40134/0 (socket says 172.21.15.80:40134) 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 -- 172.21.15.80:0/2426851090 learned_addr learned my addr 172.21.15.80:0/2426851090 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 -- 172.21.15.80:0/2426851090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 msgr2=0x55bf08c34970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c34970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff68134d640 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 -- 172.21.15.80:0/2426851090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 msgr2=0x55bf08c461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 -- 172.21.15.80:0/2426851090 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf08c2cba0 con 0x55bf0886d6b0 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff681b4e640 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0886d6b0 0x55bf08c34430 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x55bf08c2cf50 tx=0x7ff678005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514d9681b4731fed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff6677fe640 1 -- 172.21.15.80:0/2426851090 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678003de0 con 0x55bf0886d6b0 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.895+0000 7ff6677fe640 1 -- 172.21.15.80:0/2426851090 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6780205a0 con 0x55bf0886d6b0 2024-04-25T11:34:02.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff6677fe640 1 -- 172.21.15.80:0/2426851090 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678010a40 con 0x55bf0886d6b0 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 -- 172.21.15.80:0/2426851090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0886d6b0 msgr2=0x55bf08c34430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0886d6b0 0x55bf08c34430 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x55bf08c2cf50 tx=0x7ff678005f90 comp rx=0 tx=0).stop 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 -- 172.21.15.80:0/2426851090 shutdown_connections 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf0886d6b0 0x55bf08c34430 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c34970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 --2- 172.21.15.80:0/2426851090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf088654d0 0x55bf08c461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 -- 172.21.15.80:0/2426851090 >> 172.21.15.80:0/2426851090 conn(0x55bf088824e0 msgr2=0x55bf08c2b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 -- 172.21.15.80:0/2426851090 shutdown_connections 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.896+0000 7ff68ac66740 1 -- 172.21.15.80:0/2426851090 wait complete. 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 -- start start 2024-04-25T11:34:02.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 Processor -- start 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c4f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c4fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c4cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c1abc10 con 0x55bf088654d0 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c1ad080 con 0x55bf0886d6b0 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c1ac2e0 con 0x55bf0888e390 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68ac66740 10 client.0 _ll_register_callbacks cb 0x7ff66c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c4f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c4f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40136/0 (socket says 172.21.15.80:40136) 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 -- 172.21.15.80:0/1800671679 learned_addr learned my addr 172.21.15.80:0/1800671679 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff681b4e640 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c4fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 -- 172.21.15.80:0/1800671679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 msgr2=0x55bf08c4cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c4cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 -- 172.21.15.80:0/1800671679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 msgr2=0x55bf08c4fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c4fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff68134d640 1 -- 172.21.15.80:0/1800671679 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf08c4d320 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.897+0000 7ff681b4e640 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c4fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68134d640 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c4f710 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff66c032140 tx=0x7ff66c02ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d121ebe64f888b23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff6657fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff6657fa640 1 -- 172.21.15.80:0/1800671679 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c050040 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff6657fa640 1 -- 172.21.15.80:0/1800671679 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7ff66c0328d0 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6780205a0 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff6657fa640 1 -- 172.21.15.80:0/1800671679 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff66c044040 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 10 client.17841 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bf08cb4170 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff6657fa640 1 -- 172.21.15.80:0/1800671679 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6780205a0 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff6657fa640 1 -- 172.21.15.80:0/1800671679 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff66c0046c0 con 0x55bf088654d0 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 10 client.17841 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 10 client.17841 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:34:02.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 20 client.17841 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf088223a0 0x55bf08cb6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 4 client.17841 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.898+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf08b9c800 con 0x55bf088223a0 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.899+0000 7ff681b4e640 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf088223a0 0x55bf08cb6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.899+0000 7ff6657fa640 10 client.17841 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.899+0000 7ff681b4e640 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf088223a0 0x55bf08cb6840 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f1544b0a64c7da37 server_cookie=12d4bdf3ceb31980 in_seq=0 out_seq=0 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.899+0000 7ff6657fa640 1 -- 172.21.15.80:0/1800671679 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf08b9c800 con 0x55bf088223a0 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.899+0000 7ff6657fa640 10 client.17841 handle_command_reply: tid=0 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.899+0000 7ff68ac66740 1 client.17841 shutdown 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.899+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 msgr2=0x55bf08c4f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c4f710 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff66c032140 tx=0x7ff66c02ab10 comp rx=0 tx=0).stop 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 shutdown_connections 2024-04-25T11:34:02.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55bf088223a0 0x55bf08cb6840 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bf0888e390 0x55bf08c4cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf0886d6b0 0x55bf08c4fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 --2- 172.21.15.80:0/1800671679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf088654d0 0x55bf08c4f710 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff6657fa640 0 client.17841 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 >> 172.21.15.80:0/1800671679 conn(0x55bf088824e0 msgr2=0x55bf08c2ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 shutdown_connections 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 1 -- 172.21.15.80:0/1800671679 wait complete. 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff68ac66740 20 client.17841 trim_cache size 0 max 16384 2024-04-25T11:34:02.895 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:34:02.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff6680afc60 msgr2=0x7ff6680b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff6680afc60 0x7ff6680b2170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff6740a9510 tx=0x7ff67406fef0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c10d380 msgr2=0x7ff67c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:02.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c10d380 0x7ff67c19cd60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ff674010f90 tx=0x7ff67400e490 comp rx=0 tx=0).stop 2024-04-25T11:34:02.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 shutdown_connections 2024-04-25T11:34:02.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff6680afc60 0x7ff6680b2170 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff67c10d380 0x7ff67c19cd60 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c108a20 0x7ff67c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 --2- 172.21.15.80:0/3465396596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c102af0 0x7ff67c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:02.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 >> 172.21.15.80:0/3465396596 conn(0x7ff67c078100 msgr2=0x7ff67c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:02.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 shutdown_connections 2024-04-25T11:34:02.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:02.900+0000 7ff683db2640 1 -- 172.21.15.80:0/3465396596 wait complete. 2024-04-25T11:34:02.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:34:02.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:02 smithi196 ceph-mon[32659]: pgmap v303: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:03.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 -- 172.21.15.80:0/2538242363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108a20 msgr2=0x7f8084102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 --2- 172.21.15.80:0/2538242363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108a20 0x7f8084102620 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f8078009900 tx=0x7f807802a410 comp rx=0 tx=0).stop 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 -- 172.21.15.80:0/2538242363 shutdown_connections 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 --2- 172.21.15.80:0/2538242363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80841031d0 0x7f808410f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 --2- 172.21.15.80:0/2538242363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8084108ec0 0x7f8084102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 --2- 172.21.15.80:0/2538242363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108a20 0x7f8084102620 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 -- 172.21.15.80:0/2538242363 >> 172.21.15.80:0/2538242363 conn(0x7f8084078180 msgr2=0x7f80840785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 -- 172.21.15.80:0/2538242363 shutdown_connections 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.021+0000 7f808bd7a640 1 -- 172.21.15.80:0/2538242363 wait complete. 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 Processor -- start 2024-04-25T11:34:03.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 -- start start 2024-04-25T11:34:03.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80841031d0 0x7f808419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8084108a20 0x7f808419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108ec0 0x7f808419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8084112c20 con 0x7f8084108ec0 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8084112aa0 con 0x7f80841031d0 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808bd7a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8084112da0 con 0x7f8084108a20 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108ec0 0x7f808419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108ec0 0x7f808419efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40142/0 (socket says 172.21.15.80:40142) 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 -- 172.21.15.80:0/4182534221 learned_addr learned my addr 172.21.15.80:0/4182534221 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f8089315640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8084108a20 0x7f808419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f8089b16640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80841031d0 0x7f808419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 -- 172.21.15.80:0/4182534221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8084108a20 msgr2=0x7f808419ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8084108a20 0x7f808419ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 -- 172.21.15.80:0/4182534221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80841031d0 msgr2=0x7f808419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80841031d0 0x7f808419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f808a317640 1 -- 172.21.15.80:0/4182534221 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808419f610 con 0x7f8084108ec0 2024-04-25T11:34:03.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.022+0000 7f8089b16640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80841031d0 0x7f808419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:03.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.023+0000 7f808a317640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108ec0 0x7f808419efd0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f807c00eaa0 tx=0x7f807c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:03.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.023+0000 7f8076ffd640 1 -- 172.21.15.80:0/4182534221 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c00cdb0 con 0x7f8084108ec0 2024-04-25T11:34:03.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.023+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808419f900 con 0x7f8084108ec0 2024-04-25T11:34:03.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.023+0000 7f8076ffd640 1 -- 172.21.15.80:0/4182534221 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f807c005020 con 0x7f8084108ec0 2024-04-25T11:34:03.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.023+0000 7f8076ffd640 1 -- 172.21.15.80:0/4182534221 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c0116d0 con 0x7f8084108ec0 2024-04-25T11:34:03.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.023+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808419fe00 con 0x7f8084108ec0 2024-04-25T11:34:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.026+0000 7f8092c1f740 1 Processor -- start 2024-04-25T11:34:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.026+0000 7f8076ffd640 1 -- 172.21.15.80:0/4182534221 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f807c0051d0 con 0x7f8084108ec0 2024-04-25T11:34:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.026+0000 7f8092c1f740 1 -- start start 2024-04-25T11:34:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.026+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559708584390 0x559708925700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.026+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708925c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597085636b0 0x559708936ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8092c1f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55970888ad80 con 0x55970855b4d0 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8092c1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559708844a20 con 0x5597085636b0 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8092c1f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559708886d40 con 0x559708584390 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708925c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708925c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40150/0 (socket says 172.21.15.80:40150) 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 -- 172.21.15.80:0/1535769289 learned_addr learned my addr 172.21.15.80:0/1535769289 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8076ffd640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f80700afc60 0x7f80700b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089315640 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559708584390 0x559708925700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089315640 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597085636b0 0x559708936ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f808a317640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f80700afc60 0x7f80700b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 -- 172.21.15.80:0/1535769289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559708584390 msgr2=0x559708925700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559708584390 0x559708925700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 -- 172.21.15.80:0/1535769289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597085636b0 msgr2=0x559708936ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597085636b0 0x559708936ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 -- 172.21.15.80:0/1535769289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55970884fc30 con 0x55970855b4d0 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8076ffd640 1 -- 172.21.15.80:0/4182534221 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f807c0df220 con 0x7f8084108ec0 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f8089b16640 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708925c40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8078031440 tx=0x7f8078032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf0be2f98ec59e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f808a317640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f80700afc60 0x7f80700b2170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f807c0a70a0 tx=0x7f807c0d5af0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.027+0000 7f806ffff640 1 -- 172.21.15.80:0/1535769289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807803f070 con 0x55970855b4d0 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f806ffff640 1 -- 172.21.15.80:0/1535769289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80780316a0 con 0x55970855b4d0 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f806ffff640 1 -- 172.21.15.80:0/1535769289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078035070 con 0x55970855b4d0 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 -- 172.21.15.80:0/1535769289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 msgr2=0x559708925c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708925c40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8078031440 tx=0x7f8078032d00 comp rx=0 tx=0).stop 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 -- 172.21.15.80:0/1535769289 shutdown_connections 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708925c40 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597085636b0 0x559708936ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1535769289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559708584390 0x559708925700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 -- 172.21.15.80:0/1535769289 >> 172.21.15.80:0/1535769289 conn(0x5597085784e0 msgr2=0x559708921fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.028+0000 7f8092c1f740 1 -- 172.21.15.80:0/1535769289 shutdown_connections 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 -- 172.21.15.80:0/1535769289 wait complete. 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 -- start start 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 Processor -- start 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55970855b4d0 0x5597089345b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559708584390 0x559708940680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559708937140 con 0x559708584390 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559708811dc0 con 0x55970855b4d0 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5597089372c0 con 0x5597085636b0 2024-04-25T11:34:03.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8092c1f740 10 client.0 _ll_register_callbacks cb 0x55970882d600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.029+0000 7f8089315640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559708584390 0x559708940680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559708584390 0x559708940680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40156/0 (socket says 172.21.15.80:40156) 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 -- 172.21.15.80:0/2590676826 learned_addr learned my addr 172.21.15.80:0/2590676826 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089b16640 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55970855b4d0 0x5597089345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 -- 172.21.15.80:0/2590676826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 msgr2=0x559708934af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 -- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55970855b4d0 msgr2=0x5597089345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55970855b4d0 0x5597089345b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 -- 172.21.15.80:0/2590676826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970859c3f0 con 0x559708584390 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8089315640 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559708584390 0x559708940680 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f808406c3f0 tx=0x7f80800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb4bb0191f3887c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f806d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f806d7fa640 1 -- 172.21.15.80:0/2590676826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080010be0 con 0x559708584390 2024-04-25T11:34:03.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f806d7fa640 1 -- 172.21.15.80:0/2590676826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f8080010d80 con 0x559708584390 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80780316a0 con 0x559708584390 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f806d7fa640 1 -- 172.21.15.80:0/2590676826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8080004030 con 0x559708584390 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8092c1f740 10 client.17853 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5597086667d0 con 0x559708584390 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.030+0000 7f806d7fa640 1 -- 172.21.15.80:0/2590676826 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80780316a0 con 0x559708584390 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f806d7fa640 1 -- 172.21.15.80:0/2590676826 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8080028420 con 0x559708584390 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8092c1f740 10 client.17853 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8092c1f740 10 client.17853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8092c1f740 20 client.17853 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8092c1f740 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559708542f60 0x559708946a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8092c1f740 4 client.17853 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559708898990 con 0x559708542f60 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8089b16640 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559708542f60 0x559708946a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f806d7fa640 10 client.17853 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.031+0000 7f8089b16640 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559708542f60 0x559708946a80 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c78d4762fa61a8cc server_cookie=33326a2118e2485a in_seq=0 out_seq=0 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f806d7fa640 1 -- 172.21.15.80:0/2590676826 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559708898990 con 0x559708542f60 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f806d7fa640 10 client.17853 handle_command_reply: tid=0 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 client.17853 shutdown 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559708584390 msgr2=0x559708940680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559708584390 0x559708940680 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f808406c3f0 tx=0x7f80800046c0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 shutdown_connections 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x559708542f60 0x559708946a80 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559708584390 0x559708940680 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f806d7fa640 0 client.17853 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 --2- 172.21.15.80:0/2590676826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55970855b4d0 0x5597089345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.032+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 >> 172.21.15.80:0/2590676826 conn(0x5597085784e0 msgr2=0x559708927530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.033+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 shutdown_connections 2024-04-25T11:34:03.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.033+0000 7f8092c1f740 1 -- 172.21.15.80:0/2590676826 wait complete. 2024-04-25T11:34:03.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.033+0000 7f8092c1f740 20 client.17853 trim_cache size 0 max 16384 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 Processor -- start 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 -- start start 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708922150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708920d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80841b0150 con 0x55970855b4d0 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80841ada20 con 0x559708584390 2024-04-25T11:34:03.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8092c1f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f80841ab890 con 0x5597085636b0 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8089315640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708922150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8089315640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708922150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40160/0 (socket says 172.21.15.80:40160) 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.046+0000 7f8089315640 1 -- 172.21.15.80:0/1028335863 learned_addr learned my addr 172.21.15.80:0/1028335863 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089b16640 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089315640 1 -- 172.21.15.80:0/1028335863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 msgr2=0x559708934c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089315640 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089315640 1 -- 172.21.15.80:0/1028335863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 msgr2=0x559708920d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089315640 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708920d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089315640 1 -- 172.21.15.80:0/1028335863 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597089328f0 con 0x55970855b4d0 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089b16640 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f8089315640 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708922150 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f808000bc80 tx=0x7f808000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32b7bc78aeba324 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f806f7fe640 1 -- 172.21.15.80:0/1028335863 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080005850 con 0x55970855b4d0 2024-04-25T11:34:03.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f806f7fe640 1 -- 172.21.15.80:0/1028335863 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80800120c0 con 0x55970855b4d0 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.047+0000 7f806f7fe640 1 -- 172.21.15.80:0/1028335863 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80800035f0 con 0x55970855b4d0 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 -- 172.21.15.80:0/1028335863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 msgr2=0x559708922150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708922150 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f808000bc80 tx=0x7f808000bcb0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 -- 172.21.15.80:0/1028335863 shutdown_connections 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708920d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5597085636b0 0x559708934c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 --2- 172.21.15.80:0/1028335863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55970855b4d0 0x559708922150 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 -- 172.21.15.80:0/1028335863 >> 172.21.15.80:0/1028335863 conn(0x5597085784e0 msgr2=0x559708920610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 -- 172.21.15.80:0/1028335863 shutdown_connections 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 -- 172.21.15.80:0/1028335863 wait complete. 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 -- start start 2024-04-25T11:34:03.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.048+0000 7f8092c1f740 1 Processor -- start 2024-04-25T11:34:03.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55970855b4d0 0x5597089375a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597085636b0 0x559708937ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708938020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80841abee0 con 0x5597085636b0 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80841ad350 con 0x559708584390 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f80841ac5b0 con 0x55970855b4d0 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 10 client.0 _ll_register_callbacks cb 0x7f8080012690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597085636b0 0x559708937ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597085636b0 0x559708937ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40176/0 (socket says 172.21.15.80:40176) 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 -- 172.21.15.80:0/3858672603 learned_addr learned my addr 172.21.15.80:0/3858672603 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089315640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708938020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089315640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55970855b4d0 0x5597089375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 -- 172.21.15.80:0/3858672603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55970855b4d0 msgr2=0x5597089375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55970855b4d0 0x5597089375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 -- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 msgr2=0x559708938020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708938020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 -- 172.21.15.80:0/3858672603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597089acf40 con 0x5597085636b0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089315640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708938020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8089b16640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597085636b0 0x559708937ae0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8078005380 tx=0x7f80780314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4ff0918136b056 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f806d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f806d7fa640 1 -- 172.21.15.80:0/3858672603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078055060 con 0x5597085636b0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f806d7fa640 1 -- 172.21.15.80:0/3858672603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f8078004240 con 0x5597085636b0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80800120c0 con 0x5597085636b0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f806d7fa640 1 -- 172.21.15.80:0/3858672603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f807803f040 con 0x5597085636b0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 10 client.17859 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.049+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5597089ae170 con 0x5597085636b0 2024-04-25T11:34:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f806d7fa640 1 -- 172.21.15.80:0/3858672603 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80800120c0 con 0x5597085636b0 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f806d7fa640 1 -- 172.21.15.80:0/3858672603 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8078003aa0 con 0x5597085636b0 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8092c1f740 10 client.17859 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8092c1f740 10 client.17859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8092c1f740 20 client.17859 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8092c1f740 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5597085183a0 0x5597089b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8092c1f740 4 client.17859 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559708892800 con 0x5597085183a0 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8089315640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5597085183a0 0x5597089b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f806d7fa640 10 client.17859 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.050+0000 7f8089315640 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5597085183a0 0x5597089b05d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ce2e0731271722d server_cookie=7d40de556687cdf0 in_seq=0 out_seq=0 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f806d7fa640 1 -- 172.21.15.80:0/3858672603 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559708892800 con 0x5597085183a0 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f806d7fa640 10 client.17859 handle_command_reply: tid=0 2024-04-25T11:34:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 client.17859 shutdown 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597085636b0 msgr2=0x559708937ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597085636b0 0x559708937ae0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8078005380 tx=0x7f80780314a0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 shutdown_connections 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x5597085183a0 0x5597089b05d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5597085636b0 0x559708937ae0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559708584390 0x559708938020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 --2- 172.21.15.80:0/3858672603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55970855b4d0 0x5597089375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f806d7fa640 0 client.17859 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 >> 172.21.15.80:0/3858672603 conn(0x5597085784e0 msgr2=0x559708920da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 shutdown_connections 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 1 -- 172.21.15.80:0/3858672603 wait complete. 2024-04-25T11:34:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f8092c1f740 20 client.17859 trim_cache size 0 max 16384 2024-04-25T11:34:03.048 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:34:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f80700afc60 msgr2=0x7f80700b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.051+0000 7f808bd7a640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f80700afc60 0x7f80700b2170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f807c0a70a0 tx=0x7f807c0d5af0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108ec0 msgr2=0x7f808419efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108ec0 0x7f808419efd0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f807c00eaa0 tx=0x7f807c00ef60 comp rx=0 tx=0).stop 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 shutdown_connections 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f80700afc60 0x7f80700b2170 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8084108ec0 0x7f808419efd0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8084108a20 0x7f808419ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 --2- 172.21.15.80:0/4182534221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80841031d0 0x7f808419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 >> 172.21.15.80:0/4182534221 conn(0x7f8084078180 msgr2=0x7f8084074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 shutdown_connections 2024-04-25T11:34:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:03.052+0000 7f808bd7a640 1 -- 172.21.15.80:0/4182534221 wait complete. 2024-04-25T11:34:03.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:03 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1602617473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:34:03.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:03 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1602617473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:34:03.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:03 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1602617473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:34:04.052 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T11:34:04.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:34:04.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T11:34:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 -- 172.21.15.80:0/2978761638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca4102af0 msgr2=0x7f9ca4102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 --2- 172.21.15.80:0/2978761638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca4102af0 0x7f9ca4102f00 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009900 tx=0x7f9c9402a410 comp rx=0 tx=0).stop 2024-04-25T11:34:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 -- 172.21.15.80:0/2978761638 shutdown_connections 2024-04-25T11:34:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 --2- 172.21.15.80:0/2978761638 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca4102af0 0x7f9ca4102f00 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 --2- 172.21.15.80:0/2978761638 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ca410d380 0x7f9ca410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 --2- 172.21.15.80:0/2978761638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca4108a20 0x7f9ca41025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 -- 172.21.15.80:0/2978761638 >> 172.21.15.80:0/2978761638 conn(0x7f9ca4078100 msgr2=0x7f9ca4078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 -- 172.21.15.80:0/2978761638 shutdown_connections 2024-04-25T11:34:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.187+0000 7f9cabd84640 1 -- 172.21.15.80:0/2978761638 wait complete. 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 Processor -- start 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 -- start start 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ca4102af0 0x7f9ca419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca4108a20 0x7f9ca419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca410d380 0x7f9ca419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4113d00 con 0x7f9ca410d380 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4113b80 con 0x7f9ca4108a20 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9cabd84640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4113e80 con 0x7f9ca4102af0 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca410d380 0x7f9ca419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca410d380 0x7f9ca419ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40206/0 (socket says 172.21.15.80:40206) 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 -- 172.21.15.80:0/1957509499 learned_addr learned my addr 172.21.15.80:0/1957509499 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9ca931f640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca4108a20 0x7f9ca419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ca4102af0 0x7f9ca419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 -- 172.21.15.80:0/1957509499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ca4102af0 msgr2=0x7f9ca419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ca4102af0 0x7f9ca419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 -- 172.21.15.80:0/1957509499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca4108a20 msgr2=0x7f9ca419ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca4108a20 0x7f9ca419ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.188+0000 7f9caa321640 1 -- 172.21.15.80:0/1957509499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca419f560 con 0x7f9ca410d380 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.189+0000 7f9caa321640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca410d380 0x7f9ca419ef20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00eaa0 tx=0x7f9c9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.189+0000 7f9c9affd640 1 -- 172.21.15.80:0/1957509499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c00cdb0 con 0x7f9ca410d380 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.189+0000 7f9c9affd640 1 -- 172.21.15.80:0/1957509499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c9c005020 con 0x7f9ca410d380 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.189+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca419f850 con 0x7f9ca410d380 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.189+0000 7f9c9affd640 1 -- 172.21.15.80:0/1957509499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0116d0 con 0x7f9ca410d380 2024-04-25T11:34:04.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.189+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41a71d0 con 0x7f9ca410d380 2024-04-25T11:34:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9c9affd640 1 -- 172.21.15.80:0/1957509499 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f9c9c0051d0 con 0x7f9ca410d380 2024-04-25T11:34:04.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 Processor -- start 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 -- start start 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093d14410 0x5570940b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093ceb550 0x5570940b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55709401ab00 con 0x557093d14410 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557093fb6920 con 0x557093ceb550 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557094016ac0 con 0x557093cf3730 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9ca931f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093d14410 0x5570940b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9ca931f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093d14410 0x5570940b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40210/0 (socket says 172.21.15.80:40210) 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9ca931f640 1 -- 172.21.15.80:0/79377461 learned_addr learned my addr 172.21.15.80:0/79377461 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093ceb550 0x5570940b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.192+0000 7f9c9affd640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c900afc60 0x7f9c900b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9ca931f640 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9caa321640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c900afc60 0x7f9c900b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9ca931f640 1 -- 172.21.15.80:0/79377461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 msgr2=0x5570940b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9ca931f640 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9ca931f640 1 -- 172.21.15.80:0/79377461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093ceb550 msgr2=0x5570940b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9ca931f640 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093ceb550 0x5570940b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9ca931f640 1 -- 172.21.15.80:0/79377461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557093df47e0 con 0x557093d14410 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9c9affd640 1 -- 172.21.15.80:0/1957509499 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f9c9c0df160 con 0x7f9ca410d380 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9ca931f640 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093d14410 0x5570940b4620 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f9ca406c4d0 tx=0x7f9c94000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8b35552888ea91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9c8ffff640 1 -- 172.21.15.80:0/79377461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94044020 con 0x557093d14410 2024-04-25T11:34:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9caa321640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c900afc60 0x7f9c900b2170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0dce90 tx=0x7f9c9c0d5a30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9c8ffff640 1 -- 172.21.15.80:0/79377461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c940316a0 con 0x557093d14410 2024-04-25T11:34:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.193+0000 7f9c8ffff640 1 -- 172.21.15.80:0/79377461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94035040 con 0x557093d14410 2024-04-25T11:34:04.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/79377461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093d14410 msgr2=0x5570940b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093d14410 0x5570940b4620 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f9ca406c4d0 tx=0x7f9c94000bc0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/79377461 shutdown_connections 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093ceb550 0x5570940b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/79377461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093d14410 0x5570940b4620 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/79377461 >> 172.21.15.80:0/79377461 conn(0x557093d08560 msgr2=0x5570940b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/79377461 shutdown_connections 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/79377461 wait complete. 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.194+0000 7f9cb2c3a740 1 -- start start 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 1 Processor -- start 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093d14410 0x5570940cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5570940c1910 con 0x557093ceb550 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557093fb45d0 con 0x557093d14410 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5570940c1a90 con 0x557093cf3730 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9cb2c3a740 10 client.0 _ll_register_callbacks cb 0x557093fa2080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940bec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40212/0 (socket says 172.21.15.80:40212) 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 -- 172.21.15.80:0/3184112755 learned_addr learned my addr 172.21.15.80:0/3184112755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 -- 172.21.15.80:0/3184112755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 msgr2=0x5570940bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 -- 172.21.15.80:0/3184112755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093d14410 msgr2=0x5570940cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093d14410 0x5570940cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.195+0000 7f9ca931f640 1 -- 172.21.15.80:0/3184112755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557093e54f70 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9ca931f640 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940bec40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402a930 tx=0x7f9c94005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05ead5b6e16f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9c8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/3184112755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9404d070 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/3184112755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f9c94004240 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c940316a0 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/3184112755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c94059050 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 10 client.17871 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557093cec170 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/3184112755 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c940316a0 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/3184112755 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9c940046c0 con 0x557093ceb550 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 10 client.17871 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 20 client.17871 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:04.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093cd31f0 0x5570940d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 4 client.17871 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.196+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557094028710 con 0x557093cd31f0 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.197+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093cd31f0 0x5570940d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.197+0000 7f9c8d7fa640 10 client.17871 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.197+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093cd31f0 0x5570940d0e10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4572ff31ebd5a84a server_cookie=10ebfb3ba5c664b5 in_seq=0 out_seq=0 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/3184112755 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557094028710 con 0x557093cd31f0 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9c8d7fa640 10 client.17871 handle_command_reply: tid=0 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 client.17871 shutdown 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 msgr2=0x5570940bec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940bec40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402a930 tx=0x7f9c94005850 comp rx=0 tx=0).stop 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 shutdown_connections 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093cd31f0 0x5570940d0e10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093d14410 0x5570940cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cf3730 0x5570940bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9c8d7fa640 0 client.17871 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/3184112755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940bec40 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 >> 172.21.15.80:0/3184112755 conn(0x557093d08560 msgr2=0x5570940b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 shutdown_connections 2024-04-25T11:34:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/3184112755 wait complete. 2024-04-25T11:34:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.198+0000 7f9cb2c3a740 20 client.17871 trim_cache size 0 max 16384 2024-04-25T11:34:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 Processor -- start 2024-04-25T11:34:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 -- start start 2024-04-25T11:34:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570940d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 0x5570940cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41b20e0 con 0x557093ceb550 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41af9b0 con 0x557093cf3730 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.216+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41ad820 con 0x557093cd31f0 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40224/0 (socket says 172.21.15.80:40224) 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1794075170 learned_addr learned my addr 172.21.15.80:0/1794075170 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1794075170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 msgr2=0x5570940d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/1794075170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570940d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1794075170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 msgr2=0x5570940cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/1794075170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 0x5570940cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1794075170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570940b5c10 con 0x557093ceb550 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/1794075170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940afbd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x5570940b1d60 tx=0x7f9ca0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2996888a8d63057e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9c8f7fe640 1 -- 172.21.15.80:0/1794075170 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0021020 con 0x557093ceb550 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9c8f7fe640 1 -- 172.21.15.80:0/1794075170 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca0003e40 con 0x557093ceb550 2024-04-25T11:34:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.217+0000 7f9c8f7fe640 1 -- 172.21.15.80:0/1794075170 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0011c00 con 0x557093ceb550 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1794075170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 msgr2=0x5570940afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1794075170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940afbd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x5570940b1d60 tx=0x7f9ca0005850 comp rx=0 tx=0).stop 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1794075170 shutdown_connections 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1794075170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x5570940afbd0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1794075170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 0x5570940cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1794075170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570940d4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1794075170 >> 172.21.15.80:0/1794075170 conn(0x557093d08560 msgr2=0x5570940af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1794075170 shutdown_connections 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1794075170 wait complete. 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 -- start start 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.218+0000 7f9cb2c3a740 1 Processor -- start 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570941356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x557094135c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 0x55709412fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41ade70 con 0x557093ceb550 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41af2e0 con 0x557093cf3730 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41ae540 con 0x557093cd31f0 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 10 client.0 _ll_register_callbacks cb 0x7f9c9402ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x557094135c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x557094135c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40234/0 (socket says 172.21.15.80:40234) 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1295239825 learned_addr learned my addr 172.21.15.80:0/1295239825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca931f640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 0x55709412fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1295239825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 msgr2=0x5570941356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca931f640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570941356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570941356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 msgr2=0x55709412fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 0x55709412fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 -- 172.21.15.80:0/1295239825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570941300c0 con 0x557093ceb550 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca931f640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570941356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9ca9b20640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x557094135c00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000b980 tx=0x7f9ca0011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c419ffcdfd766d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9c8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/1295239825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0021030 con 0x557093ceb550 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/1295239825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f9ca0011b80 con 0x557093ceb550 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.219+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ca0003e40 con 0x557093ceb550 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/1295239825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9ca0011660 con 0x557093ceb550 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 10 client.17877 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55709413cda0 con 0x557093ceb550 2024-04-25T11:34:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/1295239825 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca0003e40 con 0x557093ceb550 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/1295239825 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9ca001d830 con 0x557093ceb550 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 10 client.17877 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 10 client.17877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 20 client.17877 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093d14410 0x55709413f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 4 client.17877 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557094022580 con 0x557093d14410 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.220+0000 7f9ca931f640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093d14410 0x55709413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.221+0000 7f9c8d7fa640 10 client.17877 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.221+0000 7f9ca931f640 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093d14410 0x55709413f500 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f91a18d75c454672 server_cookie=c9818a7d89539ff6 in_seq=0 out_seq=0 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9c8d7fa640 1 -- 172.21.15.80:0/1295239825 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557094022580 con 0x557093d14410 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9c8d7fa640 10 client.17877 handle_command_reply: tid=0 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 client.17877 shutdown 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 msgr2=0x557094135c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x557094135c00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000b980 tx=0x7f9ca0011440 comp rx=0 tx=0).stop 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 shutdown_connections 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x557093d14410 0x55709413f500 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557093ceb550 0x557094135c00 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557093cf3730 0x55709412fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9c8d7fa640 0 client.17877 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 --2- 172.21.15.80:0/1295239825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557093cd31f0 0x5570941356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 >> 172.21.15.80:0/1295239825 conn(0x557093d08560 msgr2=0x5570940b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 shutdown_connections 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 1 -- 172.21.15.80:0/1295239825 wait complete. 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.222+0000 7f9cb2c3a740 20 client.17877 trim_cache size 0 max 16384 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "return_code": 0, 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_tag": "f1a0df6d-f768-4093-8f27-aff1006260a9", 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": "asynchronous" 2024-04-25T11:34:04.218 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:04.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c900afc60 msgr2=0x7f9c900b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c900afc60 0x7f9c900b2170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0dce90 tx=0x7f9c9c0d5a30 comp rx=0 tx=0).stop 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca410d380 msgr2=0x7f9ca419ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca410d380 0x7f9ca419ef20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00eaa0 tx=0x7f9c9c00ef60 comp rx=0 tx=0).stop 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 shutdown_connections 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c900afc60 0x7f9c900b2170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca410d380 0x7f9ca419ef20 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca4108a20 0x7f9ca419ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 --2- 172.21.15.80:0/1957509499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ca4102af0 0x7f9ca419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 >> 172.21.15.80:0/1957509499 conn(0x7f9ca4078100 msgr2=0x7f9ca41040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 shutdown_connections 2024-04-25T11:34:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.223+0000 7f9cabd84640 1 -- 172.21.15.80:0/1957509499 wait complete. 2024-04-25T11:34:04.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:34:04.223 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:34:04.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3393109150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08102b00 msgr2=0x7f5b08102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3393109150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08102b00 0x7f5b08102f10 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009900 tx=0x7f5af802a410 comp rx=0 tx=0).stop 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3393109150 shutdown_connections 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3393109150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08102b00 0x7f5b08102f10 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3393109150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b0810d390 0x7f5b0810f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3393109150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b08108a30 0x7f5b081025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3393109150 >> 172.21.15.80:0/3393109150 conn(0x7f5b080fe260 msgr2=0x7f5b08100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3393109150 shutdown_connections 2024-04-25T11:34:04.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.343+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3393109150 wait complete. 2024-04-25T11:34:04.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 Processor -- start 2024-04-25T11:34:04.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 -- start start 2024-04-25T11:34:04.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b08102b00 0x7f5b08199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08108a30 0x7f5b08199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b0810d390 0x7f5b0819de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112bf0 con 0x7f5b08108a30 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112a70 con 0x7f5b08102b00 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0f4b1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112d70 con 0x7f5b0810d390 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0ca4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08108a30 0x7f5b08199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0ca4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08108a30 0x7f5b08199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40250/0 (socket says 172.21.15.80:40250) 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/3234634457 learned_addr learned my addr 172.21.15.80:0/3234634457 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b0810d390 0x7f5b0819de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.344+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b08102b00 0x7f5b08199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/3234634457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b0810d390 msgr2=0x7f5b0819de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b0810d390 0x7f5b0819de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/3234634457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b08102b00 msgr2=0x7f5b08199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b08102b00 0x7f5b08199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/3234634457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0819e4d0 con 0x7f5b08108a30 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b08102b00 0x7f5b08199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:04.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b0810d390 0x7f5b0819de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:04.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08108a30 0x7f5b08199bd0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006010 tx=0x7f5af8004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5afe7fc640 1 -- 172.21.15.80:0/3234634457 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af803f030 con 0x7f5b08108a30 2024-04-25T11:34:04.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5afe7fc640 1 -- 172.21.15.80:0/3234634457 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af8003aa0 con 0x7f5b08108a30 2024-04-25T11:34:04.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5afe7fc640 1 -- 172.21.15.80:0/3234634457 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8035070 con 0x7f5b08108a30 2024-04-25T11:34:04.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0819e760 con 0x7f5b08108a30 2024-04-25T11:34:04.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.345+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0819ec50 con 0x7f5b08108a30 2024-04-25T11:34:04.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 Processor -- start 2024-04-25T11:34:04.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 -- start start 2024-04-25T11:34:04.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5afe7fc640 1 -- 172.21.15.80:0/3234634457 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f5af8042030 con 0x7f5b08108a30 2024-04-25T11:34:04.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a705a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a705adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c996b0 0x55a1a7069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6fc0d80 con 0x55a1a6c914d0 2024-04-25T11:34:04.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6f7a8b0 con 0x55a1a6c996b0 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6fbcd40 con 0x55a1a6cba390 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b0d24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a705adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b0d24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a705adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40266/0 (socket says 172.21.15.80:40266) 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b0d24d640 1 -- 172.21.15.80:0/1510868814 learned_addr learned my addr 172.21.15.80:0/1510868814 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c996b0 0x55a1a7069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.348+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a705a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5b0d24d640 1 -- 172.21.15.80:0/1510868814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 msgr2=0x55a1a705a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a705a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5b0d24d640 1 -- 172.21.15.80:0/1510868814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c996b0 msgr2=0x55a1a7069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c996b0 0x55a1a7069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5b0d24d640 1 -- 172.21.15.80:0/1510868814 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a6f4ba40 con 0x55a1a6c914d0 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5afe7fc640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5af40afc60 0x7f5af40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a705adf0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400bd30 tx=0x7f5b0400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a09d3f8ce517667 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5af40afc60 0x7f5af40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5af37fe640 1 -- 172.21.15.80:0/1510868814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04015070 con 0x55a1a6c914d0 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5afe7fc640 1 -- 172.21.15.80:0/3234634457 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f5af80ff650 con 0x7f5b08108a30 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5af37fe640 1 -- 172.21.15.80:0/1510868814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b0400be20 con 0x55a1a6c914d0 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.349+0000 7f5af37fe640 1 -- 172.21.15.80:0/1510868814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04011970 con 0x55a1a6c914d0 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1510868814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 msgr2=0x55a1a705adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5af40afc60 0x7f5af40b2170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a1a705c6e0 tx=0x7f5b00009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a705adf0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400bd30 tx=0x7f5b0400f730 comp rx=0 tx=0).stop 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1510868814 shutdown_connections 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a705adf0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c996b0 0x55a1a7069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1510868814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a705a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1510868814 >> 172.21.15.80:0/1510868814 conn(0x55a1a6cae4e0 msgr2=0x55a1a7057210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1510868814 shutdown_connections 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1510868814 wait complete. 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 -- start start 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.350+0000 7f5b15ffd740 1 Processor -- start 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a7067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c996b0 0x55a1a7067ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55a1a706a1f0 con 0x55a1a6c914d0 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a1a6f47d10 con 0x55a1a6cba390 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a1a706a370 con 0x55a1a6c996b0 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b15ffd740 10 client.0 _ll_register_callbacks cb 0x55a1a6f74210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a7067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a7067760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40280/0 (socket says 172.21.15.80:40280) 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 -- 172.21.15.80:0/4145453295 learned_addr learned my addr 172.21.15.80:0/4145453295 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c996b0 0x55a1a7067ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 -- 172.21.15.80:0/4145453295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c996b0 msgr2=0x55a1a7067ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c996b0 0x55a1a7067ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 -- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 msgr2=0x55a1a70736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 -- 172.21.15.80:0/4145453295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a6d9c7d0 con 0x55a1a6c914d0 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c996b0 0x55a1a7067ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a7067760 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400ba70 tx=0x7f5b04005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acf76e449d163d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.351+0000 7f5af0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4145453295 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04015070 con 0x55a1a6c914d0 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b0400be20 con 0x55a1a6c914d0 2024-04-25T11:34:04.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4145453295 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f5b040054b0 con 0x55a1a6c914d0 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4145453295 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5b04004020 con 0x55a1a6c914d0 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 10 client.17889 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a1a6cd23f0 con 0x55a1a6c914d0 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4145453295 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b0400be20 con 0x55a1a6c914d0 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4145453295 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5b040046c0 con 0x55a1a6c914d0 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 10 client.17889 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 10 client.17889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 20 client.17889 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:04.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c78f60 0x55a1a7079720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 4 client.17889 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1a6fce990 con 0x55a1a6c78f60 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.352+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c78f60 0x55a1a7079720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.353+0000 7f5af0ff9640 10 client.17889 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.353+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c78f60 0x55a1a7079720 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8116f3d20f96a47 server_cookie=6369e5ce6d3685c3 in_seq=0 out_seq=0 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4145453295 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1a6fce990 con 0x55a1a6c78f60 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5af0ff9640 10 client.17889 handle_command_reply: tid=0 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 client.17889 shutdown 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 msgr2=0x55a1a7067760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a7067760 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400ba70 tx=0x7f5b04005040 comp rx=0 tx=0).stop 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 shutdown_connections 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c78f60 0x55a1a7079720 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c996b0 0x55a1a7067ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5af0ff9640 0 client.17889 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4145453295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c914d0 0x55a1a7067760 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 >> 172.21.15.80:0/4145453295 conn(0x55a1a6cae4e0 msgr2=0x55a1a705c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 shutdown_connections 2024-04-25T11:34:04.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4145453295 wait complete. 2024-04-25T11:34:04.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.354+0000 7f5b15ffd740 20 client.17889 trim_cache size 0 max 16384 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 Processor -- start 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 -- start start 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c914d0 0x55a1a7066490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7069380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a70698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081b0160 con 0x55a1a6c996b0 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ada30 con 0x55a1a6c914d0 2024-04-25T11:34:04.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ab8a0 con 0x55a1a6cba390 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7069380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40282/0 (socket says 172.21.15.80:40282) 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/1219973763 learned_addr learned my addr 172.21.15.80:0/1219973763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a70698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/1219973763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 msgr2=0x55a1a70698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a70698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/1219973763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c914d0 msgr2=0x55a1a7066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c914d0 0x55a1a7066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/1219973763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a6c920f0 con 0x55a1a6c996b0 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a70698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.372+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7069380 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5af80c37f0 tx=0x7f5af80d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14335df09feb8f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5af2ffd640 1 -- 172.21.15.80:0/1219973763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8049040 con 0x55a1a6c996b0 2024-04-25T11:34:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5af2ffd640 1 -- 172.21.15.80:0/1219973763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af80c7280 con 0x55a1a6c996b0 2024-04-25T11:34:04.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5af2ffd640 1 -- 172.21.15.80:0/1219973763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af80cbb20 con 0x55a1a6c996b0 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1219973763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 msgr2=0x55a1a7069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7069380 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5af80c37f0 tx=0x7f5af80d0040 comp rx=0 tx=0).stop 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1219973763 shutdown_connections 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7069380 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6cba390 0x55a1a70698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/1219973763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6c914d0 0x55a1a7066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1219973763 >> 172.21.15.80:0/1219973763 conn(0x55a1a6cae4e0 msgr2=0x55a1a7068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1219973763 shutdown_connections 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.373+0000 7f5b15ffd740 1 -- 172.21.15.80:0/1219973763 wait complete. 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 -- start start 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 Processor -- start 2024-04-25T11:34:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c914d0 0x55a1a7079730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7079c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70df840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081abef0 con 0x55a1a6c996b0 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ad360 con 0x55a1a6cba390 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ac5c0 con 0x55a1a6c914d0 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b15ffd740 10 client.0 _ll_register_callbacks cb 0x7f5af8105400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b0ca4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7079c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b0ca4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7079c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40292/0 (socket says 172.21.15.80:40292) 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/4230751399 learned_addr learned my addr 172.21.15.80:0/4230751399 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.374+0000 7f5b0da4e640 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c914d0 0x55a1a7079730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/4230751399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c914d0 msgr2=0x55a1a7079730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c914d0 0x55a1a7079730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 msgr2=0x55a1a70df840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70df840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b0ca4c640 1 -- 172.21.15.80:0/4230751399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a6f814b0 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b0ca4c640 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7079c70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5af803b580 tx=0x7f5af802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a32efc3236ab58a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5af0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4230751399 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8049070 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4230751399 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8550+0+0 (secure 0 0 0) 0x7f5af80c3a00 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5af80c7280 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4230751399 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5af80c6ee0 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 10 client.17895 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a1a70e0b90 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4230751399 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af80c7280 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4230751399 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f5af80fcfa0 con 0x55a1a6c996b0 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 10 client.17895 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:04.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 10 client.17895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 20 client.17895 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c4e3a0 0x55a1a70e3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 4 client.17895 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.375+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a1a6fc8800 con 0x55a1a6c4e3a0 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.376+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c4e3a0 0x55a1a70e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.376+0000 7f5af0ff9640 10 client.17895 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.376+0000 7f5b0d24d640 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c4e3a0 0x55a1a70e3310 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=861e9d736f6df301 server_cookie=2e5577bda0fb481a in_seq=0 out_seq=0 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.376+0000 7f5af0ff9640 1 -- 172.21.15.80:0/4230751399 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a1a6fc8800 con 0x55a1a6c4e3a0 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.376+0000 7f5af0ff9640 10 client.17895 handle_command_reply: tid=0 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 client.17895 shutdown 2024-04-25T11:34:04.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 msgr2=0x55a1a7079c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7079c70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5af803b580 tx=0x7f5af802a410 comp rx=0 tx=0).stop 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 shutdown_connections 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55a1a6c4e3a0 0x55a1a70e3310 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a1a6c996b0 0x55a1a7079c70 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1a6cba390 0x55a1a70df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 --2- 172.21.15.80:0/4230751399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a1a6c914d0 0x55a1a7079730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5af0ff9640 0 client.17895 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:04.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 >> 172.21.15.80:0/4230751399 conn(0x55a1a6cae4e0 msgr2=0x55a1a70696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 shutdown_connections 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 1 -- 172.21.15.80:0/4230751399 wait complete. 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b15ffd740 20 client.17895 trim_cache size 0 max 16384 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": { 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stdout: "f1a0df6d-f768-4093-8f27-aff1006260a9": { 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stdout: "path": "/", 2024-04-25T11:34:04.373 INFO:teuthology.orchestra.run.smithi080.stdout: "tag": "f1a0df6d-f768-4093-8f27-aff1006260a9", 2024-04-25T11:34:04.374 INFO:teuthology.orchestra.run.smithi080.stdout: "options": "recursive,force" 2024-04-25T11:34:04.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:04.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:04.374 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5af40afc60 msgr2=0x7f5af40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5af40afc60 0x7f5af40b2170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a1a705c6e0 tx=0x7f5b00009500 comp rx=0 tx=0).stop 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08108a30 msgr2=0x7f5b08199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08108a30 0x7f5b08199bd0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006010 tx=0x7f5af8004060 comp rx=0 tx=0).stop 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 shutdown_connections 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5af40afc60 0x7f5af40b2170 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b08108a30 0x7f5b08199bd0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b0810d390 0x7f5b0819de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.377+0000 7f5b0f4b1640 1 --2- 172.21.15.80:0/3234634457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b08102b00 0x7f5b08199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.378+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 >> 172.21.15.80:0/3234634457 conn(0x7f5b080fe260 msgr2=0x7f5b080fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.378+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 shutdown_connections 2024-04-25T11:34:04.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:04.378+0000 7f5b0f4b1640 1 -- 172.21.15.80:0/3234634457 wait complete. 2024-04-25T11:34:04.377 INFO:tasks.cephfs.filesystem:scrub status for tag:f1a0df6d-f768-4093-8f27-aff1006260a9 - {'path': '/', 'tag': 'f1a0df6d-f768-4093-8f27-aff1006260a9', 'options': 'recursive,force'} 2024-04-25T11:34:04.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:04 smithi082 ceph-mon[32440]: pgmap v304: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:04.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:04 smithi080 ceph-mon[29126]: pgmap v304: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:04.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:04 smithi196 ceph-mon[32659]: pgmap v304: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:05.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:05 smithi080 ceph-mon[29126]: scrub queued for path: / 2024-04-25T11:34:05.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:05 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:34:05.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:05 smithi080 ceph-mon[29126]: scrub summary: active paths [/] 2024-04-25T11:34:05.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:05 smithi080 ceph-mon[29126]: scrub summary: idle+waiting paths [/] 2024-04-25T11:34:05.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:05 smithi196 ceph-mon[32659]: scrub queued for path: / 2024-04-25T11:34:05.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:05 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:34:05.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:05 smithi196 ceph-mon[32659]: scrub summary: active paths [/] 2024-04-25T11:34:05.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:05 smithi196 ceph-mon[32659]: scrub summary: idle+waiting paths [/] 2024-04-25T11:34:05.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:05 smithi082 ceph-mon[32440]: scrub queued for path: / 2024-04-25T11:34:05.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:05 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:34:05.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:05 smithi082 ceph-mon[32440]: scrub summary: active paths [/] 2024-04-25T11:34:05.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:05 smithi082 ceph-mon[32440]: scrub summary: idle+waiting paths [/] 2024-04-25T11:34:06.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:06 smithi080 ceph-mon[29126]: pgmap v305: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:06.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:06 smithi196 ceph-mon[32659]: pgmap v305: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:06.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:06 smithi082 ceph-mon[32440]: pgmap v305: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:08.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:08 smithi080 ceph-mon[29126]: pgmap v306: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-04-25T11:34:08.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:08 smithi080 ceph-mon[29126]: scrub summary: idle 2024-04-25T11:34:08.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:08 smithi196 ceph-mon[32659]: pgmap v306: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-04-25T11:34:08.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:08 smithi196 ceph-mon[32659]: scrub summary: idle 2024-04-25T11:34:08.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:08 smithi082 ceph-mon[32440]: pgmap v306: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-04-25T11:34:08.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:08 smithi082 ceph-mon[32440]: scrub summary: idle 2024-04-25T11:34:09.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:09 smithi080 ceph-mon[29126]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T11:34:09.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:09 smithi196 ceph-mon[32659]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T11:34:09.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:09 smithi082 ceph-mon[32440]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T11:34:10.836 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:10 smithi196 ceph-mon[32659]: pgmap v308: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-04-25T11:34:10.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:10 smithi080 ceph-mon[29126]: pgmap v308: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-04-25T11:34:10.890 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:10 smithi082 ceph-mon[32440]: pgmap v308: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-04-25T11:34:12.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:12 smithi080 ceph-mon[29126]: pgmap v309: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-04-25T11:34:12.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:12 smithi080 ceph-mon[29126]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T11:34:12.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:12 smithi196 ceph-mon[32659]: pgmap v309: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-04-25T11:34:12.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:12 smithi196 ceph-mon[32659]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T11:34:12.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:12 smithi082 ceph-mon[32440]: pgmap v309: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-04-25T11:34:12.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:12 smithi082 ceph-mon[32440]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T11:34:14.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:14 smithi080 ceph-mon[29126]: pgmap v311: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-04-25T11:34:14.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:14 smithi196 ceph-mon[32659]: pgmap v311: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-04-25T11:34:14.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:14 smithi082 ceph-mon[32440]: pgmap v311: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-04-25T11:34:16.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:16 smithi080 ceph-mon[29126]: pgmap v312: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:34:16.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:16 smithi196 ceph-mon[32659]: pgmap v312: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:34:16.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:16 smithi082 ceph-mon[32440]: pgmap v312: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:34:18.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:18 smithi080 ceph-mon[29126]: pgmap v313: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 243 B/s wr, 7 op/s 2024-04-25T11:34:18.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:18 smithi196 ceph-mon[32659]: pgmap v313: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 243 B/s wr, 7 op/s 2024-04-25T11:34:18.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:18 smithi082 ceph-mon[32440]: pgmap v313: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 243 B/s wr, 7 op/s 2024-04-25T11:34:20.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:20 smithi080 ceph-mon[29126]: pgmap v314: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:34:20.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:20 smithi196 ceph-mon[32659]: pgmap v314: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:34:20.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:20 smithi082 ceph-mon[32440]: pgmap v314: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T11:34:21.170 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T11:34:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 -- 172.21.15.80:0/1618138854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 msgr2=0x7fb744103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 --2- 172.21.15.80:0/1618138854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb744103710 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb734009900 tx=0x7fb73402a410 comp rx=0 tx=0).stop 2024-04-25T11:34:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 -- 172.21.15.80:0/1618138854 shutdown_connections 2024-04-25T11:34:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 --2- 172.21.15.80:0/1618138854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7441042c0 0x7fb744110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 --2- 172.21.15.80:0/1618138854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb74410a010 0x7fb744103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 --2- 172.21.15.80:0/1618138854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb744103710 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 -- 172.21.15.80:0/1618138854 >> 172.21.15.80:0/1618138854 conn(0x7fb7440ff210 msgr2=0x7fb744101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 -- 172.21.15.80:0/1618138854 shutdown_connections 2024-04-25T11:34:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 -- 172.21.15.80:0/1618138854 wait complete. 2024-04-25T11:34:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.303+0000 7fb749e14640 1 Processor -- start 2024-04-25T11:34:21.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb749e14640 1 -- start start 2024-04-25T11:34:21.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb749e14640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7441042c0 0x7fb74419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb749e14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb74419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb749e14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb74410a010 0x7fb74419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb749e14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb744113d60 con 0x7fb744109b70 2024-04-25T11:34:21.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb749e14640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb744113be0 con 0x7fb74410a010 2024-04-25T11:34:21.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb749e14640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb744113ee0 con 0x7fb7441042c0 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb742ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb74419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb742ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb74419ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45654/0 (socket says 172.21.15.80:45654) 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb742ffd640 1 -- 172.21.15.80:0/1151334929 learned_addr learned my addr 172.21.15.80:0/1151334929 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb743fff640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb74410a010 0x7fb74419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb7437fe640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7441042c0 0x7fb74419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.304+0000 7fb742ffd640 1 -- 172.21.15.80:0/1151334929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7441042c0 msgr2=0x7fb74419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb742ffd640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7441042c0 0x7fb74419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb742ffd640 1 -- 172.21.15.80:0/1151334929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb74410a010 msgr2=0x7fb74419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb742ffd640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb74410a010 0x7fb74419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb742ffd640 1 -- 172.21.15.80:0/1151334929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74419f5e0 con 0x7fb744109b70 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb742ffd640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb74419ace0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb73800d740 tx=0x7fb73800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb740ff9640 1 -- 172.21.15.80:0/1151334929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738017070 con 0x7fb744109b70 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb740ff9640 1 -- 172.21.15.80:0/1151334929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb73800de50 con 0x7fb744109b70 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74419f8d0 con 0x7fb744109b70 2024-04-25T11:34:21.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb740ff9640 1 -- 172.21.15.80:0/1151334929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738003c20 con 0x7fb744109b70 2024-04-25T11:34:21.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.305+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7441a7250 con 0x7fb744109b70 2024-04-25T11:34:21.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.306+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb744050740 con 0x7fb744109b70 2024-04-25T11:34:21.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.307+0000 7fb740ff9640 1 -- 172.21.15.80:0/1151334929 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fb738003dc0 con 0x7fb744109b70 2024-04-25T11:34:21.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.308+0000 7fb740ff9640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb72c0afc50 0x7fb72c0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.308+0000 7fb7437fe640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb72c0afc50 0x7fb72c0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.308+0000 7fb740ff9640 1 -- 172.21.15.80:0/1151334929 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fb7380deec0 con 0x7fb744109b70 2024-04-25T11:34:21.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.309+0000 7fb7437fe640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb72c0afc50 0x7fb72c0b2160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb734000c00 tx=0x7fb734031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:21.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.312+0000 7fb740ff9640 1 -- 172.21.15.80:0/1151334929 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb7380a76e0 con 0x7fb744109b70 2024-04-25T11:34:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.514+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fb7440ffd30 con 0x7fb72c0afc50 2024-04-25T11:34:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.523+0000 7fb740ff9640 1 -- 172.21.15.80:0/1151334929 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fb7440ffd30 con 0x7fb72c0afc50 2024-04-25T11:34:21.512 INFO:teuthology.orchestra.run.smithi080.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T11:24:20", "first": "2024-04-25T11:25:00", "last": "2024-04-25T11:34:00", "last_pruned": "2024-04-25T11:34:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-25T11:34:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb72c0afc50 msgr2=0x7fb72c0b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb72c0afc50 0x7fb72c0b2160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb734000c00 tx=0x7fb734031400 comp rx=0 tx=0).stop 2024-04-25T11:34:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 msgr2=0x7fb74419ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb74419ace0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb73800d740 tx=0x7fb73800dc00 comp rx=0 tx=0).stop 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 shutdown_connections 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb72c0afc50 0x7fb72c0b2160 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb744109b70 0x7fb74419ace0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb74410a010 0x7fb74419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 --2- 172.21.15.80:0/1151334929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7441042c0 0x7fb74419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 >> 172.21.15.80:0/1151334929 conn(0x7fb7440ff210 msgr2=0x7fb7440ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 shutdown_connections 2024-04-25T11:34:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.525+0000 7fb749e14640 1 -- 172.21.15.80:0/1151334929 wait complete. 2024-04-25T11:34:21.525 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T11:34:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 -- 172.21.15.80:0/3158216504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 msgr2=0x7f6264102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 --2- 172.21.15.80:0/3158216504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f6264102b60 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6258009900 tx=0x7f625802a410 comp rx=0 tx=0).stop 2024-04-25T11:34:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 -- 172.21.15.80:0/3158216504 shutdown_connections 2024-04-25T11:34:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 --2- 172.21.15.80:0/3158216504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f6264102b60 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 --2- 172.21.15.80:0/3158216504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62641031d0 0x7f626410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 --2- 172.21.15.80:0/3158216504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6264108a80 0x7f6264102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 -- 172.21.15.80:0/3158216504 >> 172.21.15.80:0/3158216504 conn(0x7f62640781b0 msgr2=0x7f62640785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 -- 172.21.15.80:0/3158216504 shutdown_connections 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 -- 172.21.15.80:0/3158216504 wait complete. 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.646+0000 7f6269338640 1 Processor -- start 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6269338640 1 -- start start 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6269338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62641031d0 0x7f6264199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6269338640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6264108a80 0x7f6264199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6269338640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f626419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6269338640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6264112c70 con 0x7f6264108f20 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6269338640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6264112af0 con 0x7f62641031d0 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6269338640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6264112df0 con 0x7f6264108a80 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f626419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f626419df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45676/0 (socket says 172.21.15.80:45676) 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 -- 172.21.15.80:0/3864988416 learned_addr learned my addr 172.21.15.80:0/3864988416 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f6262ffd640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62641031d0 0x7f6264199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62627fc640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6264108a80 0x7f6264199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 -- 172.21.15.80:0/3864988416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6264108a80 msgr2=0x7f6264199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6264108a80 0x7f6264199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 -- 172.21.15.80:0/3864988416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62641031d0 msgr2=0x7f6264199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62641031d0 0x7f6264199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.647+0000 7f62637fe640 1 -- 172.21.15.80:0/3864988416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626419e5b0 con 0x7f6264108f20 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.648+0000 7f62637fe640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f626419df70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f625c00eaa0 tx=0x7f625c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.648+0000 7f624bfff640 1 -- 172.21.15.80:0/3864988416 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c00cdb0 con 0x7f6264108f20 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.648+0000 7f624bfff640 1 -- 172.21.15.80:0/3864988416 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f625c005020 con 0x7f6264108f20 2024-04-25T11:34:21.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.648+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626419e8a0 con 0x7f6264108f20 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.648+0000 7f624bfff640 1 -- 172.21.15.80:0/3864988416 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c0116d0 con 0x7f6264108f20 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.648+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62641a6220 con 0x7f6264108f20 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.649+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6264050740 con 0x7f6264108f20 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.650+0000 7f624bfff640 1 -- 172.21.15.80:0/3864988416 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f625c0051d0 con 0x7f6264108f20 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.651+0000 7f624bfff640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f624c0afc50 0x7f624c0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.651+0000 7f6262ffd640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f624c0afc50 0x7f624c0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.651+0000 7f624bfff640 1 -- 172.21.15.80:0/3864988416 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f625c0df210 con 0x7f6264108f20 2024-04-25T11:34:21.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.651+0000 7f6262ffd640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f624c0afc50 0x7f624c0b2160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6264103760 tx=0x7f6254005f90 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:21.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.655+0000 7f624bfff640 1 -- 172.21.15.80:0/3864988416 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f625c016030 con 0x7f6264108f20 2024-04-25T11:34:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.853+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 --> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6264101880 con 0x7f624c0afc50 2024-04-25T11:34:21.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.860+0000 7f624bfff640 1 -- 172.21.15.80:0/3864988416 <== mgr.15318 v2:172.21.15.80:6800/1167903144 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6264101880 con 0x7f624c0afc50 2024-04-25T11:34:21.849 INFO:teuthology.orchestra.run.smithi080.stdout:/ 1m 6m3h 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f624c0afc50 msgr2=0x7f624c0b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f624c0afc50 0x7f624c0b2160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6264103760 tx=0x7f6254005f90 comp rx=0 tx=0).stop 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 msgr2=0x7f626419df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f626419df70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f625c00eaa0 tx=0x7f625c00ef60 comp rx=0 tx=0).stop 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 shutdown_connections 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f624c0afc50 0x7f624c0b2160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6264108f20 0x7f626419df70 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6264108a80 0x7f6264199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 --2- 172.21.15.80:0/3864988416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62641031d0 0x7f6264199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.862+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 >> 172.21.15.80:0/3864988416 conn(0x7f62640781b0 msgr2=0x7f6264101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.863+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 shutdown_connections 2024-04-25T11:34:21.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:21.863+0000 7f6269338640 1 -- 172.21.15.80:0/3864988416 wait complete. 2024-04-25T11:34:21.863 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-04-25T11:34:21.874 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-04-25T11:34:22.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:22 smithi080 ceph-mon[29126]: pgmap v315: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:34:22.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:22 smithi080 ceph-mon[29126]: from='client.17901 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:34:22.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:22 smithi196 ceph-mon[32659]: pgmap v315: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:34:22.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:22 smithi196 ceph-mon[32659]: from='client.17901 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:34:22.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:22 smithi082 ceph-mon[32440]: pgmap v315: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T11:34:22.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:22 smithi082 ceph-mon[32440]: from='client.17901 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:34:23.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:23 smithi080 ceph-mon[29126]: from='client.17907 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:34:23.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:23 smithi196 ceph-mon[32659]: from='client.17907 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:34:23.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:23 smithi082 ceph-mon[32440]: from='client.17907 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T11:34:24.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:24 smithi080 ceph-mon[29126]: pgmap v316: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:34:24.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:24 smithi196 ceph-mon[32659]: pgmap v316: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:34:24.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:24 smithi082 ceph-mon[32440]: pgmap v316: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-04-25T11:34:26.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:26 smithi080 ceph-mon[29126]: pgmap v317: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:34:26.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:26 smithi196 ceph-mon[32659]: pgmap v317: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:34:26.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:26 smithi082 ceph-mon[32440]: pgmap v317: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T11:34:28.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:28 smithi080 ceph-mon[29126]: pgmap v318: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T11:34:28.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:28 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:34:28.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:28 smithi196 ceph-mon[32659]: pgmap v318: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T11:34:28.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:28 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:34:28.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:28 smithi082 ceph-mon[32440]: pgmap v318: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T11:34:28.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:28 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T11:34:30.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:30 smithi080 ceph-mon[29126]: pgmap v319: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:30.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:30 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:30 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:30 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:30 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:30 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:30 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:30 smithi196 ceph-mon[32659]: pgmap v319: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:30.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:30 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:30 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:30 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:30 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:30 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:30 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:30 smithi082 ceph-mon[32440]: pgmap v319: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:30.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:30 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:30 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:30 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:30 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:30 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:30.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:30 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:31.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:34:31.874 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:31 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.936 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:31.936 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:34:31.936 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:34:31.936 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:31 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:31.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.029 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T11:34:32.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T11:34:32.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T11:34:32.030 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:31 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' 2024-04-25T11:34:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:32 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-25T11:34:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:32 smithi080 ceph-mon[29126]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T11:34:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:32 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-25T11:34:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:32 smithi080 ceph-mon[29126]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T11:34:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:32 smithi080 ceph-mon[29126]: pgmap v320: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T11:34:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:32 smithi080 ceph-mon[29126]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-25T11:34:32.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:32 smithi080 ceph-mon[29126]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-25T11:34:32.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:32 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-25T11:34:32.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:32 smithi196 ceph-mon[32659]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T11:34:32.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:32 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-25T11:34:32.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:32 smithi196 ceph-mon[32659]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T11:34:32.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:32 smithi196 ceph-mon[32659]: pgmap v320: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T11:34:32.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:32 smithi196 ceph-mon[32659]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-25T11:34:32.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:32 smithi196 ceph-mon[32659]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-25T11:34:32.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:32 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-25T11:34:32.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:32 smithi082 ceph-mon[32440]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T11:34:32.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:32 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-25T11:34:32.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:32 smithi082 ceph-mon[32440]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T11:34:32.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:32 smithi082 ceph-mon[32440]: pgmap v320: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T11:34:32.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:32 smithi082 ceph-mon[32440]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-25T11:34:32.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:32 smithi082 ceph-mon[32440]: Unable to set osd_memory_target on smithi080 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-25T11:34:34.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T11:34:34.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T11:34:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 -- 172.21.15.80:0/2095677683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 msgr2=0x7f4af0101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 --2- 172.21.15.80:0/2095677683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0101b70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009ca0 tx=0x7f4ae002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 -- 172.21.15.80:0/2095677683 shutdown_connections 2024-04-25T11:34:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 --2- 172.21.15.80:0/2095677683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4af0102720 0x7f4af0110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 --2- 172.21.15.80:0/2095677683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4af0109f90 0x7f4af01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 --2- 172.21.15.80:0/2095677683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0101b70 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 -- 172.21.15.80:0/2095677683 >> 172.21.15.80:0/2095677683 conn(0x7f4af0077880 msgr2=0x7f4af0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 -- 172.21.15.80:0/2095677683 shutdown_connections 2024-04-25T11:34:34.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 -- 172.21.15.80:0/2095677683 wait complete. 2024-04-25T11:34:34.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.523+0000 7f4af5413640 1 Processor -- start 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4af5413640 1 -- start start 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4af5413640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4af0102720 0x7f4af0102d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4af5413640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0103290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4af5413640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4af0109f90 0x7f4af01037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4af5413640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0113d00 con 0x7f4af0109af0 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4af5413640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0113b80 con 0x7f4af0102720 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4af5413640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0113e80 con 0x7f4af0109f90 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0103290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0103290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54324/0 (socket says 172.21.15.80:54324) 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 -- 172.21.15.80:0/2939787139 learned_addr learned my addr 172.21.15.80:0/2939787139 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4af0109f90 0x7f4af01037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4af0102720 0x7f4af0102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 -- 172.21.15.80:0/2939787139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4af0109f90 msgr2=0x7f4af01037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4af0109f90 0x7f4af01037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 -- 172.21.15.80:0/2939787139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4af0102720 msgr2=0x7f4af0102d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4af0102720 0x7f4af0102d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aee7fc640 1 -- 172.21.15.80:0/2939787139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af01a8a60 con 0x7f4af0109af0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4af0109f90 0x7f4af01037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.524+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4af0102720 0x7f4af0102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.525+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0103290 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e9c0 tx=0x7f4ae400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.525+0000 7f4ad7fff640 1 -- 172.21.15.80:0/2939787139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400cd80 con 0x7f4af0109af0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.525+0000 7f4ad7fff640 1 -- 172.21.15.80:0/2939787139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae40054d0 con 0x7f4af0109af0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.525+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af01a8d50 con 0x7f4af0109af0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.525+0000 7f4ad7fff640 1 -- 172.21.15.80:0/2939787139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4010430 con 0x7f4af0109af0 2024-04-25T11:34:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.525+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af01a91e0 con 0x7f4af0109af0 2024-04-25T11:34:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.527+0000 7f4ad7fff640 1 -- 172.21.15.80:0/2939787139 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f4ae4004fd0 con 0x7f4af0109af0 2024-04-25T11:34:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 Processor -- start 2024-04-25T11:34:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 -- start start 2024-04-25T11:34:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce30390 0x55934d1d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55934d136d80 con 0x55934ce30390 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55934d0f08b0 con 0x55934ce074d0 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4afc39e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55934d132d40 con 0x55934ce0f6b0 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4ad7fff640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ad80afc60 0x7f4ad80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce30390 0x55934d1d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce30390 0x55934d1d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54330/0 (socket says 172.21.15.80:54330) 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4aef7fe640 1 -- 172.21.15.80:0/187544189 learned_addr learned my addr 172.21.15.80:0/187544189 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ad80afc60 0x7f4ad80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.528+0000 7f4ad7fff640 1 -- 172.21.15.80:0/2939787139 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f4ae40df550 con 0x7f4af0109af0 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aef7fe640 1 -- 172.21.15.80:0/187544189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 msgr2=0x55934d1dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aef7fe640 1 -- 172.21.15.80:0/187544189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 msgr2=0x55934d1d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aef7fe640 1 -- 172.21.15.80:0/187544189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55934d0c1a40 con 0x55934ce30390 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce30390 0x55934d1d0a60 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8013af0 tx=0x7f4ae8010370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865d7a26ac8957ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ad80afc60 0x7f4ad80b2170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8010870 tx=0x7f4ae801b000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4ad57fa640 1 -- 172.21.15.80:0/187544189 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8023070 con 0x55934ce30390 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4ad57fa640 1 -- 172.21.15.80:0/187544189 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae801f440 con 0x55934ce30390 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.529+0000 7f4ad57fa640 1 -- 172.21.15.80:0/187544189 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae800b910 con 0x55934ce30390 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 -- 172.21.15.80:0/187544189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce30390 msgr2=0x55934d1d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce30390 0x55934d1d0a60 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8013af0 tx=0x7f4ae8010370 comp rx=0 tx=0).stop 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 -- 172.21.15.80:0/187544189 shutdown_connections 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 --2- 172.21.15.80:0/187544189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce30390 0x55934d1d0a60 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 -- 172.21.15.80:0/187544189 >> 172.21.15.80:0/187544189 conn(0x55934ce244e0 msgr2=0x55934d1cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 -- 172.21.15.80:0/187544189 shutdown_connections 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 -- 172.21.15.80:0/187544189 wait complete. 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.530+0000 7f4afc39e740 1 -- start start 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 1 Processor -- start 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1dcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce0f6b0 0x55934d1dd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d1db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55934d1ddf80 con 0x55934ce0f6b0 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55934d0bdd10 con 0x55934ce074d0 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55934d1de100 con 0x55934ce30390 2024-04-25T11:34:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4afc39e740 10 client.0 _ll_register_callbacks cb 0x55934d0ea210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce0f6b0 0x55934d1dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce0f6b0 0x55934d1dd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54342/0 (socket says 172.21.15.80:54342) 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 -- 172.21.15.80:0/1239365645 learned_addr learned my addr 172.21.15.80:0/1239365645 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d1db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1dcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 -- 172.21.15.80:0/1239365645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 msgr2=0x55934d1db4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d1db4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 -- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 msgr2=0x55934d1dcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1dcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 -- 172.21.15.80:0/1239365645 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55934cf127d0 con 0x55934ce0f6b0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce0f6b0 0x55934d1dd520 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40a7660 tx=0x7f4ae400ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa63eb1ee2358fee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.531+0000 7f4ad2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/1239365645 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40a1e60 con 0x55934ce0f6b0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/1239365645 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f4ae40900b0 con 0x55934ce0f6b0 2024-04-25T11:34:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae801f440 con 0x55934ce0f6b0 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/1239365645 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ae40a71e0 con 0x55934ce0f6b0 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 10 client.17919 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55934ce483f0 con 0x55934ce0f6b0 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/1239365645 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae801f440 con 0x55934ce0f6b0 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/1239365645 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4ae40dcf00 con 0x55934ce0f6b0 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 10 client.17919 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 10 client.17919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 20 client.17919 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdeef60 0x55934d1ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 4 client.17919 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.532+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55934d144990 con 0x55934cdeef60 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.533+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdeef60 0x55934d1ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.533+0000 7f4ad2ff5640 10 client.17919 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.533+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdeef60 0x55934d1ed710 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2676fe06029b11e server_cookie=1f16950b0acc595e in_seq=0 out_seq=0 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/1239365645 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55934d144990 con 0x55934cdeef60 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4ad2ff5640 10 client.17919 handle_command_reply: tid=0 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 client.17919 shutdown 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce0f6b0 msgr2=0x55934d1dd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce0f6b0 0x55934d1dd520 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40a7660 tx=0x7f4ae400ac80 comp rx=0 tx=0).stop 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 shutdown_connections 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdeef60 0x55934d1ed710 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce0f6b0 0x55934d1dd520 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d1db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4ad2ff5640 0 client.17919 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 --2- 172.21.15.80:0/1239365645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce074d0 0x55934d1dcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 >> 172.21.15.80:0/1239365645 conn(0x55934ce244e0 msgr2=0x55934d1d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 shutdown_connections 2024-04-25T11:34:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 1 -- 172.21.15.80:0/1239365645 wait complete. 2024-04-25T11:34:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.534+0000 7f4afc39e740 20 client.17919 trim_cache size 0 max 16384 2024-04-25T11:34:34.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 Processor -- start 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 -- start start 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1da3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce30390 0x55934d1f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01b4660 con 0x55934ce074d0 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01b1f30 con 0x55934ce30390 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4afc39e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01afda0 con 0x55934ce0f6b0 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4aeeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1da3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4aeeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1da3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54348/0 (socket says 172.21.15.80:54348) 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4aeeffd640 1 -- 172.21.15.80:0/4142937615 learned_addr learned my addr 172.21.15.80:0/4142937615 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4aeeffd640 1 -- 172.21.15.80:0/4142937615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 msgr2=0x55934d1dd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.552+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce30390 0x55934d1f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4aeeffd640 1 -- 172.21.15.80:0/4142937615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce30390 msgr2=0x55934d1f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce30390 0x55934d1f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4aeeffd640 1 -- 172.21.15.80:0/4142937615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55934ce080f0 con 0x55934ce074d0 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce30390 0x55934d1f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1da3f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009ca0 tx=0x7f4ae0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210c9a9880c15ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4ad4ff9640 1 -- 172.21.15.80:0/4142937615 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0031cf0 con 0x55934ce074d0 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4ad4ff9640 1 -- 172.21.15.80:0/4142937615 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae0036040 con 0x55934ce074d0 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.553+0000 7f4ad4ff9640 1 -- 172.21.15.80:0/4142937615 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0046690 con 0x55934ce074d0 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- 172.21.15.80:0/4142937615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 msgr2=0x55934d1da3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1da3f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009ca0 tx=0x7f4ae0009a20 comp rx=0 tx=0).stop 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- 172.21.15.80:0/4142937615 shutdown_connections 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce30390 0x55934d1f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce0f6b0 0x55934d1dd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 --2- 172.21.15.80:0/4142937615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1da3f0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- 172.21.15.80:0/4142937615 >> 172.21.15.80:0/4142937615 conn(0x55934ce244e0 msgr2=0x55934d1dcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- 172.21.15.80:0/4142937615 shutdown_connections 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- 172.21.15.80:0/4142937615 wait complete. 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- start start 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 Processor -- start 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1e13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce0f6b0 0x55934d1e18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d25d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01b03f0 con 0x55934ce074d0 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01b1860 con 0x55934ce0f6b0 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01b0ac0 con 0x55934ce30390 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4afc39e740 10 client.0 _ll_register_callbacks cb 0x7f4ae401ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.554+0000 7f4aeeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1e13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1e13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54352/0 (socket says 172.21.15.80:54352) 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 -- 172.21.15.80:0/272215616 learned_addr learned my addr 172.21.15.80:0/272215616 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aef7fe640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d25d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce0f6b0 0x55934d1e18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 -- 172.21.15.80:0/272215616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 msgr2=0x55934d25d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d25d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 -- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce0f6b0 msgr2=0x55934d1e18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce0f6b0 0x55934d1e18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 -- 172.21.15.80:0/272215616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55934d0f74b0 con 0x55934ce074d0 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce0f6b0 0x55934d1e18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4aeeffd640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1e13a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000f80 tx=0x7f4ae002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6eef723898d532f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4ad2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/272215616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0056070 con 0x55934ce074d0 2024-04-25T11:34:34.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/272215616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f4ae0031cf0 con 0x55934ce074d0 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae0036040 con 0x55934ce074d0 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/272215616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ae0031450 con 0x55934ce074d0 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4afc39e740 10 client.17925 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55934d25e570 con 0x55934ce074d0 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.555+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/272215616 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae0036040 con 0x55934ce074d0 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/272215616 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4ae0004000 con 0x55934ce074d0 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4afc39e740 10 client.17925 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4afc39e740 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4afc39e740 20 client.17925 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:34.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4afc39e740 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdc43a0 0x55934d260ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4afc39e740 4 client.17925 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55934d13e800 con 0x55934cdc43a0 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.556+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdc43a0 0x55934d260ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4ad2ff5640 10 client.17925 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4aee7fc640 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdc43a0 0x55934d260ca0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=877245f320d5e7b8 server_cookie=75df5679dbd12e6b in_seq=0 out_seq=0 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4ad2ff5640 1 -- 172.21.15.80:0/272215616 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55934d13e800 con 0x55934cdc43a0 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4ad2ff5640 10 client.17925 handle_command_reply: tid=0 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 client.17925 shutdown 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 msgr2=0x55934d1e13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1e13a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000f80 tx=0x7f4ae002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 shutdown_connections 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55934cdc43a0 0x55934d260ca0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55934ce30390 0x55934d25d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55934ce0f6b0 0x55934d1e18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4ad2ff5640 0 client.17925 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 --2- 172.21.15.80:0/272215616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55934ce074d0 0x55934d1e13a0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 >> 172.21.15.80:0/272215616 conn(0x55934ce244e0 msgr2=0x55934d1dc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 shutdown_connections 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 1 -- 172.21.15.80:0/272215616 wait complete. 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.557+0000 7f4afc39e740 20 client.17925 trim_cache size 0 max 16384 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "status": "no active scrubs running", 2024-04-25T11:34:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "scrubs": {} 2024-04-25T11:34:34.556 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:34.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ad80afc60 msgr2=0x7f4ad80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ad80afc60 0x7f4ad80b2170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8010870 tx=0x7f4ae801b000 comp rx=0 tx=0).stop 2024-04-25T11:34:34.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 msgr2=0x7f4af0103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0103290 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e9c0 tx=0x7f4ae400ee80 comp rx=0 tx=0).stop 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 shutdown_connections 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4ad80afc60 0x7f4ad80b2170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4af0109af0 0x7f4af0103290 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4af0109f90 0x7f4af01037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 --2- 172.21.15.80:0/2939787139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4af0102720 0x7f4af0102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 >> 172.21.15.80:0/2939787139 conn(0x7f4af0077880 msgr2=0x7f4af01051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 shutdown_connections 2024-04-25T11:34:34.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.558+0000 7f4af5413640 1 -- 172.21.15.80:0/2939787139 wait complete. 2024-04-25T11:34:34.558 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T11:34:34.558 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.676+0000 7f21ecda8640 1 -- 172.21.15.80:0/1204013337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8103380 msgr2=0x7f21e8103790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.676+0000 7f21ecda8640 1 --2- 172.21.15.80:0/1204013337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8103380 0x7f21e8103790 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009900 tx=0x7f21e002a410 comp rx=0 tx=0).stop 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 -- 172.21.15.80:0/1204013337 shutdown_connections 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 --2- 172.21.15.80:0/1204013337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21e8107cc0 0x7f21e810f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 --2- 172.21.15.80:0/1204013337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21e8107240 0x7f21e8107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 --2- 172.21.15.80:0/1204013337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8103380 0x7f21e8103790 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 -- 172.21.15.80:0/1204013337 >> 172.21.15.80:0/1204013337 conn(0x7f21e80fd840 msgr2=0x7f21e80ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 -- 172.21.15.80:0/1204013337 shutdown_connections 2024-04-25T11:34:34.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 -- 172.21.15.80:0/1204013337 wait complete. 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 Processor -- start 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.677+0000 7f21ecda8640 1 -- start start 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21ecda8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21e8103380 0x7f21e819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21ecda8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8107240 0x7f21e819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21ecda8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21e8107cc0 0x7f21e819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21ecda8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8112bc0 con 0x7f21e8107240 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21ecda8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8112a40 con 0x7f21e8107cc0 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21ecda8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8112d40 con 0x7f21e8103380 2024-04-25T11:34:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8107240 0x7f21e819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8107240 0x7f21e819ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54362/0 (socket says 172.21.15.80:54362) 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 -- 172.21.15.80:0/4026422106 learned_addr learned my addr 172.21.15.80:0/4026422106 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e659c640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21e8103380 0x7f21e819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e6d9d640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21e8107cc0 0x7f21e819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 -- 172.21.15.80:0/4026422106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21e8103380 msgr2=0x7f21e819b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21e8103380 0x7f21e819b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 -- 172.21.15.80:0/4026422106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21e8107cc0 msgr2=0x7f21e819bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21e8107cc0 0x7f21e819bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 -- 172.21.15.80:0/4026422106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e81a67f0 con 0x7f21e8107240 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e6d9d640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21e8107cc0 0x7f21e819bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.678+0000 7f21e5d9b640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8107240 0x7f21e819ba20 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f21d800eb50 tx=0x7f21d800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.679+0000 7f21df7fe640 1 -- 172.21.15.80:0/4026422106 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8003b70 con 0x7f21e8107240 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.679+0000 7f21df7fe640 1 -- 172.21.15.80:0/4026422106 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d800ee50 con 0x7f21e8107240 2024-04-25T11:34:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.679+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e81a6ae0 con 0x7f21e8107240 2024-04-25T11:34:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.679+0000 7f21df7fe640 1 -- 172.21.15.80:0/4026422106 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8010790 con 0x7f21e8107240 2024-04-25T11:34:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.679+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e81a6fe0 con 0x7f21e8107240 2024-04-25T11:34:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.680+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e806a190 con 0x7f21e8107240 2024-04-25T11:34:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.681+0000 7f21df7fe640 1 -- 172.21.15.80:0/4026422106 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f21d8004020 con 0x7f21e8107240 2024-04-25T11:34:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.681+0000 7f21df7fe640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21d40afc60 0x7f21d40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.682+0000 7f21e659c640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21d40afc60 0x7f21d40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.682+0000 7f21df7fe640 1 -- 172.21.15.80:0/4026422106 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f21d80df8f0 con 0x7f21e8107240 2024-04-25T11:34:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.682+0000 7f21e659c640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21d40afc60 0x7f21d40b2170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f21e0000c00 tx=0x7f21e0031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.686+0000 7f21df7fe640 1 -- 172.21.15.80:0/4026422106 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f21d80a8170 con 0x7f21e8107240 2024-04-25T11:34:34.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:34 smithi080 ceph-mon[29126]: pgmap v321: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.903+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21e810ab20 con 0x7f21e8107240 2024-04-25T11:34:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.904+0000 7f21df7fe640 1 -- 172.21.15.80:0/4026422106 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f21d80a7a70 con 0x7f21e8107240 2024-04-25T11:34:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:34:34.894 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:34:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:34:34.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21d40afc60 msgr2=0x7f21d40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21d40afc60 0x7f21d40b2170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f21e0000c00 tx=0x7f21e0031400 comp rx=0 tx=0).stop 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8107240 msgr2=0x7f21e819ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8107240 0x7f21e819ba20 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f21d800eb50 tx=0x7f21d800c6a0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 shutdown_connections 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f21d40afc60 0x7f21d40b2170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e8107240 0x7f21e819ba20 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21e8107cc0 0x7f21e819bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 --2- 172.21.15.80:0/4026422106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21e8103380 0x7f21e819b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.906+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 >> 172.21.15.80:0/4026422106 conn(0x7f21e80fd840 msgr2=0x7f21e81055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.907+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 shutdown_connections 2024-04-25T11:34:34.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:34.907+0000 7f21ecda8640 1 -- 172.21.15.80:0/4026422106 wait complete. 2024-04-25T11:34:34.907 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T11:34:34.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:34 smithi196 ceph-mon[32659]: pgmap v321: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:34.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:34 smithi082 ceph-mon[32440]: pgmap v321: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/4165295837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd0108a40 msgr2=0x7fcdd0102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/4165295837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd0108a40 0x7fcdd0102d40 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009900 tx=0x7fcdcc02a410 comp rx=0 tx=0).stop 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/4165295837 shutdown_connections 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/4165295837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdd010d3a0 0x7fcdd010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/4165295837 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdd0103280 0x7fcdd0103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/4165295837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd0108a40 0x7fcdd0102d40 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/4165295837 >> 172.21.15.80:0/4165295837 conn(0x7fcdd0077880 msgr2=0x7fcdd0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/4165295837 shutdown_connections 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/4165295837 wait complete. 2024-04-25T11:34:35.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 Processor -- start 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.028+0000 7fcdd7ee2640 1 -- start start 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd7ee2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdd0103280 0x7fcdd019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd7ee2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdd0108a40 0x7fcdd019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd7ee2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd010d3a0 0x7fcdd019c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd7ee2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd0112c00 con 0x7fcdd010d3a0 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd7ee2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd0112a80 con 0x7fcdd0108a40 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd7ee2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd0112d80 con 0x7fcdd0103280 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd010d3a0 0x7fcdd019c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd010d3a0 0x7fcdd019c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54370/0 (socket says 172.21.15.80:54370) 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 -- 172.21.15.80:0/1475749983 learned_addr learned my addr 172.21.15.80:0/1475749983 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd547d640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdd0108a40 0x7fcdd019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdd0103280 0x7fcdd019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 -- 172.21.15.80:0/1475749983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdd0103280 msgr2=0x7fcdd019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdd0103280 0x7fcdd019b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 -- 172.21.15.80:0/1475749983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdd0108a40 msgr2=0x7fcdd019bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdd0108a40 0x7fcdd019bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 -- 172.21.15.80:0/1475749983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd01a68b0 con 0x7fcdd010d3a0 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd647f640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd010d3a0 0x7fcdd019c020 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800cad0 tx=0x7fcdc800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdc6ffd640 1 -- 172.21.15.80:0/1475749983 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800ae20 con 0x7fcdd010d3a0 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd01a6ba0 con 0x7fcdd010d3a0 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.029+0000 7fcdc6ffd640 1 -- 172.21.15.80:0/1475749983 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc8005020 con 0x7fcdd010d3a0 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.030+0000 7fcdc6ffd640 1 -- 172.21.15.80:0/1475749983 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800f6b0 con 0x7fcdd010d3a0 2024-04-25T11:34:35.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.030+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd01a70a0 con 0x7fcdd010d3a0 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.032+0000 7fcdc6ffd640 1 -- 172.21.15.80:0/1475749983 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fcdc80051d0 con 0x7fcdd010d3a0 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.032+0000 7fcdded8f740 1 Processor -- start 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdded8f740 1 -- start start 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821a8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdc6ffd640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcdbc0afc60 0x7fcdbc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81de66b0 0x556e821b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdded8f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556e8210dd80 con 0x556e81de66b0 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdded8f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556e820c7a20 con 0x556e81e07390 2024-04-25T11:34:35.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdded8f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556e82109d40 con 0x556e81dde4d0 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcdbc0afc60 0x7fcdbc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81de66b0 0x556e821b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81de66b0 0x556e821b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54376/0 (socket says 172.21.15.80:54376) 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 -- 172.21.15.80:0/1156988647 learned_addr learned my addr 172.21.15.80:0/1156988647 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdc6ffd640 1 -- 172.21.15.80:0/1475749983 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fcdc80df050 con 0x7fcdd010d3a0 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd547d640 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd547d640 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 -- 172.21.15.80:0/1156988647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 msgr2=0x556e821a8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821a8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 -- 172.21.15.80:0/1156988647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 msgr2=0x556e821a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd647f640 1 -- 172.21.15.80:0/1156988647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e820d2c30 con 0x556e81de66b0 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd547d640 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.033+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcdbc0afc60 0x7fcdbc0b2170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc005f70 tx=0x7fcdcc000bc0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.034+0000 7fcdd647f640 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81de66b0 0x556e821b56a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80dc7e0 tx=0x7fcdc8005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15285447c0c98c2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.034+0000 7fcdbbfff640 1 -- 172.21.15.80:0/1156988647 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc801b120 con 0x556e81de66b0 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.034+0000 7fcdbbfff640 1 -- 172.21.15.80:0/1156988647 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc801ce50 con 0x556e81de66b0 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.034+0000 7fcdbbfff640 1 -- 172.21.15.80:0/1156988647 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80dca00 con 0x556e81de66b0 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 -- 172.21.15.80:0/1156988647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81de66b0 msgr2=0x556e821b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81de66b0 0x556e821b56a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80dc7e0 tx=0x7fcdc8005890 comp rx=0 tx=0).stop 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 -- 172.21.15.80:0/1156988647 shutdown_connections 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81de66b0 0x556e821b56a0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1156988647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 -- 172.21.15.80:0/1156988647 >> 172.21.15.80:0/1156988647 conn(0x556e81dfb4e0 msgr2=0x556e821a4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 -- 172.21.15.80:0/1156988647 shutdown_connections 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 -- 172.21.15.80:0/1156988647 wait complete. 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 -- start start 2024-04-25T11:34:35.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.035+0000 7fcdded8f740 1 Processor -- start 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556e821b5d30 con 0x556e81dde4d0 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556e82094dc0 con 0x556e81e07390 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556e821b5eb0 con 0x556e81de66b0 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 10 client.0 _ll_register_callbacks cb 0x556e820b0600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54384/0 (socket says 172.21.15.80:54384) 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/1796106678 learned_addr learned my addr 172.21.15.80:0/1796106678 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd647f640 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/1796106678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 msgr2=0x556e821b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 msgr2=0x556e821bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/1796106678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e81e1f3f0 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821b3280 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc033000 tx=0x7fcdcc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f33266cb19ac21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdb97fa640 1 -- 172.21.15.80:0/1796106678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc04b020 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdb97fa640 1 -- 172.21.15.80:0/1796106678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fcdcc004250 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc801ce50 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdb97fa640 1 -- 172.21.15.80:0/1796106678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcdcc056050 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.036+0000 7fcdded8f740 10 client.17943 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556e81ee97d0 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdb97fa640 1 -- 172.21.15.80:0/1796106678 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc801ce50 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdb97fa640 1 -- 172.21.15.80:0/1796106678 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fcdcc03b600 con 0x556e81dde4d0 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdded8f740 10 client.17943 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdded8f740 10 client.17943 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdded8f740 20 client.17943 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81dc5f60 0x556e821c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdded8f740 4 client.17943 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e8211b990 con 0x556e81dc5f60 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.037+0000 7fcdd547d640 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81dc5f60 0x556e821c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.038+0000 7fcdb97fa640 10 client.17943 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.038+0000 7fcdd547d640 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81dc5f60 0x556e821c57a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=476a8c602aa6177 server_cookie=38edf411b8ae80e6 in_seq=0 out_seq=0 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdb97fa640 1 -- 172.21.15.80:0/1796106678 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556e8211b990 con 0x556e81dc5f60 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdb97fa640 10 client.17943 handle_command_reply: tid=0 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 client.17943 shutdown 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 msgr2=0x556e821b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821b3280 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc033000 tx=0x7fcdcc009260 comp rx=0 tx=0).stop 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 shutdown_connections 2024-04-25T11:34:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81dc5f60 0x556e821c57a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 --2- 172.21.15.80:0/1796106678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821b3280 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdb97fa640 0 client.17943 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 >> 172.21.15.80:0/1796106678 conn(0x556e81dfb4e0 msgr2=0x556e821aa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 shutdown_connections 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 1 -- 172.21.15.80:0/1796106678 wait complete. 2024-04-25T11:34:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.039+0000 7fcdded8f740 20 client.17943 trim_cache size 0 max 16384 2024-04-25T11:34:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.052+0000 7fcdded8f740 1 Processor -- start 2024-04-25T11:34:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.052+0000 7fcdded8f740 1 -- start start 2024-04-25T11:34:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdded8f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd01b2440 con 0x556e81dde4d0 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdded8f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd01afd10 con 0x556e81e07390 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdded8f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd01adb80 con 0x556e81de66b0 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821bee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54396/0 (socket says 172.21.15.80:54396) 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/3325091296 learned_addr learned my addr 172.21.15.80:0/3325091296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd647f640 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd547d640 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/3325091296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 msgr2=0x556e821a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821a3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/3325091296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 msgr2=0x556e821ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 -- 172.21.15.80:0/3325091296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e821b3f80 con 0x556e81dde4d0 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd647f640 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd547d640 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821bee10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc03ba50 tx=0x7fcdcc031790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da21fad1712f254c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdbb7fe640 1 -- 172.21.15.80:0/3325091296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc05f070 con 0x556e81dde4d0 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdbb7fe640 1 -- 172.21.15.80:0/3325091296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdcc03be40 con 0x556e81dde4d0 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.053+0000 7fcdbb7fe640 1 -- 172.21.15.80:0/3325091296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc04b070 con 0x556e81dde4d0 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 -- 172.21.15.80:0/3325091296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 msgr2=0x556e821bee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821bee10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc03ba50 tx=0x7fcdcc031790 comp rx=0 tx=0).stop 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 -- 172.21.15.80:0/3325091296 shutdown_connections 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81e07390 0x556e821ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81de66b0 0x556e821a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3325091296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81dde4d0 0x556e821bee10 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 -- 172.21.15.80:0/3325091296 >> 172.21.15.80:0/3325091296 conn(0x556e81dfb4e0 msgr2=0x556e821a3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 -- 172.21.15.80:0/3325091296 shutdown_connections 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 -- 172.21.15.80:0/3325091296 wait complete. 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 -- start start 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.054+0000 7fcdded8f740 1 Processor -- start 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81de66b0 0x556e821b6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdded8f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81e07390 0x556e8222bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdded8f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd01ae1d0 con 0x556e81e07390 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdded8f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd01af640 con 0x556e81de66b0 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdded8f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd01ae8a0 con 0x556e81dde4d0 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdded8f740 10 client.0 _ll_register_callbacks cb 0x7fcdcc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81e07390 0x556e8222bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81e07390 0x556e8222bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54412/0 (socket says 172.21.15.80:54412) 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 -- 172.21.15.80:0/3667688967 learned_addr learned my addr 172.21.15.80:0/3667688967 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd547d640 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81de66b0 0x556e821b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 -- 172.21.15.80:0/3667688967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 msgr2=0x556e821b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 -- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81de66b0 msgr2=0x556e821b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81de66b0 0x556e821b6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 -- 172.21.15.80:0/3667688967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e8222c040 con 0x556e81e07390 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdd647f640 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81e07390 0x556e8222bb00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80dc830 tx=0x7fcdc80dcc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d54375ef2b8f4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.055+0000 7fcdb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdb97fa640 1 -- 172.21.15.80:0/3667688967 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc801d040 con 0x556e81e07390 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdb97fa640 1 -- 172.21.15.80:0/3667688967 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fcdc80ab1e0 con 0x556e81e07390 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556e82115800 con 0x556e81e07390 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdb97fa640 1 -- 172.21.15.80:0/3667688967 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcdc80a6ce0 con 0x556e81e07390 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 10 client.17949 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556e8222d0a0 con 0x556e81e07390 2024-04-25T11:34:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdb97fa640 1 -- 172.21.15.80:0/3667688967 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556e82115800 con 0x556e81e07390 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdb97fa640 1 -- 172.21.15.80:0/3667688967 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fcdc8012110 con 0x556e81e07390 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 10 client.17949 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 10 client.17949 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 20 client.17949 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81d9b3a0 0x556e8222f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 4 client.17949 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 --> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e82090610 con 0x556e81d9b3a0 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.056+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81d9b3a0 0x556e8222f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdb97fa640 10 client.17949 ms_handle_connect on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdd5c7e640 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81d9b3a0 0x556e8222f3b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f7dbd17f21c52e4 server_cookie=2649d03bd6e54e45 in_seq=0 out_seq=0 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdb97fa640 1 -- 172.21.15.80:0/3667688967 <== mds.2 v2:172.21.15.82:6836/3792535888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e82090610 con 0x556e81d9b3a0 2024-04-25T11:34:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdb97fa640 10 client.17949 handle_command_reply: tid=0 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 client.17949 shutdown 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81e07390 msgr2=0x556e8222bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81e07390 0x556e8222bb00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80dc830 tx=0x7fcdc80dcc30 comp rx=0 tx=0).stop 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 shutdown_connections 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:6836/3792535888,v1:172.21.15.82:6837/3792535888] conn(0x556e81d9b3a0 0x556e8222f3b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556e81e07390 0x556e8222bb00 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdb97fa640 0 client.17949 ms_handle_reset on v2:172.21.15.82:6836/3792535888 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e81de66b0 0x556e821b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 --2- 172.21.15.80:0/3667688967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556e81dde4d0 0x556e821b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 >> 172.21.15.80:0/3667688967 conn(0x556e81dfb4e0 msgr2=0x556e821b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 shutdown_connections 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 1 -- 172.21.15.80:0/3667688967 wait complete. 2024-04-25T11:34:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.057+0000 7fcdded8f740 20 client.17949 trim_cache size 0 max 16384 2024-04-25T11:34:35.054 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcdbc0afc60 msgr2=0x7fcdbc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcdbc0afc60 0x7fcdbc0b2170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc005f70 tx=0x7fcdcc000bc0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd010d3a0 msgr2=0x7fcdd019c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd010d3a0 0x7fcdd019c020 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800cad0 tx=0x7fcdc800cf90 comp rx=0 tx=0).stop 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 shutdown_connections 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fcdbc0afc60 0x7fcdbc0b2170 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdd010d3a0 0x7fcdd019c020 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdd0108a40 0x7fcdd019bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 --2- 172.21.15.80:0/1475749983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdd0103280 0x7fcdd019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 >> 172.21.15.80:0/1475749983 conn(0x7fcdd0077880 msgr2=0x7fcdd01040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 shutdown_connections 2024-04-25T11:34:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.058+0000 7fcdd7ee2640 1 -- 172.21.15.80:0/1475749983 wait complete. 2024-04-25T11:34:35.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T11:34:35.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 -- 172.21.15.80:0/2022546389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108ed0 msgr2=0x7fe308102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 --2- 172.21.15.80:0/2022546389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108ed0 0x7fe308102b20 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009900 tx=0x7fe2f002a410 comp rx=0 tx=0).stop 2024-04-25T11:34:35.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 -- 172.21.15.80:0/2022546389 shutdown_connections 2024-04-25T11:34:35.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 --2- 172.21.15.80:0/2022546389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108ed0 0x7fe308102b20 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 --2- 172.21.15.80:0/2022546389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe308103190 0x7fe30810f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 --2- 172.21.15.80:0/2022546389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe308108a30 0x7fe3081025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 -- 172.21.15.80:0/2022546389 >> 172.21.15.80:0/2022546389 conn(0x7fe3080fe260 msgr2=0x7fe308100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 -- 172.21.15.80:0/2022546389 shutdown_connections 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 -- 172.21.15.80:0/2022546389 wait complete. 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 Processor -- start 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.179+0000 7fe30c842640 1 -- start start 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30c842640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe308103190 0x7fe30819b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30c842640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108a30 0x7fe30819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30c842640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe308108ed0 0x7fe30819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30c842640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe308112c50 con 0x7fe308108a30 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30c842640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe308112ad0 con 0x7fe308108ed0 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30c842640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe308112dd0 con 0x7fe308103190 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108a30 0x7fe30819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108a30 0x7fe30819baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54422/0 (socket says 172.21.15.80:54422) 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 -- 172.21.15.80:0/2869621193 learned_addr learned my addr 172.21.15.80:0/2869621193 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 -- 172.21.15.80:0/2869621193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe308103190 msgr2=0x7fe30819b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30659c640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe308103190 0x7fe30819b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe306d9d640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe308108ed0 0x7fe30819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe308103190 0x7fe30819b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 -- 172.21.15.80:0/2869621193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe308108ed0 msgr2=0x7fe30819c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe308108ed0 0x7fe30819c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 -- 172.21.15.80:0/2869621193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3081a6830 con 0x7fe308108a30 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2fffff640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108a30 0x7fe30819baf0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006010 tx=0x7fe2f0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2ff7fe640 1 -- 172.21.15.80:0/2869621193 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f003f030 con 0x7fe308108a30 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe2ff7fe640 1 -- 172.21.15.80:0/2869621193 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2f0003aa0 con 0x7fe308108a30 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.180+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3081a6ac0 con 0x7fe308108a30 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.181+0000 7fe2ff7fe640 1 -- 172.21.15.80:0/2869621193 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0035070 con 0x7fe308108a30 2024-04-25T11:34:35.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.181+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3081a6fb0 con 0x7fe308108a30 2024-04-25T11:34:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.183+0000 7fe2ff7fe640 1 -- 172.21.15.80:0/2869621193 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fe2f0042030 con 0x7fe308108a30 2024-04-25T11:34:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.183+0000 7fe3137c8740 1 Processor -- start 2024-04-25T11:34:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.183+0000 7fe3137c8740 1 -- start start 2024-04-25T11:34:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a839390 0x55997abda810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8104d0 0x55997abdad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 0x55997abe76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe3137c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55997ab3fd80 con 0x55997a8104d0 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe3137c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55997aaf9a20 con 0x55997a8186b0 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe3137c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55997ab3bd40 con 0x55997a839390 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8104d0 0x55997abdad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8104d0 0x55997abdad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54436/0 (socket says 172.21.15.80:54436) 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 -- 172.21.15.80:0/488059927 learned_addr learned my addr 172.21.15.80:0/488059927 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe306d9d640 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a839390 0x55997abda810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe2ff7fe640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe2f40afc60 0x7fe2f40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe2fffff640 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 0x55997abe76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe306d9d640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe2f40afc60 0x7fe2f40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 -- 172.21.15.80:0/488059927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a839390 msgr2=0x55997abda810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a839390 0x55997abda810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 -- 172.21.15.80:0/488059927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 msgr2=0x55997abe76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 0x55997abe76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe30659c640 1 -- 172.21.15.80:0/488059927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997ab04c30 con 0x55997a8104d0 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe306d9d640 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a839390 0x55997abda810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.184+0000 7fe2ff7fe640 1 -- 172.21.15.80:0/2869621193 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fe2f00ff2b0 con 0x7fe308108a30 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.185+0000 7fe30659c640 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8104d0 0x55997abdad50 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800ba60 tx=0x7fe2f800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f88534b800970f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.185+0000 7fe306d9d640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe2f40afc60 0x7fe2f40b2170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55997abd7980 tx=0x7fe300004ab0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.185+0000 7fe2fcff9640 1 -- 172.21.15.80:0/488059927 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8017420 con 0x55997a8104d0 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.185+0000 7fe2fcff9640 1 -- 172.21.15.80:0/488059927 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2f8017a70 con 0x55997a8104d0 2024-04-25T11:34:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.185+0000 7fe2fcff9640 1 -- 172.21.15.80:0/488059927 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800f9f0 con 0x55997a8104d0 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 -- 172.21.15.80:0/488059927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8104d0 msgr2=0x55997abdad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8104d0 0x55997abdad50 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800ba60 tx=0x7fe2f800bf20 comp rx=0 tx=0).stop 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 -- 172.21.15.80:0/488059927 shutdown_connections 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8104d0 0x55997abdad50 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 0x55997abe76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 --2- 172.21.15.80:0/488059927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a839390 0x55997abda810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 -- 172.21.15.80:0/488059927 >> 172.21.15.80:0/488059927 conn(0x55997a82d4e0 msgr2=0x55997abd6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 -- 172.21.15.80:0/488059927 shutdown_connections 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 -- 172.21.15.80:0/488059927 wait complete. 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 -- start start 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 Processor -- start 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.186+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8104d0 0x55997abe5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8186b0 0x55997abe57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a839390 0x55997abf1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe3137c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55997abe7d90 con 0x55997a839390 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe3137c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55997aac6dc0 con 0x55997a8104d0 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe3137c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55997abe7f10 con 0x55997a8186b0 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe3137c8740 10 client.0 _ll_register_callbacks cb 0x55997aae2600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a839390 0x55997abf1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a839390 0x55997abf1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54444/0 (socket says 172.21.15.80:54444) 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 -- 172.21.15.80:0/1745571102 learned_addr learned my addr 172.21.15.80:0/1745571102 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe30659c640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8104d0 0x55997abe5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe2fffff640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8186b0 0x55997abe57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 -- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8186b0 msgr2=0x55997abe57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8186b0 0x55997abe57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 -- 172.21.15.80:0/1745571102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8104d0 msgr2=0x55997abe5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8104d0 0x55997abe5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 -- 172.21.15.80:0/1745571102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55997a8513f0 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe2fffff640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8186b0 0x55997abe57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe306d9d640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a839390 0x55997abf1210 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe300011a30 tx=0x7fe300004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb0a88ecf52aaf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe2edffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe2edffb640 1 -- 172.21.15.80:0/1745571102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300024030 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe2edffb640 1 -- 172.21.15.80:0/1745571102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fe30000fc10 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2f8017a70 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.187+0000 7fe2edffb640 1 -- 172.21.15.80:0/1745571102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe300009ba0 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 10 client.17961 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55997a91b7d0 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe2edffb640 1 -- 172.21.15.80:0/1745571102 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2f8017a70 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe2edffb640 1 -- 172.21.15.80:0/1745571102 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe300029410 con 0x55997a839390 2024-04-25T11:34:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 10 client.17961 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 10 client.17961 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 20 client.17961 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a7f7f60 0x55997abf7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 4 client.17961 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55997ab4d990 con 0x55997a7f7f60 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.188+0000 7fe30659c640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a7f7f60 0x55997abf7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.189+0000 7fe2edffb640 10 client.17961 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.189+0000 7fe30659c640 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a7f7f60 0x55997abf7790 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3585ee5201ab93e7 server_cookie=2df75e4bdec2d86b in_seq=0 out_seq=0 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.189+0000 7fe2edffb640 1 -- 172.21.15.80:0/1745571102 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55997ab4d990 con 0x55997a7f7f60 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.189+0000 7fe2edffb640 10 client.17961 handle_command_reply: tid=0 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 client.17961 shutdown 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a839390 msgr2=0x55997abf1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a839390 0x55997abf1210 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe300011a30 tx=0x7fe300004a40 comp rx=0 tx=0).stop 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 shutdown_connections 2024-04-25T11:34:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a839390 0x55997abf1210 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a7f7f60 0x55997abf7790 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8186b0 0x55997abe57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe2edffb640 0 client.17961 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1745571102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8104d0 0x55997abe5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 >> 172.21.15.80:0/1745571102 conn(0x55997a82d4e0 msgr2=0x55997abdc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 shutdown_connections 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 1 -- 172.21.15.80:0/1745571102 wait complete. 2024-04-25T11:34:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.190+0000 7fe3137c8740 20 client.17961 trim_cache size 0 max 16384 2024-04-25T11:34:35.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 Processor -- start 2024-04-25T11:34:35.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 -- start start 2024-04-25T11:34:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a7f7f60 0x55997abe0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8186b0 0x55997abf0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081b22d0 con 0x55997a8186b0 2024-04-25T11:34:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081afba0 con 0x55997a7f7f60 2024-04-25T11:34:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.203+0000 7fe3137c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081ada10 con 0x55997a8104d0 2024-04-25T11:34:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8186b0 0x55997abf0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8186b0 0x55997abf0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54450/0 (socket says 172.21.15.80:54450) 2024-04-25T11:34:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 -- 172.21.15.80:0/3550910129 learned_addr learned my addr 172.21.15.80:0/3550910129 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe30659c640 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a7f7f60 0x55997abe0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe2fffff640 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 -- 172.21.15.80:0/3550910129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 msgr2=0x55997abe4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 -- 172.21.15.80:0/3550910129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a7f7f60 msgr2=0x55997abe0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a7f7f60 0x55997abe0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 -- 172.21.15.80:0/3550910129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997abe7e30 con 0x55997a8186b0 2024-04-25T11:34:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe30659c640 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a7f7f60 0x55997abe0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe306d9d640 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8186b0 0x55997abf0e70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe300009e30 tx=0x7fe300029f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e05e828538d0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe2effff640 1 -- 172.21.15.80:0/3550910129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300035070 con 0x55997a8186b0 2024-04-25T11:34:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe2effff640 1 -- 172.21.15.80:0/3550910129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe300037070 con 0x55997a8186b0 2024-04-25T11:34:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.204+0000 7fe2effff640 1 -- 172.21.15.80:0/3550910129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300024040 con 0x55997a8186b0 2024-04-25T11:34:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 -- 172.21.15.80:0/3550910129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8186b0 msgr2=0x55997abf0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8186b0 0x55997abf0e70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe300009e30 tx=0x7fe300029f20 comp rx=0 tx=0).stop 2024-04-25T11:34:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 -- 172.21.15.80:0/3550910129 shutdown_connections 2024-04-25T11:34:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a8186b0 0x55997abf0e70 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 --2- 172.21.15.80:0/3550910129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a7f7f60 0x55997abe0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 -- 172.21.15.80:0/3550910129 >> 172.21.15.80:0/3550910129 conn(0x55997a82d4e0 msgr2=0x55997abe3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 -- 172.21.15.80:0/3550910129 shutdown_connections 2024-04-25T11:34:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 -- 172.21.15.80:0/3550910129 wait complete. 2024-04-25T11:34:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 -- start start 2024-04-25T11:34:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.205+0000 7fe3137c8740 1 Processor -- start 2024-04-25T11:34:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a7f7f60 0x55997abed430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 0x55997abe8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081ae060 con 0x55997a7f7f60 2024-04-25T11:34:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081af4d0 con 0x55997a8186b0 2024-04-25T11:34:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081ae730 con 0x55997a8104d0 2024-04-25T11:34:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 10 client.0 _ll_register_callbacks cb 0x7fe300009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a7f7f60 0x55997abed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a7f7f60 0x55997abed430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54452/0 (socket says 172.21.15.80:54452) 2024-04-25T11:34:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 -- 172.21.15.80:0/1234846192 learned_addr learned my addr 172.21.15.80:0/1234846192 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe2fffff640 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 -- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 msgr2=0x55997abe87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 -- 172.21.15.80:0/1234846192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 msgr2=0x55997abe8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 0x55997abe8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 -- 172.21.15.80:0/1234846192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55997abe9230 con 0x55997a7f7f60 2024-04-25T11:34:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe30659c640 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a7f7f60 0x55997abed430 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x55997abd7f50 tx=0x7fe2f8005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33f08b651b1516e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe2edffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe2edffb640 1 -- 172.21.15.80:0/1234846192 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8005040 con 0x55997a7f7f60 2024-04-25T11:34:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe2edffb640 1 -- 172.21.15.80:0/1234846192 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fe2f80051e0 con 0x55997a7f7f60 2024-04-25T11:34:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe300037070 con 0x55997a7f7f60 2024-04-25T11:34:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.206+0000 7fe2edffb640 1 -- 172.21.15.80:0/1234846192 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe2f803a050 con 0x55997a7f7f60 2024-04-25T11:34:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 10 client.17967 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55997ac5f6c0 con 0x55997a7f7f60 2024-04-25T11:34:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe2edffb640 1 -- 172.21.15.80:0/1234846192 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe300037070 con 0x55997a7f7f60 2024-04-25T11:34:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe2edffb640 1 -- 172.21.15.80:0/1234846192 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe2f8035030 con 0x55997a7f7f60 2024-04-25T11:34:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 10 client.17967 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 10 client.17967 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T11:34:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 20 client.17967 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a839390 0x55997ac61c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 4 client.17967 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:34:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 --> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55997ab47800 con 0x55997a839390 2024-04-25T11:34:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.207+0000 7fe2fffff640 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a839390 0x55997ac61c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe2edffb640 10 client.17967 ms_handle_connect on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe2fffff640 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a839390 0x55997ac61c70 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6cc2bfa99860db4d server_cookie=454132c961d6d6bc in_seq=0 out_seq=0 2024-04-25T11:34:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe2edffb640 1 -- 172.21.15.80:0/1234846192 <== mds.1 v2:172.21.15.196:6838/1079728905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55997ab47800 con 0x55997a839390 2024-04-25T11:34:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe2edffb640 10 client.17967 handle_command_reply: tid=0 2024-04-25T11:34:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 client.17967 shutdown 2024-04-25T11:34:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a7f7f60 msgr2=0x55997abed430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a7f7f60 0x55997abed430 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x55997abd7f50 tx=0x7fe2f8005ea0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 shutdown_connections 2024-04-25T11:34:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:6838/1079728905,v1:172.21.15.196:6839/1079728905] conn(0x55997a839390 0x55997ac61c70 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55997a8186b0 0x55997abe8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55997a8104d0 0x55997abe87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe2edffb640 0 client.17967 ms_handle_reset on v2:172.21.15.196:6838/1079728905 2024-04-25T11:34:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 --2- 172.21.15.80:0/1234846192 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55997a7f7f60 0x55997abed430 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 >> 172.21.15.80:0/1234846192 conn(0x55997a82d4e0 msgr2=0x55997abd5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 shutdown_connections 2024-04-25T11:34:35.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 1 -- 172.21.15.80:0/1234846192 wait complete. 2024-04-25T11:34:35.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.208+0000 7fe3137c8740 20 client.17967 trim_cache size 0 max 16384 2024-04-25T11:34:35.212 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:34:35.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe2f40afc60 msgr2=0x7fe2f40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe2f40afc60 0x7fe2f40b2170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55997abd7980 tx=0x7fe300004ab0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108a30 msgr2=0x7fe30819baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108a30 0x7fe30819baf0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006010 tx=0x7fe2f0004060 comp rx=0 tx=0).stop 2024-04-25T11:34:35.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 shutdown_connections 2024-04-25T11:34:35.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fe2f40afc60 0x7fe2f40b2170 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe308108a30 0x7fe30819baf0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe308108ed0 0x7fe30819c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 --2- 172.21.15.80:0/2869621193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe308103190 0x7fe30819b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 >> 172.21.15.80:0/2869621193 conn(0x7fe3080fe260 msgr2=0x7fe3080ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 shutdown_connections 2024-04-25T11:34:35.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.209+0000 7fe30c842640 1 -- 172.21.15.80:0/2869621193 wait complete. 2024-04-25T11:34:35.218 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T11:34:35.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 -- 172.21.15.80:0/1468708060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 msgr2=0x7f9568110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 --2- 172.21.15.80:0/1468708060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f9568110610 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f9560009ca0 tx=0x7f956002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 -- 172.21.15.80:0/1468708060 shutdown_connections 2024-04-25T11:34:35.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 --2- 172.21.15.80:0/1468708060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f9568110610 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 --2- 172.21.15.80:0/1468708060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568109fa0 0x7f9568102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 --2- 172.21.15.80:0/1468708060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9568109b00 0x7f9568101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 -- 172.21.15.80:0/1468708060 >> 172.21.15.80:0/1468708060 conn(0x7f9568077880 msgr2=0x7f9568077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 -- 172.21.15.80:0/1468708060 shutdown_connections 2024-04-25T11:34:35.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 -- 172.21.15.80:0/1468708060 wait complete. 2024-04-25T11:34:35.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.340+0000 7f956da68640 1 Processor -- start 2024-04-25T11:34:35.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 -- start start 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f956819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568109b00 0x7f956819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9568109fa0 0x7f956819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9568113ce0 con 0x7f95681027a0 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9568113b60 con 0x7f9568109b00 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9568113e60 con 0x7f9568109fa0 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f956819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f956819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54474/0 (socket says 172.21.15.80:54474) 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 -- 172.21.15.80:0/661999812 learned_addr learned my addr 172.21.15.80:0/661999812 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f9566ffd640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568109b00 0x7f956819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 -- 172.21.15.80:0/661999812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9568109fa0 msgr2=0x7f956819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9568109fa0 0x7f956819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 -- 172.21.15.80:0/661999812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568109b00 msgr2=0x7f956819ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568109b00 0x7f956819ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 -- 172.21.15.80:0/661999812 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956819f640 con 0x7f95681027a0 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f9566ffd640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568109b00 0x7f956819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f95677fe640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f956819a7e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f955800d770 tx=0x7f955800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f9564ff9640 1 -- 172.21.15.80:0/661999812 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558017070 con 0x7f95681027a0 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f9564ff9640 1 -- 172.21.15.80:0/661999812 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95580054d0 con 0x7f95681027a0 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.341+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956819f930 con 0x7f95681027a0 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.342+0000 7f9564ff9640 1 -- 172.21.15.80:0/661999812 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558004c30 con 0x7f95681027a0 2024-04-25T11:34:35.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.342+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956819fe30 con 0x7f95681027a0 2024-04-25T11:34:35.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.344+0000 7f95749f2740 1 Processor -- start 2024-04-25T11:34:35.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.344+0000 7f95749f2740 1 -- start start 2024-04-25T11:34:35.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9564ff9640 1 -- 172.21.15.80:0/661999812 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f9558004e10 con 0x7f95681027a0 2024-04-25T11:34:35.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95749f2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fecd390 0x55e19026e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95749f2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e19026ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95749f2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e19027b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95749f2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e1901d3d80 con 0x55e18feac6b0 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95749f2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e19018da20 con 0x55e18fecd390 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95749f2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e1901cfd40 con 0x55e18fea44d0 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e19027b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e19027b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54482/0 (socket says 172.21.15.80:54482) 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 -- 172.21.15.80:0/2442957556 learned_addr learned my addr 172.21.15.80:0/2442957556 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9567fff640 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fecd390 0x55e19026e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95677fe640 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e19026ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 -- 172.21.15.80:0/2442957556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 msgr2=0x55e19026ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e19026ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 -- 172.21.15.80:0/2442957556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fecd390 msgr2=0x55e19026e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fecd390 0x55e19026e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 -- 172.21.15.80:0/2442957556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e190198c30 con 0x55e18feac6b0 2024-04-25T11:34:35.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9567fff640 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fecd390 0x55e19026e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f95677fe640 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e19026ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.345+0000 7f9566ffd640 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e19027b6a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f955c009b60 tx=0x7f955c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fdaba4982ad95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.346+0000 7f9564ff9640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f95500afc60 0x7f95500b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.346+0000 7f954dffb640 1 -- 172.21.15.80:0/2442957556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c016070 con 0x55e18feac6b0 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.346+0000 7f9567fff640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f95500afc60 0x7f95500b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.346+0000 7f954dffb640 1 -- 172.21.15.80:0/2442957556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f955c009e50 con 0x55e18feac6b0 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.346+0000 7f954dffb640 1 -- 172.21.15.80:0/2442957556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c011470 con 0x55e18feac6b0 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.346+0000 7f9564ff9640 1 -- 172.21.15.80:0/661999812 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f95580dec00 con 0x7f95681027a0 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 -- 172.21.15.80:0/2442957556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 msgr2=0x55e19027b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f9567fff640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f95500afc60 0x7f95500b2170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55e19026b980 tx=0x7f9560009430 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e19027b6a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f955c009b60 tx=0x7f955c00e6c0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 -- 172.21.15.80:0/2442957556 shutdown_connections 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e19027b6a0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e19026ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 --2- 172.21.15.80:0/2442957556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fecd390 0x55e19026e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 -- 172.21.15.80:0/2442957556 >> 172.21.15.80:0/2442957556 conn(0x55e18fec14e0 msgr2=0x55e19026afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 -- 172.21.15.80:0/2442957556 shutdown_connections 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 -- 172.21.15.80:0/2442957556 wait complete. 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 -- start start 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.347+0000 7f95749f2740 1 Processor -- start 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fea44d0 0x55e190278f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18feac6b0 0x55e1902794a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fecd390 0x55e1902896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e1902801a0 con 0x55e18fecd390 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e19015adc0 con 0x55e18fea44d0 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e190280320 con 0x55e18feac6b0 2024-04-25T11:34:35.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 10 client.0 _ll_register_callbacks cb 0x55e190176600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fecd390 0x55e1902896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fecd390 0x55e1902896a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54488/0 (socket says 172.21.15.80:54488) 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 -- 172.21.15.80:0/1977690009 learned_addr learned my addr 172.21.15.80:0/1977690009 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9566ffd640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18feac6b0 0x55e1902794a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95677fe640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fea44d0 0x55e190278f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 -- 172.21.15.80:0/1977690009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18feac6b0 msgr2=0x55e1902794a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18feac6b0 0x55e1902794a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 -- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fea44d0 msgr2=0x55e190278f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fea44d0 0x55e190278f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 -- 172.21.15.80:0/1977690009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e18fee53f0 con 0x55e18fecd390 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9566ffd640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18feac6b0 0x55e1902794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95677fe640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fea44d0 0x55e190278f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9567fff640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fecd390 0x55e1902896a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9560009ca0 tx=0x7f95600095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5a9f9a27df4468 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9546ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9546ffd640 1 -- 172.21.15.80:0/1977690009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956004d070 con 0x55e18fecd390 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9546ffd640 1 -- 172.21.15.80:0/1977690009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f9560004450 con 0x55e18fecd390 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f955c009e50 con 0x55e18fecd390 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f9546ffd640 1 -- 172.21.15.80:0/1977690009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9560004650 con 0x55e18fecd390 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.348+0000 7f95749f2740 10 client.17979 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e18ffaf7d0 con 0x55e18fecd390 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f9546ffd640 1 -- 172.21.15.80:0/1977690009 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f955c009e50 con 0x55e18fecd390 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f9546ffd640 1 -- 172.21.15.80:0/1977690009 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9560042040 con 0x55e18fecd390 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95749f2740 10 client.17979 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95749f2740 10 client.17979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95749f2740 20 client.17979 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95749f2740 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fe8bf60 0x55e19028f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95749f2740 4 client.17979 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T11:34:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1901e1990 con 0x55e18fe8bf60 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.349+0000 7f95677fe640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fe8bf60 0x55e19028f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.350+0000 7f95677fe640 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fe8bf60 0x55e19028f9f0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be78f890762c9bd6 server_cookie=a0ddd92286401dac in_seq=0 out_seq=0 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.350+0000 7f9546ffd640 10 client.17979 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.350+0000 7f9546ffd640 1 -- 172.21.15.80:0/1977690009 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e1901e1990 con 0x55e18fe8bf60 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.350+0000 7f9546ffd640 10 client.17979 handle_command_reply: tid=0 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.350+0000 7f95749f2740 1 client.17979 shutdown 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.350+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fecd390 msgr2=0x55e1902896a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.350+0000 7f95749f2740 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fecd390 0x55e1902896a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9560009ca0 tx=0x7f95600095c0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 shutdown_connections 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fe8bf60 0x55e19028f9f0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fecd390 0x55e1902896a0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f9546ffd640 0 client.17979 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18feac6b0 0x55e1902794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 --2- 172.21.15.80:0/1977690009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fea44d0 0x55e190278f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 >> 172.21.15.80:0/1977690009 conn(0x55e18fec14e0 msgr2=0x55e190270530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 shutdown_connections 2024-04-25T11:34:35.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 1 -- 172.21.15.80:0/1977690009 wait complete. 2024-04-25T11:34:35.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.351+0000 7f95749f2740 20 client.17979 trim_cache size 0 max 16384 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.364+0000 7f95749f2740 1 Processor -- start 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.364+0000 7f95749f2740 1 -- start start 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.364+0000 7f95749f2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fe8bf60 0x55e190273430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95749f2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e1902951b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95749f2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18feac6b0 0x55e1902956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95749f2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f95681b01b0 con 0x55e18fe8bf60 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95749f2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95681ada80 con 0x55e18feac6b0 2024-04-25T11:34:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95749f2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f95681ab8f0 con 0x55e18fea44d0 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fe8bf60 0x55e190273430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fe8bf60 0x55e190273430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54492/0 (socket says 172.21.15.80:54492) 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 -- 172.21.15.80:0/2497750931 learned_addr learned my addr 172.21.15.80:0/2497750931 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 -- 172.21.15.80:0/2497750931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 msgr2=0x55e1902951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 --2- 172.21.15.80:0/2497750931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e1902951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 -- 172.21.15.80:0/2497750931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18feac6b0 msgr2=0x55e1902956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 --2- 172.21.15.80:0/2497750931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18feac6b0 0x55e1902956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 -- 172.21.15.80:0/2497750931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e19028a1a0 con 0x55e18fe8bf60 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f95677fe640 1 --2- 172.21.15.80:0/2497750931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fe8bf60 0x55e190273430 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f95580dc930 tx=0x7f9558009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d60529ba81fd002 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f954d7fa640 1 -- 172.21.15.80:0/2497750931 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558020040 con 0x55e18fe8bf60 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f954d7fa640 1 -- 172.21.15.80:0/2497750931 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95580ab130 con 0x55e18fe8bf60 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.365+0000 7f954d7fa640 1 -- 172.21.15.80:0/2497750931 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95580dc5b0 con 0x55e18fe8bf60 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 -- 172.21.15.80:0/2497750931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fe8bf60 msgr2=0x55e190273430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 --2- 172.21.15.80:0/2497750931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fe8bf60 0x55e190273430 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f95580dc930 tx=0x7f9558009f90 comp rx=0 tx=0).stop 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 -- 172.21.15.80:0/2497750931 shutdown_connections 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 --2- 172.21.15.80:0/2497750931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18feac6b0 0x55e1902956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 --2- 172.21.15.80:0/2497750931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e1902951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 --2- 172.21.15.80:0/2497750931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18fe8bf60 0x55e190273430 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 -- 172.21.15.80:0/2497750931 >> 172.21.15.80:0/2497750931 conn(0x55e18fec14e0 msgr2=0x55e190279220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 -- 172.21.15.80:0/2497750931 shutdown_connections 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 -- 172.21.15.80:0/2497750931 wait complete. 2024-04-25T11:34:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.366+0000 7f95749f2740 1 -- start start 2024-04-25T11:34:35.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 1 Processor -- start 2024-04-25T11:34:35.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fe8bf60 0x55e1902830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e190283630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e190283b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f95681abf40 con 0x55e18feac6b0 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95681ad3b0 con 0x55e18fe8bf60 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f95681ac610 con 0x55e18fea44d0 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95749f2740 10 client.0 _ll_register_callbacks cb 0x7f9560009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e190283b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e190283b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54508/0 (socket says 172.21.15.80:54508) 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 -- 172.21.15.80:0/1389678274 learned_addr learned my addr 172.21.15.80:0/1389678274 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9566ffd640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e190283630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95677fe640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fe8bf60 0x55e1902830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 -- 172.21.15.80:0/1389678274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 msgr2=0x55e190283630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e190283630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 -- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fe8bf60 msgr2=0x55e1902830f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fe8bf60 0x55e1902830f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 -- 172.21.15.80:0/1389678274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1902f6d70 con 0x55e18feac6b0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f95677fe640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fe8bf60 0x55e1902830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9566ffd640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e190283630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9567fff640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e190283b70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9560030620 tx=0x7f9560003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8df65cea1afda32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.367+0000 7f9546ffd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f9546ffd640 1 -- 172.21.15.80:0/1389678274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956004d030 con 0x55e18feac6b0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f9546ffd640 1 -- 172.21.15.80:0/1389678274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f9560004450 con 0x55e18feac6b0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95580ab130 con 0x55e18feac6b0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f9546ffd640 1 -- 172.21.15.80:0/1389678274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9560004b40 con 0x55e18feac6b0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 10 client.17985 fetch_fsmap learned FSMap version 24 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e1902f7e50 con 0x55e18feac6b0 2024-04-25T11:34:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f9546ffd640 1 -- 172.21.15.80:0/1389678274 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95580ab130 con 0x55e18feac6b0 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f9546ffd640 1 -- 172.21.15.80:0/1389678274 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f9560042070 con 0x55e18feac6b0 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 10 client.17985 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 10 client.17985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 20 client.17985 populate_metadata read hostname 'smithi080' 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fecd390 0x55e1902fa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 4 client.17985 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.368+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 --> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1901db800 con 0x55e18fecd390 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95677fe640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fecd390 0x55e1902fa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f9546ffd640 10 client.17985 ms_handle_connect on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95677fe640 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fecd390 0x55e1902fa610 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdbab32a61aa602f server_cookie=66f5a1f474e2a008 in_seq=0 out_seq=0 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f9546ffd640 1 -- 172.21.15.80:0/1389678274 <== mds.0 v2:172.21.15.82:6838/3848058015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1901db800 con 0x55e18fecd390 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f9546ffd640 10 client.17985 handle_command_reply: tid=0 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 client.17985 shutdown 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 msgr2=0x55e190283b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e190283b70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9560030620 tx=0x7f9560003d40 comp rx=0 tx=0).stop 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 shutdown_connections 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:6838/3848058015,v1:172.21.15.82:6839/3848058015] conn(0x55e18fecd390 0x55e1902fa610 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e18feac6b0 0x55e190283b70 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e18fea44d0 0x55e190283630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f9546ffd640 0 client.17985 ms_handle_reset on v2:172.21.15.82:6838/3848058015 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 --2- 172.21.15.80:0/1389678274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e18fe8bf60 0x55e1902830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 >> 172.21.15.80:0/1389678274 conn(0x55e18fec14e0 msgr2=0x55e19027a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 shutdown_connections 2024-04-25T11:34:35.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.369+0000 7f95749f2740 1 -- 172.21.15.80:0/1389678274 wait complete. 2024-04-25T11:34:35.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f95749f2740 20 client.17985 trim_cache size 0 max 16384 2024-04-25T11:34:35.367 INFO:teuthology.orchestra.run.smithi080.stdout:[] 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f95500afc60 msgr2=0x7f95500b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f95500afc60 0x7f95500b2170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55e19026b980 tx=0x7f9560009430 comp rx=0 tx=0).stop 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 msgr2=0x7f956819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f956819a7e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f955800d770 tx=0x7f955800dc30 comp rx=0 tx=0).stop 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 shutdown_connections 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f95500afc60 0x7f95500b2170 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9568109fa0 0x7f956819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568109b00 0x7f956819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 --2- 172.21.15.80:0/661999812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681027a0 0x7f956819a7e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 >> 172.21.15.80:0/661999812 conn(0x7f9568077880 msgr2=0x7f9568100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 shutdown_connections 2024-04-25T11:34:35.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:35.370+0000 7f956da68640 1 -- 172.21.15.80:0/661999812 wait complete. 2024-04-25T11:34:35.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:35 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/4026422106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:34:35.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:35 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/4026422106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:34:35.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:35 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/4026422106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:34:36.370 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-04-25T11:34:36.371 INFO:tasks.fwd_scrub:done joining 2024-04-25T11:34:36.371 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-25T11:34:36.382 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 -- 172.21.15.80:0/4280661334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac109bb0 msgr2=0x7fecac101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/4280661334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac109bb0 0x7fecac101b20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009900 tx=0x7fec9c02a410 comp rx=0 tx=0).stop 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 -- 172.21.15.80:0/4280661334 shutdown_connections 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/4280661334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecac10e560 0x7fecac110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/4280661334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fecac102060 0x7fecac102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/4280661334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac109bb0 0x7fecac101b20 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 -- 172.21.15.80:0/4280661334 >> 172.21.15.80:0/4280661334 conn(0x7fecac0fd850 msgr2=0x7fecac0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 -- 172.21.15.80:0/4280661334 shutdown_connections 2024-04-25T11:34:36.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.514+0000 7fecb0f5e640 1 -- 172.21.15.80:0/4280661334 wait complete. 2024-04-25T11:34:36.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.515+0000 7fecb0f5e640 1 Processor -- start 2024-04-25T11:34:36.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.515+0000 7fecb0f5e640 1 -- start start 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.515+0000 7fecb0f5e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac102060 0x7fecac19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.515+0000 7fecb0f5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecac109bb0 0x7fecac19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecb0f5e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fecac10e560 0x7fecac19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecb0f5e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fecac113d20 con 0x7fecac102060 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecb0f5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fecac113ba0 con 0x7fecac109bb0 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecb0f5e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fecac113ea0 con 0x7fecac10e560 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac102060 0x7fecac19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac102060 0x7fecac19a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53702/0 (socket says 172.21.15.80:53702) 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 -- 172.21.15.80:0/3906410536 learned_addr learned my addr 172.21.15.80:0/3906410536 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaad9d640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fecac10e560 0x7fecac19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7feca3fff640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecac109bb0 0x7fecac19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 -- 172.21.15.80:0/3906410536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fecac10e560 msgr2=0x7fecac19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fecac10e560 0x7fecac19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 -- 172.21.15.80:0/3906410536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecac109bb0 msgr2=0x7fecac19ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecac109bb0 0x7fecac19ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 -- 172.21.15.80:0/3906410536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac19f600 con 0x7fecac102060 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecaa59c640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac102060 0x7fecac19a7a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fec9c02a930 tx=0x7fec9c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7feca37fe640 1 -- 172.21.15.80:0/3906410536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c03f030 con 0x7fecac102060 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7feca37fe640 1 -- 172.21.15.80:0/3906410536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec9c003aa0 con 0x7fecac102060 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac19f890 con 0x7fecac102060 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7feca37fe640 1 -- 172.21.15.80:0/3906410536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c035070 con 0x7fecac102060 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.516+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac19fd80 con 0x7fecac102060 2024-04-25T11:34:36.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.517+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecac06a190 con 0x7fecac102060 2024-04-25T11:34:36.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.520+0000 7feca37fe640 1 -- 172.21.15.80:0/3906410536 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fec9c042030 con 0x7fecac102060 2024-04-25T11:34:36.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.520+0000 7feca37fe640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fec980afc60 0x7fec980b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.520+0000 7feca3fff640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fec980afc60 0x7fec980b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.520+0000 7feca37fe640 1 -- 172.21.15.80:0/3906410536 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fec9c0ffc40 con 0x7fecac102060 2024-04-25T11:34:36.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.521+0000 7feca3fff640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fec980afc60 0x7fec980b2170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec94005fd0 tx=0x7fec94005850 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:36.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.524+0000 7feca37fe640 1 -- 172.21.15.80:0/3906410536 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fec9c0c84c0 con 0x7fecac102060 2024-04-25T11:34:36.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.704+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecac1a72d0 con 0x7fecac102060 2024-04-25T11:34:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.706+0000 7feca37fe640 1 -- 172.21.15.80:0/3906410536 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+23147 (secure 0 0 0) 0x7fec9c0c7dc0 con 0x7fecac102060 2024-04-25T11:34:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:34:36.695 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:34:11.655946+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":88,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/4228038844":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1814218335":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/1536113811":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/4111395089":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fec980afc60 msgr2=0x7fec980b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fec980afc60 0x7fec980b2170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec94005fd0 tx=0x7fec94005850 comp rx=0 tx=0).stop 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac102060 msgr2=0x7fecac19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac102060 0x7fecac19a7a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fec9c02a930 tx=0x7fec9c004270 comp rx=0 tx=0).stop 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 shutdown_connections 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fec980afc60 0x7fec980b2170 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fecac10e560 0x7fecac19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecac109bb0 0x7fecac19ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 --2- 172.21.15.80:0/3906410536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecac102060 0x7fecac19a7a0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 >> 172.21.15.80:0/3906410536 conn(0x7fecac0fd850 msgr2=0x7fecac0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 shutdown_connections 2024-04-25T11:34:36.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.708+0000 7fecb0f5e640 1 -- 172.21.15.80:0/3906410536 wait complete. 2024-04-25T11:34:36.707 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:36 smithi080 ceph-mon[29126]: pgmap v322: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:36.708 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 88, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:34:36.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:34:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 -- 172.21.15.80:0/1509441116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a41027e0 msgr2=0x7f05a4110690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/1509441116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a41027e0 0x7f05a4110690 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f059c009ca0 tx=0x7f059c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 -- 172.21.15.80:0/1509441116 shutdown_connections 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/1509441116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a41027e0 0x7f05a4110690 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/1509441116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a410a040 0x7f05a4102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/1509441116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a4109ba0 0x7f05a4101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 -- 172.21.15.80:0/1509441116 >> 172.21.15.80:0/1509441116 conn(0x7f05a4077880 msgr2=0x7f05a4077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 -- 172.21.15.80:0/1509441116 shutdown_connections 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.829+0000 7f05a8b9d640 1 -- 172.21.15.80:0/1509441116 wait complete. 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 Processor -- start 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 -- start start 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a41027e0 0x7f05a419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a4109ba0 0x7f05a419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a410a040 0x7f05a419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05a4113d60 con 0x7f05a410a040 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05a4113be0 con 0x7f05a4109ba0 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.830+0000 7f05a8b9d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05a4113ee0 con 0x7f05a41027e0 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a410a040 0x7f05a419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a410a040 0x7f05a419f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53732/0 (socket says 172.21.15.80:53732) 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 -- 172.21.15.80:0/978244724 learned_addr learned my addr 172.21.15.80:0/978244724 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a259c640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a41027e0 0x7f05a419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f059bfff640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a4109ba0 0x7f05a419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 -- 172.21.15.80:0/978244724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a41027e0 msgr2=0x7f05a419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a41027e0 0x7f05a419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 -- 172.21.15.80:0/978244724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a4109ba0 msgr2=0x7f05a419ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a4109ba0 0x7f05a419ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 -- 172.21.15.80:0/978244724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a419f640 con 0x7f05a410a040 2024-04-25T11:34:36.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a2d9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a410a040 0x7f05a419f000 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f059c0319f0 tx=0x7f059c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f059b7fe640 1 -- 172.21.15.80:0/978244724 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c003bf0 con 0x7f05a410a040 2024-04-25T11:34:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f059b7fe640 1 -- 172.21.15.80:0/978244724 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f059c003d90 con 0x7f05a410a040 2024-04-25T11:34:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a419f8d0 con 0x7f05a410a040 2024-04-25T11:34:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f059b7fe640 1 -- 172.21.15.80:0/978244724 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c02fc00 con 0x7f05a410a040 2024-04-25T11:34:36.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.831+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a419fe20 con 0x7f05a410a040 2024-04-25T11:34:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.832+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a4104f50 con 0x7f05a410a040 2024-04-25T11:34:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.835+0000 7f059b7fe640 1 -- 172.21.15.80:0/978244724 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f059c004610 con 0x7f05a410a040 2024-04-25T11:34:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.835+0000 7f059b7fe640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05900afc60 0x7f05900b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.835+0000 7f05a259c640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05900afc60 0x7f05900b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.835+0000 7f059b7fe640 1 -- 172.21.15.80:0/978244724 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f059c100650 con 0x7f05a410a040 2024-04-25T11:34:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.836+0000 7f05a259c640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05900afc60 0x7f05900b2170 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f059400bbe0 tx=0x7f059400b390 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:36.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:36.839+0000 7f059b7fe640 1 -- 172.21.15.80:0/978244724 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f059c0c8fe0 con 0x7f05a410a040 2024-04-25T11:34:36.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:36 smithi196 ceph-mon[32659]: pgmap v322: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:36.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:36 smithi082 ceph-mon[32440]: pgmap v322: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T11:34:37.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.014+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f05a410bc40 con 0x7f05a410a040 2024-04-25T11:34:37.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.015+0000 7f059b7fe640 1 -- 172.21.15.80:0/978244724 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f059c0c88e0 con 0x7f05a410a040 2024-04-25T11:34:37.004 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05900afc60 msgr2=0x7f05900b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05900afc60 0x7f05900b2170 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f059400bbe0 tx=0x7f059400b390 comp rx=0 tx=0).stop 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a410a040 msgr2=0x7f05a419f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a410a040 0x7f05a419f000 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f059c0319f0 tx=0x7f059c031a20 comp rx=0 tx=0).stop 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 shutdown_connections 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f05900afc60 0x7f05900b2170 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05a410a040 0x7f05a419f000 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05a4109ba0 0x7f05a419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 --2- 172.21.15.80:0/978244724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05a41027e0 0x7f05a419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 >> 172.21.15.80:0/978244724 conn(0x7f05a4077880 msgr2=0x7f05a40ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 shutdown_connections 2024-04-25T11:34:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.017+0000 7f05a8b9d640 1 -- 172.21.15.80:0/978244724 wait complete. 2024-04-25T11:34:37.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:34:37.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 -- 172.21.15.80:0/1600719757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084108a20 msgr2=0x7fb0841025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 --2- 172.21.15.80:0/1600719757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084108a20 0x7fb0841025b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009900 tx=0x7fb06c02a410 comp rx=0 tx=0).stop 2024-04-25T11:34:37.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 -- 172.21.15.80:0/1600719757 shutdown_connections 2024-04-25T11:34:37.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 --2- 172.21.15.80:0/1600719757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08410d380 0x7fb08410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 --2- 172.21.15.80:0/1600719757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb084102af0 0x7fb084102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 --2- 172.21.15.80:0/1600719757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084108a20 0x7fb0841025b0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 -- 172.21.15.80:0/1600719757 >> 172.21.15.80:0/1600719757 conn(0x7fb084078100 msgr2=0x7fb084078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 -- 172.21.15.80:0/1600719757 shutdown_connections 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.137+0000 7fb08990d640 1 -- 172.21.15.80:0/1600719757 wait complete. 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 Processor -- start 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 -- start start 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084102af0 0x7fb08419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb084108a20 0x7fb08419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08410d380 0x7fb08419c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112be0 con 0x7fb084102af0 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112a60 con 0x7fb08410d380 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb08990d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112d60 con 0x7fb084108a20 2024-04-25T11:34:37.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.138+0000 7fb082ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084102af0 0x7fb08419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084102af0 0x7fb08419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53746/0 (socket says 172.21.15.80:53746) 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 -- 172.21.15.80:0/377714617 learned_addr learned my addr 172.21.15.80:0/377714617 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb0837fe640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08410d380 0x7fb08419c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb07a7fc640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb084108a20 0x7fb08419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 -- 172.21.15.80:0/377714617 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb084108a20 msgr2=0x7fb08419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb084108a20 0x7fb08419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 -- 172.21.15.80:0/377714617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08410d380 msgr2=0x7fb08419c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08410d380 0x7fb08419c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 -- 172.21.15.80:0/377714617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0841a6890 con 0x7fb084102af0 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb082ffd640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084102af0 0x7fb08419b580 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb06c032fd0 tx=0x7fb06c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb08890b640 1 -- 172.21.15.80:0/377714617 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c03f030 con 0x7fb084102af0 2024-04-25T11:34:37.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb08890b640 1 -- 172.21.15.80:0/377714617 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb06c004490 con 0x7fb084102af0 2024-04-25T11:34:37.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0841a6b20 con 0x7fb084102af0 2024-04-25T11:34:37.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb08890b640 1 -- 172.21.15.80:0/377714617 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c035070 con 0x7fb084102af0 2024-04-25T11:34:37.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.139+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0841a7010 con 0x7fb084102af0 2024-04-25T11:34:37.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.140+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08406afa0 con 0x7fb084102af0 2024-04-25T11:34:37.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.142+0000 7fb08890b640 1 -- 172.21.15.80:0/377714617 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fb06c042030 con 0x7fb084102af0 2024-04-25T11:34:37.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.142+0000 7fb08890b640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb0640afc60 0x7fb0640b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.142+0000 7fb07a7fc640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb0640afc60 0x7fb0640b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.142+0000 7fb08890b640 1 -- 172.21.15.80:0/377714617 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7fb06c0ff890 con 0x7fb084102af0 2024-04-25T11:34:37.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.143+0000 7fb07a7fc640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb0640afc60 0x7fb0640b2170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb08410e9d0 tx=0x7fb07400b390 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:37.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.146+0000 7fb08890b640 1 -- 172.21.15.80:0/377714617 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb06c0c7ac0 con 0x7fb084102af0 2024-04-25T11:34:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.323+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb084106950 con 0x7fb084102af0 2024-04-25T11:34:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.324+0000 7fb08890b640 1 -- 172.21.15.80:0/377714617 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fb06c0cbdc0 con 0x7fb084102af0 2024-04-25T11:34:37.313 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb0640afc60 msgr2=0x7fb0640b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb0640afc60 0x7fb0640b2170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb08410e9d0 tx=0x7fb07400b390 comp rx=0 tx=0).stop 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084102af0 msgr2=0x7fb08419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084102af0 0x7fb08419b580 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb06c032fd0 tx=0x7fb06c004270 comp rx=0 tx=0).stop 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 shutdown_connections 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fb0640afc60 0x7fb0640b2170 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08410d380 0x7fb08419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb084108a20 0x7fb08419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 --2- 172.21.15.80:0/377714617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb084102af0 0x7fb08419b580 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 >> 172.21.15.80:0/377714617 conn(0x7fb084078100 msgr2=0x7fb0841040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 shutdown_connections 2024-04-25T11:34:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.326+0000 7fb08990d640 1 -- 172.21.15.80:0/377714617 wait complete. 2024-04-25T11:34:37.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:34:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/1462502851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28102b10 msgr2=0x7f9c28102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/1462502851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28102b10 0x7f9c28102f20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c1802a410 comp rx=0 tx=0).stop 2024-04-25T11:34:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/1462502851 shutdown_connections 2024-04-25T11:34:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/1462502851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28102b10 0x7f9c28102f20 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/1462502851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c2810d3a0 0x7f9c2810f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/1462502851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c28108a40 0x7f9c281025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/1462502851 >> 172.21.15.80:0/1462502851 conn(0x7f9c28078180 msgr2=0x7f9c280785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/1462502851 shutdown_connections 2024-04-25T11:34:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.448+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/1462502851 wait complete. 2024-04-25T11:34:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 Processor -- start 2024-04-25T11:34:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 -- start start 2024-04-25T11:34:37.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c28102b10 0x7f9c2819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28108a40 0x7f9c2819acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c2810d3a0 0x7f9c2819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28113d10 con 0x7f9c28108a40 2024-04-25T11:34:37.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28113b90 con 0x7f9c2810d3a0 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2f8ee640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28113e90 con 0x7f9c28102b10 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28108a40 0x7f9c2819acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28108a40 0x7f9c2819acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53764/0 (socket says 172.21.15.80:53764) 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 -- 172.21.15.80:0/3070470039 learned_addr learned my addr 172.21.15.80:0/3070470039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2d68a640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c28102b10 0x7f9c2819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2de8b640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c2810d3a0 0x7f9c2819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 -- 172.21.15.80:0/3070470039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c28102b10 msgr2=0x7f9c2819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c28102b10 0x7f9c2819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 -- 172.21.15.80:0/3070470039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c2810d3a0 msgr2=0x7f9c2819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c2810d3a0 0x7f9c2819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.449+0000 7f9c2ce89640 1 -- 172.21.15.80:0/3070470039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2819f5d0 con 0x7f9c28108a40 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.450+0000 7f9c2ce89640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28108a40 0x7f9c2819acd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9c1802a930 tx=0x7f9c18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.450+0000 7f9c1e7fc640 1 -- 172.21.15.80:0/3070470039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1803f030 con 0x7f9c28108a40 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.450+0000 7f9c1e7fc640 1 -- 172.21.15.80:0/3070470039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c18003aa0 con 0x7f9c28108a40 2024-04-25T11:34:37.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.450+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2819f860 con 0x7f9c28108a40 2024-04-25T11:34:37.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.450+0000 7f9c1e7fc640 1 -- 172.21.15.80:0/3070470039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18035070 con 0x7f9c28108a40 2024-04-25T11:34:37.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.450+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2819fd50 con 0x7f9c28108a40 2024-04-25T11:34:37.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.451+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c280692e0 con 0x7f9c28108a40 2024-04-25T11:34:37.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.452+0000 7f9c1e7fc640 1 -- 172.21.15.80:0/3070470039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f9c18042030 con 0x7f9c28108a40 2024-04-25T11:34:37.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.453+0000 7f9c1e7fc640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c140afc60 0x7f9c140b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.453+0000 7f9c2d68a640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c140afc60 0x7f9c140b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.453+0000 7f9c1e7fc640 1 -- 172.21.15.80:0/3070470039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f9c180ffc40 con 0x7f9c28108a40 2024-04-25T11:34:37.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.453+0000 7f9c2d68a640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c140afc60 0x7f9c140b2170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c24005fd0 tx=0x7f9c24005850 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:37.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.456+0000 7f9c1e7fc640 1 -- 172.21.15.80:0/3070470039 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9c180c84c0 con 0x7f9c28108a40 2024-04-25T11:34:37.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.634+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9c28106f00 con 0x7f9c28108a40 2024-04-25T11:34:37.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:37 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3906410536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:34:37.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:37 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/978244724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:34:37.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:37 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/377714617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:34:37.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.634+0000 7f9c1e7fc640 1 -- 172.21.15.80:0/3070470039 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f9c180c7dc0 con 0x7f9c28108a40 2024-04-25T11:34:37.624 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:34:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c140afc60 msgr2=0x7f9c140b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c140afc60 0x7f9c140b2170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c24005fd0 tx=0x7f9c24005850 comp rx=0 tx=0).stop 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28108a40 msgr2=0x7f9c2819acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28108a40 0x7f9c2819acd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9c1802a930 tx=0x7f9c18004270 comp rx=0 tx=0).stop 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 shutdown_connections 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f9c140afc60 0x7f9c140b2170 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c28108a40 0x7f9c2819acd0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c2810d3a0 0x7f9c2819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 --2- 172.21.15.80:0/3070470039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c28102b10 0x7f9c2819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.636+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 >> 172.21.15.80:0/3070470039 conn(0x7f9c28078180 msgr2=0x7f9c281040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.637+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 shutdown_connections 2024-04-25T11:34:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.637+0000 7f9c2f8ee640 1 -- 172.21.15.80:0/3070470039 wait complete. 2024-04-25T11:34:37.636 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-25T11:34:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 -- 172.21.15.80:0/853461211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae0108a30 msgr2=0x7f3ae01025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/853461211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae0108a30 0x7f3ae01025c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad402a410 comp rx=0 tx=0).stop 2024-04-25T11:34:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 -- 172.21.15.80:0/853461211 shutdown_connections 2024-04-25T11:34:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/853461211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ae010d390 0x7f3ae010f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/853461211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae0102b00 0x7f3ae0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/853461211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae0108a30 0x7f3ae01025c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 -- 172.21.15.80:0/853461211 >> 172.21.15.80:0/853461211 conn(0x7f3ae00fe080 msgr2=0x7f3ae01004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 -- 172.21.15.80:0/853461211 shutdown_connections 2024-04-25T11:34:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.757+0000 7f3ae53ba640 1 -- 172.21.15.80:0/853461211 wait complete. 2024-04-25T11:34:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 Processor -- start 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 -- start start 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae0102b00 0x7f3ae019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ae0108a30 0x7f3ae019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae010d390 0x7f3ae019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0113da0 con 0x7f3ae010d390 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0113c20 con 0x7f3ae0102b00 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ae53ba640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0113f20 con 0x7f3ae0108a30 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae010d390 0x7f3ae019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae010d390 0x7f3ae019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53792/0 (socket says 172.21.15.80:53792) 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 -- 172.21.15.80:0/1196964389 learned_addr learned my addr 172.21.15.80:0/1196964389 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ade7fc640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ae0108a30 0x7f3ae019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adeffd640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae0102b00 0x7f3ae019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 -- 172.21.15.80:0/1196964389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ae0108a30 msgr2=0x7f3ae019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ae0108a30 0x7f3ae019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 -- 172.21.15.80:0/1196964389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae0102b00 msgr2=0x7f3ae019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae0102b00 0x7f3ae019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adf7fe640 1 -- 172.21.15.80:0/1196964389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae019f580 con 0x7f3ae010d390 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3ade7fc640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ae0108a30 0x7f3ae019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.758+0000 7f3adeffd640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae0102b00 0x7f3ae019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.759+0000 7f3adf7fe640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae010d390 0x7f3ae019ef40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800b970 tx=0x7f3ad800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.759+0000 7f3ac7fff640 1 -- 172.21.15.80:0/1196964389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8019070 con 0x7f3ae010d390 2024-04-25T11:34:37.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.759+0000 7f3ac7fff640 1 -- 172.21.15.80:0/1196964389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ad8014440 con 0x7f3ae010d390 2024-04-25T11:34:37.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.759+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae019f870 con 0x7f3ae010d390 2024-04-25T11:34:37.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.759+0000 7f3ac7fff640 1 -- 172.21.15.80:0/1196964389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80075d0 con 0x7f3ae010d390 2024-04-25T11:34:37.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.759+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01a71f0 con 0x7f3ae010d390 2024-04-25T11:34:37.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.760+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae006a190 con 0x7f3ae010d390 2024-04-25T11:34:37.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.761+0000 7f3ac7fff640 1 -- 172.21.15.80:0/1196964389 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f3ad801c070 con 0x7f3ae010d390 2024-04-25T11:34:37.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.762+0000 7f3ac7fff640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3ac80afc60 0x7f3ac80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:34:37.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.762+0000 7f3adeffd640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3ac80afc60 0x7f3ac80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:34:37.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.762+0000 7f3ac7fff640 1 -- 172.21.15.80:0/1196964389 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8550+0+0 (secure 0 0 0) 0x7f3ad80deaa0 con 0x7f3ae010d390 2024-04-25T11:34:37.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.763+0000 7f3adeffd640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3ac80afc60 0x7f3ac80b2170 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3ad402a930 tx=0x7f3ad4005fd0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:34:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.766+0000 7f3ac7fff640 1 -- 172.21.15.80:0/1196964389 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3ad80a7430 con 0x7f3ae010d390 2024-04-25T11:34:37.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:37 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3906410536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:34:37.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:37 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/978244724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:34:37.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:37 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/377714617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:34:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.990+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f3ae01a7450 con 0x7f3ae010d390 2024-04-25T11:34:37.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:37.999+0000 7f3ac7fff640 1 -- 172.21.15.80:0/1196964389 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+803658 (secure 0 0 0) 0x7f3ad80a6d30 con 0x7f3ae010d390 2024-04-25T11:34:37.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:37 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3906410536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:34:37.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:37 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/978244724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:34:37.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:37 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/377714617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 25, 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "active_gid": 15318, 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "active_name": "x", 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "active_addrs": { 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1167903144 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:37.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1167903144 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "active_addr": "172.21.15.80:6801/1167903144", 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "active_change": "2024-04-25T11:24:14.749987+0000", 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "active_mgr_features": 4540701547738038271, 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "available": true, 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "standbys": [ 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "gid": 24956, 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "y", 2024-04-25T11:34:38.000 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_features": 4540701547738038271, 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "available_modules": [ 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "alerts", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.001 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.005 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.006 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_destination": { 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_destination", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.007 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email address to send alerts to", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_from_name": { 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_from_name", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "Ceph", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email From: name", 2024-04-25T11:34:38.008 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_host": { 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_host", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP server", 2024-04-25T11:34:38.009 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_password": { 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_password", 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.010 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Password to authenticate with", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_port": { 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_port", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "465", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP port", 2024-04-25T11:34:38.011 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_sender": { 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_sender", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP envelope sender", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.012 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_ssl": { 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_ssl", 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.013 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_user": { 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_user", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "User to authenticate as", 2024-04-25T11:34:38.014 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.015 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "balancer", 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "active": { 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "active", 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.016 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_time": { 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_time", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0000", 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_weekday": { 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_weekday", 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.018 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_max_iterations": { 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_max_iterations", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.019 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "25", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "250", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_metrics": { 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_metrics", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T11:34:38.020 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_step": { 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_step", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.5", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0.001", 2024-04-25T11:34:38.021 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "0.999", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "aggressiveness of optimization", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "end_time": { 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_time", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2359", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.022 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "end_weekday": { 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_weekday", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-25T11:34:38.023 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.024 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.025 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.027 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.029 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "min_score": { 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_score", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.031 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "upmap", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-compat", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "none", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "read", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap", 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap-read" 2024-04-25T11:34:38.032 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Balancer mode", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_ids": { 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_ids", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T11:34:38.033 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.034 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.035 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_deviation": { 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_deviation", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T11:34:38.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_optimizations": { 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_optimizations", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.037 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm", 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_down_multiplier": { 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_down_multiplier", 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.038 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_refresh_rate": { 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_refresh_rate", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "20", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_starting_port": { 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_starting_port", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.040 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4721", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_ptrace": { 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_ptrace", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.041 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_interval": { 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_interval", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.042 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_memory_target_ratio": { 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.043 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.7", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_log_destination": { 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm_log_destination", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.044 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "file", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "file,syslog", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "syslog" 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "cgroups_split": { 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cgroups_split", 2024-04-25T11:34:38.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "config_checks_enabled": { 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_checks_enabled", 2024-04-25T11:34:38.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "config_dashboard": { 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_dashboard", 2024-04-25T11:34:38.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_alertmanager": { 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_alertmanager", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.048 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_base": { 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_base", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Container image name, without the tag", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_elasticsearch": { 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_elasticsearch", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.050 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "elasticsearch container image", 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_grafana": { 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_grafana", 2024-04-25T11:34:38.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_haproxy": { 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_haproxy", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.052 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "HAproxy container image", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_agent": { 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_agent", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.053 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger agent container image", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_collector": { 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_collector", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.054 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger collector container image", 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_query": { 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_query", 2024-04-25T11:34:38.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger query container image", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_keepalived": { 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_keepalived", 2024-04-25T11:34:38.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Keepalived container image", 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_loki": { 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_loki", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Loki container image", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.058 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_node_exporter": { 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_node_exporter", 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.059 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_nvmeof": { 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_nvmeof", 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.060 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Nvme-of container image", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_prometheus": { 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_prometheus", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.061 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_promtail": { 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_promtail", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.062 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Promtail container image", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_samba": { 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_samba", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.063 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Samba/SMB container image", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_snmp_gateway": { 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_snmp_gateway", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.064 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SNMP Gateway container image", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "container_init": { 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_init", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "daemon_cache_timeout": { 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "daemon_cache_timeout", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "default_cephadm_command_timeout": { 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "900", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "default_registry": { 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_registry", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "device_cache_timeout": { 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_cache_timeout", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1800", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache device inventory", 2024-04-25T11:34:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "device_enhanced_scan": { 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_enhanced_scan", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T11:34:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "facts_cache_timeout": { 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "facts_cache_timeout", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache host facts data", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "grafana_dashboards_path": { 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "grafana_dashboards_path", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "host_check_interval": { 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "host_check_interval", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to perform a host check", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "hw_monitoring": { 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hw_monitoring", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "inventory_list_all": { 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "inventory_list_all", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "log_refresh_metadata": { 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_refresh_metadata", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T11:34:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T11:34:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "*", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "max_count_per_host": { 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_count_per_host", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of daemons per service per host", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd_draining_count": { 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_osd_draining_count", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "migration_current": { 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "migration_current", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "internal - do not modify", 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "root", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm-package", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "root" 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "oob_default_addr": { 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "oob_default_addr", 2024-04-25T11:34:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "169.254.1.1", 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "prometheus_alerts_path": { 2024-04-25T11:34:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus_alerts_path", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_insecure": { 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_insecure", 2024-04-25T11:34:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_password": { 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_password", 2024-04-25T11:34:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_url": { 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_url", 2024-04-25T11:34:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_username": { 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_username", 2024-04-25T11:34:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "secure_monitoring_stack": { 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "secure_monitoring_stack", 2024-04-25T11:34:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "service_discovery_port": { 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "service_discovery_port", 2024-04-25T11:34:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8765", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "cephadm service discovery port", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ssh_config_file": { 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssh_config_file", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "use_agent": { 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_agent", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "use_repo_digest": { 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_repo_digest", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_failed_host_check": { 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_failed_host_check", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_daemons": { 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_daemons", 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_hosts": { 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_hosts", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crash", 2024-04-25T11:34:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "retain_interval": { 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retain_interval", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "31536000", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_recent_interval": { 2024-04-25T11:34:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_recent_interval", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1209600", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dashboard", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_ENABLED": { 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T11:34:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T11:34:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_URL": { 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_URL", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T11:34:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T11:34:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T11:34:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "[]", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "{}", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.136 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T11:34:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8", 2024-04-25T11:34:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "45", 2024-04-25T11:34:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "cross_origin_url": { 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cross_origin_url", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "crt_file": { 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crt_file", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "debug": { 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "debug", 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable/disable debug options", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "jwt_token_ttl": { 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "jwt_token_ttl", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "28800", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.164 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.165 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "motd": { 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "motd", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.166 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "The message of the day", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect_resolve_ip_addr": { 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.167 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.168 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8080", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.169 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.170 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.171 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl_server_port": { 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl_server_port", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8443", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.172 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "redirect", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect" 2024-04-25T11:34:38.173 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.174 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "url_prefix": { 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url_prefix", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.175 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_monitoring": { 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_monitoring", 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "monitor device health metrics", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.177 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.178 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.179 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.180 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.181 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mark_out_threshold": { 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mark_out_threshold", 2024-04-25T11:34:38.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2419200", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": { 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_name", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.183 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "device_health_metrics", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "retention_period": { 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retention_period", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15552000", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain device health metrics", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_frequency": { 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_frequency", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.185 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "self_heal": { 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "self_heal", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.187 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.188 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_threshold": { 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_threshold", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7257600", 2024-04-25T11:34:38.189 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "diskprediction_local", 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.190 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.191 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.192 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.193 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.194 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "predict_interval": { 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predict_interval", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "predictor_model": { 2024-04-25T11:34:38.196 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predictor_model", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "prophetstor", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.199 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "influx", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": false, 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "influxdb python module not found", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "batch_size": { 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "batch_size", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5000", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T11:34:38.200 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "database": { 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "database", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "ceph", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T11:34:38.201 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": { 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hostname", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server hostname", 2024-04-25T11:34:38.202 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "30", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "5", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T11:34:38.203 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.204 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.206 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.207 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "password": { 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "password", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "password of InfluxDB server user", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "port": { 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "port", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8086", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server port", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-25T11:34:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "false", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "threads": { 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threads", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "32", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "username": { 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "username", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.213 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "username of InfluxDB server user", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "verify_ssl": { 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "verify_ssl", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "true", 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "insights", 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "iostat", 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "k8sevents", 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_event_retention_days": { 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ceph_event_retention_days", 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7", 2024-04-25T11:34:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "config_check_secs": { 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_check_secs", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "10", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "localpool", 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "failure_domain": { 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "failure_domain", 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "host", 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.236 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "failure domain for any created local pool", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.237 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.238 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.239 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.241 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": { 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_size", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default min_size for any created local pool", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T11:34:38.242 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "num_rep": { 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "num_rep", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default replica count for any created local pool", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.243 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": { 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_num", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "128", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.244 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "prefix": { 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prefix", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name prefix for any created local pool", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.245 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.246 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "subtree": { 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "subtree", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "rack", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T11:34:38.247 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mds_autoscaler", 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.248 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.249 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.250 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.251 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.252 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.253 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirroring", 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.254 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.255 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.256 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.257 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.258 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.259 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.260 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "nfs", 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.261 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.262 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.263 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.264 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.265 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.266 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.267 INFO:teuthology.orchestra.run.smithi080.stdout: "fail_fs": { 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "fail_fs", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.268 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.269 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.270 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.271 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.272 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator": { 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "rook", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "test_orchestrator" 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Orchestrator backend", 2024-04-25T11:34:38.274 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.275 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_perf_query", 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.276 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.277 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.278 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.279 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.280 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.281 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_support", 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.282 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.283 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.284 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.285 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.286 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.288 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_autoscaler", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.289 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.290 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.291 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.293 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.294 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "threshold": { 2024-04-25T11:34:38.295 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threshold", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1.0", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "scaling threshold", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "progress", 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_pg_recovery_event": { 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_pg_recovery_event", 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.297 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.298 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.300 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.301 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.302 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.303 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "max_completed_events": { 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_completed_events", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "50", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.304 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "number of past completed events to remember", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long the module is going to sleep", 2024-04-25T11:34:38.305 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.306 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus", 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "cache": { 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cache", 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.307 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "exclude_perf_counters": { 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "exclude_perf_counters", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.308 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.309 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.310 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.311 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.312 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.313 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools": { 2024-04-25T11:34:38.314 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T11:34:38.315 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "300", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_interval": { 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_interval", 2024-04-25T11:34:38.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15.0", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:38.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:38.318 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "9283", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.319 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "stale_cache_strategy": { 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stale_cache_strategy", 2024-04-25T11:34:38.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "log", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.321 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "default", 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "default", 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "error" 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.322 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.324 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.325 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.326 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.327 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.328 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_snap_create": { 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_snap_create", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.329 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "mirror_snapshot_schedule": { 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.330 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.331 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "trash_purge_schedule": { 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "trash_purge_schedule", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.332 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "restful", 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.333 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_auth": { 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_auth", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.334 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.335 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.336 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.337 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.339 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.340 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.341 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.342 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rgw", 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.343 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.344 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.345 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.346 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.347 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.348 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rook", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.350 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.353 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.354 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.355 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_class": { 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "storage_class", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "local", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T11:34:38.356 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "selftest", 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.357 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.358 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.359 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.360 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.361 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "roption1": { 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption1", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.362 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "roption2": { 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption2", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "xyz", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption1": { 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption1", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.364 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption2": { 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption2", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.365 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption3": { 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption3", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.366 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption4": { 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption4", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.367 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption5": { 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption5", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.368 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption6": { 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption6", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.369 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption7": { 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption7", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.370 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "42", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.371 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "testkey": { 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testkey", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.372 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "testlkey": { 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testlkey", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.373 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "testnewline": { 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testnewline", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.374 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_m_granularity": { 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_m_granularity", 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "dump_on_update": { 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dump_on_update", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "dump database to debug log on update", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.377 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.378 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.379 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.380 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.381 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.382 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stats", 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.383 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.384 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.385 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.386 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.387 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.388 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "status", 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.389 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.390 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.391 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.392 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.394 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.395 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telegraf", 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "address": { 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "address", 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.396 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15", 2024-04-25T11:34:38.397 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.398 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.401 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.402 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.403 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telemetry", 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_basic": { 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_basic", 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.404 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_crash": { 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_crash", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.405 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_device": { 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_device", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.406 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_ident": { 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_ident", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T11:34:38.407 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_perf": { 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_perf", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.408 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "contact": { 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "contact", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.409 INFO:teuthology.orchestra.run.smithi080.stdout: "description": { 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "description", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.410 INFO:teuthology.orchestra.run.smithi080.stdout: "device_url": { 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_url", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-25T11:34:38.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.412 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "24", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "8", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "last_opt_revision": { 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "last_opt_revision", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.413 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard": { 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.414 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard_description": { 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard_description", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.415 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.416 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.417 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.419 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "organization": { 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "organization", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.421 INFO:teuthology.orchestra.run.smithi080.stdout: "proxy": { 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "proxy", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.422 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "url": { 2024-04-25T11:34:38.423 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "test_orchestrator", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.425 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.426 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.427 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.429 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.431 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.433 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.434 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.435 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_clones": { 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_clones", 2024-04-25T11:34:38.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "periodic_async_work": { 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "periodic_async_work", 2024-04-25T11:34:38.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Periodically check for async work", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_delay": { 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_delay", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_no_wait": { 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.440 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.441 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.442 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "discovery_interval": { 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "discovery_interval", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "100", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.443 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "identifier": { 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "identifier", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.444 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.445 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.446 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.447 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.448 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.449 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.450 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.451 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_host": { 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_host", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.452 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_port": { 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_port", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10051", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.453 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_sender": { 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_sender", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.454 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: "gid": 24961, 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "z", 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_features": 4540701547738038271, 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: "available_modules": [ 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.455 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "alerts", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T11:34:38.456 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.457 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.459 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.460 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.461 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_destination": { 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_destination", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.462 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email address to send alerts to", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_from_name": { 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_from_name", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "Ceph", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.463 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email From: name", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_host": { 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_host", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.464 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP server", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_password": { 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_password", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Password to authenticate with", 2024-04-25T11:34:38.465 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_port": { 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_port", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "465", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP port", 2024-04-25T11:34:38.466 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_sender": { 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_sender", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP envelope sender", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.467 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_ssl": { 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_ssl", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.468 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_user": { 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_user", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "User to authenticate as", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.470 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "balancer", 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "active": { 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "active", 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.471 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_time": { 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_time", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0000", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.472 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_weekday": { 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_weekday", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-25T11:34:38.473 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_max_iterations": { 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_max_iterations", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "25", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "250", 2024-04-25T11:34:38.474 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_metrics": { 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_metrics", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.475 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_step": { 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_step", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.5", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0.001", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "0.999", 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.476 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "aggressiveness of optimization", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "end_time": { 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_time", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2359", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T11:34:38.477 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "end_weekday": { 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_weekday", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T11:34:38.478 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.479 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.480 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.481 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.482 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "min_score": { 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_score", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "upmap", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-compat", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "none", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "read", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap", 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap-read" 2024-04-25T11:34:38.485 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Balancer mode", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_ids": { 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_ids", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.486 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.487 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.488 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_deviation": { 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_deviation", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T11:34:38.489 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_optimizations": { 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_optimizations", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T11:34:38.490 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm", 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_down_multiplier": { 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_down_multiplier", 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.491 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_refresh_rate": { 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_refresh_rate", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.492 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "20", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_starting_port": { 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_starting_port", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.493 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4721", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_ptrace": { 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_ptrace", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.494 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_interval": { 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_interval", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.495 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_memory_target_ratio": { 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.7", 2024-04-25T11:34:38.496 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_log_destination": { 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm_log_destination", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.497 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "file", 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "file,syslog", 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "syslog" 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "cgroups_split": { 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cgroups_split", 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.498 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "config_checks_enabled": { 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_checks_enabled", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.499 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "config_dashboard": { 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_dashboard", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.500 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_alertmanager": { 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_alertmanager", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.501 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_base": { 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_base", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.502 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Container image name, without the tag", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_elasticsearch": { 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_elasticsearch", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T11:34:38.503 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "elasticsearch container image", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_grafana": { 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_grafana", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.504 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_haproxy": { 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_haproxy", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.505 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "HAproxy container image", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_agent": { 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_agent", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.506 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger agent container image", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_collector": { 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_collector", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.507 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger collector container image", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_query": { 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_query", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.508 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger query container image", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_keepalived": { 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_keepalived", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.509 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Keepalived container image", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_loki": { 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_loki", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.510 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Loki container image", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_node_exporter": { 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_node_exporter", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.511 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_nvmeof": { 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_nvmeof", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.512 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Nvme-of container image", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_prometheus": { 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_prometheus", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.513 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_promtail": { 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_promtail", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Promtail container image", 2024-04-25T11:34:38.514 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_samba": { 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_samba", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Samba/SMB container image", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_snmp_gateway": { 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_snmp_gateway", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SNMP Gateway container image", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.516 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "container_init": { 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_init", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "daemon_cache_timeout": { 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "daemon_cache_timeout", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "default_cephadm_command_timeout": { 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "900", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "default_registry": { 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_registry", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "device_cache_timeout": { 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_cache_timeout", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1800", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache device inventory", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.521 INFO:teuthology.orchestra.run.smithi080.stdout: "device_enhanced_scan": { 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_enhanced_scan", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.522 INFO:teuthology.orchestra.run.smithi080.stdout: "facts_cache_timeout": { 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "facts_cache_timeout", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache host facts data", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "grafana_dashboards_path": { 2024-04-25T11:34:38.523 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "grafana_dashboards_path", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "host_check_interval": { 2024-04-25T11:34:38.524 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "host_check_interval", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to perform a host check", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "hw_monitoring": { 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hw_monitoring", 2024-04-25T11:34:38.525 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "inventory_list_all": { 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "inventory_list_all", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.526 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.528 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "log_refresh_metadata": { 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_refresh_metadata", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.531 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.532 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.533 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "*", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.534 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "max_count_per_host": { 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_count_per_host", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.535 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of daemons per service per host", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd_draining_count": { 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_osd_draining_count", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.536 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "migration_current": { 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "migration_current", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.537 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "internal - do not modify", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "root", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.538 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm-package", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "root" 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "oob_default_addr": { 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "oob_default_addr", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "169.254.1.1", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.539 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "prometheus_alerts_path": { 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus_alerts_path", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.540 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_insecure": { 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_insecure", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.541 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_password": { 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_password", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T11:34:38.542 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_url": { 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_url", 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.543 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_username": { 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_username", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T11:34:38.544 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "secure_monitoring_stack": { 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "secure_monitoring_stack", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.545 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "service_discovery_port": { 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "service_discovery_port", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8765", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "cephadm service discovery port", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.546 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.547 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "ssh_config_file": { 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssh_config_file", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.548 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "use_agent": { 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_agent", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.549 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "use_repo_digest": { 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_repo_digest", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.550 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_failed_host_check": { 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_failed_host_check", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.551 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_daemons": { 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_daemons", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_hosts": { 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_hosts", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crash", 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.557 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.558 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "retain_interval": { 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retain_interval", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "31536000", 2024-04-25T11:34:38.559 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.560 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_recent_interval": { 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_recent_interval", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1209600", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.561 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dashboard", 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T11:34:38.562 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T11:34:38.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.564 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_ENABLED": { 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.565 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.566 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.567 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.568 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.569 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.570 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.571 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.572 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.573 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.574 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.575 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.576 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.577 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_URL": { 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_URL", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.579 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.580 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.581 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.582 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.583 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "[]", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.584 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "{}", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.586 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.587 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.588 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.590 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.592 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T11:34:38.593 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.594 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.595 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.596 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T11:34:38.597 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T11:34:38.598 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "45", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.599 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.600 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T11:34:38.601 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.602 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.603 INFO:teuthology.orchestra.run.smithi080.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T11:34:38.604 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T11:34:38.605 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T11:34:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "cross_origin_url": { 2024-04-25T11:34:38.607 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cross_origin_url", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "crt_file": { 2024-04-25T11:34:38.608 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crt_file", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "debug": { 2024-04-25T11:34:38.609 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "debug", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable/disable debug options", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "jwt_token_ttl": { 2024-04-25T11:34:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "jwt_token_ttl", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "28800", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-25T11:34:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "motd": { 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "motd", 2024-04-25T11:34:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "The message of the day", 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect_resolve_ip_addr": { 2024-04-25T11:34:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8080", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-25T11:34:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl_server_port": { 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl_server_port", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8443", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "redirect", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect" 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "url_prefix": { 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url_prefix", 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_monitoring": { 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_monitoring", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "monitor device health metrics", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "mark_out_threshold": { 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mark_out_threshold", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2419200", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": { 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_name", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "device_health_metrics", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "retention_period": { 2024-04-25T11:34:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retention_period", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15552000", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain device health metrics", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_frequency": { 2024-04-25T11:34:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_frequency", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "self_heal": { 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "self_heal", 2024-04-25T11:34:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_threshold": { 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_threshold", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7257600", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "diskprediction_local", 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "predict_interval": { 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predict_interval", 2024-04-25T11:34:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "predictor_model": { 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predictor_model", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "prophetstor", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "influx", 2024-04-25T11:34:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": false, 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "influxdb python module not found", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "batch_size": { 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "batch_size", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5000", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "database": { 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "database", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "ceph", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": { 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hostname", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server hostname", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "30", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "5", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "password": { 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "password", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "password of InfluxDB server user", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "port": { 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "port", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8086", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server port", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "false", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "threads": { 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threads", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "32", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "username": { 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "username", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "username of InfluxDB server user", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "verify_ssl": { 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "verify_ssl", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "true", 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "insights", 2024-04-25T11:34:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "iostat", 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "k8sevents", 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_event_retention_days": { 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ceph_event_retention_days", 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "config_check_secs": { 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_check_secs", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "10", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "localpool", 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "failure_domain": { 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "failure_domain", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "host", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "failure domain for any created local pool", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": { 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_size", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default min_size for any created local pool", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "num_rep": { 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "num_rep", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default replica count for any created local pool", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": { 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_num", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "128", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "prefix": { 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prefix", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name prefix for any created local pool", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "subtree": { 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "subtree", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "rack", 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mds_autoscaler", 2024-04-25T11:34:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirroring", 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "nfs", 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.716 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.717 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.718 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.719 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.720 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.721 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.722 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "fail_fs": { 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "fail_fs", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.723 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.725 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.726 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.727 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator": { 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "rook", 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "test_orchestrator" 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.729 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Orchestrator backend", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.730 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_perf_query", 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.731 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.732 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.734 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.735 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.736 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_support", 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.737 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.738 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.739 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.740 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.741 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.742 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_autoscaler", 2024-04-25T11:34:38.743 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.744 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.745 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.746 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.747 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.749 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.750 INFO:teuthology.orchestra.run.smithi080.stdout: "threshold": { 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threshold", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1.0", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "scaling threshold", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "progress", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_pg_recovery_event": { 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_pg_recovery_event", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.752 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.753 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.754 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.755 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.756 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.757 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.758 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "max_completed_events": { 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_completed_events", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "50", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.759 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "number of past completed events to remember", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.760 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long the module is going to sleep", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.761 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus", 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.762 INFO:teuthology.orchestra.run.smithi080.stdout: "cache": { 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cache", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.763 INFO:teuthology.orchestra.run.smithi080.stdout: "exclude_perf_counters": { 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "exclude_perf_counters", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.765 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.766 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.767 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.768 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools": { 2024-04-25T11:34:38.769 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.770 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "300", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.771 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_interval": { 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_interval", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15.0", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:38.772 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:38.773 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "9283", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.774 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "stale_cache_strategy": { 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stale_cache_strategy", 2024-04-25T11:34:38.775 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "log", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-25T11:34:38.776 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "default", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "default", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "error" 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.779 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.780 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.781 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.782 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.783 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_snap_create": { 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_snap_create", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.784 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "mirror_snapshot_schedule": { 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.785 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.786 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "trash_purge_schedule": { 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "trash_purge_schedule", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.787 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "restful", 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_auth": { 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_auth", 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.788 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.789 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.790 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.791 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.792 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.793 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.794 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.795 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.796 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.797 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rgw", 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.798 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.799 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.800 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.801 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.802 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.803 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.804 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rook", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.805 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.806 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.807 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.808 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.809 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_class": { 2024-04-25T11:34:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "storage_class", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "local", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "selftest", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.813 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.814 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.815 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.816 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "roption1": { 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption1", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.817 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "roption2": { 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption2", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "xyz", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.818 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption1": { 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption1", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption2": { 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption2", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption3": { 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption3", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.821 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption4": { 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption4", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.822 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption5": { 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption5", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.823 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption6": { 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption6", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption7": { 2024-04-25T11:34:38.824 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption7", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "42", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.825 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "testkey": { 2024-04-25T11:34:38.826 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testkey", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "testlkey": { 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testlkey", 2024-04-25T11:34:38.827 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "testnewline": { 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testnewline", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.828 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-25T11:34:38.829 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_m_granularity": { 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_m_granularity", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T11:34:38.830 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "dump_on_update": { 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dump_on_update", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "dump database to debug log on update", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.831 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.832 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.833 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.834 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.835 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.836 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.837 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stats", 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.838 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.839 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.840 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.841 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.842 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.843 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "status", 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.844 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.845 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.846 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.847 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.848 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.849 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.850 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telegraf", 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "address": { 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "address", 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.851 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15", 2024-04-25T11:34:38.852 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.853 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.854 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.855 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.856 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.857 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.858 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telemetry", 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_basic": { 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_basic", 2024-04-25T11:34:38.859 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_crash": { 2024-04-25T11:34:38.860 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_crash", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_device": { 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_device", 2024-04-25T11:34:38.861 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_ident": { 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_ident", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.863 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_perf": { 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_perf", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.864 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "contact": { 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "contact", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.865 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "description": { 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "description", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.866 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "device_url": { 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_url", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.867 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.868 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "24", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "8", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "last_opt_revision": { 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "last_opt_revision", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard": { 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.871 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard_description": { 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard_description", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.872 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.873 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.874 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.875 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.876 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "organization": { 2024-04-25T11:34:38.877 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "organization", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.878 INFO:teuthology.orchestra.run.smithi080.stdout: "proxy": { 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "proxy", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.879 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "url": { 2024-04-25T11:34:38.880 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "test_orchestrator", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.882 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.883 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.884 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.885 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.886 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.887 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.888 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.889 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.890 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.891 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.892 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_clones": { 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_clones", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.893 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "periodic_async_work": { 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "periodic_async_work", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.894 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Periodically check for async work", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_delay": { 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_delay", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.895 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_no_wait": { 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.896 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.897 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix", 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.898 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "discovery_interval": { 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "discovery_interval", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "100", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "identifier": { 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "identifier", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.901 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.902 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.903 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.904 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.905 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.906 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_host": { 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_host", 2024-04-25T11:34:38.907 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_port": { 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_port", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.908 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10051", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_sender": { 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_sender", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.909 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.910 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "modules": [ 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "dashboard", 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "iostat", 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "nfs", 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "restful", 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_schedule" 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: "available_modules": [ 2024-04-25T11:34:38.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "alerts", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T11:34:38.912 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.913 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.914 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.915 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.917 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_destination": { 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_destination", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email address to send alerts to", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.918 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_from_name": { 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_from_name", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "Ceph", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email From: name", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_host": { 2024-04-25T11:34:38.919 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_host", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP server", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_password": { 2024-04-25T11:34:38.920 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_password", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Password to authenticate with", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.921 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_port": { 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_port", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "465", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP port", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.922 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_sender": { 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_sender", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP envelope sender", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.923 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_ssl": { 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_ssl", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.924 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_user": { 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_user", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "User to authenticate as", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.925 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.926 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "balancer", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "active": { 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "active", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.927 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_time": { 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_time", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0000", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.928 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_weekday": { 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_weekday", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-25T11:34:38.929 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_max_iterations": { 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_max_iterations", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "25", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "250", 2024-04-25T11:34:38.930 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_metrics": { 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_metrics", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.931 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_step": { 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_step", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.5", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0.001", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "0.999", 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.932 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "aggressiveness of optimization", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "end_time": { 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_time", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2359", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.933 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "end_weekday": { 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_weekday", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.934 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.935 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.936 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.937 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.938 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.939 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "min_score": { 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_score", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T11:34:38.940 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "upmap", 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.941 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-compat", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "none", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "read", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap-read" 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Balancer mode", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_ids": { 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_ids", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.942 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.943 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:38.944 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_deviation": { 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_deviation", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.945 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_optimizations": { 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_optimizations", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.946 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm", 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:38.947 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_down_multiplier": { 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_down_multiplier", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.948 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_refresh_rate": { 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_refresh_rate", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "20", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_starting_port": { 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_starting_port", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4721", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_ptrace": { 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_ptrace", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_interval": { 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_interval", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.952 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_memory_target_ratio": { 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.7", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.953 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_log_destination": { 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm_log_destination", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "file", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "file,syslog", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "syslog" 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T11:34:38.954 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "cgroups_split": { 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cgroups_split", 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.955 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "config_checks_enabled": { 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_checks_enabled", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.956 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "config_dashboard": { 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_dashboard", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T11:34:38.957 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_alertmanager": { 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_alertmanager", 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.958 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_base": { 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_base", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.959 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Container image name, without the tag", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_elasticsearch": { 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_elasticsearch", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "elasticsearch container image", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_grafana": { 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_grafana", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.961 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_haproxy": { 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_haproxy", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "HAproxy container image", 2024-04-25T11:34:38.962 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_agent": { 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_agent", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger agent container image", 2024-04-25T11:34:38.963 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_collector": { 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_collector", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger collector container image", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.964 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_query": { 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_query", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger query container image", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_keepalived": { 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_keepalived", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Keepalived container image", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_loki": { 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_loki", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Loki container image", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_node_exporter": { 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_node_exporter", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.968 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_nvmeof": { 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_nvmeof", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Nvme-of container image", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_prometheus": { 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_prometheus", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_promtail": { 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_promtail", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Promtail container image", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_samba": { 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_samba", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Samba/SMB container image", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.972 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_snmp_gateway": { 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_snmp_gateway", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SNMP Gateway container image", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.973 INFO:teuthology.orchestra.run.smithi080.stdout: "container_init": { 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_init", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "daemon_cache_timeout": { 2024-04-25T11:34:38.974 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "daemon_cache_timeout", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "default_cephadm_command_timeout": { 2024-04-25T11:34:38.975 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "900", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "default_registry": { 2024-04-25T11:34:38.976 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_registry", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "device_cache_timeout": { 2024-04-25T11:34:38.977 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_cache_timeout", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1800", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache device inventory", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "device_enhanced_scan": { 2024-04-25T11:34:38.978 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_enhanced_scan", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "facts_cache_timeout": { 2024-04-25T11:34:38.979 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "facts_cache_timeout", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache host facts data", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "grafana_dashboards_path": { 2024-04-25T11:34:38.980 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "grafana_dashboards_path", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "host_check_interval": { 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "host_check_interval", 2024-04-25T11:34:38.981 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to perform a host check", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "hw_monitoring": { 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hw_monitoring", 2024-04-25T11:34:38.982 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "inventory_list_all": { 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "inventory_list_all", 2024-04-25T11:34:38.983 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.984 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.985 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "log_refresh_metadata": { 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_refresh_metadata", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.986 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.987 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:38.988 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.989 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.990 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "*", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.991 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "max_count_per_host": { 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_count_per_host", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of daemons per service per host", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd_draining_count": { 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_osd_draining_count", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "migration_current": { 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "migration_current", 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "internal - do not modify", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "root", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm-package", 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "root" 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "oob_default_addr": { 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "oob_default_addr", 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "169.254.1.1", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "prometheus_alerts_path": { 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus_alerts_path", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_insecure": { 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_insecure", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_password": { 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_password", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_url": { 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_url", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_username": { 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_username", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "secure_monitoring_stack": { 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "secure_monitoring_stack", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "service_discovery_port": { 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "service_discovery_port", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8765", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "cephadm service discovery port", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "ssh_config_file": { 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssh_config_file", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "use_agent": { 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_agent", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "use_repo_digest": { 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_repo_digest", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_failed_host_check": { 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_failed_host_check", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T11:34:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_daemons": { 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_daemons", 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_hosts": { 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_hosts", 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crash", 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "retain_interval": { 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retain_interval", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "31536000", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_recent_interval": { 2024-04-25T11:34:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_recent_interval", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1209600", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dashboard", 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_ENABLED": { 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T11:34:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T11:34:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T11:34:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_URL": { 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_URL", 2024-04-25T11:34:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "[]", 2024-04-25T11:34:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "{}", 2024-04-25T11:34:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "45", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "cross_origin_url": { 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cross_origin_url", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "crt_file": { 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crt_file", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "debug": { 2024-04-25T11:34:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "debug", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable/disable debug options", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "jwt_token_ttl": { 2024-04-25T11:34:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "jwt_token_ttl", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "28800", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-25T11:34:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "motd": { 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "motd", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "The message of the day", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect_resolve_ip_addr": { 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8080", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl_server_port": { 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl_server_port", 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8443", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "redirect", 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect" 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-25T11:34:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "url_prefix": { 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url_prefix", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_monitoring": { 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_monitoring", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "monitor device health metrics", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "mark_out_threshold": { 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mark_out_threshold", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2419200", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": { 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_name", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "device_health_metrics", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "retention_period": { 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retention_period", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15552000", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain device health metrics", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_frequency": { 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_frequency", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "self_heal": { 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "self_heal", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_threshold": { 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_threshold", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7257600", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "diskprediction_local", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "predict_interval": { 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predict_interval", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "predictor_model": { 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predictor_model", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "prophetstor", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "influx", 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": false, 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "influxdb python module not found", 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "batch_size": { 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "batch_size", 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5000", 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "database": { 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "database", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "ceph", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": { 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hostname", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server hostname", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "30", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "5", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "password": { 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "password", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "password of InfluxDB server user", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "port": { 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "port", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8086", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server port", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.121 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "false", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "threads": { 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threads", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "32", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "username": { 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "username", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "username of InfluxDB server user", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: "verify_ssl": { 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "verify_ssl", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "true", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "insights", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.128 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.129 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.130 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.132 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "iostat", 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.133 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.134 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.135 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.136 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.137 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "k8sevents", 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_event_retention_days": { 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ceph_event_retention_days", 2024-04-25T11:34:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "config_check_secs": { 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_check_secs", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.140 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "10", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.141 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.142 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.144 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.145 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.146 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "localpool", 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "failure_domain": { 2024-04-25T11:34:39.147 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "failure_domain", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "host", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "failure domain for any created local pool", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": { 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_size", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default min_size for any created local pool", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "num_rep": { 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "num_rep", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default replica count for any created local pool", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": { 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_num", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "128", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "prefix": { 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prefix", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name prefix for any created local pool", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "subtree": { 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "subtree", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "rack", 2024-04-25T11:34:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mds_autoscaler", 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirroring", 2024-04-25T11:34:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "nfs", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "fail_fs": { 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "fail_fs", 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator": { 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "rook", 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "test_orchestrator" 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Orchestrator backend", 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_perf_query", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_support", 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_autoscaler", 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "threshold": { 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threshold", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1.0", 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "scaling threshold", 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "progress", 2024-04-25T11:34:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_pg_recovery_event": { 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_pg_recovery_event", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "max_completed_events": { 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_completed_events", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "50", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "number of past completed events to remember", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-25T11:34:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long the module is going to sleep", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "cache": { 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cache", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "exclude_perf_counters": { 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "exclude_perf_counters", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T11:34:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools": { 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "300", 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_interval": { 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_interval", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15.0", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "9283", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "stale_cache_strategy": { 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stale_cache_strategy", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "log", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "default", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "default", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "error" 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_snap_create": { 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_snap_create", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "mirror_snapshot_schedule": { 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "trash_purge_schedule": { 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "trash_purge_schedule", 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "restful", 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_auth": { 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_auth", 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rgw", 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.257 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.258 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rook", 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.260 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.261 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.262 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.263 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.264 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.265 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_class": { 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "storage_class", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "local", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.266 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "selftest", 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.268 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.269 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.270 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.271 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "roption1": { 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption1", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.272 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "roption2": { 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption2", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "xyz", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption1": { 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption1", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.274 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption2": { 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption2", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.275 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption3": { 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption3", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.276 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption4": { 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption4", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.277 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption5": { 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption5", 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.278 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption6": { 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption6", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.279 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption7": { 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption7", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "42", 2024-04-25T11:34:39.280 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.281 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "testkey": { 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testkey", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.282 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "testlkey": { 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testlkey", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.283 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "testnewline": { 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testnewline", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.284 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_m_granularity": { 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_m_granularity", 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.285 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "dump_on_update": { 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dump_on_update", 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.286 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "dump database to debug log on update", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.287 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.288 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.289 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.290 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.291 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.292 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stats", 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.294 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.295 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.296 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.297 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.298 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "status", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.299 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.300 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.301 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.302 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.303 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.304 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telegraf", 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "address": { 2024-04-25T11:34:39.305 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "address", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.306 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.307 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.308 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.309 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.310 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.311 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.312 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telemetry", 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_basic": { 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_basic", 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.313 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_crash": { 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_crash", 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.314 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_device": { 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_device", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.315 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_ident": { 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_ident", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.316 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_perf": { 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_perf", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "contact": { 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "contact", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.318 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "description": { 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "description", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.319 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "device_url": { 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_url", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "24", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "8", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "last_opt_revision": { 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "last_opt_revision", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1", 2024-04-25T11:34:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard": { 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard_description": { 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard_description", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "organization": { 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "organization", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "proxy": { 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "proxy", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "url": { 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "test_orchestrator", 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_clones": { 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_clones", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "periodic_async_work": { 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "periodic_async_work", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Periodically check for async work", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_delay": { 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_delay", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_no_wait": { 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix", 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "discovery_interval": { 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "discovery_interval", 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "100", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "identifier": { 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "identifier", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-25T11:34:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "sqlite3_killpoint": { 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sqlite3_killpoint", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "dev", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_host": { 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_host", 2024-04-25T11:34:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_port": { 2024-04-25T11:34:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_port", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10051", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_sender": { 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_sender", 2024-04-25T11:34:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "services": { 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "dashboard": "https://172.21.15.80:8443/" 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "always_on_modules": { 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "octopus": [ 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-25T11:34:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "pacific": [ 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "quincy": [ 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-25T11:34:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "reef": [ 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-25T11:34:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "squid": [ 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-25T11:34:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_failure_osd_epoch": 80, 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "active_clients": [ 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-25T11:34:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1998805916 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "libcephsqlite", 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4146075106 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-25T11:34:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4029843847 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-25T11:34:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 239452715 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4248249557 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3829345827 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-25T11:34:39.371 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:39.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:38 smithi082 ceph-mon[32440]: pgmap v323: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T11:34:39.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3070470039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:34:39.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:38 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1196964389' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T11:34:39.373 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:38 smithi196 ceph-mon[32659]: pgmap v323: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T11:34:39.373 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3070470039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:34:39.373 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:38 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1196964389' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3ac80afc60 msgr2=0x7f3ac80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3ac80afc60 0x7f3ac80b2170 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3ad402a930 tx=0x7f3ad4005fd0 comp rx=0 tx=0).stop 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae010d390 msgr2=0x7f3ae019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae010d390 0x7f3ae019ef40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800b970 tx=0x7f3ad800be30 comp rx=0 tx=0).stop 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 shutdown_connections 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f3ac80afc60 0x7f3ac80b2170 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ae010d390 0x7f3ae019ef40 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ae0108a30 0x7f3ae019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 --2- 172.21.15.80:0/1196964389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae0102b00 0x7f3ae019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:34:39.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 >> 172.21.15.80:0/1196964389 conn(0x7f3ae00fe080 msgr2=0x7f3ae010e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:34:39.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 shutdown_connections 2024-04-25T11:34:39.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:34:38.005+0000 7f3ae53ba640 1 -- 172.21.15.80:0/1196964389 wait complete. 2024-04-25T11:34:39.381 DEBUG:tasks.check_counter:Getting stats from a 2024-04-25T11:34:39.381 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-25T11:34:39.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:38 smithi080 ceph-mon[29126]: pgmap v323: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T11:34:39.381 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3070470039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:34:39.382 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:38 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1196964389' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T11:34:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:34:40.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:40 smithi080 ceph-mon[29126]: pgmap v324: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:40.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:40 smithi196 ceph-mon[32659]: pgmap v324: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:40.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:40 smithi082 ceph-mon[32440]: pgmap v324: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:41.569 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:34:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 0, 2024-04-25T11:34:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 2, 2024-04-25T11:34:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 0, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 0, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 0, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.001228679, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.000273363, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 6, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 158, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 3312, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 185008, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-25T11:34:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.014630529, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.010067866, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.002418168, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 156, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.014968555, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000095952 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 185008 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 214, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 204, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1537744, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 125344, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 2, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 1, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.044768848, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.013462985, 2024-04-25T11:34:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.037980001, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.004291548, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 203, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.010406482, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000051263 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1537744, 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 125344 2024-04-25T11:34:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:34:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:34:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 148977, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 30, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-25T11:34:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 928, 2024-04-25T11:34:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 2, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 216, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 1507570, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 216, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-25T11:34:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 216, 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 1507570, 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:41.580 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:42.231 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-04-25T11:34:42.231 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-04-25T11:34:42.231 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-04-25T11:34:42.231 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-04-25T11:34:42.231 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-04-25T11:34:42.231 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-04-25T11:34:42.231 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-04-25T11:34:42.231 DEBUG:tasks.check_counter:Getting stats from d 2024-04-25T11:34:42.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-25T11:34:42.476 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:34:42.800 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:42 smithi080 ceph-mon[29126]: pgmap v325: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:42.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:42 smithi196 ceph-mon[32659]: pgmap v325: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:42.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:42 smithi082 ceph-mon[32440]: pgmap v325: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:44.175 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:44.175 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:34:44.175 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 224, 2024-04-25T11:34:44.175 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 212, 2024-04-25T11:34:44.175 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1542432, 2024-04-25T11:34:44.175 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 129152, 2024-04-25T11:34:44.175 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-25T11:34:44.176 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 0, 2024-04-25T11:34:44.176 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.045775371, 2024-04-25T11:34:44.176 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.013949047, 2024-04-25T11:34:44.176 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.037499543, 2024-04-25T11:34:44.176 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.004206536, 2024-04-25T11:34:44.176 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 212, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.011010100, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000051934 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1542432, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 129152 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:34:44.177 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 2, 2024-04-25T11:34:44.178 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 160, 2024-04-25T11:34:44.178 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 320, 2024-04-25T11:34:44.178 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 185264, 2024-04-25T11:34:44.178 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-25T11:34:44.178 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-25T11:34:44.178 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.013547058, 2024-04-25T11:34:44.178 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.009268711, 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.001977558, 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 157, 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.017013369, 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000108365 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:44.179 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 185264 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 0, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 2, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 0, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 0, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 2, 2024-04-25T11:34:44.180 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 1, 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.000180964, 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.000120172, 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:44.181 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-25T11:34:44.182 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:34:44.183 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-25T11:34:44.184 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 148995, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 31, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-25T11:34:44.185 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:34:44.186 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:34:44.187 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-25T11:34:44.187 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-25T11:34:44.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 928, 2024-04-25T11:34:44.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 2, 2024-04-25T11:34:44.187 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-25T11:34:44.187 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-25T11:34:44.187 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-25T11:34:44.188 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-25T11:34:44.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:44.188 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:34:44.188 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-25T11:34:44.188 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-25T11:34:44.188 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-25T11:34:44.190 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 222, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 1508414, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 222, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 222, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 1508414, 2024-04-25T11:34:44.191 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-25T11:34:44.192 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:44.192 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:44.192 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:44.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:44.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:44.192 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:44.785 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-25T11:34:44.786 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-25T11:34:44.786 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-25T11:34:44.786 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-25T11:34:44.786 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-25T11:34:44.786 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-25T11:34:44.786 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-25T11:34:44.786 DEBUG:tasks.check_counter:Getting stats from g 2024-04-25T11:34:44.787 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-25T11:34:44.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:44 smithi080 ceph-mon[29126]: pgmap v326: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:44.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:44 smithi196 ceph-mon[32659]: pgmap v326: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:44.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:44 smithi082 ceph-mon[32440]: pgmap v326: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:34:46.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:46 smithi080 ceph-mon[29126]: pgmap v327: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:46.835 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:46.835 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:34:46.835 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 0, 2024-04-25T11:34:46.835 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 2, 2024-04-25T11:34:46.835 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 0, 2024-04-25T11:34:46.835 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 0, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 0, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.001208267, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.000277121, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:46.836 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 216, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 206, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1538288, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 126624, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 2, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 1, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.049205525, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.013505721, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.042734965, 2024-04-25T11:34:46.837 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.004385225, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 205, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.010532649, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000051378 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1538288, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 126624 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:34:46.838 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 6, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 159, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 3312, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 185184, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.014878750, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.009870282, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.002654985, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 157, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.017736848, 2024-04-25T11:34:46.839 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000112973 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 185184 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 0, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.840 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:34:46.841 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:34:46.842 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 149034, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 32, 2024-04-25T11:34:46.843 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-25T11:34:46.844 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 928, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 2, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 218, 2024-04-25T11:34:46.845 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 1507830, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 218, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 218, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 1507830, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:46.846 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:46.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:46 smithi196 ceph-mon[32659]: pgmap v327: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:46.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:46 smithi082 ceph-mon[32440]: pgmap v327: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:47.490 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-04-25T11:34:47.490 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-04-25T11:34:47.491 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-04-25T11:34:47.491 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-04-25T11:34:47.491 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-04-25T11:34:47.491 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-04-25T11:34:47.491 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-04-25T11:34:47.491 DEBUG:tasks.check_counter:Getting stats from j 2024-04-25T11:34:47.491 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-25T11:34:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T11:34:48.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:48 smithi080 ceph-mon[29126]: pgmap v328: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:48.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:48 smithi196 ceph-mon[32659]: pgmap v328: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:48.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:48 smithi082 ceph-mon[32440]: pgmap v328: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:49.445 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-25T11:34:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 226, 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 214, 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1542976, 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 130432, 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 0, 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.046842243, 2024-04-25T11:34:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.014349958, 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.039595718, 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.004278201, 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 214, 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.011155206, 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000052127 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1542976, 2024-04-25T11:34:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 130432 2024-04-25T11:34:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 2, 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 162, 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 320, 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 185616, 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-25T11:34:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.013569206, 2024-04-25T11:34:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.009398613, 2024-04-25T11:34:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.001928868, 2024-04-25T11:34:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 159, 2024-04-25T11:34:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.022650397, 2024-04-25T11:34:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000142455 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T11:34:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 185616 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 0, 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 2, 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 0, 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 0, 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 2, 2024-04-25T11:34:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 1, 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.000348541, 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.000263888, 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 0, 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:34:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-25T11:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:34:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-25T11:34:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-25T11:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:34:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-25T11:34:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 149034, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 32, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:34:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 0, 2024-04-25T11:34:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 0, 2024-04-25T11:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-25T11:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-25T11:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 928, 2024-04-25T11:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 2, 2024-04-25T11:34:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-25T11:34:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-25T11:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 224, 2024-04-25T11:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 1508674, 2024-04-25T11:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 224, 2024-04-25T11:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-25T11:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-25T11:34:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 224, 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 1508674, 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-25T11:34:49.465 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-25T11:34:50.089 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-25T11:34:50.089 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-25T11:34:50.090 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-25T11:34:50.090 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-25T11:34:50.090 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-25T11:34:50.090 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-25T11:34:50.090 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-25T11:34:50.090 DEBUG:tasks.check_counter:Getting stats from b 2024-04-25T11:34:50.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-25T11:34:50.340 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:34:50.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:50 smithi082 ceph-mon[32440]: pgmap v329: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:50.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:50 smithi080 ceph-mon[29126]: pgmap v329: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:50.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:50 smithi196 ceph-mon[32659]: pgmap v329: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:52.294 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-25T11:34:52.294 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:34:52.294 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1116, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 893, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 371700, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 3402310, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 181, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.158638695, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.028678973, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.080226056, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.030470729, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 886, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.441773075, 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000498615 2024-04-25T11:34:52.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 536, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000095345, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000177 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 132096, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 32064 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1633, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1132, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 557418, 2024-04-25T11:34:52.296 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 807735, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 10, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 6, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.209168495, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.065069333, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.079891102, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.059990274, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1134, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.415346315, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000366266 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2026, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000481406, 2024-04-25T11:34:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000237 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 341328, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 526096 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1972, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1319, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 2251433, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 742130, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 24, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 7, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.257459620, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.066327084, 2024-04-25T11:34:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.126165447, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.069939100, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1319, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.380224470, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000288267 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1953, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000474895, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000243 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1911440, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 247616 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 740, 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.207354340, 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000280208 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-25T11:34:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 85, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.003458178, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000040684 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 163, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 163, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 163, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.169026303, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001036971 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-25T11:34:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 60, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 39, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 9, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 30, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 25, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 3, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 4, 2024-04-25T11:34:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 2, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 222, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 209, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-25T11:34:52.303 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 234, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 6, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 234, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 146, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 20, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 126, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 88, 2024-04-25T11:34:52.304 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 16, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 34, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 106, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 84, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 2, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 25 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 6, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-04-25T11:34:52.305 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 15, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 2, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 6, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 4, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-25T11:34:52.306 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 20, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 252, 2024-04-25T11:34:52.307 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 168, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 168, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 84, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 18, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 13, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 12, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 12, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 1, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 1, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 1, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 5176860, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 5307017, 2024-04-25T11:34:52.308 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 0, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 204, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.454819777, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002229508 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 0 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 29, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 53, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 24, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 20, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 20, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 0, 2024-04-25T11:34:52.309 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 39, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 43, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 4, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 4, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 21, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 17, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 127120, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 231824 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 214, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 1, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 163, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 32, 2024-04-25T11:34:52.310 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 2, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 8, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.006768126, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000846015 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 100, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.022321184, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000223211 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.311 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000241013, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000120506 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.312 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000393866, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000196933 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.313 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10, 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001872529, 2024-04-25T11:34:52.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000187252 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 8, 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.014226249, 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001778281 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-25T11:34:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.052891045, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.005289104 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000224810, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000224810 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-25T11:34:52.316 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.004404527, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002202263 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002910144, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001455072 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.317 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.013371341, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.006685670 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.020524009, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.005131002 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.318 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000898533, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000898533 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 7, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.020895826, 2024-04-25T11:34:52.320 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002985118 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.007083101, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001770775 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-25T11:34:52.321 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 5, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 3, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 27, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 13, 2024-04-25T11:34:52.322 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 611, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:34:52.323 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:34:52.324 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 334893, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 139, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 616, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 7, 2024-04-25T11:34:52.325 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8136, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 170, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 136997, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 1246, 2024-04-25T11:34:52.326 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 1242, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 1224153, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 37, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 1242, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1242, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 23.137550935, 2024-04-25T11:34:52.327 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.018629268 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1242, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1410 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 1242, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 276, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 966, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 40, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 28, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 22, 2024-04-25T11:34:52.328 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 206, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 57, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 579, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 254, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 56, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-25T11:34:52.329 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-25T11:34:52.330 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 89, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 13, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 12, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 12, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-25T11:34:52.331 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 156, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 0, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 12 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 1, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-25T11:34:52.332 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 64, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 3, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 67, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 4, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 4717, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 2655781, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 4717, 2024-04-25T11:34:52.333 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 4717, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2655781, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:52.334 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 1242, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 1224589, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 1242, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1224589, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-25T11:34:52.335 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 1242, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 1242, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 1242, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1242, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.336 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 4, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 436, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 4, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 436, 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:52.337 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x5611b8174680": { 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 252, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1112713, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 252, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:52.338 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 204, 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1112713, 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:52.339 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-25T11:34:52.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:52 smithi082 ceph-mon[32440]: pgmap v330: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:52.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:52 smithi080 ceph-mon[29126]: pgmap v330: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:52.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:52 smithi196 ceph-mon[32659]: pgmap v330: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:53.136 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-04-25T11:34:53.136 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-04-25T11:34:53.137 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=6 2024-04-25T11:34:53.137 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-04-25T11:34:53.137 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-25T11:34:53.137 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-04-25T11:34:53.137 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-04-25T11:34:53.137 DEBUG:tasks.check_counter:Getting stats from e 2024-04-25T11:34:53.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-25T11:34:53.384 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:34:54.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:54 smithi080 ceph-mon[29126]: pgmap v331: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:54.897 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:54 smithi082 ceph-mon[32440]: pgmap v331: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:54.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:54 smithi196 ceph-mon[32659]: pgmap v331: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 768, 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 768, 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 205903, 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 243464, 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-04-25T11:34:55.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.077130590, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.031282025, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.018013019, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.019934912, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 767, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.033311589, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000043431 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 693, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 852, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 170328, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 664527, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.075594267, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.026244335, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.016466599, 2024-04-25T11:34:55.172 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.024959725, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 849, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.044388855, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000052283 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 444784 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.173 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 998, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 985, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1826976, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 373336, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 3, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.150856745, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.045125419, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.064726334, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.041561007, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 984, 2024-04-25T11:34:55.174 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.056316896, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000057232 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1572960, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 132928 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-25T11:34:55.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3641, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.120423131, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000033074 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.176 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-25T11:34:55.177 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-04-25T11:34:55.178 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-04-25T11:34:55.179 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T11:34:55.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-04-25T11:34:55.181 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-04-25T11:34:55.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 8, 2024-04-25T11:34:55.183 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 2, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 4196488, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 4196347, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 8 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 3, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 0, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 1, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 1, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 0, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 0, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 0, 2024-04-25T11:34:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 118424, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215440 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-25T11:34:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-25T11:34:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-25T11:34:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-25T11:34:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-25T11:34:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 0, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 3, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 3, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-25T11:34:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 1251, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:34:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:34:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-25T11:34:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 189450, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 53, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:34:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8136, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 170, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 8512, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 13, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2211, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2211, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2211, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.511970444, 2024-04-25T11:34:55.204 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000683840 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2211, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2212 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2211, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2211, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1445, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-04-25T11:34:55.205 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 764, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-25T11:34:55.206 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-25T11:34:55.207 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 89, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 12, 2024-04-25T11:34:55.208 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 5, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 5, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.209 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:55.210 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2455, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1966864, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2455, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2455, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1966864, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.211 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2211, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2189, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2211, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2189, 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:55.212 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2211, 2024-04-25T11:34:55.213 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2211, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2211, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2211, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:55.214 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55c430682c30": { 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:55.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.216 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:55.217 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-25T11:34:56.208 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-25T11:34:56.208 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-25T11:34:56.209 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-04-25T11:34:56.209 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-04-25T11:34:56.209 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-04-25T11:34:56.209 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-25T11:34:56.209 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T11:34:56.209 DEBUG:tasks.check_counter:Getting stats from h 2024-04-25T11:34:56.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-25T11:34:56.449 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:34:56.851 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:56 smithi082 ceph-mon[32440]: pgmap v332: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:56.872 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:56 smithi080 ceph-mon[29126]: pgmap v332: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:56.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:56 smithi196 ceph-mon[32659]: pgmap v332: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:34:58.279 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-25T11:34:58.279 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:34:58.279 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 346, 2024-04-25T11:34:58.279 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 335, 2024-04-25T11:34:58.279 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1596534, 2024-04-25T11:34:58.279 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 675618, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 54, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.074401306, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.016983552, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.060066050, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.006009473, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 332, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.025680562, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000077351 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:58.280 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 66, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000026660, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000403 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1585744, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 141328 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 79, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 107, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 32076, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 167567, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 10, 2024-04-25T11:34:58.281 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.010875810, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.003570287, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.006581386, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000452759, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 107, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.014709385, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000137470 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 108, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000030561, 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000282 2024-04-25T11:34:58.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 4992, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 131888 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 533, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 742, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 157433, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 468059, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.072383393, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.035623373, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.032115172, 2024-04-25T11:34:58.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.004297767, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 740, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.058792695, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000079449 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1094, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000273276, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000249 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 319440 2024-04-25T11:34:58.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 55, 2024-04-25T11:34:58.285 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002269027, 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000041255 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000008704, 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000004352 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-25T11:34:58.286 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 6, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 4, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002011486, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000502871 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 2, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 11, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-25T11:34:58.287 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 16, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 16, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 13, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 4, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 3, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 16, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 11, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 2, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 3, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-25T11:34:58.288 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 6, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T11:34:58.289 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-04-25T11:34:58.290 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 9, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 6, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 7, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-04-25T11:34:58.291 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-25T11:34:58.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 8, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 8, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 2, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 2, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-04-25T11:34:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 4196488, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 0, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 7, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.016927204, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002418172 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 0 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 20, 2024-04-25T11:34:58.294 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 22, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 2, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 19, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 21, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 2, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 16, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 20, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 4, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 4, 2024-04-25T11:34:58.295 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 4, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 124368, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 223632 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 9, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 6, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 12, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 1, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001652194, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000826097 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.297 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000359292, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000179646 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.298 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.299 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-25T11:34:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.301 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.302 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.303 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.305 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.306 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-25T11:34:58.307 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 0, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 3, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 3, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 0, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-25T11:34:58.308 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 3, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 1, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 86, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:34:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:34:58.310 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:34:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 255591, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 90, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8136, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 170, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:34:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 83389, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 332, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 46, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 12721, 2024-04-25T11:34:58.313 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 33, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 46, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 46, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.242995300, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.005282506 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 46, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 70 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.314 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 46, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 46, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 10, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 7, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 8, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-25T11:34:58.315 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 6, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 0, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 20, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-25T11:34:58.316 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-25T11:34:58.317 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 89, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 12, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 9, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 9, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-25T11:34:58.318 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 17, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 0, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 2 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 1, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-04-25T11:34:58.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-25T11:34:58.320 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 954, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1682535, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 954, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 954, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1682535, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.321 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 46, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 12721, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 46, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 12721, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.322 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 46, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 46, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 46, 2024-04-25T11:34:58.323 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 46, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:58.324 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55d08efb6820": { 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:34:58.325 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 8, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 2184, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 8, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 7, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2184, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:34:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.327 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:34:58.327 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-25T11:34:58.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:34:58 smithi080 ceph-mon[29126]: pgmap v333: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:58.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:34:58 smithi196 ceph-mon[32659]: pgmap v333: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:58.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:34:58 smithi082 ceph-mon[32440]: pgmap v333: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:34:59.051 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-04-25T11:34:59.051 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-04-25T11:34:59.051 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-04-25T11:34:59.051 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=9 2024-04-25T11:34:59.051 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-04-25T11:34:59.051 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-25T11:34:59.051 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T11:34:59.051 DEBUG:tasks.check_counter:Getting stats from k 2024-04-25T11:34:59.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-25T11:34:59.290 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T11:35:00.738 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:00 smithi082 ceph-mon[32440]: pgmap v334: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:00.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:00 smithi080 ceph-mon[29126]: pgmap v334: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:00.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:00 smithi196 ceph-mon[32659]: pgmap v334: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:00.999 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-25T11:35:00.999 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:35:00.999 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 4, 2024-04-25T11:35:00.999 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4, 2024-04-25T11:35:00.999 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 2992, 2024-04-25T11:35:00.999 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 448, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.001557580, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000047596, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000748265, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000859506, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000286502 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 226, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 216, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1541072, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 132544, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-04-25T11:35:01.001 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.052176436, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.014190816, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.042836770, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.005931165, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 215, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.012868142, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000059851 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1541072, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 132544 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 165, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 320, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 186144, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.012546774, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.008359471, 2024-04-25T11:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.001740778, 2024-04-25T11:35:01.004 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:35:01.005 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:01.005 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 162, 2024-04-25T11:35:01.006 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.027255057, 2024-04-25T11:35:01.006 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000168241 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 186144 2024-04-25T11:35:01.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:35:01.008 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:35:01.009 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:35:01.010 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148967, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 29, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-04-25T11:35:01.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-25T11:35:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 228, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1509194, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 228, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 228, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1509194, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-25T11:35:01.013 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-25T11:35:01.014 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-25T11:35:01.014 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:35:01.014 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-25T11:35:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-25T11:35:01.734 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-04-25T11:35:01.735 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-04-25T11:35:01.735 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-04-25T11:35:01.735 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-04-25T11:35:01.735 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-04-25T11:35:01.735 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-04-25T11:35:01.735 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-04-25T11:35:01.735 DEBUG:tasks.check_counter:Getting stats from c 2024-04-25T11:35:01.735 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-25T11:35:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:35:02.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:02 smithi080 ceph-mon[29126]: pgmap v335: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:35:02.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:02 smithi082 ceph-mon[32440]: pgmap v335: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:35:02.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:02 smithi196 ceph-mon[32659]: pgmap v335: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 594, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 594, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 148321, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 188075, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 6, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 2, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.063057970, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.021906396, 2024-04-25T11:35:03.836 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.013625366, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.021077906, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 593, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.027410985, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000046224 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.837 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 1454, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 1452, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 1770957, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 506675, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 4, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 3, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.162281623, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.054483308, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.049631770, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.047131108, 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1451, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.061958305, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000042700 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 363264, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 100528 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 4, 2024-04-25T11:35:03.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 124, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 1506, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 299075, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 5, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 4, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.007566684, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.004585394, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.001735937, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.000055590, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 122, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.008682877, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000071171 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 298112 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 1, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-MDSRank": { 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-04-25T11:35:03.841 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 3065, 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.095682727, 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000031217 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-PurgeQueue": { 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.842 INFO:teuthology.orchestra.run.smithi196.stdout: "mds": { 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "request": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "reply": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "reply_latency": { 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_reply": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "forward": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_complete": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_keys": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_commit": 0, 2024-04-25T11:35:03.843 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_split": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_merge": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes": 23, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_top": 3, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_bottom": 20, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pin_tail": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pinned": 19, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_expired": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_with_caps": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "caps": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "subtrees": 2, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_hit": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_forward": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_discover": 0, 2024-04-25T11:35:03.844 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_dir_fetch": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_remote_ino": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_lock": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "load_cent": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "q": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "exported": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "exported_inodes": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "imported": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "imported_inodes": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_dir_fetch": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_backtrace_fetch": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_peer_discover": 0, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rfiles": 4, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rbytes": 234, 2024-04-25T11:35:03.845 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rsnaps": 6, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_set_tag": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_inotable_repaired": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_inodes": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_file_inodes": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_inode_file_caps": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_grant": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T11:35:03.846 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps_dirty": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_cap_release": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "process_request_cap_release": 0 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_cache": { 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update_receipt": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_try_discover": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_send_discover": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_handle_discover": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_delayed": 0, 2024-04-25T11:35:03.847 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_enqueuing": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_created": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_enqueued": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_reintegrated": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_migrated": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_processing": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_enqueued": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_prioritized": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_started": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_completed": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_path": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_inode": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T11:35:03.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_exportdir": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_flush": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragmentdir": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragstats": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_inodestats": 0 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_log": { 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "evlrg": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "evadd": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "evex": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "evtrm": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "ev": 211, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "evexg": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "evexd": 0, 2024-04-25T11:35:03.849 INFO:teuthology.orchestra.run.smithi196.stdout: "segadd": 0, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "segex": 0, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "segtrm": 0, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "seg": 2, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "segmjr": 8, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "segexg": 0, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "segexd": 0, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "expos": 5176860, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "wrpos": 5310215, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "rdpos": 5310131, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "jlat": { 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.850 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "replayed": 211 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_mem": { 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "ino": 14, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "ino+": 18, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "ino-": 4, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "dir": 9, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "dir+": 9, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "dir-": 0, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "dn": 23, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "dn+": 23, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "dn-": 0, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "cap": 0, 2024-04-25T11:35:03.851 INFO:teuthology.orchestra.run.smithi196.stdout: "cap+": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "cap-": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "rss": 121260, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "heap": 215440 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_server": { 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_client_request": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_server_request": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_request": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_session": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_peer_request": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "req_create_latency": { 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.852 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getattr_latency": { 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getfilelock_latency": { 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "req_link_latency": { 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.853 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookup_latency": { 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookuphash_latency": { 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupino_latency": { 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.854 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupname_latency": { 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupparent_latency": { 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupsnap_latency": { 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lssnap_latency": { 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mkdir_latency": { 2024-04-25T11:35:03.856 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mknod_latency": { 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mksnap_latency": { 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "req_open_latency": { 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "req_readdir_latency": { 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rename_latency": { 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.858 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "req_renamesnap_latency": { 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "req_snapdiff_latency": { 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmdir_latency": { 2024-04-25T11:35:03.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmsnap_latency": { 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmxattr_latency": { 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.860 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setattr_latency": { 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setdirlayout_latency": { 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setfilelock_latency": { 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.861 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setlayout_latency": { 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setxattr_latency": { 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "req_symlink_latency": { 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "req_unlink_latency": { 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_revoke_eviction": 0, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_acquisition_throttle": 0, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getvxattr_latency": { 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.863 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_sessions": { 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "session_count": 2, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "session_add": 4, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "session_remove": 2, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_open": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_stale": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "total_load": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "average_load": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avg_session_uptime": 3019, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "mdthresh_evicted": 0 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:35:03.864 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:35:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:35:03.866 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 197813, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 64, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:35:03.867 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-04-25T11:35:03.869 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 8136, 2024-04-25T11:35:03.869 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 170, 2024-04-25T11:35:03.869 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:35:03.869 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:35:03.869 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 72680, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 645, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.870 INFO:teuthology.orchestra.run.smithi196.stdout: "objecter": { 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_active": 0, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_laggy": 0, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send": 1870, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send_bytes": 26, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_resend": 4, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_reply": 1870, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_latency": { 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1870, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.908980494, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000486085 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_inflight": 0, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "oplen_avg": { 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1870, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 1871 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op": 1870, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_r": 1870, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_w": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_rmw": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_pg": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_stat": 1174, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_create": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_read": 693, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_write": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writefull": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writesame": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_append": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_zero": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_truncate": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_delete": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_mapext": 0, 2024-04-25T11:35:03.872 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_sparse_read": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_clonerange": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_getxattr": 2, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_setxattr": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_cmpxattr": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_rmxattr": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_resetxattrs": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_call": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_watch": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_notify": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls_filter": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_other": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_active": 0, 2024-04-25T11:35:03.873 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_send": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_resend": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_ping": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_active": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_send": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_resend": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_active": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_send": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_resend": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_active": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_send": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_resend": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "command_active": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "command_send": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "command_resend": 0, 2024-04-25T11:35:03.874 INFO:teuthology.orchestra.run.smithi196.stdout: "map_epoch": 89, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "map_full": 0, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "map_inc": 8, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_sessions": 6, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_open": 6, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_close": 0, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_laggy": 0, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_wr": 0, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_rd": 2, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_del": 0 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "oft": { 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_objs": 0, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_kv_pairs": 0, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_updates": 0, 2024-04-25T11:35:03.875 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_removes": 0 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "osd-slow-ops": { 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_ops_count": 0 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "purge_queue": { 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops": 0, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing": 0, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_high_water": 0, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed_ops": 0, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed": 0, 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_item_in_journal": 0 2024-04-25T11:35:03.876 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 2048, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 1724394, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 2048, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 2048, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1724394, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.877 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_bytes": { 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 1870, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 1029165, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1870, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1029165, 2024-04-25T11:35:03.878 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_ops": { 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 1024, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 1870, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 1870, 2024-04-25T11:35:03.879 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1870, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1870, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle": { 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:03.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle-0x564e026d8c30": { 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:03.881 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:03.882 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-25T11:35:04.727 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-04-25T11:35:04.728 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-04-25T11:35:04.728 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-04-25T11:35:04.728 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-04-25T11:35:04.728 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-04-25T11:35:04.728 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-25T11:35:04.728 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T11:35:04.728 DEBUG:tasks.check_counter:Getting stats from f 2024-04-25T11:35:04.728 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-25T11:35:04.873 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:04 smithi080 ceph-mon[29126]: pgmap v336: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:04.934 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:04 smithi196 ceph-mon[32659]: pgmap v336: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:04.980 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:35:04.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:04 smithi082 ceph-mon[32440]: pgmap v336: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:06.809 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:06 smithi196 ceph-mon[32659]: pgmap v337: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 2245, 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 2247, 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 636793, 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 713917, 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 6, 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 2, 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.213518760, 2024-04-25T11:35:06.857 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.070885912, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.053756947, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.072364608, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2245, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.092937697, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000041397 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 251, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 236, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 1577324, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 135994, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 3, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 2, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.051166409, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.015304415, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.040532685, 2024-04-25T11:35:06.859 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.005857154, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 236, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.014430876, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000061147 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 1576768, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 135296 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.860 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 3, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 165, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 588, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 452094, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 6, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 4, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.010747649, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.006234280, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.002536786, 2024-04-25T11:35:06.861 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.000034368, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 162, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.022986478, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000141891 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 451776 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.862 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 1, 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-MDSRank": { 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 3787, 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.113867501, 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000030067 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-PurgeQueue": { 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-04-25T11:35:06.863 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "mds": { 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "request": 0, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "reply": 0, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "reply_latency": { 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_reply": 0, 2024-04-25T11:35:06.864 INFO:teuthology.orchestra.run.smithi196.stdout: "forward": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_complete": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_keys": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_commit": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_split": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_merge": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_top": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_bottom": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pin_tail": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pinned": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_expired": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_with_caps": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "caps": 0, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "subtrees": 1, 2024-04-25T11:35:06.865 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_hit": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_forward": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_discover": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_dir_fetch": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_remote_ino": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_lock": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "load_cent": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "q": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "exported": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "exported_inodes": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "imported": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "imported_inodes": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_dir_fetch": 0, 2024-04-25T11:35:06.866 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_backtrace_fetch": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_peer_discover": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rfiles": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rbytes": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rsnaps": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_set_tag": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_inotable_repaired": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_inodes": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_file_inodes": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_inode_file_caps": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T11:35:06.867 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_grant": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps_dirty": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_cap_release": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "process_request_cap_release": 0 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_cache": { 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update_receipt": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_try_discover": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_send_discover": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_handle_discover": 0, 2024-04-25T11:35:06.868 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_delayed": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_enqueuing": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_created": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_enqueued": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_reintegrated": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_migrated": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_processing": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_enqueued": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_prioritized": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_started": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_completed": 0, 2024-04-25T11:35:06.869 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_path": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_inode": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_exportdir": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_flush": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragmentdir": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragstats": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_inodestats": 0 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_log": { 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "evlrg": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "evadd": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "evex": 0, 2024-04-25T11:35:06.870 INFO:teuthology.orchestra.run.smithi196.stdout: "evtrm": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "ev": 9, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "evexg": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "evexd": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "segadd": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "segex": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "segtrm": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "seg": 2, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "segmjr": 2, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "segexg": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "segexd": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "expos": 4194304, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "wrpos": 4196796, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "rdpos": 4196655, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "jlat": { 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.871 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "replayed": 9 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_mem": { 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "ino": 3, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "ino+": 3, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "ino-": 0, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "dir": 1, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "dir+": 1, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "dir-": 0, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "dn": 0, 2024-04-25T11:35:06.872 INFO:teuthology.orchestra.run.smithi196.stdout: "dn+": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "dn-": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "cap": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "cap+": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "cap-": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "rss": 118528, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "heap": 215440 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_server": { 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_client_request": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_server_request": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_request": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_session": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_peer_request": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "req_create_latency": { 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.873 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getattr_latency": { 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getfilelock_latency": { 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "req_link_latency": { 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.874 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookup_latency": { 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookuphash_latency": { 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupino_latency": { 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.875 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupname_latency": { 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupparent_latency": { 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupsnap_latency": { 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.876 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.877 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lssnap_latency": { 2024-04-25T11:35:06.877 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.877 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.877 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.877 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.877 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mkdir_latency": { 2024-04-25T11:35:06.877 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.877 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:06 smithi080 ceph-mon[29126]: pgmap v337: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mknod_latency": { 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mksnap_latency": { 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.878 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "req_open_latency": { 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "req_readdir_latency": { 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rename_latency": { 2024-04-25T11:35:06.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "req_renamesnap_latency": { 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "req_snapdiff_latency": { 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.880 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmdir_latency": { 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmsnap_latency": { 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmxattr_latency": { 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setattr_latency": { 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setdirlayout_latency": { 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setfilelock_latency": { 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.882 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setlayout_latency": { 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setxattr_latency": { 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "req_symlink_latency": { 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.883 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "req_unlink_latency": { 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_revoke_eviction": 0, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_acquisition_throttle": 0, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getvxattr_latency": { 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_sessions": { 2024-04-25T11:35:06.884 INFO:teuthology.orchestra.run.smithi196.stdout: "session_count": 1, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "session_add": 4, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "session_remove": 3, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_open": 3, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_stale": 0, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "total_load": 0, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "average_load": 0, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "avg_session_uptime": 4120, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "mdthresh_evicted": 0 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:35:06.885 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-04-25T11:35:06.886 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:35:06.887 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 181303, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 46, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 8136, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 170, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-04-25T11:35:06.888 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 8512, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 13, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "objecter": { 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "op_active": 0, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "op_laggy": 0, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send": 2248, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send_bytes": 21, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "op_resend": 3, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "op_reply": 2248, 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "op_latency": { 2024-04-25T11:35:06.889 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2248, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 1.220973846, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000543137 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "op_inflight": 0, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "oplen_avg": { 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2248, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 2249 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "op": 2248, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "op_r": 2248, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "op_w": 0, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "op_rmw": 0, 2024-04-25T11:35:06.890 INFO:teuthology.orchestra.run.smithi196.stdout: "op_pg": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_stat": 1469, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_create": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_read": 777, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_write": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writefull": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writesame": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_append": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_zero": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_truncate": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_delete": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_mapext": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_sparse_read": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_clonerange": 0, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_getxattr": 1, 2024-04-25T11:35:06.891 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_setxattr": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_cmpxattr": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_rmxattr": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_resetxattrs": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_call": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_watch": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_notify": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls_filter": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_other": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_active": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_send": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_resend": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_ping": 0, 2024-04-25T11:35:06.892 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_active": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_send": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_resend": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_active": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_send": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_resend": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_active": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_send": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_resend": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "command_active": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "command_send": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "command_resend": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "map_epoch": 89, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "map_full": 0, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "map_inc": 12, 2024-04-25T11:35:06.893 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_sessions": 4, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_open": 4, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_close": 0, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_laggy": 0, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_wr": 0, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_rd": 2, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_del": 0 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "oft": { 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_objs": 0, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_kv_pairs": 0, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_updates": 0, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_removes": 0 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.894 INFO:teuthology.orchestra.run.smithi196.stdout: "osd-slow-ops": { 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_ops_count": 0 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "purge_queue": { 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops": 0, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing": 0, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_high_water": 0, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed_ops": 0, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed": 0, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_item_in_journal": 0 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-04-25T11:35:06.895 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 2495, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 1974606, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 2495, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 2495, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1974606, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.896 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_bytes": { 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 2248, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 2497, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 2248, 2024-04-25T11:35:06.897 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 2497, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_ops": { 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 1024, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:06.898 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 2248, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 2248, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 2248, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 2248, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle": { 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-04-25T11:35:06.899 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:06.900 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle-0x556d2504ec30": { 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:06.901 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:06.902 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.902 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:06.902 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-25T11:35:06.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:06 smithi082 ceph-mon[32440]: pgmap v337: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T11:35:07.840 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-25T11:35:07.840 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-25T11:35:07.840 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-04-25T11:35:07.840 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-04-25T11:35:07.841 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-04-25T11:35:07.841 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-25T11:35:07.841 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T11:35:07.841 DEBUG:tasks.check_counter:Getting stats from i 2024-04-25T11:35:07.841 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-25T11:35:08.085 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:35:08.925 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:08 smithi196 ceph-mon[32659]: pgmap v338: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T11:35:08.989 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:08 smithi082 ceph-mon[32440]: pgmap v338: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T11:35:09.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:08 smithi080 ceph-mon[29126]: pgmap v338: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T11:35:09.798 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:09 smithi196 ceph-mon[32659]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T11:35:09.798 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:09 smithi196 ceph-mon[32659]: pgmap v340: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:35:09.836 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 566, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 773, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 169850, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 589962, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 9, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 4, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.076245171, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.031345921, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.035039416, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.005309207, 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 771, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.058491512, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000075864 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1134, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000322745, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000284 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 323024 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:35:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 91, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 135, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 33998, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 213254, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 15, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 5, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.022075987, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.006386652, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.015341144, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.000279156, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 133, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.021808903, 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000163976 2024-04-25T11:35:09.839 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 159, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000035989, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000226 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 7632, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 136896 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 326, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 310, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 1596471, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 625359, 2024-04-25T11:35:09.840 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 47, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 4, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.067794673, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.016404876, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.056131742, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.005790137, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 309, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.021125290, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000068366 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 48, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000007195, 2024-04-25T11:35:09.841 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000149 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 1588464, 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 139360 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 1, 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-MDSRank": { 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 57, 2024-04-25T11:35:09.842 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.002016719, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000035381 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-PurgeQueue": { 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000009948, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000004974 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "mds": { 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "request": 3, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "reply": 1, 2024-04-25T11:35:09.843 INFO:teuthology.orchestra.run.smithi196.stdout: "reply_latency": { 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000190171, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000190171 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_reply": 0, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "forward": 2, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_complete": 0, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_keys": 0, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_commit": 11, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_split": 0, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_merge": 0, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes": 16, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_top": 0, 2024-04-25T11:35:09.844 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_bottom": 16, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pin_tail": 0, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pinned": 13, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_expired": 4, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_with_caps": 0, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "caps": 0, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "subtrees": 3, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse": 11, 2024-04-25T11:35:09.845 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_hit": 5, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_forward": 1, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_discover": 4, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_dir_fetch": 0, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_remote_ino": 0, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_lock": 0, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "load_cent": 0, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "q": 0, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "exported": 0, 2024-04-25T11:35:09.846 INFO:teuthology.orchestra.run.smithi196.stdout: "exported_inodes": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "imported": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "imported_inodes": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_dir_fetch": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_backtrace_fetch": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_peer_discover": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rfiles": 4, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rbytes": 234, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rsnaps": 6, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_set_tag": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_inotable_repaired": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_inodes": 0, 2024-04-25T11:35:09.847 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_file_inodes": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_inode_file_caps": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_grant": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps_dirty": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_cap_release": 0, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "process_request_cap_release": 1 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.848 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_cache": { 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update_receipt": 9, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_try_discover": 6, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_send_discover": 8, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_handle_discover": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_delayed": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_enqueuing": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_created": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_enqueued": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_reintegrated": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_migrated": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_processing": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_enqueued": 0, 2024-04-25T11:35:09.849 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_prioritized": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_started": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_completed": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_path": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_inode": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_exportdir": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_flush": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragmentdir": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragstats": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_inodestats": 0 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_log": { 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "evlrg": 0, 2024-04-25T11:35:09.850 INFO:teuthology.orchestra.run.smithi196.stdout: "evadd": 9, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "evex": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "evtrm": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "ev": 9, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "evexg": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "evexd": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "segadd": 2, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "segex": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "segtrm": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "seg": 2, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "segmjr": 2, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "segexg": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "segexd": 0, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "expos": 4194304, 2024-04-25T11:35:09.851 INFO:teuthology.orchestra.run.smithi196.stdout: "wrpos": 4196796, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "rdpos": 0, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "jlat": { 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 8, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.014611041, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.001826380 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "replayed": 0 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_mem": { 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "ino": 20, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "ino+": 22, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "ino-": 2, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "dir": 19, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "dir+": 22, 2024-04-25T11:35:09.852 INFO:teuthology.orchestra.run.smithi196.stdout: "dir-": 3, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "dn": 16, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "dn+": 20, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "dn-": 4, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "cap": 0, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "cap+": 1, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "cap-": 1, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "rss": 122068, 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: "heap": 223632 2024-04-25T11:35:09.853 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_server": { 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_client_request": 4, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_server_request": 0, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_request": 3, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_session": 21, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_peer_request": 0, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "req_create_latency": { 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getattr_latency": { 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1, 2024-04-25T11:35:09.854 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000190171, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000190171 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getfilelock_latency": { 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "req_link_latency": { 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookup_latency": { 2024-04-25T11:35:09.855 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookuphash_latency": { 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.856 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupino_latency": { 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupname_latency": { 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupparent_latency": { 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.857 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupsnap_latency": { 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lssnap_latency": { 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.858 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.859 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mkdir_latency": { 2024-04-25T11:35:09.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.859 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.859 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mknod_latency": { 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mksnap_latency": { 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "req_open_latency": { 2024-04-25T11:35:09.860 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "req_readdir_latency": { 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rename_latency": { 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.861 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "req_renamesnap_latency": { 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "req_snapdiff_latency": { 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmdir_latency": { 2024-04-25T11:35:09.862 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmsnap_latency": { 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmxattr_latency": { 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.863 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setattr_latency": { 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setdirlayout_latency": { 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setfilelock_latency": { 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.864 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setlayout_latency": { 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setxattr_latency": { 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "req_symlink_latency": { 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.865 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "req_unlink_latency": { 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_revoke_eviction": 0, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_acquisition_throttle": 0, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getvxattr_latency": { 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.866 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_sessions": { 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "session_count": 1, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "session_add": 4, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "session_remove": 3, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_open": 1, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_stale": 0, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "total_load": 1, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "average_load": 1, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "avg_session_uptime": 657, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "mdthresh_evicted": 0 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-04-25T11:35:09.867 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-04-25T11:35:09.868 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:35:09.869 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 255127, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 88, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-04-25T11:35:09.870 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 8256, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 173, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 83389, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 332, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "objecter": { 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_active": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_laggy": 0, 2024-04-25T11:35:09.871 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send": 45, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send_bytes": 12884, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_resend": 28, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_reply": 45, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_latency": { 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 45, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.325993111, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.007244291 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_inflight": 0, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "oplen_avg": { 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 45, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 67 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op": 45, 2024-04-25T11:35:09.872 INFO:teuthology.orchestra.run.smithi196.stdout: "op_r": 0, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "op_w": 45, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "op_rmw": 0, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "op_pg": 0, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_stat": 0, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_create": 10, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_read": 0, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_write": 8, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writefull": 8, 2024-04-25T11:35:09.873 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writesame": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_append": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_zero": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_truncate": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_delete": 6, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_mapext": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_sparse_read": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_clonerange": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_getxattr": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_setxattr": 20, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_cmpxattr": 0, 2024-04-25T11:35:09.874 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_rmxattr": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_resetxattrs": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_call": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_watch": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_notify": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls_filter": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_other": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_active": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_send": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_resend": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_ping": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_active": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_send": 0, 2024-04-25T11:35:09.875 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_resend": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_active": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_send": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_resend": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_active": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_send": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_resend": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "command_active": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "command_send": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "command_resend": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "map_epoch": 90, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "map_full": 0, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "map_inc": 13, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_sessions": 9, 2024-04-25T11:35:09.876 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_open": 9, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_close": 0, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_laggy": 0, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_wr": 14, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_rd": 0, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_del": 1 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "oft": { 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_objs": 1, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_kv_pairs": 0, 2024-04-25T11:35:09.877 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_updates": 0, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_removes": 0 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "osd-slow-ops": { 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_ops_count": 0 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "purge_queue": { 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops": 0, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing": 0, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_high_water": 0, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed_ops": 0, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed": 0, 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_item_in_journal": 0 2024-04-25T11:35:09.878 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 979, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 1694285, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 979, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 979, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1694285, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.879 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_bytes": { 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 45, 2024-04-25T11:35:09.880 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 12884, 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 45, 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 12884, 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.881 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_ops": { 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 1024, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 45, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 45, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 45, 2024-04-25T11:35:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 45, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle": { 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:09.883 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle-0x555a85246750": { 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 9, 2024-04-25T11:35:09.884 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 2492, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 9, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 8, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 2492, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:09.885 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-25T11:35:09.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:09 smithi082 ceph-mon[32440]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T11:35:09.988 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:09 smithi082 ceph-mon[32440]: pgmap v340: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:35:10.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:09 smithi080 ceph-mon[29126]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T11:35:10.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:09 smithi080 ceph-mon[29126]: pgmap v340: 97 pgs: 97 active+clean; 2.3 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:35:10.800 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-04-25T11:35:10.800 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-04-25T11:35:10.800 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-04-25T11:35:10.800 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=9 2024-04-25T11:35:10.801 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-04-25T11:35:10.801 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-25T11:35:10.801 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T11:35:10.801 DEBUG:tasks.check_counter:Getting stats from l 2024-04-25T11:35:10.801 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid bba277ec-02f4-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-25T11:35:11.042 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T11:35:12.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:12 smithi196 ceph-mon[32659]: pgmap v341: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:35:12.263 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:12 smithi196 ceph-mon[32659]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T11:35:12.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:12 smithi080 ceph-mon[29126]: pgmap v341: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:35:12.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:12 smithi080 ceph-mon[29126]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T11:35:12.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:12 smithi082 ceph-mon[32440]: pgmap v341: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T11:35:12.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:12 smithi082 ceph-mon[32440]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 234, 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 222, 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 1545152, 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 135552, 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 4, 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 0, 2024-04-25T11:35:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.050131053, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.014483650, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.039873681, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.005755648, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 222, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.013380758, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000060273 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 1545152, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 135552 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 2, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 168, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 320, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 186672, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 5, 2024-04-25T11:35:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 3, 2024-04-25T11:35:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.011399057, 2024-04-25T11:35:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.007718187, 2024-04-25T11:35:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.001166049, 2024-04-25T11:35:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:35:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 165, 2024-04-25T11:35:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.023303005, 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000141230 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 186672 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 0, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 2, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 0, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 0, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 2, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 1, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.000295133, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.000232775, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T11:35:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T11:35:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 0, 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-04-25T11:35:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-04-25T11:35:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T11:35:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 149007, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 30, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-04-25T11:35:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-04-25T11:35:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-04-25T11:35:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-04-25T11:35:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-04-25T11:35:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-04-25T11:35:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 928, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 2, 2024-04-25T11:35:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-04-25T11:35:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 232, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 1509714, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 232, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 232, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1509714, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-25T11:35:13.021 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-25T11:35:13.743 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-04-25T11:35:13.743 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-04-25T11:35:13.744 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-04-25T11:35:13.744 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-04-25T11:35:13.744 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-04-25T11:35:13.744 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-04-25T11:35:13.744 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-04-25T11:35:13.744 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T11:35:13.759 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T11:35:13.759 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:35:13.759 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T11:35:13.780 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-25T11:35:13.780 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T11:35:13.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:35:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 -- 172.21.15.80:0/3666937258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938104280 msgr2=0x7f2938110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 --2- 172.21.15.80:0/3666937258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938104280 0x7f2938110650 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2928009900 tx=0x7f292802a410 comp rx=0 tx=0).stop 2024-04-25T11:35:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 -- 172.21.15.80:0/3666937258 shutdown_connections 2024-04-25T11:35:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 --2- 172.21.15.80:0/3666937258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938104280 0x7f2938110650 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 --2- 172.21.15.80:0/3666937258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2938109fd0 0x7f2938103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 --2- 172.21.15.80:0/3666937258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938109b30 0x7f29381036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 -- 172.21.15.80:0/3666937258 >> 172.21.15.80:0/3666937258 conn(0x7f29380ff210 msgr2=0x7f2938101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 -- 172.21.15.80:0/3666937258 shutdown_connections 2024-04-25T11:35:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.023+0000 7f293d135640 1 -- 172.21.15.80:0/3666937258 wait complete. 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.024+0000 7f293d135640 1 Processor -- start 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.024+0000 7f293d135640 1 -- start start 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293d135640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938104280 0x7f293819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293d135640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938109b30 0x7f293819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293d135640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2938109fd0 0x7f293819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293d135640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2938113d40 con 0x7f2938109b30 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293d135640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2938113bc0 con 0x7f2938104280 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293d135640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2938113ec0 con 0x7f2938109fd0 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938109b30 0x7f293819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938109b30 0x7f293819ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45060/0 (socket says 172.21.15.80:45060) 2024-04-25T11:35:14.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 -- 172.21.15.80:0/395435545 learned_addr learned my addr 172.21.15.80:0/395435545 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293759e640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2938109fd0 0x7f293819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f2936d9d640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938104280 0x7f293819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 -- 172.21.15.80:0/395435545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2938109fd0 msgr2=0x7f293819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2938109fd0 0x7f293819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 -- 172.21.15.80:0/395435545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938104280 msgr2=0x7f293819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938104280 0x7f293819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 -- 172.21.15.80:0/395435545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293819f540 con 0x7f2938109b30 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.025+0000 7f293659c640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938109b30 0x7f293819ac40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f292000e9f0 tx=0x7f292000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.026+0000 7f292ffff640 1 -- 172.21.15.80:0/395435545 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292000ccc0 con 0x7f2938109b30 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.026+0000 7f292ffff640 1 -- 172.21.15.80:0/395435545 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29200035f0 con 0x7f2938109b30 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.026+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293819f830 con 0x7f2938109b30 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.026+0000 7f292ffff640 1 -- 172.21.15.80:0/395435545 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292000ce60 con 0x7f2938109b30 2024-04-25T11:35:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.026+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293819fd30 con 0x7f2938109b30 2024-04-25T11:35:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.027+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293806a190 con 0x7f2938109b30 2024-04-25T11:35:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.028+0000 7f292ffff640 1 -- 172.21.15.80:0/395435545 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f2920003aa0 con 0x7f2938109b30 2024-04-25T11:35:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.029+0000 7f292ffff640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f29240afc60 0x7f29240b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.029+0000 7f2936d9d640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f29240afc60 0x7f29240b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.029+0000 7f292ffff640 1 -- 172.21.15.80:0/395435545 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7f29200df4d0 con 0x7f2938109b30 2024-04-25T11:35:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.030+0000 7f2936d9d640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f29240afc60 0x7f29240b2170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2938104810 tx=0x7f2930009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.033+0000 7f292ffff640 1 -- 172.21.15.80:0/395435545 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f293819fd30 con 0x7f2938109b30 2024-04-25T11:35:14.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.212+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f293810b6b0 con 0x7f2938109b30 2024-04-25T11:35:14.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.214+0000 7f292ffff640 1 -- 172.21.15.80:0/395435545 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23147 (secure 0 0 0) 0x7f29200a7d50 con 0x7f2938109b30 2024-04-25T11:35:14.203 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:35:14.203 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:35:11.668831+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/4228038844":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1814218335":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/1536113811":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/4111395089":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:35:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f29240afc60 msgr2=0x7f29240b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f29240afc60 0x7f29240b2170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2938104810 tx=0x7f2930009500 comp rx=0 tx=0).stop 2024-04-25T11:35:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938109b30 msgr2=0x7f293819ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938109b30 0x7f293819ac40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f292000e9f0 tx=0x7f292000eeb0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 shutdown_connections 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f29240afc60 0x7f29240b2170 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2938109b30 0x7f293819ac40 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2938109fd0 0x7f293819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 --2- 172.21.15.80:0/395435545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938104280 0x7f293819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 >> 172.21.15.80:0/395435545 conn(0x7f29380ff210 msgr2=0x7f29381064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 shutdown_connections 2024-04-25T11:35:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.216+0000 7f293d135640 1 -- 172.21.15.80:0/395435545 wait complete. 2024-04-25T11:35:14.215 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:14 smithi080 ceph-mon[29126]: pgmap v343: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:35:14.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T11:17:23.277450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T11:22:11.573006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T11:22:12.693752+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T11:35:14.217 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:35:14.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 -- 172.21.15.80:0/126603612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5341031c0 msgr2=0x7ff53410f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 --2- 172.21.15.80:0/126603612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5341031c0 0x7ff53410f4a0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009ca0 tx=0x7ff52c02a8c0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 -- 172.21.15.80:0/126603612 shutdown_connections 2024-04-25T11:35:14.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 --2- 172.21.15.80:0/126603612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5341031c0 0x7ff53410f4a0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 --2- 172.21.15.80:0/126603612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534108eb0 0x7ff534102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 --2- 172.21.15.80:0/126603612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff534108a10 0x7ff534102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 -- 172.21.15.80:0/126603612 >> 172.21.15.80:0/126603612 conn(0x7ff5340781b0 msgr2=0x7ff5340785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 -- 172.21.15.80:0/126603612 shutdown_connections 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.339+0000 7ff539557640 1 -- 172.21.15.80:0/126603612 wait complete. 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 Processor -- start 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 -- start start 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5341031c0 0x7ff534199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534108a10 0x7ff534199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534108eb0 0x7ff53419de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff534112c50 con 0x7ff534108eb0 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff534112ad0 con 0x7ff5341031c0 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff539557640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff534112dd0 con 0x7ff534108a10 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534108eb0 0x7ff53419de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534108eb0 0x7ff53419de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45082/0 (socket says 172.21.15.80:45082) 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff5337fe640 1 -- 172.21.15.80:0/2605854994 learned_addr learned my addr 172.21.15.80:0/2605854994 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff52bfff640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534108a10 0x7ff534199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.340+0000 7ff532ffd640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5341031c0 0x7ff534199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff5337fe640 1 -- 172.21.15.80:0/2605854994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534108a10 msgr2=0x7ff534199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff5337fe640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534108a10 0x7ff534199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff5337fe640 1 -- 172.21.15.80:0/2605854994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5341031c0 msgr2=0x7ff534199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff5337fe640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5341031c0 0x7ff534199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff5337fe640 1 -- 172.21.15.80:0/2605854994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53419e470 con 0x7ff534108eb0 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff5337fe640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534108eb0 0x7ff53419de30 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0098d0 tx=0x7ff52c031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff530ff9640 1 -- 172.21.15.80:0/2605854994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c04a070 con 0x7ff534108eb0 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff530ff9640 1 -- 172.21.15.80:0/2605854994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52c003b80 con 0x7ff534108eb0 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53419e700 con 0x7ff534108eb0 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff530ff9640 1 -- 172.21.15.80:0/2605854994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c02f8c0 con 0x7ff534108eb0 2024-04-25T11:35:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.341+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53419ec50 con 0x7ff534108eb0 2024-04-25T11:35:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.342+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff534103d00 con 0x7ff534108eb0 2024-04-25T11:35:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.343+0000 7ff530ff9640 1 -- 172.21.15.80:0/2605854994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7ff52c04d070 con 0x7ff534108eb0 2024-04-25T11:35:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.344+0000 7ff530ff9640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5200afc60 0x7ff5200b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.344+0000 7ff532ffd640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5200afc60 0x7ff5200b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.344+0000 7ff530ff9640 1 -- 172.21.15.80:0/2605854994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7ff52c101540 con 0x7ff534108eb0 2024-04-25T11:35:14.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.344+0000 7ff532ffd640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5200afc60 0x7ff5200b2170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff524005d00 tx=0x7ff52400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.349+0000 7ff530ff9640 1 -- 172.21.15.80:0/2605854994 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff52c081ff0 con 0x7ff534108eb0 2024-04-25T11:35:14.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:14 smithi196 ceph-mon[32659]: pgmap v343: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:35:14.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:14 smithi082 ceph-mon[32440]: pgmap v343: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-04-25T11:35:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.525+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff53410a520 con 0x7ff534108eb0 2024-04-25T11:35:14.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.526+0000 7ff530ff9640 1 -- 172.21.15.80:0/2605854994 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7ff52c0c9880 con 0x7ff534108eb0 2024-04-25T11:35:14.515 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5200afc60 msgr2=0x7ff5200b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5200afc60 0x7ff5200b2170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff524005d00 tx=0x7ff52400b410 comp rx=0 tx=0).stop 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534108eb0 msgr2=0x7ff53419de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534108eb0 0x7ff53419de30 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0098d0 tx=0x7ff52c031730 comp rx=0 tx=0).stop 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 shutdown_connections 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7ff5200afc60 0x7ff5200b2170 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534108eb0 0x7ff53419de30 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534108a10 0x7ff534199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 --2- 172.21.15.80:0/2605854994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5341031c0 0x7ff534199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 >> 172.21.15.80:0/2605854994 conn(0x7ff5340781b0 msgr2=0x7ff534100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 shutdown_connections 2024-04-25T11:35:14.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.528+0000 7ff539557640 1 -- 172.21.15.80:0/2605854994 wait complete. 2024-04-25T11:35:14.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:35:14.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 -- 172.21.15.80:0/3894268056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54102050 msgr2=0x7f4f54102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 --2- 172.21.15.80:0/3894268056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54102050 0x7f4f54102460 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009900 tx=0x7f4f4802a410 comp rx=0 tx=0).stop 2024-04-25T11:35:14.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 -- 172.21.15.80:0/3894268056 shutdown_connections 2024-04-25T11:35:14.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 --2- 172.21.15.80:0/3894268056 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54102050 0x7f4f54102460 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 --2- 172.21.15.80:0/3894268056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5410e550 0x7f4f54110970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 --2- 172.21.15.80:0/3894268056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f54109ba0 0x7f4f54101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 -- 172.21.15.80:0/3894268056 >> 172.21.15.80:0/3894268056 conn(0x7f4f54077880 msgr2=0x7f4f54077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:14.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 -- 172.21.15.80:0/3894268056 shutdown_connections 2024-04-25T11:35:14.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.650+0000 7f4f58c51640 1 -- 172.21.15.80:0/3894268056 wait complete. 2024-04-25T11:35:14.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 Processor -- start 2024-04-25T11:35:14.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 -- start start 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f54102050 0x7f4f5419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f54109ba0 0x7f4f5419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5410e550 0x7f4f5419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54113d10 con 0x7f4f5410e550 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54113b90 con 0x7f4f54102050 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f58c51640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54113e90 con 0x7f4f54109ba0 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f52d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5410e550 0x7f4f5419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f52d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5410e550 0x7f4f5419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45106/0 (socket says 172.21.15.80:45106) 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f52d9d640 1 -- 172.21.15.80:0/1934645978 learned_addr learned my addr 172.21.15.80:0/1934645978 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f5259c640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f54102050 0x7f4f5419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.651+0000 7f4f51d9b640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f54109ba0 0x7f4f5419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f52d9d640 1 -- 172.21.15.80:0/1934645978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f54109ba0 msgr2=0x7f4f5419acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f52d9d640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f54109ba0 0x7f4f5419acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f52d9d640 1 -- 172.21.15.80:0/1934645978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f54102050 msgr2=0x7f4f5419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f52d9d640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f54102050 0x7f4f5419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f52d9d640 1 -- 172.21.15.80:0/1934645978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5419f5b0 con 0x7f4f5410e550 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f5259c640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f54102050 0x7f4f5419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f52d9d640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5410e550 0x7f4f5419ef70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e970 tx=0x7f4f4c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f437fe640 1 -- 172.21.15.80:0/1934645978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00ccc0 con 0x7f4f5410e550 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f437fe640 1 -- 172.21.15.80:0/1934645978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c0054d0 con 0x7f4f5410e550 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5419f8a0 con 0x7f4f5410e550 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f437fe640 1 -- 172.21.15.80:0/1934645978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c010430 con 0x7f4f5410e550 2024-04-25T11:35:14.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.652+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5419fd70 con 0x7f4f5410e550 2024-04-25T11:35:14.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.653+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f540692e0 con 0x7f4f5410e550 2024-04-25T11:35:14.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.655+0000 7f4f437fe640 1 -- 172.21.15.80:0/1934645978 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f4f4c004fe0 con 0x7f4f5410e550 2024-04-25T11:35:14.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.656+0000 7f4f437fe640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f3c0afc60 0x7f4f3c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.656+0000 7f4f5259c640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f3c0afc60 0x7f4f3c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.656+0000 7f4f437fe640 1 -- 172.21.15.80:0/1934645978 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7f4f4c0df630 con 0x7f4f5410e550 2024-04-25T11:35:14.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.656+0000 7f4f5259c640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f3c0afc60 0x7f4f3c0b2170 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f54075520 tx=0x7f4f44009500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.660+0000 7f4f437fe640 1 -- 172.21.15.80:0/1934645978 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4f4c053ff0 con 0x7f4f5410e550 2024-04-25T11:35:14.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.839+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4f5410d370 con 0x7f4f5410e550 2024-04-25T11:35:14.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.839+0000 7f4f437fe640 1 -- 172.21.15.80:0/1934645978 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f4f4c0a7eb0 con 0x7f4f5410e550 2024-04-25T11:35:14.828 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-25T11:35:14.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f3c0afc60 msgr2=0x7f4f3c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f3c0afc60 0x7f4f3c0b2170 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f54075520 tx=0x7f4f44009500 comp rx=0 tx=0).stop 2024-04-25T11:35:14.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5410e550 msgr2=0x7f4f5419ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5410e550 0x7f4f5419ef70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e970 tx=0x7f4f4c00ee30 comp rx=0 tx=0).stop 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 shutdown_connections 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f4f3c0afc60 0x7f4f3c0b2170 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5410e550 0x7f4f5419ef70 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f54109ba0 0x7f4f5419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 --2- 172.21.15.80:0/1934645978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f54102050 0x7f4f5419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.841+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 >> 172.21.15.80:0/1934645978 conn(0x7f4f54077880 msgr2=0x7f4f5410a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.842+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 shutdown_connections 2024-04-25T11:35:14.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.842+0000 7f4f58c51640 1 -- 172.21.15.80:0/1934645978 wait complete. 2024-04-25T11:35:14.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:35:14.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 -- 172.21.15.80:0/57233716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 msgr2=0x7fed6c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 --2- 172.21.15.80:0/57233716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c102f00 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009900 tx=0x7fed5c02a410 comp rx=0 tx=0).stop 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 -- 172.21.15.80:0/57233716 shutdown_connections 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 --2- 172.21.15.80:0/57233716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c102f00 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 --2- 172.21.15.80:0/57233716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c10d380 0x7fed6c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 --2- 172.21.15.80:0/57233716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed6c108a20 0x7fed6c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 -- 172.21.15.80:0/57233716 >> 172.21.15.80:0/57233716 conn(0x7fed6c078100 msgr2=0x7fed6c078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 -- 172.21.15.80:0/57233716 shutdown_connections 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 -- 172.21.15.80:0/57233716 wait complete. 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 Processor -- start 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.964+0000 7fed73b01640 1 -- start start 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c108a20 0x7fed6c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed6c10d380 0x7fed6c19c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c112c40 con 0x7fed6c102af0 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c112ac0 con 0x7fed6c10d380 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c112dc0 con 0x7fed6c108a20 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c19b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45126/0 (socket says 172.21.15.80:45126) 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 -- 172.21.15.80:0/3474953098 learned_addr learned my addr 172.21.15.80:0/3474953098 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 -- 172.21.15.80:0/3474953098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c108a20 msgr2=0x7fed6c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c108a20 0x7fed6c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 -- 172.21.15.80:0/3474953098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed6c10d380 msgr2=0x7fed6c19c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed6c10d380 0x7fed6c19c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 -- 172.21.15.80:0/3474953098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c1a6840 con 0x7fed6c102af0 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed7189d640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c19b5c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fed6800c970 tx=0x7fed6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed62ffd640 1 -- 172.21.15.80:0/3474953098 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68014070 con 0x7fed6c102af0 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed62ffd640 1 -- 172.21.15.80:0/3474953098 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed68004440 con 0x7fed6c102af0 2024-04-25T11:35:14.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6c1a6b30 con 0x7fed6c102af0 2024-04-25T11:35:14.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed62ffd640 1 -- 172.21.15.80:0/3474953098 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68003e50 con 0x7fed6c102af0 2024-04-25T11:35:14.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.965+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6c1a7080 con 0x7fed6c102af0 2024-04-25T11:35:14.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.966+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c06afa0 con 0x7fed6c102af0 2024-04-25T11:35:14.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.969+0000 7fed62ffd640 1 -- 172.21.15.80:0/3474953098 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fed68017070 con 0x7fed6c102af0 2024-04-25T11:35:14.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.969+0000 7fed62ffd640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fed580afe00 0x7fed580b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:14.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.969+0000 7fed7109c640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fed580afe00 0x7fed580b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:14.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.969+0000 7fed62ffd640 1 -- 172.21.15.80:0/3474953098 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7fed680df430 con 0x7fed6c102af0 2024-04-25T11:35:14.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.970+0000 7fed7109c640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fed580afe00 0x7fed580b2310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed5c02a930 tx=0x7fed5c031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:14.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:14.973+0000 7fed62ffd640 1 -- 172.21.15.80:0/3474953098 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fed6801e030 con 0x7fed6c102af0 2024-04-25T11:35:15.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/395435545' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:35:15.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2605854994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:35:15.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:15 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1934645978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:35:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.153+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fed6c02db50 con 0x7fed6c102af0 2024-04-25T11:35:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.154+0000 7fed62ffd640 1 -- 172.21.15.80:0/3474953098 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fed680a7cb0 con 0x7fed6c102af0 2024-04-25T11:35:15.142 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-25T11:35:15.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fed580afe00 msgr2=0x7fed580b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fed580afe00 0x7fed580b2310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed5c02a930 tx=0x7fed5c031400 comp rx=0 tx=0).stop 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 msgr2=0x7fed6c19b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c19b5c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fed6800c970 tx=0x7fed6800ce30 comp rx=0 tx=0).stop 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 shutdown_connections 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fed580afe00 0x7fed580b2310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed6c10d380 0x7fed6c19c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c108a20 0x7fed6c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 --2- 172.21.15.80:0/3474953098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed6c102af0 0x7fed6c19b5c0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 >> 172.21.15.80:0/3474953098 conn(0x7fed6c078100 msgr2=0x7fed6c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 shutdown_connections 2024-04-25T11:35:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.156+0000 7fed73b01640 1 -- 172.21.15.80:0/3474953098 wait complete. 2024-04-25T11:35:15.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T11:35:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.275+0000 7fbd33a51640 1 -- 172.21.15.80:0/146079820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109b10 msgr2=0x7fbd2c1036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.275+0000 7fbd33a51640 1 --2- 172.21.15.80:0/146079820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109b10 0x7fbd2c1036b0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009900 tx=0x7fbd2802a410 comp rx=0 tx=0).stop 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 -- 172.21.15.80:0/146079820 shutdown_connections 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 --2- 172.21.15.80:0/146079820 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2c104260 0x7fbd2c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 --2- 172.21.15.80:0/146079820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2c109fb0 0x7fbd2c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 --2- 172.21.15.80:0/146079820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109b10 0x7fbd2c1036b0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 -- 172.21.15.80:0/146079820 >> 172.21.15.80:0/146079820 conn(0x7fbd2c0ff210 msgr2=0x7fbd2c101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 -- 172.21.15.80:0/146079820 shutdown_connections 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 -- 172.21.15.80:0/146079820 wait complete. 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 Processor -- start 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.276+0000 7fbd33a51640 1 -- start start 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2c104260 0x7fbd2c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2c109b10 0x7fbd2c19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109fb0 0x7fbd2c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c113d00 con 0x7fbd2c109fb0 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c113b80 con 0x7fbd2c109b10 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c113e80 con 0x7fbd2c104260 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109fb0 0x7fbd2c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109fb0 0x7fbd2c19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45144/0 (socket says 172.21.15.80:45144) 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 -- 172.21.15.80:0/2032514943 learned_addr learned my addr 172.21.15.80:0/2032514943 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd30fec640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2c109b10 0x7fbd2c19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd317ed640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2c104260 0x7fbd2c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 -- 172.21.15.80:0/2032514943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2c104260 msgr2=0x7fbd2c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2c104260 0x7fbd2c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 -- 172.21.15.80:0/2032514943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2c109b10 msgr2=0x7fbd2c19aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2c109b10 0x7fbd2c19aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 -- 172.21.15.80:0/2032514943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c19f5a0 con 0x7fbd2c109fb0 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd30fec640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2c109b10 0x7fbd2c19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:35:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd317ed640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2c104260 0x7fbd2c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:35:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd31fee640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109fb0 0x7fbd2c19ef60 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400eaa0 tx=0x7fbd2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd227fc640 1 -- 172.21.15.80:0/2032514943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400cdb0 con 0x7fbd2c109fb0 2024-04-25T11:35:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2c19f890 con 0x7fbd2c109fb0 2024-04-25T11:35:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd227fc640 1 -- 172.21.15.80:0/2032514943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd24005020 con 0x7fbd2c109fb0 2024-04-25T11:35:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd227fc640 1 -- 172.21.15.80:0/2032514943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd240116d0 con 0x7fbd2c109fb0 2024-04-25T11:35:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.277+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2c1a7210 con 0x7fbd2c109fb0 2024-04-25T11:35:15.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.279+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2c06a160 con 0x7fbd2c109fb0 2024-04-25T11:35:15.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.280+0000 7fbd227fc640 1 -- 172.21.15.80:0/2032514943 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fbd240054a0 con 0x7fbd2c109fb0 2024-04-25T11:35:15.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.280+0000 7fbd227fc640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fbd180afc60 0x7fbd180b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.280+0000 7fbd317ed640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fbd180afc60 0x7fbd180b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.280+0000 7fbd227fc640 1 -- 172.21.15.80:0/2032514943 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7fbd240df290 con 0x7fbd2c109fb0 2024-04-25T11:35:15.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.281+0000 7fbd317ed640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fbd180afc60 0x7fbd180b2170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd280096c0 tx=0x7fbd28031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:15.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.285+0000 7fbd227fc640 1 -- 172.21.15.80:0/2032514943 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbd24016030 con 0x7fbd2c109fb0 2024-04-25T11:35:15.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/395435545' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:35:15.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2605854994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:35:15.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:15 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1934645978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:35:15.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.472+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd2c1a74b0 con 0x7fbd2c109fb0 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.472+0000 7fbd227fc640 1 -- 172.21.15.80:0/2032514943 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v91) ==== 81+0+944 (secure 0 0 0) 0x7fbd240a7b10 con 0x7fbd2c109fb0 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/4228038844 2024-04-26T11:24:14.749761+0000 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/3135257773 2024-04-26T11:24:14.749761+0000 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1814218335 2024-04-26T11:24:14.749761+0000 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1475839219 2024-04-26T11:14:55.185433+0000 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/2391075178 2024-04-26T11:14:55.185433+0000 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/2554689632 2024-04-26T11:14:55.185433+0000 2024-04-25T11:35:15.461 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/3135257773 2024-04-26T11:24:14.749761+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1376368736 2024-04-26T11:14:55.185433+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/572796280 2024-04-26T11:14:28.254016+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/2554689632 2024-04-26T11:14:55.185433+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/369805094 2024-04-26T11:14:28.254016+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1536113811 2024-04-26T11:24:14.749761+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/1021361872 2024-04-26T11:14:28.254016+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/1021361872 2024-04-26T11:14:28.254016+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/4111395089 2024-04-26T11:24:14.749761+0000 2024-04-25T11:35:15.462 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/2537462013 2024-04-26T11:14:28.254016+0000 2024-04-25T11:35:15.463 INFO:teuthology.orchestra.run.smithi080.stderr:listed 16 entries 2024-04-25T11:35:15.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fbd180afc60 msgr2=0x7fbd180b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fbd180afc60 0x7fbd180b2170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd280096c0 tx=0x7fbd28031400 comp rx=0 tx=0).stop 2024-04-25T11:35:15.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109fb0 msgr2=0x7fbd2c19ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109fb0 0x7fbd2c19ef60 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400eaa0 tx=0x7fbd2400ef60 comp rx=0 tx=0).stop 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 shutdown_connections 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fbd180afc60 0x7fbd180b2170 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd2c109fb0 0x7fbd2c19ef60 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2c109b10 0x7fbd2c19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 --2- 172.21.15.80:0/2032514943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2c104260 0x7fbd2c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 >> 172.21.15.80:0/2032514943 conn(0x7fbd2c0ff210 msgr2=0x7fbd2c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 shutdown_connections 2024-04-25T11:35:15.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.474+0000 7fbd33a51640 1 -- 172.21.15.80:0/2032514943 wait complete. 2024-04-25T11:35:15.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T11:35:15.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:35:15.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T11:35:15.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/395435545' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:35:15.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2605854994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T11:35:15.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:15 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1934645978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T11:35:15.514 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:35:15.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:35:15.514 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T11:35:15.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:35:15.574 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-25T11:35:15.630 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T11:35:15.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:35:15.630 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T11:35:15.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:35:15.695 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-25T11:35:15.802 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-25T11:35:15.813 INFO:tasks.cephadm:Teardown begin 2024-04-25T11:35:15.813 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T11:35:15.813 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:35:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 -- 172.21.15.80:0/2985032346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390109fd0 msgr2=0x7fd390103c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 --2- 172.21.15.80:0/2985032346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390109fd0 0x7fd390103c10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fd384009900 tx=0x7fd38402a410 comp rx=0 tx=0).stop 2024-04-25T11:35:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 -- 172.21.15.80:0/2985032346 shutdown_connections 2024-04-25T11:35:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 --2- 172.21.15.80:0/2985032346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390109fd0 0x7fd390103c10 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 --2- 172.21.15.80:0/2985032346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd390104280 0x7fd390110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 --2- 172.21.15.80:0/2985032346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd390109b30 0x7fd3901036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 -- 172.21.15.80:0/2985032346 >> 172.21.15.80:0/2985032346 conn(0x7fd3900ff210 msgr2=0x7fd390101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 -- 172.21.15.80:0/2985032346 shutdown_connections 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.933+0000 7fd396184640 1 -- 172.21.15.80:0/2985032346 wait complete. 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 Processor -- start 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 -- start start 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390104280 0x7fd39019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd390109b30 0x7fd39019ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd390109fd0 0x7fd39019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd390113d80 con 0x7fd390104280 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd390113c00 con 0x7fd390109fd0 2024-04-25T11:35:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd396184640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd390113f00 con 0x7fd390109b30 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.934+0000 7fd38f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390104280 0x7fd39019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390104280 0x7fd39019a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45160/0 (socket says 172.21.15.80:45160) 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 -- 172.21.15.80:0/2781227421 learned_addr learned my addr 172.21.15.80:0/2781227421 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38ffff640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd390109fd0 0x7fd39019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38effd640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd390109b30 0x7fd39019ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 -- 172.21.15.80:0/2781227421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd390109b30 msgr2=0x7fd39019ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd390109b30 0x7fd39019ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 -- 172.21.15.80:0/2781227421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd390109fd0 msgr2=0x7fd39019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd390109fd0 0x7fd39019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 -- 172.21.15.80:0/2781227421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39019f640 con 0x7fd390104280 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38f7fe640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390104280 0x7fd39019a7e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd38000b450 tx=0x7fd38000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38cff9640 1 -- 172.21.15.80:0/2781227421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380015020 con 0x7fd390104280 2024-04-25T11:35:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38cff9640 1 -- 172.21.15.80:0/2781227421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd380011d40 con 0x7fd390104280 2024-04-25T11:35:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39019f930 con 0x7fd390104280 2024-04-25T11:35:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd38cff9640 1 -- 172.21.15.80:0/2781227421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38000f340 con 0x7fd390104280 2024-04-25T11:35:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.935+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3901a72b0 con 0x7fd390104280 2024-04-25T11:35:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.936+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39006a190 con 0x7fd390104280 2024-04-25T11:35:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.938+0000 7fd38cff9640 1 -- 172.21.15.80:0/2781227421 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7fd380018020 con 0x7fd390104280 2024-04-25T11:35:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.938+0000 7fd38cff9640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3780afc60 0x7fd3780b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.939+0000 7fd38effd640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3780afc60 0x7fd3780b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.939+0000 7fd38cff9640 1 -- 172.21.15.80:0/2781227421 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7fd3800def90 con 0x7fd390104280 2024-04-25T11:35:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.939+0000 7fd38effd640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3780afc60 0x7fd3780b2170 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd384009230 tx=0x7fd384031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:15.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:15.942+0000 7fd38cff9640 1 -- 172.21.15.80:0/2781227421 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd38001f020 con 0x7fd390104280 2024-04-25T11:35:16.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.159+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd39019bb30 con 0x7fd390104280 2024-04-25T11:35:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.159+0000 7fd38cff9640 1 -- 172.21.15.80:0/2781227421 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7fd38000d040 con 0x7fd390104280 2024-04-25T11:35:16.148 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:35:16.148 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:35:16.149 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:35:16.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3780afc60 msgr2=0x7fd3780b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3780afc60 0x7fd3780b2170 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd384009230 tx=0x7fd384031400 comp rx=0 tx=0).stop 2024-04-25T11:35:16.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390104280 msgr2=0x7fd39019a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390104280 0x7fd39019a7e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd38000b450 tx=0x7fd38000b910 comp rx=0 tx=0).stop 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 shutdown_connections 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7fd3780afc60 0x7fd3780b2170 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd390109fd0 0x7fd39019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd390109b30 0x7fd39019ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.161+0000 7fd396184640 1 --2- 172.21.15.80:0/2781227421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd390104280 0x7fd39019a7e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.162+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 >> 172.21.15.80:0/2781227421 conn(0x7fd3900ff210 msgr2=0x7fd39010f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.162+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 shutdown_connections 2024-04-25T11:35:16.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.162+0000 7fd396184640 1 -- 172.21.15.80:0/2781227421 wait complete. 2024-04-25T11:35:16.162 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 -- 172.21.15.80:0/723823555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc108a30 msgr2=0x7f63cc1025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 --2- 172.21.15.80:0/723823555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc108a30 0x7f63cc1025c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009900 tx=0x7f63bc02a410 comp rx=0 tx=0).stop 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 -- 172.21.15.80:0/723823555 shutdown_connections 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 --2- 172.21.15.80:0/723823555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63cc10d390 0x7f63cc10f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 --2- 172.21.15.80:0/723823555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63cc102b00 0x7f63cc102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 --2- 172.21.15.80:0/723823555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc108a30 0x7f63cc1025c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 -- 172.21.15.80:0/723823555 >> 172.21.15.80:0/723823555 conn(0x7f63cc0fe080 msgr2=0x7f63cc1004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 -- 172.21.15.80:0/723823555 shutdown_connections 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.281+0000 7f63d2f84640 1 -- 172.21.15.80:0/723823555 wait complete. 2024-04-25T11:35:16.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 Processor -- start 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 -- start start 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63cc102b00 0x7f63cc19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63cc108a30 0x7f63cc19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc10d390 0x7f63cc19bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc112bf0 con 0x7f63cc10d390 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc112a70 con 0x7f63cc102b00 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d2f84640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc112d70 con 0x7f63cc108a30 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d1521640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc10d390 0x7f63cc19bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d1521640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc10d390 0x7f63cc19bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45178/0 (socket says 172.21.15.80:45178) 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d1521640 1 -- 172.21.15.80:0/1524934042 learned_addr learned my addr 172.21.15.80:0/1524934042 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63cbfff640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63cc108a30 0x7f63cc19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.282+0000 7f63d0d20640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63cc102b00 0x7f63cc19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d1521640 1 -- 172.21.15.80:0/1524934042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63cc108a30 msgr2=0x7f63cc19ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d1521640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63cc108a30 0x7f63cc19ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d1521640 1 -- 172.21.15.80:0/1524934042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63cc102b00 msgr2=0x7f63cc19b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d1521640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63cc102b00 0x7f63cc19b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d1521640 1 -- 172.21.15.80:0/1524934042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc1a6860 con 0x7f63cc10d390 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d1521640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc10d390 0x7f63cc19bfd0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f63c400eaa0 tx=0x7f63c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63c9ffb640 1 -- 172.21.15.80:0/1524934042 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c400cdb0 con 0x7f63cc10d390 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63c9ffb640 1 -- 172.21.15.80:0/1524934042 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63c4005020 con 0x7f63cc10d390 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc1a6b50 con 0x7f63cc10d390 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63c9ffb640 1 -- 172.21.15.80:0/1524934042 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c40116d0 con 0x7f63cc10d390 2024-04-25T11:35:16.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.283+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc1a7050 con 0x7f63cc10d390 2024-04-25T11:35:16.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.284+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc06a190 con 0x7f63cc10d390 2024-04-25T11:35:16.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.285+0000 7f63c9ffb640 1 -- 172.21.15.80:0/1524934042 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f63c40051d0 con 0x7f63cc10d390 2024-04-25T11:35:16.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.286+0000 7f63c9ffb640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f63b80afc60 0x7f63b80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.286+0000 7f63d0d20640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f63b80afc60 0x7f63b80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.286+0000 7f63c9ffb640 1 -- 172.21.15.80:0/1524934042 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7f63c40df4f0 con 0x7f63cc10d390 2024-04-25T11:35:16.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.287+0000 7f63d0d20640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f63b80afc60 0x7f63b80b2170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f63bc000c00 tx=0x7f63bc031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:16.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.290+0000 7f63c9ffb640 1 -- 172.21.15.80:0/1524934042 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f63c4016030 con 0x7f63cc10d390 2024-04-25T11:35:16.372 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:16 smithi080 ceph-mon[29126]: pgmap v344: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:35:16.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:16 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3474953098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:35:16.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:16 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2032514943' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T11:35:16.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:16 smithi196 ceph-mon[32659]: pgmap v344: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:35:16.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:16 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3474953098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:35:16.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:16 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2032514943' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T11:35:16.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:16 smithi082 ceph-mon[32440]: pgmap v344: 97 pgs: 97 active+clean; 2.3 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-25T11:35:16.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:16 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3474953098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T11:35:16.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:16 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2032514943' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T11:35:16.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.505+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63cc0753c0 con 0x7f63cc10d390 2024-04-25T11:35:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.506+0000 7f63c9ffb640 1 -- 172.21.15.80:0/1524934042 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11860 (secure 0 0 0) 0x7f63c40a7720 con 0x7f63cc10d390 2024-04-25T11:35:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:35:16.495 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14574,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/620066651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":620066651},{"type":"v1","addr":"172.21.15.80:6835","nonce":620066651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14586,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/461835634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":461835634},{"type":"v1","addr":"172.21.15.80:6837","nonce":461835634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/362397006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":362397006},{"type":"v1","addr":"172.21.15.80:6839","nonce":362397006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/4101739388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":4101739388},{"type":"v1","addr":"172.21.15.80:6841","nonce":4101739388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3230889920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3230889920},{"type":"v1","addr":"172.21.15.196:6833","nonce":3230889920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/942979898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":942979898},{"type":"v1","addr":"172.21.15.82:6833","nonce":942979898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T11:22:13.737406+0000","modified":"2024-04-25T11:25:16.198925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24521,"mds_1":24499,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/4149738023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":4149738023},{"type":"v1","addr":"172.21.15.82:6835","nonce":4149738023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3574274014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3574274014},{"type":"v1","addr":"172.21.15.196:6835","nonce":3574274014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6837/3792535888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3792535888},{"type":"v1","addr":"172.21.15.82:6837","nonce":3792535888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.196:6839/1079728905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1079728905},{"type":"v1","addr":"172.21.15.196:6839","nonce":1079728905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3848058015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3848058015},{"type":"v1","addr":"172.21.15.82:6839","nonce":3848058015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25306":{"gid":25306,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6837/2667891296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":2667891296},{"type":"v1","addr":"172.21.15.196:6837","nonce":2667891296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24521,"qdb_cluster":[24476,24499,24521]},"id":1}]} 2024-04-25T11:35:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f63b80afc60 msgr2=0x7f63b80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f63b80afc60 0x7f63b80b2170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f63bc000c00 tx=0x7f63bc031400 comp rx=0 tx=0).stop 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc10d390 msgr2=0x7f63cc19bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc10d390 0x7f63cc19bfd0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f63c400eaa0 tx=0x7f63c400ef60 comp rx=0 tx=0).stop 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 shutdown_connections 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f63b80afc60 0x7f63b80b2170 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63cc10d390 0x7f63cc19bfd0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63cc108a30 0x7f63cc19ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 --2- 172.21.15.80:0/1524934042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63cc102b00 0x7f63cc19b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 >> 172.21.15.80:0/1524934042 conn(0x7f63cc0fe080 msgr2=0x7f63cc10e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 shutdown_connections 2024-04-25T11:35:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.508+0000 7f63d2f84640 1 -- 172.21.15.80:0/1524934042 wait complete. 2024-04-25T11:35:16.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:35:16.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 -- 172.21.15.80:0/3071899557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40109f90 msgr2=0x7f5d40102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 --2- 172.21.15.80:0/3071899557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40109f90 0x7f5d40102100 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009900 tx=0x7f5d2802a410 comp rx=0 tx=0).stop 2024-04-25T11:35:16.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 -- 172.21.15.80:0/3071899557 shutdown_connections 2024-04-25T11:35:16.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 --2- 172.21.15.80:0/3071899557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40109f90 0x7f5d40102100 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 --2- 172.21.15.80:0/3071899557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d40102770 0x7f5d40110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 --2- 172.21.15.80:0/3071899557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40109af0 0x7f5d40101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 -- 172.21.15.80:0/3071899557 >> 172.21.15.80:0/3071899557 conn(0x7f5d400fd810 msgr2=0x7f5d400ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:16.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 -- 172.21.15.80:0/3071899557 shutdown_connections 2024-04-25T11:35:16.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.627+0000 7f5d46061640 1 -- 172.21.15.80:0/3071899557 wait complete. 2024-04-25T11:35:16.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 Processor -- start 2024-04-25T11:35:16.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 -- start start 2024-04-25T11:35:16.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40102770 0x7f5d4019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d40109af0 0x7f5d4019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40109f90 0x7f5d4019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40113ce0 con 0x7f5d40102770 2024-04-25T11:35:16.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40113b60 con 0x7f5d40109f90 2024-04-25T11:35:16.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d46061640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40113e60 con 0x7f5d40109af0 2024-04-25T11:35:16.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d3f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40102770 0x7f5d4019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d3f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40102770 0x7f5d4019a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37936/0 (socket says 172.21.15.80:37936) 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d3f7fe640 1 -- 172.21.15.80:0/2686392259 learned_addr learned my addr 172.21.15.80:0/2686392259 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d36ffd640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d40109af0 0x7f5d4019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.628+0000 7f5d3ffff640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40109f90 0x7f5d4019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3f7fe640 1 -- 172.21.15.80:0/2686392259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d40109af0 msgr2=0x7f5d4019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3f7fe640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d40109af0 0x7f5d4019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3f7fe640 1 -- 172.21.15.80:0/2686392259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40109f90 msgr2=0x7f5d4019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3f7fe640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40109f90 0x7f5d4019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3f7fe640 1 -- 172.21.15.80:0/2686392259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4019f5a0 con 0x7f5d40102770 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3f7fe640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40102770 0x7f5d4019a740 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000d770 tx=0x7f5d3000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3d7fa640 1 -- 172.21.15.80:0/2686392259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30017070 con 0x7f5d40102770 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4019f890 con 0x7f5d40102770 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3d7fa640 1 -- 172.21.15.80:0/2686392259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d30009c30 con 0x7f5d40102770 2024-04-25T11:35:16.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d3d7fa640 1 -- 172.21.15.80:0/2686392259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000f620 con 0x7f5d40102770 2024-04-25T11:35:16.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.629+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d401a7210 con 0x7f5d40102770 2024-04-25T11:35:16.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.630+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d40104ee0 con 0x7f5d40102770 2024-04-25T11:35:16.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.631+0000 7f5d3d7fa640 1 -- 172.21.15.80:0/2686392259 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f5d3001a070 con 0x7f5d40102770 2024-04-25T11:35:16.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.632+0000 7f5d3d7fa640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5d2c0afc60 0x7f5d2c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.632+0000 7f5d36ffd640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5d2c0afc60 0x7f5d2c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.632+0000 7f5d3d7fa640 1 -- 172.21.15.80:0/2686392259 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7f5d300deb70 con 0x7f5d40102770 2024-04-25T11:35:16.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.633+0000 7f5d36ffd640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5d2c0afc60 0x7f5d2c0b2170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009230 tx=0x7f5d28031400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:16.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.636+0000 7f5d3d7fa640 1 -- 172.21.15.80:0/2686392259 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5d30009de0 con 0x7f5d40102770 2024-04-25T11:35:16.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.817+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d401a73e0 con 0x7f5d40102770 2024-04-25T11:35:16.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.819+0000 7f5d3d7fa640 1 -- 172.21.15.80:0/2686392259 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23147 (secure 0 0 0) 0x7f5d300a73f0 con 0x7f5d40102770 2024-04-25T11:35:16.808 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-25T11:35:16.808 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"bba277ec-02f4-11ef-bc93-c7b262605968","created":"2024-04-25T11:14:01.466404+0000","modified":"2024-04-25T11:35:11.668831+0000","last_up_change":"2024-04-25T11:21:19.787308+0000","last_in_change":"2024-04-25T11:20:58.410652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T11:17:23.277450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T11:22:11.573006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T11:22:12.693752+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43065203-899a-4a95-b206-10e80ad20d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6803","nonce":1124765688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6805","nonce":1124765688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6809","nonce":1124765688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1124765688},{"type":"v1","addr":"172.21.15.80:6807","nonce":1124765688}]},"public_addr":"172.21.15.80:6803/1124765688","cluster_addr":"172.21.15.80:6805/1124765688","heartbeat_back_addr":"172.21.15.80:6809/1124765688","heartbeat_front_addr":"172.21.15.80:6807/1124765688","state":["exists","up"]},{"osd":1,"uuid":"e75fb74a-e338-408d-b098-edd1c4aeff77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913713373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913713373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913713373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913713373},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913713373}]},"public_addr":"172.21.15.82:6801/3913713373","cluster_addr":"172.21.15.82:6803/3913713373","heartbeat_back_addr":"172.21.15.82:6807/3913713373","heartbeat_front_addr":"172.21.15.82:6805/3913713373","state":["exists","up"]},{"osd":2,"uuid":"1352c87b-d8f4-4f62-b4d9-d256d66bbe0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6801","nonce":700082321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6803","nonce":700082321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6807","nonce":700082321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":700082321},{"type":"v1","addr":"172.21.15.196:6805","nonce":700082321}]},"public_addr":"172.21.15.196:6801/700082321","cluster_addr":"172.21.15.196:6803/700082321","heartbeat_back_addr":"172.21.15.196:6807/700082321","heartbeat_front_addr":"172.21.15.196:6805/700082321","state":["exists","up"]},{"osd":3,"uuid":"870b8e57-a5a4-48b9-8973-413bd846a860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6811","nonce":1446045179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6813","nonce":1446045179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6817","nonce":1446045179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1446045179},{"type":"v1","addr":"172.21.15.80:6815","nonce":1446045179}]},"public_addr":"172.21.15.80:6811/1446045179","cluster_addr":"172.21.15.80:6813/1446045179","heartbeat_back_addr":"172.21.15.80:6817/1446045179","heartbeat_front_addr":"172.21.15.80:6815/1446045179","state":["exists","up"]},{"osd":4,"uuid":"cbdae8fe-80db-417f-b27b-b7a436f3035b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6809","nonce":3035622192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6811","nonce":3035622192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6815","nonce":3035622192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3035622192},{"type":"v1","addr":"172.21.15.82:6813","nonce":3035622192}]},"public_addr":"172.21.15.82:6809/3035622192","cluster_addr":"172.21.15.82:6811/3035622192","heartbeat_back_addr":"172.21.15.82:6815/3035622192","heartbeat_front_addr":"172.21.15.82:6813/3035622192","state":["exists","up"]},{"osd":5,"uuid":"e7a50804-7087-46cc-b4fb-0f6487dc15e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6809","nonce":2327068088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6811","nonce":2327068088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6815","nonce":2327068088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2327068088},{"type":"v1","addr":"172.21.15.196:6813","nonce":2327068088}]},"public_addr":"172.21.15.196:6809/2327068088","cluster_addr":"172.21.15.196:6811/2327068088","heartbeat_back_addr":"172.21.15.196:6815/2327068088","heartbeat_front_addr":"172.21.15.196:6813/2327068088","state":["exists","up"]},{"osd":6,"uuid":"fd84057a-f5a0-4027-9b4e-e6948e1aa055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6819","nonce":3879298562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6821","nonce":3879298562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6825","nonce":3879298562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3879298562},{"type":"v1","addr":"172.21.15.80:6823","nonce":3879298562}]},"public_addr":"172.21.15.80:6819/3879298562","cluster_addr":"172.21.15.80:6821/3879298562","heartbeat_back_addr":"172.21.15.80:6825/3879298562","heartbeat_front_addr":"172.21.15.80:6823/3879298562","state":["exists","up"]},{"osd":7,"uuid":"854ef90b-8feb-45c3-a5c9-175a69bf967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6817","nonce":2941501012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6819","nonce":2941501012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6823","nonce":2941501012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2941501012},{"type":"v1","addr":"172.21.15.82:6821","nonce":2941501012}]},"public_addr":"172.21.15.82:6817/2941501012","cluster_addr":"172.21.15.82:6819/2941501012","heartbeat_back_addr":"172.21.15.82:6823/2941501012","heartbeat_front_addr":"172.21.15.82:6821/2941501012","state":["exists","up"]},{"osd":8,"uuid":"30ef2bc4-8039-4330-a4eb-1c75fe5da3e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6817","nonce":2100656217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6819","nonce":2100656217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6823","nonce":2100656217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2100656217},{"type":"v1","addr":"172.21.15.196:6821","nonce":2100656217}]},"public_addr":"172.21.15.196:6817/2100656217","cluster_addr":"172.21.15.196:6819/2100656217","heartbeat_back_addr":"172.21.15.196:6823/2100656217","heartbeat_front_addr":"172.21.15.196:6821/2100656217","state":["exists","up"]},{"osd":9,"uuid":"88aaa775-ab55-451c-b0cf-ef29189adf6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6827","nonce":2904539109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6829","nonce":2904539109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6833","nonce":2904539109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2904539109},{"type":"v1","addr":"172.21.15.80:6831","nonce":2904539109}]},"public_addr":"172.21.15.80:6827/2904539109","cluster_addr":"172.21.15.80:6829/2904539109","heartbeat_back_addr":"172.21.15.80:6833/2904539109","heartbeat_front_addr":"172.21.15.80:6831/2904539109","state":["exists","up"]},{"osd":10,"uuid":"7dd6ff75-c6e5-4eb6-81f4-36b723fa0db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6825","nonce":247644031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6827","nonce":247644031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6831","nonce":247644031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":247644031},{"type":"v1","addr":"172.21.15.82:6829","nonce":247644031}]},"public_addr":"172.21.15.82:6825/247644031","cluster_addr":"172.21.15.82:6827/247644031","heartbeat_back_addr":"172.21.15.82:6831/247644031","heartbeat_front_addr":"172.21.15.82:6829/247644031","state":["exists","up"]},{"osd":11,"uuid":"980819ee-a7db-463d-aa88-5d68654f58f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6825","nonce":3938310451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6827","nonce":3938310451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6831","nonce":3938310451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3938310451},{"type":"v1","addr":"172.21.15.196:6829","nonce":3938310451}]},"public_addr":"172.21.15.196:6825/3938310451","cluster_addr":"172.21.15.196:6827/3938310451","heartbeat_back_addr":"172.21.15.196:6831/3938310451","heartbeat_front_addr":"172.21.15.196:6829/3938310451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:31.105073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:16:55.764740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:20.418337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:17:45.855495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:11.242274+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:18:37.306408+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:03.344862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:29.924763+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:19:56.210765+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:23.238007+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:20:50.103127+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T11:21:17.375294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":3,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:0/4228038844":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1814218335":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1475839219":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/2391075178":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:6801/3135257773":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/1376368736":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/572796280":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6800/2554689632":"2024-04-26T11:14:55.185433+0000","172.21.15.80:0/369805094":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/1536113811":"2024-04-26T11:24:14.749761+0000","172.21.15.80:6800/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:6801/1021361872":"2024-04-26T11:14:28.254016+0000","172.21.15.80:0/4111395089":"2024-04-26T11:24:14.749761+0000","172.21.15.80:0/2537462013":"2024-04-26T11:14:28.254016+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5d2c0afc60 msgr2=0x7f5d2c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5d2c0afc60 0x7f5d2c0b2170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009230 tx=0x7f5d28031400 comp rx=0 tx=0).stop 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40102770 msgr2=0x7f5d4019a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40102770 0x7f5d4019a740 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000d770 tx=0x7f5d3000dc30 comp rx=0 tx=0).stop 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 shutdown_connections 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f5d2c0afc60 0x7f5d2c0b2170 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40109f90 0x7f5d4019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d40109af0 0x7f5d4019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 --2- 172.21.15.80:0/2686392259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d40102770 0x7f5d4019a740 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 >> 172.21.15.80:0/2686392259 conn(0x7f5d400fd810 msgr2=0x7f5d400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:16.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 shutdown_connections 2024-04-25T11:35:16.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.821+0000 7f5d46061640 1 -- 172.21.15.80:0/2686392259 wait complete. 2024-04-25T11:35:16.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T11:35:16.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 -- 172.21.15.80:0/469493466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 msgr2=0x7f67d0110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 --2- 172.21.15.80:0/469493466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d0110630 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009ca0 tx=0x7f67c802a8c0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 -- 172.21.15.80:0/469493466 shutdown_connections 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 --2- 172.21.15.80:0/469493466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d0110630 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 --2- 172.21.15.80:0/469493466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d0109fb0 0x7f67d0103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 --2- 172.21.15.80:0/469493466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d0109b10 0x7f67d01036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 -- 172.21.15.80:0/469493466 >> 172.21.15.80:0/469493466 conn(0x7f67d00ff230 msgr2=0x7f67d0101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 -- 172.21.15.80:0/469493466 shutdown_connections 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.942+0000 7f67d5f06640 1 -- 172.21.15.80:0/469493466 wait complete. 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.943+0000 7f67d5f06640 1 Processor -- start 2024-04-25T11:35:16.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.943+0000 7f67d5f06640 1 -- start start 2024-04-25T11:35:16.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d0109b10 0x7f67d019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d0109fb0 0x7f67d019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0113d20 con 0x7f67d0104260 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0113ba0 con 0x7f67d0109fb0 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0113ea0 con 0x7f67d0109b10 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37958/0 (socket says 172.21.15.80:37958) 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 -- 172.21.15.80:0/3523829956 learned_addr learned my addr 172.21.15.80:0/3523829956 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67ceffd640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d0109b10 0x7f67d019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cffff640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d0109fb0 0x7f67d019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 -- 172.21.15.80:0/3523829956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d0109b10 msgr2=0x7f67d019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d0109b10 0x7f67d019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 -- 172.21.15.80:0/3523829956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d0109fb0 msgr2=0x7f67d019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d0109fb0 0x7f67d019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 -- 172.21.15.80:0/3523829956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d019f560 con 0x7f67d0104260 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67ceffd640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d0109b10 0x7f67d019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:35:16.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cffff640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d0109fb0 0x7f67d019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67cf7fe640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d019a700 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f67c000d770 tx=0x7f67c000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67ccff9640 1 -- 172.21.15.80:0/3523829956 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0017070 con 0x7f67d0104260 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67ccff9640 1 -- 172.21.15.80:0/3523829956 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67c0009c30 con 0x7f67d0104260 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d019f850 con 0x7f67d0104260 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67ccff9640 1 -- 172.21.15.80:0/3523829956 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c000f620 con 0x7f67d0104260 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.944+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d01a71d0 con 0x7f67d0104260 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.945+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d006a160 con 0x7f67d0104260 2024-04-25T11:35:16.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.947+0000 7f67ccff9640 1 -- 172.21.15.80:0/3523829956 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f67c001a070 con 0x7f67d0104260 2024-04-25T11:35:16.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.948+0000 7f67ccff9640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f67b80afc60 0x7f67b80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:16.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.948+0000 7f67ceffd640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f67b80afc60 0x7f67b80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:16.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.948+0000 7f67ccff9640 1 -- 172.21.15.80:0/3523829956 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8550+0+0 (secure 0 0 0) 0x7f67c00dec50 con 0x7f67d0104260 2024-04-25T11:35:16.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.948+0000 7f67ceffd640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f67b80afc60 0x7f67b80b2170 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f67c4005fd0 tx=0x7f67c4005850 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:16.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:16.952+0000 7f67ccff9640 1 -- 172.21.15.80:0/3523829956 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f67c0009de0 con 0x7f67d0104260 2024-04-25T11:35:17.122 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:17 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2781227421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:17 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1524934042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.123 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:17 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2686392259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.169+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f67d010bc20 con 0x7f67d0104260 2024-04-25T11:35:17.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.172+0000 7f67ccff9640 1 -- 172.21.15.80:0/3523829956 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7f67c00a74d0 con 0x7f67d0104260 2024-04-25T11:35:17.160 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f67b80afc60 msgr2=0x7f67b80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f67b80afc60 0x7f67b80b2170 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f67c4005fd0 tx=0x7f67c4005850 comp rx=0 tx=0).stop 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 msgr2=0x7f67d019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d019a700 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f67c000d770 tx=0x7f67c000dc30 comp rx=0 tx=0).stop 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 shutdown_connections 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f67b80afc60 0x7f67b80b2170 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d0109fb0 0x7f67d019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67d0109b10 0x7f67d019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 --2- 172.21.15.80:0/3523829956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d0104260 0x7f67d019a700 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 >> 172.21.15.80:0/3523829956 conn(0x7f67d00ff230 msgr2=0x7f67d0106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 shutdown_connections 2024-04-25T11:35:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.175+0000 7f67d5f06640 1 -- 172.21.15.80:0/3523829956 wait complete. 2024-04-25T11:35:17.175 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T11:35:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 -- 172.21.15.80:0/3764231487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a0104c40 msgr2=0x7f67a0105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 --2- 172.21.15.80:0/3764231487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a0104c40 0x7f67a0105050 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6790009900 tx=0x7f679002a410 comp rx=0 tx=0).stop 2024-04-25T11:35:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 -- 172.21.15.80:0/3764231487 shutdown_connections 2024-04-25T11:35:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 --2- 172.21.15.80:0/3764231487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67a010e090 0x7f67a0110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 --2- 172.21.15.80:0/3764231487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a010b6a0 0x7f67a010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 --2- 172.21.15.80:0/3764231487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a0104c40 0x7f67a0105050 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 -- 172.21.15.80:0/3764231487 >> 172.21.15.80:0/3764231487 conn(0x7f67a00fe260 msgr2=0x7f67a0100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 -- 172.21.15.80:0/3764231487 shutdown_connections 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 -- 172.21.15.80:0/3764231487 wait complete. 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 Processor -- start 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.301+0000 7f67a79ce640 1 -- start start 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a79ce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a0104c40 0x7f67a0102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a79ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67a010b6a0 0x7f67a0102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a79ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a010e090 0x7f67a0102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a79ce640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0113cf0 con 0x7f67a010e090 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a79ce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0113b70 con 0x7f67a010b6a0 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a79ce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0113e70 con 0x7f67a0104c40 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a010e090 0x7f67a0102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a010e090 0x7f67a0102f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37986/0 (socket says 172.21.15.80:37986) 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 -- 172.21.15.80:0/2662161371 learned_addr learned my addr 172.21.15.80:0/2662161371 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a4f69640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67a010b6a0 0x7f67a0102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a576a640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a0104c40 0x7f67a0102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 -- 172.21.15.80:0/2662161371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a0104c40 msgr2=0x7f67a0102500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a0104c40 0x7f67a0102500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 -- 172.21.15.80:0/2662161371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67a010b6a0 msgr2=0x7f67a0102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67a010b6a0 0x7f67a0102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 -- 172.21.15.80:0/2662161371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a01a8ad0 con 0x7f67a010e090 2024-04-25T11:35:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67a5f6b640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a010e090 0x7f67a0102f80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f679800eaa0 tx=0x7f679800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67967fc640 1 -- 172.21.15.80:0/2662161371 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679800cdb0 con 0x7f67a010e090 2024-04-25T11:35:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.302+0000 7f67967fc640 1 -- 172.21.15.80:0/2662161371 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6798005020 con 0x7f67a010e090 2024-04-25T11:35:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.303+0000 7f67967fc640 1 -- 172.21.15.80:0/2662161371 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67980116d0 con 0x7f67a010e090 2024-04-25T11:35:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.303+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a01a8dc0 con 0x7f67a010e090 2024-04-25T11:35:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.303+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a01a9280 con 0x7f67a010e090 2024-04-25T11:35:17.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.303+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a006a160 con 0x7f67a010e090 2024-04-25T11:35:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.305+0000 7f67967fc640 1 -- 172.21.15.80:0/2662161371 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f67980051d0 con 0x7f67a010e090 2024-04-25T11:35:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.306+0000 7f67967fc640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f678c0afce0 0x7f678c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.306+0000 7f67a576a640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f678c0afce0 0x7f678c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.306+0000 7f67967fc640 1 -- 172.21.15.80:0/2662161371 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8764+0+0 (secure 0 0 0) 0x7f67980df5c0 con 0x7f67a010e090 2024-04-25T11:35:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.307+0000 7f67a576a640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f678c0afce0 0x7f678c0b21f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6790031440 tx=0x7f6790009560 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:17.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.309+0000 7f67967fc640 1 -- 172.21.15.80:0/2662161371 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6798016030 con 0x7f67a010e090 2024-04-25T11:35:17.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2781227421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1524934042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2686392259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.435 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f[63372]: ignoring --setuser ceph since I am not root 2024-04-25T11:35:17.435 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f[63372]: ignoring --setgroup ceph since I am not root 2024-04-25T11:35:17.435 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-mds[63376]: -- 172.21.15.196:0/3697394153 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f8cc17a40 con 0x556f8cc5f180 2024-04-25T11:35:17.435 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f[63372]: starting mds.f at 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[67044]: ignoring --setuser ceph since I am not root 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[67044]: ignoring --setgroup ceph since I am not root 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-mds[67048]: -- 172.21.15.196:0/1480297740 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e3d45e9a40 con 0x55e3d4631180 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[67044]: starting mds.c at 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i[63990]: ignoring --setuser ceph since I am not root 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i[63990]: ignoring --setgroup ceph since I am not root 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-mds[63994]: -- 172.21.15.196:0/3351183901 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a37459a40 con 0x555a374a1a80 2024-04-25T11:35:17.436 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:35:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i[63990]: starting mds.i at 2024-04-25T11:35:17.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:17 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a[29122]: 2024-04-25T11:35:17.170+0000 7fd3a27cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T11:35:17.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2781227421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1524934042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2686392259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: ignoring --setuser ceph since I am not root 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: ignoring --setgroup ceph since I am not root 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-mds[63201]: -- 172.21.15.82:0/528223491 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x555573c724e0 con 0x555573cbd180 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-mds[63201]: -- 172.21.15.82:0/528223491 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555573c75a40 con 0x555573cbd180 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: starting mds.b at 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e[62576]: ignoring --setuser ceph since I am not root 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e[62576]: ignoring --setgroup ceph since I am not root 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-mds[62580]: -- 172.21.15.82:0/51990905 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dbdda43a40 con 0x55dbdda8b600 2024-04-25T11:35:17.489 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e[62576]: starting mds.e at 2024-04-25T11:35:17.490 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h[62885]: ignoring --setuser ceph since I am not root 2024-04-25T11:35:17.490 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h[62885]: ignoring --setgroup ceph since I am not root 2024-04-25T11:35:17.490 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-mds[62889]: -- 172.21.15.82:0/665475418 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613474a9a40 con 0x5613474f1600 2024-04-25T11:35:17.490 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:35:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h[62885]: starting mds.h at 2024-04-25T11:35:17.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:17.537+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f67a01a9610 con 0x7f67a010e090 2024-04-25T11:35:18.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.173+0000 7f67967fc640 1 -- 172.21.15.80:0/2662161371 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) ==== 104+0+0 (secure 0 0 0) 0x7f67980a7740 con 0x7f67a010e090 2024-04-25T11:35:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f678c0afce0 msgr2=0x7f678c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f678c0afce0 0x7f678c0b21f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6790031440 tx=0x7f6790009560 comp rx=0 tx=0).stop 2024-04-25T11:35:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a010e090 msgr2=0x7f67a0102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a010e090 0x7f67a0102f80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f679800eaa0 tx=0x7f679800ef60 comp rx=0 tx=0).stop 2024-04-25T11:35:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 shutdown_connections 2024-04-25T11:35:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f678c0afce0 0x7f678c0b21f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67a010e090 0x7f67a0102f80 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.176+0000 7f67a79ce640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67a010b6a0 0x7f67a0102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.177+0000 7f67a79ce640 1 --2- 172.21.15.80:0/2662161371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a0104c40 0x7f67a0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.177+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 >> 172.21.15.80:0/2662161371 conn(0x7f67a00fe260 msgr2=0x7f67a010e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.177+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 shutdown_connections 2024-04-25T11:35:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.177+0000 7f67a79ce640 1 -- 172.21.15.80:0/2662161371 wait complete. 2024-04-25T11:35:18.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T11:35:18.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 -- 172.21.15.80:0/3868527254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 msgr2=0x7f20b810f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:18.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/3868527254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b810f510 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009ca0 tx=0x7f20b002a8c0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 -- 172.21.15.80:0/3868527254 shutdown_connections 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/3868527254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b810f510 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/3868527254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8107260 0x7f20b8107670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/3868527254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20b81033a0 0x7f20b81037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 -- 172.21.15.80:0/3868527254 >> 172.21.15.80:0/3868527254 conn(0x7f20b8077880 msgr2=0x7f20b8077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 -- 172.21.15.80:0/3868527254 shutdown_connections 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.303+0000 7f20bfaf2640 1 -- 172.21.15.80:0/3868527254 wait complete. 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 Processor -- start 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 -- start start 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20b81033a0 0x7f20b819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8107260 0x7f20b819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:18.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8112be0 con 0x7f20b8107ce0 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8112a60 con 0x7f20b8107260 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bfaf2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8112d60 con 0x7f20b81033a0 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20be08f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20be08f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38006/0 (socket says 172.21.15.80:38006) 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20be08f640 1 -- 172.21.15.80:0/1814317260 learned_addr learned my addr 172.21.15.80:0/1814317260 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bd08d640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8107260 0x7f20b819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.304+0000 7f20bd88e640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20b81033a0 0x7f20b819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20be08f640 1 -- 172.21.15.80:0/1814317260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20b81033a0 msgr2=0x7f20b819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20be08f640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20b81033a0 0x7f20b819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20be08f640 1 -- 172.21.15.80:0/1814317260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8107260 msgr2=0x7f20b819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20be08f640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8107260 0x7f20b819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:18.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20be08f640 1 -- 172.21.15.80:0/1814317260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b819f530 con 0x7f20b8107ce0 2024-04-25T11:35:18.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20be08f640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b819eef0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f20b00098d0 tx=0x7f20b00317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:18.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20aeffd640 1 -- 172.21.15.80:0/1814317260 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0003b70 con 0x7f20b8107ce0 2024-04-25T11:35:18.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b819f7c0 con 0x7f20b8107ce0 2024-04-25T11:35:18.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20aeffd640 1 -- 172.21.15.80:0/1814317260 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b0003d10 con 0x7f20b8107ce0 2024-04-25T11:35:18.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20aeffd640 1 -- 172.21.15.80:0/1814317260 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b002fa20 con 0x7f20b8107ce0 2024-04-25T11:35:18.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.305+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b819fd10 con 0x7f20b8107ce0 2024-04-25T11:35:18.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.306+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b80692e0 con 0x7f20b8107ce0 2024-04-25T11:35:18.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.308+0000 7f20aeffd640 1 -- 172.21.15.80:0/1814317260 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f20b002fbe0 con 0x7f20b8107ce0 2024-04-25T11:35:18.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.308+0000 7f20aeffd640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f20a40afc60 0x7f20a40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:18.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.308+0000 7f20bd88e640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f20a40afc60 0x7f20a40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:18.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.309+0000 7f20aeffd640 1 -- 172.21.15.80:0/1814317260 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8764+0+0 (secure 0 0 0) 0x7f20b0100650 con 0x7f20b8107ce0 2024-04-25T11:35:18.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.309+0000 7f20bd88e640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f20a40afc60 0x7f20a40b2170 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20a80058c0 tx=0x7f20a800a2d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.316+0000 7f20aeffd640 1 -- 172.21.15.80:0/1814317260 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f20b00c8f10 con 0x7f20b8107ce0 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: pgmap v345: 97 pgs: 97 active+clean; 2.3 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 738 B/s wr, 8 op/s 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3523829956' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/3523829956' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T11:35:18.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:18 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2662161371' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:35:18.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: pgmap v345: 97 pgs: 97 active+clean; 2.3 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 738 B/s wr, 8 op/s 2024-04-25T11:35:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3523829956' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T11:35:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T11:35:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T11:35:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/3523829956' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T11:35:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T11:35:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T11:35:18.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:18 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2662161371' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:35:18.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: pgmap v345: 97 pgs: 97 active+clean; 2.3 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 738 B/s wr, 8 op/s 2024-04-25T11:35:18.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3523829956' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T11:35:18.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T11:35:18.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T11:35:18.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/3523829956' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T11:35:18.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T11:35:18.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T11:35:18.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:18 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2662161371' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T11:35:18.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:18.501+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20b81a7260 con 0x7f20b8107ce0 2024-04-25T11:35:19.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.179+0000 7f20aeffd640 1 -- 172.21.15.80:0/1814317260 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f20b00c8810 con 0x7f20b8107ce0 2024-04-25T11:35:19.168 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f20a40afc60 msgr2=0x7f20a40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f20a40afc60 0x7f20a40b2170 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20a80058c0 tx=0x7f20a800a2d0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 msgr2=0x7f20b819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b819eef0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f20b00098d0 tx=0x7f20b00317b0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 shutdown_connections 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f20a40afc60 0x7f20a40b2170 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8107ce0 0x7f20b819eef0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8107260 0x7f20b819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 --2- 172.21.15.80:0/1814317260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20b81033a0 0x7f20b819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 >> 172.21.15.80:0/1814317260 conn(0x7f20b8077880 msgr2=0x7f20b81065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:19.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.182+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 shutdown_connections 2024-04-25T11:35:19.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.183+0000 7f20bfaf2640 1 -- 172.21.15.80:0/1814317260 wait complete. 2024-04-25T11:35:19.185 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T11:35:19.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 -- 172.21.15.80:0/2298412103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 msgr2=0x7f9940110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:19.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2298412103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f9940110580 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9938009ca0 tx=0x7f993802a9e0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 -- 172.21.15.80:0/2298412103 shutdown_connections 2024-04-25T11:35:19.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2298412103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f9940110580 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2298412103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f994010b6e0 0x7f994010db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2298412103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9940104c80 0x7f9940105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 -- 172.21.15.80:0/2298412103 >> 172.21.15.80:0/2298412103 conn(0x7f99400fe0c0 msgr2=0x7f9940100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:19.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 -- 172.21.15.80:0/2298412103 shutdown_connections 2024-04-25T11:35:19.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.312+0000 7f9945bb2640 1 -- 172.21.15.80:0/2298412103 wait complete. 2024-04-25T11:35:19.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 Processor -- start 2024-04-25T11:35:19.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 -- start start 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940104c80 0x7f994019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f994010b6e0 0x7f994019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f994019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9940113cf0 con 0x7f994010e090 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9940113b70 con 0x7f9940104c80 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9945bb2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9940113e70 con 0x7f994010b6e0 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f994019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f994019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38024/0 (socket says 172.21.15.80:38024) 2024-04-25T11:35:19.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 -- 172.21.15.80:0/2770681400 learned_addr learned my addr 172.21.15.80:0/2770681400 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f9936ffd640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f994010b6e0 0x7f994019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993f7fe640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940104c80 0x7f994019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 -- 172.21.15.80:0/2770681400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f994010b6e0 msgr2=0x7f994019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f994010b6e0 0x7f994019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 -- 172.21.15.80:0/2770681400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940104c80 msgr2=0x7f994019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940104c80 0x7f994019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.313+0000 7f993ffff640 1 -- 172.21.15.80:0/2770681400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994019f4d0 con 0x7f994010e090 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.314+0000 7f993ffff640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f994019ef10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f993802e5c0 tx=0x7f993802e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.314+0000 7f993d7fa640 1 -- 172.21.15.80:0/2770681400 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938046070 con 0x7f994010e090 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.314+0000 7f993d7fa640 1 -- 172.21.15.80:0/2770681400 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9938038900 con 0x7f994010e090 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.314+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994019f760 con 0x7f994010e090 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.314+0000 7f993d7fa640 1 -- 172.21.15.80:0/2770681400 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938033040 con 0x7f994010e090 2024-04-25T11:35:19.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.314+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994019fc50 con 0x7f994010e090 2024-04-25T11:35:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.315+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9940069310 con 0x7f994010e090 2024-04-25T11:35:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.316+0000 7f993d7fa640 1 -- 172.21.15.80:0/2770681400 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 147651+0+0 (secure 0 0 0) 0x7f9938049070 con 0x7f994010e090 2024-04-25T11:35:19.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.317+0000 7f993d7fa640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f992c0afc60 0x7f992c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:35:19.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.317+0000 7f993f7fe640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f992c0afc60 0x7f992c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:35:19.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.317+0000 7f993d7fa640 1 -- 172.21.15.80:0/2770681400 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8210+0+0 (secure 0 0 0) 0x7f9938100010 con 0x7f994010e090 2024-04-25T11:35:19.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.317+0000 7f993f7fe640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f992c0afc60 0x7f992c0b2170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9930005fd0 tx=0x7f9930005e20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:35:19.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.320+0000 7f993d7fa640 1 -- 172.21.15.80:0/2770681400 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9938050020 con 0x7f994010e090 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: Cluster is now healthy 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2662161371' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6835/1233532439,v1:172.21.15.82:6838/1233532439] up:boot 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6834/2929056997,v1:172.21.15.82:6837/2929056997] up:boot 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.82:6836/2174382431,v1:172.21.15.82:6839/2174382431] up:boot 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6834/344087397,v1:172.21.15.196:6835/344087397] up:boot 2024-04-25T11:35:19.373 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6836/2771701576,v1:172.21.15.196:6837/2771701576] up:boot 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: mds.? [v2:172.21.15.196:6838/4121913648,v1:172.21.15.196:6839/4121913648] up:boot 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: fsmap 12 up:standby 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:35:19.374 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:19 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1814317260' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: Cluster is now healthy 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2662161371' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6835/1233532439,v1:172.21.15.82:6838/1233532439] up:boot 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6834/2929056997,v1:172.21.15.82:6837/2929056997] up:boot 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.82:6836/2174382431,v1:172.21.15.82:6839/2174382431] up:boot 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6834/344087397,v1:172.21.15.196:6835/344087397] up:boot 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6836/2771701576,v1:172.21.15.196:6837/2771701576] up:boot 2024-04-25T11:35:19.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: mds.? [v2:172.21.15.196:6838/4121913648,v1:172.21.15.196:6839/4121913648] up:boot 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: fsmap 12 up:standby 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:35:19.436 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:19 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1814317260' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T11:35:19.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:19.497+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99401a7220 con 0x7f994010e090 2024-04-25T11:35:19.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T11:35:19.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T11:35:19.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: Cluster is now healthy 2024-04-25T11:35:19.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2662161371' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T11:35:19.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6835/1233532439,v1:172.21.15.82:6838/1233532439] up:boot 2024-04-25T11:35:19.488 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6834/2929056997,v1:172.21.15.82:6837/2929056997] up:boot 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.82:6836/2174382431,v1:172.21.15.82:6839/2174382431] up:boot 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6834/344087397,v1:172.21.15.196:6835/344087397] up:boot 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6836/2771701576,v1:172.21.15.196:6837/2771701576] up:boot 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: mds.? [v2:172.21.15.196:6838/4121913648,v1:172.21.15.196:6839/4121913648] up:boot 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: fsmap 12 up:standby 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='mgr.15318 172.21.15.80:0/1256230548' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T11:35:19.489 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:19 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1814317260' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T11:35:20.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.190+0000 7f993d7fa640 1 -- 172.21.15.80:0/2770681400 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7f99380c89e0 con 0x7f994010e090 2024-04-25T11:35:20.179 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-25T11:35:20.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.193+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f992c0afc60 msgr2=0x7f992c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:20.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.193+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f992c0afc60 0x7f992c0b2170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9930005fd0 tx=0x7f9930005e20 comp rx=0 tx=0).stop 2024-04-25T11:35:20.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.193+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 msgr2=0x7f994019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:35:20.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.193+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f994019ef10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f993802e5c0 tx=0x7f993802e5f0 comp rx=0 tx=0).stop 2024-04-25T11:35:20.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.193+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 shutdown_connections 2024-04-25T11:35:20.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.193+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:6800/1167903144,v1:172.21.15.80:6801/1167903144] conn(0x7f992c0afc60 0x7f992c0b2170 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:20.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.194+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f994010e090 0x7f994019ef10 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:20.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.194+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f994010b6e0 0x7f994019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:20.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.194+0000 7f9945bb2640 1 --2- 172.21.15.80:0/2770681400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940104c80 0x7f994019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:35:20.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.194+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 >> 172.21.15.80:0/2770681400 conn(0x7f99400fe0c0 msgr2=0x7f994010e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:35:20.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.194+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 shutdown_connections 2024-04-25T11:35:20.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-25T11:35:20.194+0000 7f9945bb2640 1 -- 172.21.15.80:0/2770681400 wait complete. 2024-04-25T11:35:20.201 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:35:20.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:35:20.253 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:20 smithi082 ceph-mon[32440]: pgmap v347: 97 pgs: 97 active+clean; 2.3 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 639 B/s wr, 4 op/s 2024-04-25T11:35:20.253 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/1814317260' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T11:35:20.253 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:20 smithi082 ceph-mon[32440]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T11:35:20.253 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:20 smithi082 ceph-mon[32440]: from='client.? 172.21.15.80:0/2770681400' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T11:35:20.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:35:20.285 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-25T11:35:20.285 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T11:35:20.301 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T11:35:20.319 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T11:35:20.341 INFO:tasks.cephadm:Stopping all daemons... 2024-04-25T11:35:20.341 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-25T11:35:20.341 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a 2024-04-25T11:35:20.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:20 smithi196 ceph-mon[32659]: pgmap v347: 97 pgs: 97 active+clean; 2.3 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 639 B/s wr, 4 op/s 2024-04-25T11:35:20.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/1814317260' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T11:35:20.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:20 smithi196 ceph-mon[32659]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T11:35:20.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:20 smithi196 ceph-mon[32659]: from='client.? 172.21.15.80:0/2770681400' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T11:35:20.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 ceph-mon[29126]: pgmap v347: 97 pgs: 97 active+clean; 2.3 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 639 B/s wr, 4 op/s 2024-04-25T11:35:20.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/1814317260' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T11:35:20.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 ceph-mon[29126]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T11:35:20.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 ceph-mon[29126]: from='client.? 172.21.15.80:0/2770681400' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T11:35:20.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 systemd[1]: Stopping Ceph mon.a for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a[29122]: 2024-04-25T11:35:20.676+0000 7fd3a7fd7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:21.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a[29122]: 2024-04-25T11:35:20.676+0000 7fd3a7fd7700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-25T11:35:21.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 podman[96399]: 2024-04-25 11:35:20.69865134 +0000 UTC m=+0.151860972 container stop 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:35:21.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:20 smithi080 podman[96399]: 2024-04-25 11:35:20.727311432 +0000 UTC m=+0.180521076 container died 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:35:21.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:21 smithi080 podman[96399]: 2024-04-25 11:35:21.112282157 +0000 UTC m=+0.565491789 container cleanup 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-25T11:35:21.285 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:21 smithi080 bash[96399]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a 2024-04-25T11:35:21.530 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service' 2024-04-25T11:35:21.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:21 smithi080 podman[96413]: 2024-04-25 11:35:21.297347354 +0000 UTC m=+0.593582805 container remove 48cc840f8d89de0cd260588e5a2a61b9d873fe8ad4b1c49763102c88ba66e183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:35:21.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:21 smithi080 systemd[1]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-25T11:35:21.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:21 smithi080 systemd[1]: Stopped Ceph mon.a for bba277ec-02f4-11ef-bc93-c7b262605968. 2024-04-25T11:35:21.551 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 25 11:35:21 smithi080 systemd[1]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.a.service: Consumed 20.652s CPU time. 2024-04-25T11:35:21.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:21.585 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-25T11:35:21.586 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-25T11:35:21.586 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.b 2024-04-25T11:35:21.892 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:21 smithi082 systemd[1]: Stopping Ceph mon.b for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:22.238 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-b[32436]: 2024-04-25T11:35:21.904+0000 7f673e6ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:22.238 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-b[32436]: 2024-04-25T11:35:21.904+0000 7f673e6ea700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-25T11:35:22.238 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:22 smithi082 podman[68666]: 2024-04-25 11:35:22.017118691 +0000 UTC m=+0.234141104 container died cbf4f3ec1a581f8bf84eecfa8b4472514db49ba52b70743ac05d0d8b6dae7637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T11:35:22.644 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:22 smithi082 podman[68666]: 2024-04-25 11:35:22.430208496 +0000 UTC m=+0.647230907 container cleanup cbf4f3ec1a581f8bf84eecfa8b4472514db49ba52b70743ac05d0d8b6dae7637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-25T11:35:22.644 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 25 11:35:22 smithi082 bash[68666]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-b 2024-04-25T11:35:22.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.b.service' 2024-04-25T11:35:22.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:22.832 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-25T11:35:22.832 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-25T11:35:22.832 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.c 2024-04-25T11:35:23.152 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:22 smithi196 systemd[1]: Stopping Ceph mon.c for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:23.434 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-c[32642]: 2024-04-25T11:35:23.163+0000 7f53bf225700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:23.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-c[32642]: 2024-04-25T11:35:23.163+0000 7f53bf225700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-25T11:35:23.435 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:23 smithi196 podman[69629]: 2024-04-25 11:35:23.2558152 +0000 UTC m=+0.215654607 container died 37ca34ca85f63c38f4cc0b8ea6d175a35433dea7940c1715cb9dd835cc6327b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-c, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:35:23.895 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:23 smithi196 podman[69629]: 2024-04-25 11:35:23.639829377 +0000 UTC m=+0.599668780 container cleanup 37ca34ca85f63c38f4cc0b8ea6d175a35433dea7940c1715cb9dd835cc6327b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-c, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-25T11:35:23.895 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 25 11:35:23 smithi196 bash[69629]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mon-c 2024-04-25T11:35:23.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mon.c.service' 2024-04-25T11:35:24.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:24.054 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-25T11:35:24.055 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-25T11:35:24.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.x 2024-04-25T11:35:24.364 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:35:24 smithi080 systemd[1]: Stopping Ceph mgr.x for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:24.623 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:35:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x[29355]: 2024-04-25T11:35:24.374+0000 7fc5599e0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:24.623 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:35:24 smithi080 podman[96608]: 2024-04-25 11:35:24.416583584 +0000 UTC m=+0.160341089 container died 9991e343a928f6601477e49179d20381d9dac74cb651e8919c1a232b7b6a2861 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-25T11:35:25.041 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:35:24 smithi080 podman[96608]: 2024-04-25 11:35:24.843102886 +0000 UTC m=+0.586860381 container cleanup 9991e343a928f6601477e49179d20381d9dac74cb651e8919c1a232b7b6a2861 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T11:35:25.041 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 25 11:35:24 smithi080 bash[96608]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-x 2024-04-25T11:35:25.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-25T11:35:25.294 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:25.295 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-25T11:35:25.295 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-25T11:35:25.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.y 2024-04-25T11:35:25.644 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:35:25 smithi082 systemd[1]: Stopping Ceph mgr.y for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:25.947 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:35:25 smithi082 podman[68786]: 2024-04-25 11:35:25.656955373 +0000 UTC m=+0.153187834 container died 2994882f2731864f4932e208b12b039bfcf4ac8480e817cd03388dd20aea11a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-25T11:35:26.238 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:35:26 smithi082 podman[68786]: 2024-04-25 11:35:26.059580337 +0000 UTC m=+0.555812795 container cleanup 2994882f2731864f4932e208b12b039bfcf4ac8480e817cd03388dd20aea11a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-25T11:35:26.238 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 25 11:35:26 smithi082 bash[68786]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-y 2024-04-25T11:35:26.464 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-25T11:35:26.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:26.497 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-25T11:35:26.497 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-25T11:35:26.497 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.z 2024-04-25T11:35:26.838 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:35:26 smithi196 systemd[1]: Stopping Ceph mgr.z for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:27.133 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:35:26 smithi196 podman[69752]: 2024-04-25 11:35:26.85040362 +0000 UTC m=+0.152285999 container died 4844d3feb8f5ba8a9ac5f197314ee503bbe969dbcfe92a6d04c9a93c29385fa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-25T11:35:27.434 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:35:27 smithi196 podman[69752]: 2024-04-25 11:35:27.237010193 +0000 UTC m=+0.538892571 container cleanup 4844d3feb8f5ba8a9ac5f197314ee503bbe969dbcfe92a6d04c9a93c29385fa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T11:35:27.434 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 25 11:35:27 smithi196 bash[69752]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mgr-z 2024-04-25T11:35:27.643 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-25T11:35:27.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:27.676 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-25T11:35:27.677 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-25T11:35:27.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.0 2024-04-25T11:35:28.011 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:27 smithi080 systemd[1]: Stopping Ceph osd.0 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:28.373 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0[43897]: 2024-04-25T11:35:28.022+0000 7f6ab8b9a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:28.373 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0[43897]: 2024-04-25T11:35:28.022+0000 7f6ab8b9a700 -1 osd.0 94 *** Got signal Terminated *** 2024-04-25T11:35:28.373 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0[43897]: 2024-04-25T11:35:28.022+0000 7f6ab8b9a700 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:35:33.787 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:33 smithi080 podman[96729]: 2024-04-25 11:35:33.492984882 +0000 UTC m=+5.604329055 container died 07516da1ba7f13732659ba91502cca7adbf39f5ff84beb333643e9e7ae1ec7ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T11:35:34.123 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:33 smithi080 podman[96729]: 2024-04-25 11:35:33.898418423 +0000 UTC m=+6.009762587 container cleanup 07516da1ba7f13732659ba91502cca7adbf39f5ff84beb333643e9e7ae1ec7ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-25T11:35:34.123 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:33 smithi080 bash[96729]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0 2024-04-25T11:35:34.405 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:34 smithi080 podman[96746]: 2024-04-25 11:35:34.141580428 +0000 UTC m=+0.646684341 container remove 07516da1ba7f13732659ba91502cca7adbf39f5ff84beb333643e9e7ae1ec7ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-25T11:35:34.742 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:34 smithi080 podman[96838]: 2024-04-25 11:35:34.367358933 +0000 UTC m=+0.018231068 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:35:34.742 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:34 smithi080 podman[96838]: 2024-04-25 11:35:34.501778983 +0000 UTC m=+0.152651107 container create 61896c8f7de558006c35852fd588111f280f36a0449d64c05fc09538e95e4875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-25T11:35:35.040 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:34 smithi080 podman[96838]: 2024-04-25 11:35:34.754564158 +0000 UTC m=+0.405436283 container init 61896c8f7de558006c35852fd588111f280f36a0449d64c05fc09538e95e4875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-25T11:35:35.040 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:34 smithi080 podman[96838]: 2024-04-25 11:35:34.758052568 +0000 UTC m=+0.408924694 container start 61896c8f7de558006c35852fd588111f280f36a0449d64c05fc09538e95e4875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T11:35:35.040 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:34 smithi080 podman[96838]: 2024-04-25 11:35:34.854764224 +0000 UTC m=+0.505636352 container attach 61896c8f7de558006c35852fd588111f280f36a0449d64c05fc09538e95e4875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-25T11:35:35.373 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 25 11:35:35 smithi080 podman[96838]: 2024-04-25 11:35:35.053073708 +0000 UTC m=+0.703945841 container died 61896c8f7de558006c35852fd588111f280f36a0449d64c05fc09538e95e4875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-25T11:35:35.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.0.service' 2024-04-25T11:35:35.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:35.799 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-25T11:35:35.799 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-25T11:35:35.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.1 2024-04-25T11:35:36.102 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:35 smithi082 systemd[1]: Stopping Ceph osd.1 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:36.488 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1[37034]: 2024-04-25T11:35:36.113+0000 7f0a4a04e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:36.488 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1[37034]: 2024-04-25T11:35:36.113+0000 7f0a4a04e700 -1 osd.1 94 *** Got signal Terminated *** 2024-04-25T11:35:36.488 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1[37034]: 2024-04-25T11:35:36.113+0000 7f0a4a04e700 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:35:41.738 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:41 smithi082 podman[68912]: 2024-04-25 11:35:41.474833893 +0000 UTC m=+5.476684269 container died 3507f3425f39b866aa8683ad8e42e9806e8ff8bc2e8f0a5c3ea2c2c7d9a75dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-25T11:35:42.177 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:41 smithi082 podman[68912]: 2024-04-25 11:35:41.863219448 +0000 UTC m=+5.865069818 container cleanup 3507f3425f39b866aa8683ad8e42e9806e8ff8bc2e8f0a5c3ea2c2c7d9a75dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T11:35:42.177 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:41 smithi082 bash[68912]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1 2024-04-25T11:35:42.488 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:42 smithi082 podman[68929]: 2024-04-25 11:35:42.189653574 +0000 UTC m=+0.708888194 container remove 3507f3425f39b866aa8683ad8e42e9806e8ff8bc2e8f0a5c3ea2c2c7d9a75dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , ceph=True) 2024-04-25T11:35:42.814 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:42 smithi082 podman[69020]: 2024-04-25 11:35:42.437431464 +0000 UTC m=+0.018671040 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:35:42.814 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:42 smithi082 podman[69020]: 2024-04-25 11:35:42.574075133 +0000 UTC m=+0.155314710 container create e75c7a1f9b4e4d8ea175feaa7bf5a83b07292da65da511afff36611df2cb2345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-25T11:35:43.105 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:42 smithi082 podman[69020]: 2024-04-25 11:35:42.827053077 +0000 UTC m=+0.408292655 container init e75c7a1f9b4e4d8ea175feaa7bf5a83b07292da65da511afff36611df2cb2345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T11:35:43.105 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:42 smithi082 podman[69020]: 2024-04-25 11:35:42.830262975 +0000 UTC m=+0.411502558 container start e75c7a1f9b4e4d8ea175feaa7bf5a83b07292da65da511afff36611df2cb2345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T11:35:43.105 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:42 smithi082 podman[69020]: 2024-04-25 11:35:42.918639777 +0000 UTC m=+0.499879360 container attach e75c7a1f9b4e4d8ea175feaa7bf5a83b07292da65da511afff36611df2cb2345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-25T11:35:43.372 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 25 11:35:43 smithi082 podman[69020]: 2024-04-25 11:35:43.117732303 +0000 UTC m=+0.698971885 container died e75c7a1f9b4e4d8ea175feaa7bf5a83b07292da65da511afff36611df2cb2345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2) 2024-04-25T11:35:43.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.1.service' 2024-04-25T11:35:43.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:43.859 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-25T11:35:43.859 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-25T11:35:43.859 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.2 2024-04-25T11:35:44.179 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:43 smithi196 systemd[1]: Stopping Ceph osd.2 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:44.434 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2[37836]: 2024-04-25T11:35:44.190+0000 7fcc18cd2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:44.434 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2[37836]: 2024-04-25T11:35:44.190+0000 7fcc18cd2700 -1 osd.2 94 *** Got signal Terminated *** 2024-04-25T11:35:44.434 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2[37836]: 2024-04-25T11:35:44.190+0000 7fcc18cd2700 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:35:50.013 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:49 smithi196 podman[69879]: 2024-04-25 11:35:49.717654478 +0000 UTC m=+5.645639032 container died 2353d3b9dd519cb6d00e26e4146b46f7071b59f1d53864803294a5015ec73749 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-25T11:35:50.381 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:50 smithi196 podman[69879]: 2024-04-25 11:35:50.124934216 +0000 UTC m=+6.052918769 container cleanup 2353d3b9dd519cb6d00e26e4146b46f7071b59f1d53864803294a5015ec73749 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:35:50.381 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:50 smithi196 bash[69879]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2 2024-04-25T11:35:50.684 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:50 smithi196 podman[69907]: 2024-04-25 11:35:50.393619314 +0000 UTC m=+0.679303924 container remove 2353d3b9dd519cb6d00e26e4146b46f7071b59f1d53864803294a5015ec73749 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True) 2024-04-25T11:35:51.009 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:50 smithi196 podman[70000]: 2024-04-25 11:35:50.64011921 +0000 UTC m=+0.018522596 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:35:51.009 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:50 smithi196 podman[70000]: 2024-04-25 11:35:50.761278252 +0000 UTC m=+0.139681628 container create 1acdc0069eb4181e7e1a505b901420b0b8b106f802752712d3fbcc131845085e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:35:51.303 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:51 smithi196 podman[70000]: 2024-04-25 11:35:51.022243867 +0000 UTC m=+0.400647241 container init 1acdc0069eb4181e7e1a505b901420b0b8b106f802752712d3fbcc131845085e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-25T11:35:51.303 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:51 smithi196 podman[70000]: 2024-04-25 11:35:51.02542366 +0000 UTC m=+0.403827042 container start 1acdc0069eb4181e7e1a505b901420b0b8b106f802752712d3fbcc131845085e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-25T11:35:51.303 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:51 smithi196 podman[70000]: 2024-04-25 11:35:51.122719739 +0000 UTC m=+0.501123126 container attach 1acdc0069eb4181e7e1a505b901420b0b8b106f802752712d3fbcc131845085e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-25T11:35:51.614 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 25 11:35:51 smithi196 podman[70000]: 2024-04-25 11:35:51.315235717 +0000 UTC m=+0.693639085 container died 1acdc0069eb4181e7e1a505b901420b0b8b106f802752712d3fbcc131845085e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T11:35:51.968 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.2.service' 2024-04-25T11:35:52.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:35:52.007 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-25T11:35:52.007 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-25T11:35:52.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.3 2024-04-25T11:35:52.373 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:52 smithi080 systemd[1]: Stopping Ceph osd.3 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:35:53.122 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:52 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3[50701]: 2024-04-25T11:35:52.643+0000 7fceea15a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:35:53.123 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:52 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3[50701]: 2024-04-25T11:35:52.643+0000 7fceea15a700 -1 osd.3 94 *** Got signal Terminated *** 2024-04-25T11:35:53.123 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:52 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3[50701]: 2024-04-25T11:35:52.643+0000 7fceea15a700 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:35:54.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:35:54 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:35:54.351+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:35:54.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:35:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:35:54.472+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:35:55.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:35:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:35:55.464+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:35:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:35:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:35:55.318+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:35:55.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:35:55 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:35:55.388+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:35:56.122 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:55 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3[50701]: 2024-04-25T11:35:55.736+0000 7fcee6710700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.855750+0000 front 2024-04-25T11:35:32.855811+0000 (oldest deadline 2024-04-25T11:35:55.155847+0000) 2024-04-25T11:35:56.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:35:55 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:35:55.692+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:35:56.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:35:56 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:35:56.315+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:35:56.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:35:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:35:56.436+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:35:56.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:35:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:35:56.346+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:35:56.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:35:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:35:56.382+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:35:56.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:35:56 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:35:56.353+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:35:57.099 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:56 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3[50701]: 2024-04-25T11:35:56.750+0000 7fcee6710700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.855750+0000 front 2024-04-25T11:35:32.855811+0000 (oldest deadline 2024-04-25T11:35:55.155847+0000) 2024-04-25T11:35:57.100 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:35:56 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:35:56.690+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:35:57.372 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:35:57 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:35:57.332+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:35:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:35:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:35:57.379+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:35:57.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:35:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:35:57.368+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:35:57.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:35:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:35:57.475+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:35:57.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:35:57 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:35:57.365+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:35:58.032 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:35:57 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:35:57.685+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:35:58.305 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:58 smithi080 podman[96947]: 2024-04-25 11:35:58.151411828 +0000 UTC m=+5.927918962 container died 705c68dad910607fa5cc0aa7b4f3f4e68ed6f7b277db08bb0ed0b0899cf1c3c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:35:58.561 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:35:58 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:35:58.317+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:35:58.562 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:58 smithi080 podman[96947]: 2024-04-25 11:35:58.560660953 +0000 UTC m=+6.337168101 container cleanup 705c68dad910607fa5cc0aa7b4f3f4e68ed6f7b277db08bb0ed0b0899cf1c3c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-25T11:35:58.562 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:58 smithi080 bash[96947]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3 2024-04-25T11:35:58.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:35:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:35:58.359+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:35:58.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:35:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:35:58.487+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:35:58.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:35:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:35:58.415+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:35:58.737 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:35:58 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:35:58.393+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:35:59.069 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:58 smithi080 podman[96977]: 2024-04-25 11:35:58.787189977 +0000 UTC m=+0.634123978 container remove 705c68dad910607fa5cc0aa7b4f3f4e68ed6f7b277db08bb0ed0b0899cf1c3c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-25T11:35:59.070 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:35:58 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:35:58.713+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:35:59.322 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:35:59 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:35:59.328+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:35:59.322 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:59 smithi080 podman[97060]: 2024-04-25 11:35:58.985649731 +0000 UTC m=+0.017994489 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:35:59.322 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:59 smithi080 podman[97060]: 2024-04-25 11:35:59.106943456 +0000 UTC m=+0.139288214 container create ee4cdac434481277c74958d8be1f6cc0f694ddbe882b95dfa2028f57718a9802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-25T11:35:59.322 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:59 smithi080 podman[97060]: 2024-04-25 11:35:59.334899873 +0000 UTC m=+0.367244629 container init ee4cdac434481277c74958d8be1f6cc0f694ddbe882b95dfa2028f57718a9802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:35:59.616 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:59 smithi080 podman[97060]: 2024-04-25 11:35:59.338131411 +0000 UTC m=+0.370476171 container start ee4cdac434481277c74958d8be1f6cc0f694ddbe882b95dfa2028f57718a9802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T11:35:59.616 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:59 smithi080 podman[97060]: 2024-04-25 11:35:59.43517151 +0000 UTC m=+0.467516274 container attach ee4cdac434481277c74958d8be1f6cc0f694ddbe882b95dfa2028f57718a9802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:35:59.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:35:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:35:59.471+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:35:59.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:35:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:35:59.329+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:35:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:35:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:35:59.375+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:35:59.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:35:59 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:35:59.345+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:35:59.873 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 25 11:35:59 smithi080 podman[97060]: 2024-04-25 11:35:59.628762797 +0000 UTC m=+0.661107554 container died ee4cdac434481277c74958d8be1f6cc0f694ddbe882b95dfa2028f57718a9802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T11:35:59.873 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:35:59 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:35:59.678+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:00.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.3.service' 2024-04-25T11:36:00.279 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:00.280 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-25T11:36:00.280 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-25T11:36:00.280 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.4 2024-04-25T11:36:00.622 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:00 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:00.335+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:00.622 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:00 smithi082 systemd[1]: Stopping Ceph osd.4 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:00.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:00 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:00.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:00.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:00.347+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:00.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:00.327+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:00.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:00.439+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:00.988 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:00 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4[43795]: 2024-04-25T11:36:00.631+0000 7fa66adbb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:00.988 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:00 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4[43795]: 2024-04-25T11:36:00.631+0000 7fa66adbb700 -1 osd.4 94 *** Got signal Terminated *** 2024-04-25T11:36:00.988 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:00 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4[43795]: 2024-04-25T11:36:00.631+0000 7fa66adbb700 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:01.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:00 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:00.660+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:01.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:01 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:01.379+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:01.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:01 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:01.469+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:01.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:01 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:01.286+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:01.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:01 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:01.347+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:01.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:01 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:01.320+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:02.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:01 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:01.703+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:02.486 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:02 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:02.244+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:02.486 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:02 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:02.342+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:02.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:02 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:02.373+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:02.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:02 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:02.282+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:02.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:02 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:02.498+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:03.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:02 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:02.701+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:03.524 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:03.245+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:03.525 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:03.317+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:03.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:03 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:03.342+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:03.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:03 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:03.311+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:03.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:03.537+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:03.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:03 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:03.537+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:04.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:03 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:03.651+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:04.507 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:04 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:04.265+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:04.508 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:04 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:04.314+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:04.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:04 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:04.359+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:04.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:04 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:04.359+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:04.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:04 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:04.348+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:04.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:04 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:04.519+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:04.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:04 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:04.519+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:05.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:04 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:04.647+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:05.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:04 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:04.647+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:05.557 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:05 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:05.361+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:05.558 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:05 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:05.298+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:05.558 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:05 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:05.298+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:05.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:05 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:05.321+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:05.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:05 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:05.321+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:05.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:05 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:05.391+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:05.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:05 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:05.391+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:05.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:05 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:05.570+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:05.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:05 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:05.570+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:06.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:05 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:05.690+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:06.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:05 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:05.690+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:06.238 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:05 smithi082 podman[69141]: 2024-04-25 11:36:05.996535635 +0000 UTC m=+5.503974457 container died e6b2cc8aae36ae1d1ff173b41ab7dcfbdd261cfd9734b3abeaf2a60436ce90b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:36:06.553 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:06 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:06.399+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:06.554 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:06 smithi082 podman[69141]: 2024-04-25 11:36:06.356572542 +0000 UTC m=+5.864011366 container cleanup e6b2cc8aae36ae1d1ff173b41ab7dcfbdd261cfd9734b3abeaf2a60436ce90b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-25T11:36:06.554 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:06 smithi082 bash[69141]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4 2024-04-25T11:36:06.554 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:06 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:06.361+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:06.554 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:06 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:06.361+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:06.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:06 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:06.316+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:06.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:06 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:06.316+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:06.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:06.346+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:06.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:06.346+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:06.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:06.578+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:06.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:06.578+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:06.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:06.353+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:06.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:06 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:06.353+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:06.962 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:06 smithi082 podman[69158]: 2024-04-25 11:36:06.566224283 +0000 UTC m=+0.561466425 container remove e6b2cc8aae36ae1d1ff173b41ab7dcfbdd261cfd9734b3abeaf2a60436ce90b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-25T11:36:07.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:06 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:06.729+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:07.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:06 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:06.729+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:07.215 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:06 smithi082 podman[69251]: 2024-04-25 11:36:06.975309627 +0000 UTC m=+0.114839499 container create 3f0a8458e8d8963da0cd417c06b4aa29fd154de97e3f5176a890ec45fcd05472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-25T11:36:07.215 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:06 smithi082 podman[69251]: 2024-04-25 11:36:06.878574711 +0000 UTC m=+0.018104598 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:36:07.215 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:07 smithi082 podman[69251]: 2024-04-25 11:36:07.227693416 +0000 UTC m=+0.367223287 container init 3f0a8458e8d8963da0cd417c06b4aa29fd154de97e3f5176a890ec45fcd05472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-25T11:36:07.488 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:07.381+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:07.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:07.384+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:07.489 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:07 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:07.384+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:07.489 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:07 smithi082 podman[69251]: 2024-04-25 11:36:07.230954476 +0000 UTC m=+0.370484355 container start 3f0a8458e8d8963da0cd417c06b4aa29fd154de97e3f5176a890ec45fcd05472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T11:36:07.489 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:07 smithi082 podman[69251]: 2024-04-25 11:36:07.327975823 +0000 UTC m=+0.467505709 container attach 3f0a8458e8d8963da0cd417c06b4aa29fd154de97e3f5176a890ec45fcd05472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=) 2024-04-25T11:36:07.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:07.362+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:07.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:07.362+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:07.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:07.394+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:07.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:07.394+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:07.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:07.578+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:07.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:07.578+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:07.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:07.356+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:07.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:07 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:07.356+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:07.793 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 25 11:36:07 smithi082 podman[69251]: 2024-04-25 11:36:07.519513102 +0000 UTC m=+0.659042979 container died 3f0a8458e8d8963da0cd417c06b4aa29fd154de97e3f5176a890ec45fcd05472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-25T11:36:08.101 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:07.771+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:08.101 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:07 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:07.771+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:08.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.4.service' 2024-04-25T11:36:08.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:08.160 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-25T11:36:08.160 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-25T11:36:08.160 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.5 2024-04-25T11:36:08.372 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:08.357+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:08.372 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:08.357+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:08.484 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:08 smithi196 systemd[1]: Stopping Ceph osd.5 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:08.484 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:08.409+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:08.485 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:08.409+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:08.485 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:08.496+0000 7f242c6ec700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:08.485 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:08.391+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:08.485 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:08.391+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:08.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:08.408+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:08.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:08.407+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:08.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:08 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:08.407+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:08.934 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:08.496+0000 7f242c6ec700 -1 osd.5 94 *** Got signal Terminated *** 2024-04-25T11:36:08.934 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:08.496+0000 7f242c6ec700 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:08.935 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:08.576+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:08.935 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:08 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:08.576+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:09.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:08.782+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:09.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:08 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:08.782+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:09.626 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:09.348+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:09.626 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:09.348+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:09.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:09.385+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:09.684 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:09.385+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:09.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:09.562+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:09.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:09.562+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:09.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:09.358+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:09.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:09 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:09.358+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:09.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:09.373+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:09.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:09.359+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:09.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:09 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:09.359+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:10.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:09.739+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:10.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:09 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:09.739+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:10.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:10.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:10.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:10.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:10.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:10.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:10.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:10.523+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:10.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:10.523+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:10.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:10.392+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:10.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:10.392+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:10.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:10.426+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:10.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:10.426+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:10.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:10 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:10.426+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.546179+0000 front 2024-04-25T11:35:46.546097+0000 (oldest deadline 2024-04-25T11:36:10.046348+0000) 2024-04-25T11:36:10.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:10.326+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:10.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:10.326+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:10.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:10.325+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:10.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:10.325+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:10.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:10 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:10.325+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:11.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:10.786+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:11.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:10.786+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:11.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:10.786+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:11.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:11.316+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:11.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:11.316+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:11.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:11.316+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:11.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:11.485+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:11.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:11.485+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:11.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:11.349+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:11.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:11.349+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:11.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:11.349+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:11.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:11.399+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:11.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:11.399+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:11.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:11 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:11.399+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.546179+0000 front 2024-04-25T11:35:46.546097+0000 (oldest deadline 2024-04-25T11:36:10.046348+0000) 2024-04-25T11:36:11.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:11.323+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:11.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:11.323+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:11.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:11.342+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:11.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:11.342+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:11.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:11 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:11.342+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:12.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:11.825+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:12.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:11.825+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:12.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:11 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:11.825+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:12.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:12.273+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:12.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:12.273+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:12.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:12.273+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:12.639 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:12.355+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:12.639 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:12.355+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:12.639 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:12.328+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:12.639 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:12.328+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:12.640 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:12 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:12.328+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:12.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:12.455+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:12.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:12.455+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:12.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:12.352+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:12.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:12.352+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:12.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:12.352+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.546179+0000 front 2024-04-25T11:35:46.546097+0000 (oldest deadline 2024-04-25T11:36:10.046348+0000) 2024-04-25T11:36:12.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:12.357+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:12.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:12.357+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:12.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:12 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:12.357+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:13.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:12.833+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:13.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:12.833+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:13.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:12 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:12.833+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:13.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:13.263+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:13.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:13.263+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:13.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:13.263+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:13.655 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:13.320+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:13.655 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:13.320+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:13.655 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:13.337+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:13.655 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:13.337+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:13.655 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:13 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:13.337+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:13.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:13.473+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:13.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:13.473+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:13.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:13.386+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.243607+0000 front 2024-04-25T11:35:30.243699+0000 (oldest deadline 2024-04-25T11:35:55.543459+0000) 2024-04-25T11:36:13.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:13.386+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.844709+0000 front 2024-04-25T11:35:40.844648+0000 (oldest deadline 2024-04-25T11:36:04.344658+0000) 2024-04-25T11:36:13.685 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-25T11:36:13.386+0000 7f2428ca2700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.546179+0000 front 2024-04-25T11:35:46.546097+0000 (oldest deadline 2024-04-25T11:36:10.046348+0000) 2024-04-25T11:36:13.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:13.356+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:13.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:13.356+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:13.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:13 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:13.356+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:14.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:13.809+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:14.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:13.809+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:14.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:13 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:13.809+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:14.177 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:13 smithi196 podman[70106]: 2024-04-25 11:36:13.883500056 +0000 UTC m=+5.514061195 container died c21891864e1469317aa3de1cd0eec46563a8075fa50bb63cabf16935c0e55539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:36:14.434 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:14 smithi196 podman[70106]: 2024-04-25 11:36:14.289019231 +0000 UTC m=+5.919580406 container cleanup c21891864e1469317aa3de1cd0eec46563a8075fa50bb63cabf16935c0e55539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, ceph=True) 2024-04-25T11:36:14.434 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:14 smithi196 bash[70106]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5 2024-04-25T11:36:14.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:14.342+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:14.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:14.342+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:14.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:14.342+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:14.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:14.242+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:14.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:14.242+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:14.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:14.242+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:14.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:14.362+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:14.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:14.362+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:14.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:14.370+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:14.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:14.370+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:14.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:14 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:14.370+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:14.898 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:14 smithi196 podman[70124]: 2024-04-25 11:36:14.54862039 +0000 UTC m=+0.661344673 container remove c21891864e1469317aa3de1cd0eec46563a8075fa50bb63cabf16935c0e55539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T11:36:14.898 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:14.511+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:14.898 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:14.511+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:14.898 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:14 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:14.511+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:15.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:14.814+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:15.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:14.814+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:15.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:14 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:14.814+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:15.184 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:14 smithi196 podman[70217]: 2024-04-25 11:36:14.814013333 +0000 UTC m=+0.018388156 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:36:15.184 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:14 smithi196 podman[70217]: 2024-04-25 11:36:14.924415909 +0000 UTC m=+0.128790742 container create 176dc8b3ee2a9d2e913bd5890d62f276ff46a743628d67d83cd24e2466c75201 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:36:15.184 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:15 smithi196 podman[70217]: 2024-04-25 11:36:15.143666931 +0000 UTC m=+0.348041733 container init 176dc8b3ee2a9d2e913bd5890d62f276ff46a743628d67d83cd24e2466c75201 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:36:15.184 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:15 smithi196 podman[70217]: 2024-04-25 11:36:15.146614551 +0000 UTC m=+0.350989346 container start 176dc8b3ee2a9d2e913bd5890d62f276ff46a743628d67d83cd24e2466c75201 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:36:15.477 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:15 smithi196 podman[70217]: 2024-04-25 11:36:15.235558916 +0000 UTC m=+0.439933721 container attach 176dc8b3ee2a9d2e913bd5890d62f276ff46a743628d67d83cd24e2466c75201 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:36:15.477 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 25 11:36:15 smithi196 podman[70217]: 2024-04-25 11:36:15.444242541 +0000 UTC m=+0.648617346 container died 176dc8b3ee2a9d2e913bd5890d62f276ff46a743628d67d83cd24e2466c75201 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-25T11:36:15.477 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:15 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:15.358+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:15.477 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:15 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:15.358+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:15.477 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:15 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:15.358+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:15.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:15.195+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:15.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:15.195+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:15.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:15.195+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:15.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:15 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:15.388+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:15.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:15 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:15.388+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:15.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:15 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:15.347+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:15.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:15 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:15.347+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:15.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:15 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:15.347+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:15.743 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:15 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:15.488+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:15.743 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:15 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:15.488+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:15.743 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:15 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:15.488+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:16.063 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.5.service' 2024-04-25T11:36:16.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:16.100 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-25T11:36:16.100 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-25T11:36:16.100 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.6 2024-04-25T11:36:16.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:15.778+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:16.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:15.778+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:16.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:15.778+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:16.421 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:16 smithi080 systemd[1]: Stopping Ceph osd.6 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:16.421 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:16.188+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:16.421 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:16.188+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:16.421 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:16.188+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:16.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:16 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:16.464+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:16.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:16 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:16.464+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:16.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:16 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:16.464+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:16.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:16 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:16.311+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:16.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:16 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:16.311+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:16.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:16 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:16.311+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:16.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:16 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:16.428+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:16.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:16 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:16.428+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:16.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:16 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:16.309+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:16.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:16 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:16.309+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:16.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:16 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:16.309+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:16.805 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:16.432+0000 7fad698c3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:16.805 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:16.432+0000 7fad698c3700 -1 osd.6 94 *** Got signal Terminated *** 2024-04-25T11:36:16.806 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:16.432+0000 7fad698c3700 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:16.806 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:16.817+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:16.806 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:16.817+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:16.806 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:16 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:16.817+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:17.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:17 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:17.232+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:17.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:17 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:17.232+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:17.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:17 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:17.232+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:17.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:17.471+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:17.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:17.471+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:17.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:17.471+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:17.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:17.271+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:17.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:17.271+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:17.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:17 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:17.271+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:17.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:17.456+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:17.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:17.456+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:17.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:17.261+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:17.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:17.261+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:17.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:17 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:17.261+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:18.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:17 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:17.781+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:18.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:17 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:17.781+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:18.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:17 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:17.781+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:18.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:18.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:18.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:18.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:18.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:18.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:18.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:18.433+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:18.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:18.433+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:18.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:18.433+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:18.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:18.255+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:18.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:18.255+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:18.686 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:18 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:18.255+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:18.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:18 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:18.429+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:18.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:18 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:18.429+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:18.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:18 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:18.303+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:18.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:18 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:18.303+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:18.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:18 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:18.303+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:19.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:18.782+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:19.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:18.782+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:19.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:18 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:18.782+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:19.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:19 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:19.243+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:19.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:19 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:19.243+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:19.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:19 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:19.243+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:19.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:19 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:19.394+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:19.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:19 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:19.394+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:19.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:19 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:19.394+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:19.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:19 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:19.248+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:19.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:19 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:19.248+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:19.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:19 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:19.248+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:19.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:19.449+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:19.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:19.449+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:19.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:19.449+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:19.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:19.336+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:19.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:19.336+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:19.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:19.336+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:19.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:19.336+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:20.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:19 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:19.744+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:20.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:19 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:19.744+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:20.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:19 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:19.744+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:20.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:20.291+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:20.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:20.291+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:20.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:20.291+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:20.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:20 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:20.358+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:20.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:20 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:20.358+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:20.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:20 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:20.358+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:20.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:20 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:20.226+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:20.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:20 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:20.226+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:20.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:20 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:20.226+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:20.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:20 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:20.472+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:20.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:20 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:20.472+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:20.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:20 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:20.472+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:20.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:20 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:20.377+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:20.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:20 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:20.377+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:20.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:20 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:20.377+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:20.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:20 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:20.377+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:21.122 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:20.760+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.438059+0000 front 2024-04-25T11:35:31.438211+0000 (oldest deadline 2024-04-25T11:35:55.538289+0000) 2024-04-25T11:36:21.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:20.760+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.540382+0000 front 2024-04-25T11:35:39.540158+0000 (oldest deadline 2024-04-25T11:36:04.140407+0000) 2024-04-25T11:36:21.123 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:20 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6[57283]: 2024-04-25T11:36:20.760+0000 7fad61e71700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:45.841494+0000 front 2024-04-25T11:35:45.841659+0000 (oldest deadline 2024-04-25T11:36:09.841769+0000) 2024-04-25T11:36:21.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:21.278+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:21.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:21.278+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:21.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:21.278+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:21.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:21 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:21.278+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:21.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:21.393+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:21.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:21.393+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:21.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:21.393+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:21.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:21.243+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:21.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:21.243+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:21.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:21 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:21.243+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:21.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:21.450+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:21.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:21.450+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:21.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:21.450+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:21.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:21.375+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:21.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:21.375+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:21.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:21.375+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:21.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:21 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:21.375+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:22.213 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:21 smithi080 podman[97164]: 2024-04-25 11:36:21.958152387 +0000 UTC m=+5.651716848 container stop eae23db77b1ffae448c53c57cb11959f58700f533a31ec21a8ef2bc45816b9d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-25T11:36:22.213 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:21 smithi080 podman[97164]: 2024-04-25 11:36:21.986402428 +0000 UTC m=+5.679966896 container died eae23db77b1ffae448c53c57cb11959f58700f533a31ec21a8ef2bc45816b9d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:36:22.480 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:22 smithi080 podman[97164]: 2024-04-25 11:36:22.324593173 +0000 UTC m=+6.018157624 container cleanup eae23db77b1ffae448c53c57cb11959f58700f533a31ec21a8ef2bc45816b9d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-04-25T11:36:22.480 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:22 smithi080 bash[97164]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6 2024-04-25T11:36:22.480 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:22 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:22.268+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:22.480 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:22 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:22.268+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:22.480 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:22 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:22.268+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:22.480 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:22 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:22.268+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:22.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:22 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:22.408+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:22.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:22 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:22.408+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:22.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:22 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:22.408+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:22.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:22 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:22.203+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:22.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:22 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:22.203+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:22.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:22 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:22.203+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:22.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:22.469+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:22.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:22.469+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:22.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:22.469+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:22.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:22.371+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:22.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:22.371+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:22.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:22.371+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:22.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:22.371+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:22.872 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:22 smithi080 podman[97181]: 2024-04-25 11:36:22.492589904 +0000 UTC m=+0.528083981 container remove eae23db77b1ffae448c53c57cb11959f58700f533a31ec21a8ef2bc45816b9d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:36:23.208 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:22 smithi080 podman[97272]: 2024-04-25 11:36:22.794284221 +0000 UTC m=+0.018171861 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:36:23.208 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:22 smithi080 podman[97272]: 2024-04-25 11:36:22.910464192 +0000 UTC m=+0.134351805 container create ff1103cac50b04a1757ae42f83331b4a7b649f2816f0acb93eda1529e9093f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-25T11:36:23.209 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:23 smithi080 podman[97272]: 2024-04-25 11:36:23.121173198 +0000 UTC m=+0.345060810 container init ff1103cac50b04a1757ae42f83331b4a7b649f2816f0acb93eda1529e9093f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-25T11:36:23.209 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:23 smithi080 podman[97272]: 2024-04-25 11:36:23.124379824 +0000 UTC m=+0.348267445 container start ff1103cac50b04a1757ae42f83331b4a7b649f2816f0acb93eda1529e9093f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-25T11:36:23.209 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:23 smithi080 podman[97272]: 2024-04-25 11:36:23.22126013 +0000 UTC m=+0.445147751 container attach ff1103cac50b04a1757ae42f83331b4a7b649f2816f0acb93eda1529e9093f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:36:23.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:23.162+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:23.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:23.162+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:23.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:23.162+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:23.623 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:23 smithi080 podman[97272]: 2024-04-25 11:36:23.416358192 +0000 UTC m=+0.640245811 container died ff1103cac50b04a1757ae42f83331b4a7b649f2816f0acb93eda1529e9093f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6-deactivate, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-25T11:36:23.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:23.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:23.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:23.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:23.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:23.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:23.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:23 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:23.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:23.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:23 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:23.429+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:23.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:23 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:23.429+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:23.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:23 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:23.429+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:23.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:23 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:23.345+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:23.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:23 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:23.345+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:23.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:23 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:23.345+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:23.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:23 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:23.345+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:23.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:23.452+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:23.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:23.452+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:23.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:23.452+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:23.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:23 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:23.452+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:23.972 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 25 11:36:23 smithi080 podman[97299]: 2024-04-25 11:36:23.966739414 +0000 UTC m=+0.539581440 container remove ff1103cac50b04a1757ae42f83331b4a7b649f2816f0acb93eda1529e9093f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T11:36:23.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.6.service' 2024-04-25T11:36:24.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:24.056 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-25T11:36:24.056 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-25T11:36:24.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.7 2024-04-25T11:36:24.343 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:24 smithi082 systemd[1]: Stopping Ceph osd.7 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:24.407 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:24 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:24.129+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:24.407 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:24 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:24.129+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:24.407 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:24 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:24.129+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:24.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:24.335+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:24.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:24.335+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:24.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:24.335+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:24.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:24 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:24.335+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:24.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:24 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:24.419+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:24.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:24 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:24.419+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:24.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:24 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:24.419+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:24.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:24 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:24.419+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:24.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:24.373+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:24.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:24.373+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:24.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:24.373+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:24.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:24.373+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:24.739 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:24.384+0000 7f50488d6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:24.739 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:24.384+0000 7f50488d6700 -1 osd.7 94 *** Got signal Terminated *** 2024-04-25T11:36:24.739 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:24.384+0000 7f50488d6700 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:24.739 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:24.465+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:24.739 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:24.465+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:24.739 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:24 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:24.465+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:25.405 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:25 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:25.117+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:25.405 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:25 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:25.117+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:25.405 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:25 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:25.117+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:25.537 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:25.289+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:25.537 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:25.289+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:25.537 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:25.289+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:25.538 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:25 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:25.289+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:25.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:25 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:25.416+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:25.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:25 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:25.416+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:25.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:25 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:25.416+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:25.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:25 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:25.416+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:25.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:25 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:25.500+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:25.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:25 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:25.500+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:25.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:25 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:25.500+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:25.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:25 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:25.368+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:25.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:25 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:25.368+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:25.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:25 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:25.368+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:25.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:25 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:25.368+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:26.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:26 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:26.410+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:26.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:26 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:26.410+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:26.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:26 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:26.410+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:26.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:26 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:26.410+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:26.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:26 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:26.161+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:26.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:26 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:26.161+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:26.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:26 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:26.161+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:26.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:26.266+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:26.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:26.266+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:26.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:26.266+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:26.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:26 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:26.266+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:26.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:26.525+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:26.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:26.525+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:26.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:26.525+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:26.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:26.402+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:26.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:26.402+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:26.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:26.402+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:26.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:26.402+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:27.351 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:27.113+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:27.351 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:27.113+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:27.351 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:27.113+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:27.352 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:27.113+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:27.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:27 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:27.260+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:27.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:27 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:27.260+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:27.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:27 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:27.260+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:27.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:27 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:27.260+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:27.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:27 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:27.260+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:27.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:27.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:27.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:27.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:27.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:27.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:27.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:27 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:27.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:27.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:27 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:27.571+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:27.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:27 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:27.571+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:27.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:27 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:27.571+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:27.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:27 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:27.372+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:27.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:27 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:27.372+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:27.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:27 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:27.372+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:27.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:27 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:27.372+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:28.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:28.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:28.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:28.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:28.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:28.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:28.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:28.363+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:28.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:28.153+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:28.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:28.153+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:28.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:28.153+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:28.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:28 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:28.153+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:28.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:28.246+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:28.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:28.246+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:28.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:28.246+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:28.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:28.246+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:28.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:28 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:28.246+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:28.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:28.601+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:37.236366+0000 front 2024-04-25T11:35:37.236520+0000 (oldest deadline 2024-04-25T11:36:06.037177+0000) 2024-04-25T11:36:28.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:28.601+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:46.538339+0000 front 2024-04-25T11:35:46.538445+0000 (oldest deadline 2024-04-25T11:36:09.939134+0000) 2024-04-25T11:36:28.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7[50777]: 2024-04-25T11:36:28.601+0000 7f5040e84700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.940738+0000 front 2024-04-25T11:35:56.940664+0000 (oldest deadline 2024-04-25T11:36:18.640596+0000) 2024-04-25T11:36:28.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:28.358+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:28.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:28.358+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:28.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:28.358+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:28.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:28.358+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:28.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:28 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:28.358+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:29.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:29.346+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:29.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:29.346+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:29.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:29.346+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:29.435 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:29.346+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:29.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:29.117+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:29.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:29.117+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:29.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:29.117+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:29.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:29 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:29.117+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:29.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:29 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:29.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:29.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:29 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:29.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:29.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:29 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:29.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:29.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:29 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:29.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:29.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:29 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:29.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:29.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:29 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:29.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:29.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:29 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:29.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:29.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:29 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:29.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:29.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:29 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:29.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:29.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:29 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:29.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:30.112 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:29 smithi082 podman[69368]: 2024-04-25 11:36:29.853542941 +0000 UTC m=+5.592378356 container died 1c7efc92a18432be094d894532bee81db7b164738fe5f4b8d37c55d10c50e00e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-25T11:36:30.383 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:30.123+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:30.383 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:30.123+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:30.383 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:30.123+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:30.383 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:30.123+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:30.397 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:30 smithi082 podman[69368]: 2024-04-25 11:36:30.223823911 +0000 UTC m=+5.962659318 container cleanup 1c7efc92a18432be094d894532bee81db7b164738fe5f4b8d37c55d10c50e00e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:36:30.397 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:30 smithi082 bash[69368]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7 2024-04-25T11:36:30.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:30 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:30.331+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:30.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:30 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:30.331+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:30.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:30 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:30.331+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:30.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:30 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:30.331+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:30.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:30 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:30.331+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:30.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:30.395+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:30.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:30.395+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:30.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:30.395+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:30.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:30 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:30.395+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:30.738 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:30 smithi082 podman[69387]: 2024-04-25 11:36:30.51682406 +0000 UTC m=+0.660231667 container remove 1c7efc92a18432be094d894532bee81db7b164738fe5f4b8d37c55d10c50e00e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-25T11:36:30.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:30.409+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:30.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:30.409+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:30.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:30.409+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:30.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:30.409+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:30.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:30.409+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:31.165 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:30 smithi082 podman[69475]: 2024-04-25 11:36:30.745429553 +0000 UTC m=+0.017555917 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:36:31.165 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:30 smithi082 podman[69475]: 2024-04-25 11:36:30.851000425 +0000 UTC m=+0.123126855 container create d633e3134e20b55f373ecac16dc1c7fbc05681d4b4d0104ba7ca8f50fa033601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:36:31.165 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:31 smithi082 podman[69475]: 2024-04-25 11:36:31.078423541 +0000 UTC m=+0.350549909 container init d633e3134e20b55f373ecac16dc1c7fbc05681d4b4d0104ba7ca8f50fa033601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-25T11:36:31.165 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:31 smithi082 podman[69475]: 2024-04-25 11:36:31.081637501 +0000 UTC m=+0.353763865 container start d633e3134e20b55f373ecac16dc1c7fbc05681d4b4d0104ba7ca8f50fa033601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T11:36:31.165 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:31 smithi082 podman[69475]: 2024-04-25 11:36:31.178033389 +0000 UTC m=+0.450159766 container attach d633e3134e20b55f373ecac16dc1c7fbc05681d4b4d0104ba7ca8f50fa033601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T11:36:31.402 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:31.155+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:31.402 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:31.155+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:31.402 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:31.155+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:31.402 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:31.155+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:31.488 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 25 11:36:31 smithi082 podman[69475]: 2024-04-25 11:36:31.372432892 +0000 UTC m=+0.644559261 container died d633e3134e20b55f373ecac16dc1c7fbc05681d4b4d0104ba7ca8f50fa033601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-25T11:36:31.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:31 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:31.382+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:31.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:31 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:31.382+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:31.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:31 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:31.382+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:31.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:31 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:31.382+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:31.489 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:31 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:31.382+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:31.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:31 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:31.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:31.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:31 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:31.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:31.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:31 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:31.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:31.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:31 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:31.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:31.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:31 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:31.281+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:31.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:31.413+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:31.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:31.413+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:31.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:31.413+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:31.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:31 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:31.413+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:32.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.7.service' 2024-04-25T11:36:32.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:32.099 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-25T11:36:32.100 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-25T11:36:32.100 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.8 2024-04-25T11:36:32.418 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 systemd[1]: Stopping Ceph osd.8 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:32.418 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:32.180+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:32.418 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:32.180+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:32.418 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:32.180+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:32.418 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:32.180+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:32.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:32 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:32.301+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:32.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:32 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:32.301+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:32.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:32 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:32.301+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:32.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:32 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:32.301+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:32.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:32 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:32.301+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:32.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:32.429+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:32.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:32.429+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:32.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:32.429+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:32.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:32.429+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:32.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:32.433+0000 7ff8633e7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:32.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:32.433+0000 7ff8633e7700 -1 osd.8 94 *** Got signal Terminated *** 2024-04-25T11:36:32.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:32 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:32.433+0000 7ff8633e7700 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:32.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:32 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:32.354+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:32.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:32 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:32.354+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:32.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:32 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:32.354+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:32.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:32 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:32.354+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:32.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:32 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:32.354+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:33.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:33.157+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:33.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:33.157+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:33.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:33.157+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:33.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:33.157+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:33.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:33 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:33.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:33.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:33 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:33.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:33.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:33 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:33.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:33.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:33 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:33.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:33.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:33 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:33.387+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:33.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:33.340+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:33.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:33.340+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:33.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:33.340+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:33.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:33.340+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:33.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:33 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:33.340+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:33.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:33.467+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:33.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:33.467+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:33.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:33.467+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:33.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:33 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:33.467+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:34.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:34.174+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:34.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:34.174+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:34.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:34.174+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:34.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:34.174+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:34.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:34.174+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:34.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:34 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:34.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:34.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:34 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:34.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:34.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:34 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:34.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:34.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:34 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:34.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:34.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:34 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:34.350+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:34.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:34 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:34.415+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:34.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:34 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:34.415+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:34.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:34 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:34.415+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:34.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:34 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:34.415+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:34.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:34 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:34.415+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:34.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:34 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:34.415+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:34.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:34.465+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:34.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:34.465+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:34.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:34.465+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:34.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:34.465+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:34.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:34 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:34.465+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.555877+0000 front 2024-04-25T11:36:09.555763+0000 (oldest deadline 2024-04-25T11:36:34.255961+0000) 2024-04-25T11:36:35.406 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:35.163+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:35.407 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:35.163+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:35.407 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:35.163+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:35.407 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:35.163+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:35.407 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:35.163+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:35.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:35 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:35.323+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:35.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:35 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:35.323+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:35.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:35 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:35.323+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:35.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:35 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:35.323+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:35.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:35 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:35.323+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:35.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:35 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:35.323+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:35.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:35.418+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:35.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:35.418+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:35.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:35.418+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:35.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:35.418+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:35.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:35.418+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.555877+0000 front 2024-04-25T11:36:09.555763+0000 (oldest deadline 2024-04-25T11:36:34.255961+0000) 2024-04-25T11:36:35.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:35 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:35.396+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:35.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:35 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:35.396+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:35.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:35 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:35.396+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:35.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:35 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:35.396+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:35.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:35 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:35.396+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:35.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:35 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:35.396+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:36.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:36.173+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:36.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:36.173+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:36.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:36.173+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:36.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:36.173+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:36.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:36.173+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:36.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:36 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:36.305+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:36.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:36 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:36.305+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:36.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:36 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:36.305+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:36.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:36 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:36.305+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:36.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:36 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:36.305+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:36.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:36 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:36.305+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:36.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:36.411+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:36.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:36.411+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:36.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:36.411+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:36.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:36.411+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:36.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:36.411+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:36.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:36 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:36.411+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:36.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:36.468+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:36.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:36.468+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:36.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:36.468+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:36.934 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:36.468+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:36.935 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:36 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:36.468+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.555877+0000 front 2024-04-25T11:36:09.555763+0000 (oldest deadline 2024-04-25T11:36:34.255961+0000) 2024-04-25T11:36:37.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:37 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:37.308+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:37.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:37 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:37.308+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:37.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:37 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:37.308+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:37.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:37 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:37.308+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:37.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:37 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:37.308+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:37.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:37 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:37.308+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:37.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:37.431+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:32.750893+0000 front 2024-04-25T11:35:32.750936+0000 (oldest deadline 2024-04-25T11:35:53.850877+0000) 2024-04-25T11:36:37.684 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:37.431+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:36.151926+0000 front 2024-04-25T11:35:36.152026+0000 (oldest deadline 2024-04-25T11:36:02.552347+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:37.431+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:47.853300+0000 front 2024-04-25T11:35:47.853229+0000 (oldest deadline 2024-04-25T11:36:13.753308+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:37.431+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:57.254541+0000 front 2024-04-25T11:35:57.254439+0000 (oldest deadline 2024-04-25T11:36:23.154388+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8[51798]: 2024-04-25T11:36:37.431+0000 7ff85b995700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.555877+0000 front 2024-04-25T11:36:09.555763+0000 (oldest deadline 2024-04-25T11:36:34.255961+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:37.213+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:37.213+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:37.213+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:37.213+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:37.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:37 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:37.213+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:37.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:37 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:37.404+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:37.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:37 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:37.404+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:37.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:37 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:37.404+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:37.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:37 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:37.404+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:37.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:37 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:37.404+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:37.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:37 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:37.404+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:38.073 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:37 smithi196 podman[70323]: 2024-04-25 11:36:37.809188797 +0000 UTC m=+5.501533114 container died 17fd6f11ef9656615aa2c8772ba950d9aa9e2f33b619b653ce6e564753ac7504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-25T11:36:38.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:38 smithi196 podman[70323]: 2024-04-25 11:36:38.185900435 +0000 UTC m=+5.878244751 container cleanup 17fd6f11ef9656615aa2c8772ba950d9aa9e2f33b619b653ce6e564753ac7504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T11:36:38.434 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:38 smithi196 bash[70323]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8 2024-04-25T11:36:38.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:38.227+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:38.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:38.227+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:38.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:38.227+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:38.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:38.227+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:38.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:38.227+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:38.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:38 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:38.318+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:38.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:38 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:38.318+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:38.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:38 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:38.318+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:38.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:38 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:38.318+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:38.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:38 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:38.318+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:38.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:38 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:38.318+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:38.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:38 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:38.445+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:38.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:38 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:38.445+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:38.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:38 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:38.445+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:38.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:38 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:38.445+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:38.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:38 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:38.445+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:38.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:38 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:38.445+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:38.767 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:38 smithi196 podman[70341]: 2024-04-25 11:36:38.479729275 +0000 UTC m=+0.663403559 container remove 17fd6f11ef9656615aa2c8772ba950d9aa9e2f33b619b653ce6e564753ac7504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T11:36:39.029 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:38 smithi196 podman[70433]: 2024-04-25 11:36:38.780548336 +0000 UTC m=+0.104287488 container create 619209ff99a98fbe42c47564180c3c1ea70b85245c962a971ab078045fc5a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2) 2024-04-25T11:36:39.029 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:38 smithi196 podman[70433]: 2024-04-25 11:36:38.694483399 +0000 UTC m=+0.018222533 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:36:39.030 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:39 smithi196 podman[70433]: 2024-04-25 11:36:39.042386766 +0000 UTC m=+0.366125873 container init 619209ff99a98fbe42c47564180c3c1ea70b85245c962a971ab078045fc5a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-04-25T11:36:39.322 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:39 smithi196 podman[70433]: 2024-04-25 11:36:39.045867581 +0000 UTC m=+0.369606691 container start 619209ff99a98fbe42c47564180c3c1ea70b85245c962a971ab078045fc5a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:36:39.322 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:39 smithi196 podman[70433]: 2024-04-25 11:36:39.176148689 +0000 UTC m=+0.499887827 container attach 619209ff99a98fbe42c47564180c3c1ea70b85245c962a971ab078045fc5a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:36:39.323 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:39 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:39.241+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:39.323 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:39 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:39.241+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:39.323 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:39 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:39.241+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:39.323 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:39 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:39.241+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:39.323 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:39 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:39.241+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:39.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:39 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:39.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:39.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:39 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:39.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:39.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:39 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:39.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:39.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:39 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:39.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:39.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:39 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:39.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:39.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:39 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:39.293+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:39.666 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 25 11:36:39 smithi196 podman[70433]: 2024-04-25 11:36:39.33512826 +0000 UTC m=+0.658867371 container died 619209ff99a98fbe42c47564180c3c1ea70b85245c962a971ab078045fc5a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-04-25T11:36:39.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:39 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:39.424+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:39.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:39 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:39.424+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:39.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:39 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:39.424+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:39.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:39 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:39.424+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:39.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:39 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:39.424+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:39.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:39 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:39.424+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:39.962 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.8.service' 2024-04-25T11:36:40.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:40.001 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-25T11:36:40.001 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-25T11:36:40.001 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.9 2024-04-25T11:36:40.322 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 systemd[1]: Stopping Ceph osd.9 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.248+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.248+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.248+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.248+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.248+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.248+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.334+0000 7f25d29fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.334+0000 7f25d29fd700 -1 osd.9 94 *** Got signal Terminated *** 2024-04-25T11:36:40.323 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:40 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:40.334+0000 7f25d29fd700 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:40.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:40 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:40.267+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:40.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:40 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:40.267+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:40.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:40 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:40.267+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:40.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:40 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:40.267+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:40.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:40 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:40.267+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:40.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:40 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:40.386+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:40.741 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:40 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:40.386+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:40.741 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:40 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:40.386+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:40.741 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:40 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:40.386+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:40.741 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:40 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:40.386+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:40.741 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:40 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:40.386+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:41.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:41 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:41.287+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:41.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:41 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:41.287+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:41.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:41 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:41.287+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:41.434 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:41 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:41.287+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:41.435 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:41 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:41.287+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:41.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:41 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:41.225+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:41.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:41 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:41.225+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:41.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:41 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:41.225+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:41.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:41 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:41.225+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:41.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:41 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:41.225+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:41.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:41 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:41.225+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:41.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:41 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:41.432+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:41.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:41 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:41.432+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:41.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:41 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:41.432+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:41.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:41 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:41.432+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:41.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:41 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:41.432+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:41.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:41 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:41.432+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:42.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:42 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:42.256+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:42.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:42 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:42.256+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:42.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:42 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:42.256+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:42.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:42 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:42.256+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:42.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:42 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:42.256+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:42.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:42 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:42.256+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:42.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:42 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:42.291+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:42.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:42 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:42.291+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:42.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:42 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:42.291+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:42.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:42 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:42.291+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:42.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:42 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:42.291+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:42.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:42 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:42.423+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:42.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:42 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:42.423+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:42.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:42 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:42.423+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:42.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:42 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:42.423+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:42.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:42 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:42.423+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:42.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:42 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:42.423+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:42.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:42 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:42.423+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:43.585 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:43 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:43.301+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:43.586 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:43 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:43.301+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:43.586 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:43 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:43.301+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:43.586 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:43 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:43.301+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:43.586 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:43 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:43.301+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:43.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:43 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:43.244+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:43.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:43 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:43.244+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:43.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:43 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:43.244+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:43.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:43 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:43.244+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:43.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:43 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:43.244+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:43.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:43 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:43.244+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:43.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:43 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:43.454+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:43.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:43 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:43.454+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:43.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:43 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:43.454+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:43.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:43 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:43.454+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:43.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:43 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:43.454+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:43.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:43 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:43.454+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:43.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:43 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:43.454+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:44.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:44 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:44.267+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:44.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:44 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:44.267+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:44.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:44 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:44.267+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:44.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:44 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:44.267+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:44.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:44 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:44.267+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:44.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:44 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:44.267+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:44.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:44.300+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:44.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:44.300+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:44.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:44.300+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:44.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:44.300+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:44.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:44.300+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:44.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:44 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:44.300+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:44.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:44 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:44.495+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:44.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:44 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:44.495+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:44.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:44 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:44.495+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:44.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:44 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:44.495+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:44.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:44 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:44.495+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:44.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:44 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:44.495+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:44.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:44 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:44.495+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:45.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:45 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:45.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:31.372917+0000 front 2024-04-25T11:35:31.372887+0000 (oldest deadline 2024-04-25T11:35:56.073201+0000) 2024-04-25T11:36:45.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:45 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:45.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.174262+0000 front 2024-04-25T11:35:40.174379+0000 (oldest deadline 2024-04-25T11:36:03.674332+0000) 2024-04-25T11:36:45.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:45 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:45.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.875940+0000 front 2024-04-25T11:35:48.876147+0000 (oldest deadline 2024-04-25T11:36:09.975781+0000) 2024-04-25T11:36:45.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:45 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:45.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:55.876690+0000 front 2024-04-25T11:35:55.876715+0000 (oldest deadline 2024-04-25T11:36:20.576727+0000) 2024-04-25T11:36:45.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:45 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:45.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.277904+0000 front 2024-04-25T11:36:05.277823+0000 (oldest deadline 2024-04-25T11:36:26.377564+0000) 2024-04-25T11:36:45.623 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:45 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9[64061]: 2024-04-25T11:36:45.296+0000 7f25cefb3700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:09.278512+0000 front 2024-04-25T11:36:09.278604+0000 (oldest deadline 2024-04-25T11:36:35.178401+0000) 2024-04-25T11:36:45.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:45 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:45.273+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:45.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:45 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:45.273+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:45.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:45 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:45.273+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:45.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:45 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:45.273+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:45.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:45 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:45.273+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:45.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:45 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:45.273+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:45.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:45 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:45.447+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:45.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:45 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:45.447+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:45.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:45 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:45.447+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:45.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:45 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:45.447+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:45.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:45 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:45.448+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:45.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:45 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:45.448+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:45.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:45 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:45.448+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:46.039 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:45 smithi080 podman[97391]: 2024-04-25 11:36:45.795417731 +0000 UTC m=+5.587166065 container died 1187f555fda74184129e276c53f3086156f2607bb79efa65a0f7a6b9eb430d5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-25T11:36:46.364 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 podman[97391]: 2024-04-25 11:36:46.14278584 +0000 UTC m=+5.934534158 container cleanup 1187f555fda74184129e276c53f3086156f2607bb79efa65a0f7a6b9eb430d5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-25T11:36:46.364 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 bash[97391]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9 2024-04-25T11:36:46.622 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 podman[97408]: 2024-04-25 11:36:46.377376919 +0000 UTC m=+0.582068270 container remove 1187f555fda74184129e276c53f3086156f2607bb79efa65a0f7a6b9eb430d5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-25T11:36:46.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:46.309+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:46.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:46.309+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:46.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:46.309+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:46.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:46.309+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:46.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:46.310+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:46.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:46.310+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:46.737 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:46 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:46.450+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:46.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:46 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:46.450+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:46.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:46 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:46.450+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:46.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:46 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:46.450+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:46.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:46 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:46.450+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:46.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:46 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:46.450+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:46.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:46 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:46.450+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:46.934 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 podman[97498]: 2024-04-25 11:36:46.571675972 +0000 UTC m=+0.018259918 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:36:46.935 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 podman[97498]: 2024-04-25 11:36:46.66990551 +0000 UTC m=+0.116489446 container create 60e5697bc8298ff967b047787dd927b87afca6391062260498c87595cb85d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:36:46.935 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 podman[97498]: 2024-04-25 11:36:46.86425641 +0000 UTC m=+0.310840346 container init 60e5697bc8298ff967b047787dd927b87afca6391062260498c87595cb85d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS) 2024-04-25T11:36:46.935 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 podman[97498]: 2024-04-25 11:36:46.867326807 +0000 UTC m=+0.313910746 container start 60e5697bc8298ff967b047787dd927b87afca6391062260498c87595cb85d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:36:46.935 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:46 smithi080 podman[97498]: 2024-04-25 11:36:46.947471032 +0000 UTC m=+0.394054983 container attach 60e5697bc8298ff967b047787dd927b87afca6391062260498c87595cb85d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:36:47.372 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 25 11:36:47 smithi080 podman[97498]: 2024-04-25 11:36:47.15798456 +0000 UTC m=+0.604568501 container died 60e5697bc8298ff967b047787dd927b87afca6391062260498c87595cb85d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:36:47.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:47 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:47.274+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:47.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:47 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:47.274+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:47.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:47 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:47.274+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:47.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:47 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:47.274+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:47.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:47 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:47.274+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:47.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:47 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:47.274+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:47.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:47.483+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:47.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:47.483+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:47.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:47.483+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:47.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:47.483+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:47.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:47.483+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:47.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:47.483+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:47.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:47.483+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:47.763 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.9.service' 2024-04-25T11:36:47.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:47.800 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-25T11:36:47.800 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-25T11:36:47.800 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.10 2024-04-25T11:36:48.112 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:47 smithi082 systemd[1]: Stopping Ceph osd.10 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:48.478 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.124+0000 7fbb84501700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:48.478 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.124+0000 7fbb84501700 -1 osd.10 94 *** Got signal Terminated *** 2024-04-25T11:36:48.478 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.124+0000 7fbb84501700 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:48.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:48 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:48.261+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:48.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:48 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:48.261+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:48.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:48 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:48.261+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:48.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:48 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:48.261+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:48.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:48 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:48.261+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:48.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:48 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:48.261+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:48.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.490+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:48.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.490+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:48.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.490+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:48.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.490+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:48.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.490+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:48.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.490+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:48.739 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:48 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:48.490+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:49.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:49 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:49.263+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:49.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:49 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:49.263+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:49.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:49 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:49.263+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:49.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:49 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:49.263+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:49.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:49 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:49.263+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:49.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:49 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:49.263+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:49.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:49 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:49.505+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:49.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:49 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:49.505+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:49.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:49 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:49.505+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:49.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:49 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:49.505+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:49.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:49 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:49.505+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:49.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:49 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:49.505+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:49.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:49 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:49.505+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:50.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:50 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:50.312+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:50.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:50 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:50.312+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:50.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:50 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:50.312+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:50.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:50 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:50.312+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:50.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:50 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:50.312+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:50.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:50 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:50.312+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:50.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:50.504+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:50.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:50.504+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:50.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:50.504+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:50.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:50.504+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:50.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:50.504+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:50.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:50.504+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:50.988 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:50 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:50.504+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:51.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:51 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:51.362+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:51.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:51 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:51.362+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:51.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:51 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:51.362+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:51.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:51 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:51.362+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:51.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:51 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:51.362+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:51.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:51 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:51.362+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:51.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:51 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:51.474+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:51.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:51 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:51.474+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:51.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:51 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:51.474+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:51.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:51 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:51.474+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:51.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:51 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:51.474+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:51.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:51 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:51.474+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:51.738 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:51 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:51.474+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:52.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:52 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:52.327+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:52.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:52 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:52.327+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:52.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:52 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:52.327+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:52.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:52 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:52.327+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:52.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:52 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:52.327+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:52.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:52 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:52.327+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:52.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:52 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:52.327+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:36:52.734 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:52 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:52.487+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:30.965309+0000 front 2024-04-25T11:35:30.965559+0000 (oldest deadline 2024-04-25T11:35:53.865327+0000) 2024-04-25T11:36:52.734 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:52 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:52.487+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:39.066860+0000 front 2024-04-25T11:35:39.066833+0000 (oldest deadline 2024-04-25T11:36:04.367030+0000) 2024-04-25T11:36:52.734 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:52 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:52.487+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:44.367522+0000 front 2024-04-25T11:35:44.367363+0000 (oldest deadline 2024-04-25T11:36:10.267415+0000) 2024-04-25T11:36:52.734 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:52 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:52.487+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-25T11:35:56.168533+0000 front 2024-04-25T11:35:56.168616+0000 (oldest deadline 2024-04-25T11:36:18.369016+0000) 2024-04-25T11:36:52.734 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:52 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:52.487+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:05.370633+0000 front 2024-04-25T11:36:05.370682+0000 (oldest deadline 2024-04-25T11:36:28.270753+0000) 2024-04-25T11:36:52.735 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:52 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:52.487+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:08.271541+0000 front 2024-04-25T11:36:08.271523+0000 (oldest deadline 2024-04-25T11:36:34.071903+0000) 2024-04-25T11:36:52.735 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:52 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10[57854]: 2024-04-25T11:36:52.487+0000 7fbb80ab7700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:18.773160+0000 front 2024-04-25T11:36:18.773188+0000 (oldest deadline 2024-04-25T11:36:42.272941+0000) 2024-04-25T11:36:53.644 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:53.285+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:53.644 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:53.285+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:53.644 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:53.285+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:53.644 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:53.285+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:53.644 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:53.285+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:53.644 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:53.285+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:53.644 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:53 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:53.285+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:36:53.846 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:53 smithi082 podman[69592]: 2024-04-25 11:36:53.541121589 +0000 UTC m=+5.535815169 container died a9b72fbfdf523132d0398fe47cee3ad8453110c26ef748b5eb5e57ea0575fd27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T11:36:54.163 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:53 smithi082 podman[69592]: 2024-04-25 11:36:53.958895625 +0000 UTC m=+5.953589255 container cleanup a9b72fbfdf523132d0398fe47cee3ad8453110c26ef748b5eb5e57ea0575fd27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-25T11:36:54.164 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:53 smithi082 bash[69592]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10 2024-04-25T11:36:54.488 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:54 smithi082 podman[69609]: 2024-04-25 11:36:54.176778059 +0000 UTC m=+0.626793654 container remove a9b72fbfdf523132d0398fe47cee3ad8453110c26ef748b5eb5e57ea0575fd27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-04-25T11:36:54.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:54.326+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:54.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:54.326+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:54.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:54.326+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:54.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:54.326+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:54.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:54.326+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:54.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:54.326+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:54.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:54 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:54.326+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:36:54.808 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:54 smithi082 podman[69698]: 2024-04-25 11:36:54.411797119 +0000 UTC m=+0.018322426 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:36:54.808 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:54 smithi082 podman[69698]: 2024-04-25 11:36:54.510849314 +0000 UTC m=+0.117374666 container create 3e4ad1765957df902f5b5e43d8211f5e954d22c7a6a877780e9412c29a9f547e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T11:36:54.808 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:54 smithi082 podman[69698]: 2024-04-25 11:36:54.738005275 +0000 UTC m=+0.344530582 container init 3e4ad1765957df902f5b5e43d8211f5e954d22c7a6a877780e9412c29a9f547e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-25T11:36:54.808 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:54 smithi082 podman[69698]: 2024-04-25 11:36:54.741227963 +0000 UTC m=+0.347753270 container start 3e4ad1765957df902f5b5e43d8211f5e954d22c7a6a877780e9412c29a9f547e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:36:54.808 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:54 smithi082 podman[69698]: 2024-04-25 11:36:54.821232566 +0000 UTC m=+0.427757876 container attach 3e4ad1765957df902f5b5e43d8211f5e954d22c7a6a877780e9412c29a9f547e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:36:55.237 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 25 11:36:55 smithi082 podman[69698]: 2024-04-25 11:36:55.030941356 +0000 UTC m=+0.637466654 container died 3e4ad1765957df902f5b5e43d8211f5e954d22c7a6a877780e9412c29a9f547e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:36:55.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.10.service' 2024-04-25T11:36:55.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:36:55.662 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-25T11:36:55.662 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-25T11:36:55.662 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.11 2024-04-25T11:36:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.295+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.295+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.295+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.295+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.295+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.295+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:55.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.295+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:36:55.986 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 systemd[1]: Stopping Ceph osd.11 for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.998+0000 7f515e734700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.998+0000 7f515e734700 -1 osd.11 94 *** Got signal Terminated *** 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:55 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:55.998+0000 7f515e734700 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:56.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:56.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:56.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:56.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:56.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:56.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:56.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:56.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:56.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:56 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:56.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:36:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:57.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:57.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:57.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:57.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:57.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:57.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:57.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:57 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:57.325+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:36:58.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:58.368+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:58.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:58.368+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:58.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:58.368+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:58.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:58.368+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:58.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:58.368+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:58.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:58.368+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:58.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:58 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:58.368+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:36:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:59.411+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:36:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:59.411+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:36:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:59.411+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:36:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:59.411+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:36:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:59.411+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:36:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:59.411+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:36:59.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:36:59 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:36:59.411+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:37:00.684 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.434+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-25T11:35:29.020475+0000 front 2024-04-25T11:35:29.020405+0000 (oldest deadline 2024-04-25T11:35:54.920531+0000) 2024-04-25T11:37:00.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.435+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-25T11:35:40.122499+0000 front 2024-04-25T11:35:40.122569+0000 (oldest deadline 2024-04-25T11:36:05.422424+0000) 2024-04-25T11:37:00.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.435+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-04-25T11:35:48.923336+0000 front 2024-04-25T11:35:48.923470+0000 (oldest deadline 2024-04-25T11:36:10.623420+0000) 2024-04-25T11:37:00.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.435+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-25T11:36:04.927668+0000 front 2024-04-25T11:36:04.927570+0000 (oldest deadline 2024-04-25T11:36:26.627579+0000) 2024-04-25T11:37:00.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.435+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-04-25T11:36:12.329722+0000 front 2024-04-25T11:36:12.329637+0000 (oldest deadline 2024-04-25T11:36:34.029791+0000) 2024-04-25T11:37:00.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.435+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-25T11:36:17.431471+0000 front 2024-04-25T11:36:17.431420+0000 (oldest deadline 2024-04-25T11:36:43.331342+0000) 2024-04-25T11:37:00.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.435+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-25T11:36:29.132882+0000 front 2024-04-25T11:36:29.132859+0000 (oldest deadline 2024-04-25T11:36:51.432857+0000) 2024-04-25T11:37:00.685 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:00 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11[58396]: 2024-04-25T11:37:00.435+0000 7f5156ce2700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.196:6820 osd.8 since back 2024-04-25T11:36:37.234437+0000 front 2024-04-25T11:36:37.234475+0000 (oldest deadline 2024-04-25T11:37:00.134448+0000) 2024-04-25T11:37:01.669 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:01 smithi196 podman[70551]: 2024-04-25 11:37:01.425914166 +0000 UTC m=+5.546964797 container died 105472e13c0bc2f0b871a6560404c22844bec49257b75c54695c9529da9ddb67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-25T11:37:01.934 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:01 smithi196 podman[70551]: 2024-04-25 11:37:01.755915927 +0000 UTC m=+5.876966551 container cleanup 105472e13c0bc2f0b871a6560404c22844bec49257b75c54695c9529da9ddb67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T11:37:01.934 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:01 smithi196 bash[70551]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11 2024-04-25T11:37:02.353 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:01 smithi196 podman[70569]: 2024-04-25 11:37:01.948632603 +0000 UTC m=+0.519594284 container remove 105472e13c0bc2f0b871a6560404c22844bec49257b75c54695c9529da9ddb67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-04-25T11:37:02.613 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:02 smithi196 podman[70661]: 2024-04-25 11:37:02.26973172 +0000 UTC m=+0.018244945 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T11:37:02.614 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:02 smithi196 podman[70661]: 2024-04-25 11:37:02.415053163 +0000 UTC m=+0.163566372 container create 2dc66c26b6d3c43d613b3d0127e4f862f593dd6d4ab26b06af94a873c64b5f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:37:02.614 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:02 smithi196 podman[70661]: 2024-04-25 11:37:02.626534519 +0000 UTC m=+0.375047732 container init 2dc66c26b6d3c43d613b3d0127e4f862f593dd6d4ab26b06af94a873c64b5f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-25T11:37:02.910 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:02 smithi196 podman[70661]: 2024-04-25 11:37:02.629742487 +0000 UTC m=+0.378255701 container start 2dc66c26b6d3c43d613b3d0127e4f862f593dd6d4ab26b06af94a873c64b5f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=) 2024-04-25T11:37:02.910 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:02 smithi196 podman[70661]: 2024-04-25 11:37:02.701660846 +0000 UTC m=+0.450174068 container attach 2dc66c26b6d3c43d613b3d0127e4f862f593dd6d4ab26b06af94a873c64b5f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-25T11:37:03.184 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 25 11:37:02 smithi196 podman[70661]: 2024-04-25 11:37:02.923213211 +0000 UTC m=+0.671726424 container died 2dc66c26b6d3c43d613b3d0127e4f862f593dd6d4ab26b06af94a873c64b5f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:37:03.466 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@osd.11.service' 2024-04-25T11:37:03.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:03.545 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-25T11:37:03.545 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-25T11:37:03.545 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.a 2024-04-25T11:37:03.840 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:37:03 smithi080 systemd[1]: Stopping Ceph mds.a for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:04.122 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:37:03 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a[70618]: 2024-04-25T11:37:03.851+0000 7f8e899ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:04.122 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:37:03 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a[70618]: 2024-04-25T11:37:03.851+0000 7f8e899ff700 -1 mds.a *** got signal Terminated *** 2024-04-25T11:37:05.164 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:37:04 smithi080 podman[97614]: 2024-04-25 11:37:04.886768652 +0000 UTC m=+1.140859396 container died 8ccd7807e23ad29b00c95dc8e9f54ddc285bcd2a83812ee101acb9c6cf70881a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:37:05.490 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:37:05 smithi080 podman[97614]: 2024-04-25 11:37:05.260468983 +0000 UTC m=+1.514559721 container cleanup 8ccd7807e23ad29b00c95dc8e9f54ddc285bcd2a83812ee101acb9c6cf70881a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424) 2024-04-25T11:37:05.490 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 25 11:37:05 smithi080 bash[97614]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-a 2024-04-25T11:37:05.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.a.service' 2024-04-25T11:37:05.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:05.661 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-25T11:37:05.661 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-25T11:37:05.661 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.d 2024-04-25T11:37:06.005 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:37:05 smithi080 systemd[1]: Stopping Ceph mds.d for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:06.372 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:37:06 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d[69656]: 2024-04-25T11:37:06.017+0000 7fd53b1e3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:06.372 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:37:06 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d[69656]: 2024-04-25T11:37:06.017+0000 7fd53b1e3700 -1 mds.d *** got signal Terminated *** 2024-04-25T11:37:09.202 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:37:08 smithi080 podman[97737]: 2024-04-25 11:37:08.906311094 +0000 UTC m=+3.006596170 container died d96ba53fdd88d73b6431d10c1e9f4c6dff855eb15635cd90d05db4c673a6ddde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-25T11:37:09.502 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:37:09 smithi080 podman[97737]: 2024-04-25 11:37:09.297674799 +0000 UTC m=+3.397959868 container cleanup d96ba53fdd88d73b6431d10c1e9f4c6dff855eb15635cd90d05db4c673a6ddde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-25T11:37:09.502 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 25 11:37:09 smithi080 bash[97737]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-d 2024-04-25T11:37:09.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.d.service' 2024-04-25T11:37:09.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:09.665 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-25T11:37:09.666 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-25T11:37:09.666 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.g 2024-04-25T11:37:09.872 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 25 11:37:09 smithi080 systemd[1]: Stopping Ceph mds.g for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:10.372 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 25 11:37:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-g[70265]: 2024-04-25T11:37:10.001+0000 7f6c4e268700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:10.372 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 25 11:37:10 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-g[70265]: 2024-04-25T11:37:10.001+0000 7f6c4e268700 -1 mds.g *** got signal Terminated *** 2024-04-25T11:37:14.372 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 25 11:37:14 smithi080 podman[97858]: 2024-04-25 11:37:14.010015956 +0000 UTC m=+4.115558608 container died 4b180c95824ccef099a8241b22f204745c16e51f88e5170f1d594b0a69c7e797 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-g, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T11:37:14.705 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 25 11:37:14 smithi080 podman[97858]: 2024-04-25 11:37:14.475958582 +0000 UTC m=+4.581501227 container cleanup 4b180c95824ccef099a8241b22f204745c16e51f88e5170f1d594b0a69c7e797 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-25T11:37:14.705 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 25 11:37:14 smithi080 bash[97858]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-g 2024-04-25T11:37:14.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.g.service' 2024-04-25T11:37:14.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:14.862 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-25T11:37:14.862 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-25T11:37:14.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.j 2024-04-25T11:37:15.122 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 25 11:37:14 smithi080 systemd[1]: Stopping Ceph mds.j for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:15.622 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 25 11:37:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-j[69308]: 2024-04-25T11:37:15.213+0000 7fe3a7f63700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:15.622 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 25 11:37:15 smithi080 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-j[69308]: 2024-04-25T11:37:15.213+0000 7fe3a7f63700 -1 mds.j *** got signal Terminated *** 2024-04-25T11:37:18.372 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 25 11:37:18 smithi080 podman[97978]: 2024-04-25 11:37:18.132828777 +0000 UTC m=+3.046408159 container died 3e4d7f36062b278f8dcf8f93f19038317e045d0a12e65aef352cf84ff9372fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:37:18.742 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 25 11:37:18 smithi080 podman[97978]: 2024-04-25 11:37:18.52988164 +0000 UTC m=+3.443461008 container cleanup 3e4d7f36062b278f8dcf8f93f19038317e045d0a12e65aef352cf84ff9372fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T11:37:18.743 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 25 11:37:18 smithi080 bash[97978]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-j 2024-04-25T11:37:18.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.j.service' 2024-04-25T11:37:18.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:18.916 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-25T11:37:18.916 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-25T11:37:18.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.b 2024-04-25T11:37:19.206 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:37:18 smithi082 systemd[1]: Stopping Ceph mds.b for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:19.467 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:37:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: 2024-04-25T11:37:19.215+0000 7fe54af73700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:19.467 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:37:19 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b[63197]: 2024-04-25T11:37:19.215+0000 7fe54af73700 -1 mds.b *** got signal Terminated *** 2024-04-25T11:37:21.519 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:37:21 smithi082 podman[69803]: 2024-04-25 11:37:21.266701421 +0000 UTC m=+2.147548822 container died ee77e2f0910e32169f2eb98aee5347c3c005ae91065b3ef11957e926edf8be95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T11:37:21.869 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:37:21 smithi082 podman[69803]: 2024-04-25 11:37:21.631516356 +0000 UTC m=+2.512363796 container cleanup ee77e2f0910e32169f2eb98aee5347c3c005ae91065b3ef11957e926edf8be95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True) 2024-04-25T11:37:21.870 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 25 11:37:21 smithi082 bash[69803]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-b 2024-04-25T11:37:21.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.b.service' 2024-04-25T11:37:22.028 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:22.028 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-25T11:37:22.028 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-25T11:37:22.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.e 2024-04-25T11:37:22.237 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:37:22 smithi082 systemd[1]: Stopping Ceph mds.e for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:22.737 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:37:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e[62576]: 2024-04-25T11:37:22.359+0000 7fa251304700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:22.738 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:37:22 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e[62576]: 2024-04-25T11:37:22.359+0000 7fa251304700 -1 mds.e *** got signal Terminated *** 2024-04-25T11:37:25.548 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:37:25 smithi082 podman[69935]: 2024-04-25 11:37:25.271187045 +0000 UTC m=+3.011648386 container died 0fe8dddd2e876f893034bf0a4913ef62ee068eac32c5d2f2e36ca360c6db39a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:37:25.890 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:37:25 smithi082 podman[69935]: 2024-04-25 11:37:25.643346577 +0000 UTC m=+3.383807924 container cleanup 0fe8dddd2e876f893034bf0a4913ef62ee068eac32c5d2f2e36ca360c6db39a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True) 2024-04-25T11:37:25.890 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 25 11:37:25 smithi082 bash[69935]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-e 2024-04-25T11:37:26.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.e.service' 2024-04-25T11:37:26.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:26.088 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-25T11:37:26.088 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-25T11:37:26.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.h 2024-04-25T11:37:26.410 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:37:26 smithi082 systemd[1]: Stopping Ceph mds.h for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:26.737 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:37:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h[62885]: 2024-04-25T11:37:26.422+0000 7f3102b59700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:26.737 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:37:26 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h[62885]: 2024-04-25T11:37:26.422+0000 7f3102b59700 -1 mds.h *** got signal Terminated *** 2024-04-25T11:37:29.526 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:37:29 smithi082 podman[70055]: 2024-04-25 11:37:29.273183412 +0000 UTC m=+2.951494573 container died d2f46978b6ba6eab89fd9ede9935d111727feee8189371c168a8e168b1a8ece8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-25T11:37:29.885 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:37:29 smithi082 podman[70055]: 2024-04-25 11:37:29.621921428 +0000 UTC m=+3.300232594 container cleanup d2f46978b6ba6eab89fd9ede9935d111727feee8189371c168a8e168b1a8ece8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:37:29.885 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 25 11:37:29 smithi082 bash[70055]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-h 2024-04-25T11:37:30.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.h.service' 2024-04-25T11:37:30.073 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:30.073 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-25T11:37:30.073 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-25T11:37:30.073 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.k 2024-04-25T11:37:30.454 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:37:30 smithi082 systemd[1]: Stopping Ceph mds.k for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:30.454 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:37:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k[62255]: 2024-04-25T11:37:30.408+0000 7fbd3fce8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:30.454 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:37:30 smithi082 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k[62255]: 2024-04-25T11:37:30.408+0000 7fbd3fce8700 -1 mds.k *** got signal Terminated *** 2024-04-25T11:37:34.738 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:37:34 smithi082 podman[70177]: 2024-04-25 11:37:34.4151871 +0000 UTC m=+4.111768474 container died 88a655b1c17661aeb1cc1f889e5c120f519796b795d37fe841aec548781d5829 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:37:35.038 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:37:34 smithi082 podman[70177]: 2024-04-25 11:37:34.841634469 +0000 UTC m=+4.538215843 container cleanup 88a655b1c17661aeb1cc1f889e5c120f519796b795d37fe841aec548781d5829 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-25T11:37:35.038 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 25 11:37:34 smithi082 bash[70177]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-k 2024-04-25T11:37:35.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.k.service' 2024-04-25T11:37:35.285 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:35.285 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-25T11:37:35.286 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-25T11:37:35.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.c 2024-04-25T11:37:35.582 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:37:35 smithi196 systemd[1]: Stopping Ceph mds.c for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:35.897 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:37:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[67044]: 2024-04-25T11:37:35.594+0000 7fbda9e9e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:35.897 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:37:35 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c[67044]: 2024-04-25T11:37:35.594+0000 7fbda9e9e700 -1 mds.c *** got signal Terminated *** 2024-04-25T11:37:37.540 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:37:37 smithi196 podman[70767]: 2024-04-25 11:37:37.274281761 +0000 UTC m=+1.788319990 container died 159950ffb95a36bdd18707015299870ed598c36b515b4919c705a178ef86bbcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-25T11:37:37.899 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:37:37 smithi196 podman[70767]: 2024-04-25 11:37:37.652958834 +0000 UTC m=+2.166997147 container cleanup 159950ffb95a36bdd18707015299870ed598c36b515b4919c705a178ef86bbcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-25T11:37:37.899 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 25 11:37:37 smithi196 bash[70767]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-c 2024-04-25T11:37:38.066 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.c.service' 2024-04-25T11:37:38.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:38.100 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-25T11:37:38.100 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-25T11:37:38.101 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.f 2024-04-25T11:37:38.434 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:37:38 smithi196 systemd[1]: Stopping Ceph mds.f for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:38.434 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:37:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f[63372]: 2024-04-25T11:37:38.414+0000 7fa31beb2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:38.434 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:37:38 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f[63372]: 2024-04-25T11:37:38.414+0000 7fa31beb2700 -1 mds.f *** got signal Terminated *** 2024-04-25T11:37:41.561 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:37:41 smithi196 podman[70903]: 2024-04-25 11:37:41.283518581 +0000 UTC m=+2.953953278 container died d30e06c9f41ddf7ea5bb3a8baacbb77ca4c44c9e38f7cd2d1548bb6796e2d3fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:37:41.903 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:37:41 smithi196 podman[70903]: 2024-04-25 11:37:41.681737784 +0000 UTC m=+3.352172474 container cleanup d30e06c9f41ddf7ea5bb3a8baacbb77ca4c44c9e38f7cd2d1548bb6796e2d3fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T11:37:41.903 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 25 11:37:41 smithi196 bash[70903]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-f 2024-04-25T11:37:42.037 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.f.service' 2024-04-25T11:37:42.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:42.069 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-25T11:37:42.070 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-25T11:37:42.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.i 2024-04-25T11:37:42.183 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:37:42 smithi196 systemd[1]: Stopping Ceph mds.i for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:42.684 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:37:42 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i[63990]: 2024-04-25T11:37:42.409+0000 7f80bfd18700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:42.684 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:37:42 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i[63990]: 2024-04-25T11:37:42.410+0000 7f80bfd18700 -1 mds.i *** got signal Terminated *** 2024-04-25T11:37:45.531 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:37:45 smithi196 podman[71025]: 2024-04-25 11:37:45.270094581 +0000 UTC m=+2.967846956 container died b2f85528d22ece9704290d71de9f31257669363dac3bac2cf5eec7c9a56356b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-25T11:37:45.889 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:37:45 smithi196 podman[71025]: 2024-04-25 11:37:45.635330447 +0000 UTC m=+3.333082829 container cleanup b2f85528d22ece9704290d71de9f31257669363dac3bac2cf5eec7c9a56356b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T11:37:45.889 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 25 11:37:45 smithi196 bash[71025]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-i 2024-04-25T11:37:46.044 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.i.service' 2024-04-25T11:37:46.075 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:46.075 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-25T11:37:46.075 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-25T11:37:46.075 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.l 2024-04-25T11:37:46.434 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:37:46 smithi196 systemd[1]: Stopping Ceph mds.l for bba277ec-02f4-11ef-bc93-c7b262605968... 2024-04-25T11:37:46.434 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:37:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l[63066]: 2024-04-25T11:37:46.404+0000 7fc21f68b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T11:37:46.434 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:37:46 smithi196 ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l[63066]: 2024-04-25T11:37:46.404+0000 7fc21f68b700 -1 mds.l *** got signal Terminated *** 2024-04-25T11:37:48.643 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:37:48 smithi196 podman[71147]: 2024-04-25 11:37:48.380591403 +0000 UTC m=+2.074667571 container died 6f38fb2a60e439ca9deca75bf10617e28390a4dd4703f5ee43f9fcdd625011f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True) 2024-04-25T11:37:48.934 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:37:48 smithi196 podman[71147]: 2024-04-25 11:37:48.738899311 +0000 UTC m=+2.432975470 container cleanup 6f38fb2a60e439ca9deca75bf10617e28390a4dd4703f5ee43f9fcdd625011f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T11:37:48.934 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 25 11:37:48 smithi196 bash[71147]: ceph-bba277ec-02f4-11ef-bc93-c7b262605968-mds-l 2024-04-25T11:37:49.149 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bba277ec-02f4-11ef-bc93-c7b262605968@mds.l.service' 2024-04-25T11:37:49.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T11:37:49.180 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-25T11:37:49.180 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bba277ec-02f4-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T11:37:49.366 INFO:teuthology.orchestra.run.smithi080.stdout:Deleting cluster with fsid: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:37:51.791 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bba277ec-02f4-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T11:37:51.981 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:37:54.429 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bba277ec-02f4-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T11:37:54.628 INFO:teuthology.orchestra.run.smithi196.stdout:Deleting cluster with fsid: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:37:56.966 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:37:56.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:37:57.029 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T11:37:57.054 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-25T11:37:57.056 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi080/crash 2024-04-25T11:37:57.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash -- . 2024-04-25T11:37:57.095 INFO:teuthology.orchestra.run.smithi080.stderr:tar: /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T11:37:57.095 INFO:teuthology.orchestra.run.smithi080.stderr:tar: Error is not recoverable: exiting now 2024-04-25T11:37:57.097 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi082/crash 2024-04-25T11:37:57.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash -- . 2024-04-25T11:37:57.162 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T11:37:57.162 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-04-25T11:37:57.165 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi196/crash 2024-04-25T11:37:57.165 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash -- . 2024-04-25T11:37:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:tar: /var/lib/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T11:37:57.198 INFO:teuthology.orchestra.run.smithi196.stderr:tar: Error is not recoverable: exiting now 2024-04-25T11:37:57.199 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-25T11:37:57.199 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-25T11:37:57.234 INFO:tasks.cephadm:Compressing logs... 2024-04-25T11:37:57.234 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T11:37:57.276 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T11:37:57.278 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T11:37:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T11:37:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:: No such file or directory 2024-04-25T11:37:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log 2024-04-25T11:37:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T11:37:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-25T11:37:57.301 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-25T11:37:57.301 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-25T11:37:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-25T11:37:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-25T11:37:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-25T11:37:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.x.log: 87.5% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T11:37:57.304 INFO:teuthology.orchestra.run.smithi080.stderr: 90.2%gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-25T11:37:57.304 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:: No such file or directory 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.f.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-25T11:37:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.c.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.z.log: 87.6% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T11:37:57.308 INFO:teuthology.orchestra.run.smithi196.stderr: 90.4% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T11:37:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T11:37:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-25T11:37:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log: 84.1% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T11:37:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-25T11:37:57.314 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.11.log: 91.9% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.a.log: 94.5% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 94.6% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr: 84.5% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.a.log: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr: 94.6% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-25T11:37:57.317 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-25T11:37:57.318 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-25T11:37:57.318 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.d.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.9.log: 94.5% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-25T11:37:57.320 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-04-25T11:37:57.320 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/cephadm.log 2024-04-25T11:37:57.320 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log 2024-04-25T11:37:57.320 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T11:37:57.320 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-25T11:37:57.320 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.7.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.b.log: --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6%/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.y.log: -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.h.log: gzip 90.4% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.10.log: 84.2% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr: 91.9% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T11:37:57.321 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-25T11:37:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T11:37:57.326 INFO:teuthology.orchestra.run.smithi080.stderr: 91.1% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T11:37:57.332 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-25T11:37:57.334 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-25T11:37:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.b.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T11:37:57.359 INFO:teuthology.orchestra.run.smithi082.stderr: 94.4% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-25T11:37:57.359 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.l.log: 94.6% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-25T11:37:57.361 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T11:37:57.363 INFO:teuthology.orchestra.run.smithi196.stderr: 94.5% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-25T11:37:57.378 INFO:teuthology.orchestra.run.smithi196.stderr: 92.5% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-25T11:37:57.378 INFO:teuthology.orchestra.run.smithi082.stderr: 92.7% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-25T11:37:57.391 INFO:teuthology.orchestra.run.smithi082.stderr: 94.4% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-25T11:37:57.416 INFO:teuthology.orchestra.run.smithi196.stderr: 93.4% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-25T11:37:57.544 INFO:teuthology.orchestra.run.smithi080.stderr: 90.0% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-25T11:37:57.619 INFO:teuthology.orchestra.run.smithi082.stderr: 92.0% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-25T11:37:57.702 INFO:teuthology.orchestra.run.smithi196.stderr: 92.0% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-25T11:37:57.734 INFO:teuthology.orchestra.run.smithi082.stderr: 92.8% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-25T11:37:58.529 INFO:teuthology.orchestra.run.smithi080.stderr: 90.6% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-25T11:37:59.438 INFO:teuthology.orchestra.run.smithi080.stderr: 91.6% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-25T11:37:59.693 INFO:teuthology.orchestra.run.smithi196.stderr: 92.7% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-25T11:37:59.786 INFO:teuthology.orchestra.run.smithi080.stderr: 92.1% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-25T11:38:00.202 INFO:teuthology.orchestra.run.smithi080.stderr: 92.2% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-25T11:38:00.393 INFO:teuthology.orchestra.run.smithi082.stderr: 92.2% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-25T11:38:00.486 INFO:teuthology.orchestra.run.smithi082.stderr: 91.8% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-25T11:38:00.525 INFO:teuthology.orchestra.run.smithi196.stderr: 92.0% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-25T11:38:00.644 INFO:teuthology.orchestra.run.smithi196.stderr: 91.9% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-25T11:38:00.658 INFO:teuthology.orchestra.run.smithi082.stderr: 92.0% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-25T11:38:00.734 INFO:teuthology.orchestra.run.smithi082.stderr: 92.2% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-25T11:38:00.736 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-04-25T11:38:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m3.443s 2024-04-25T11:38:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m13.496s 2024-04-25T11:38:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m0.446s 2024-04-25T11:38:01.290 INFO:teuthology.orchestra.run.smithi196.stderr: 92.1% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-25T11:38:01.292 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-04-25T11:38:01.292 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m3.999s 2024-04-25T11:38:01.292 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m13.170s 2024-04-25T11:38:01.292 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m0.409s 2024-04-25T11:38:01.462 INFO:teuthology.orchestra.run.smithi080.stderr: 91.5% -- replaced with /var/log/ceph/bba277ec-02f4-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-25T11:38:01.464 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-25T11:38:01.464 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m4.175s 2024-04-25T11:38:01.464 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m12.785s 2024-04-25T11:38:01.464 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.406s 2024-04-25T11:38:01.464 INFO:tasks.cephadm:Archiving logs... 2024-04-25T11:38:01.464 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi080/log 2024-04-25T11:38:01.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T11:38:03.515 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi082/log 2024-04-25T11:38:03.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T11:38:05.634 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi196/log 2024-04-25T11:38:05.635 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T11:38:07.805 INFO:tasks.cephadm:Removing cluster... 2024-04-25T11:38:07.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bba277ec-02f4-11ef-bc93-c7b262605968 --force 2024-04-25T11:38:08.002 INFO:teuthology.orchestra.run.smithi080.stdout:Deleting cluster with fsid: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:38:08.403 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bba277ec-02f4-11ef-bc93-c7b262605968 --force 2024-04-25T11:38:08.594 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:38:08.871 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bba277ec-02f4-11ef-bc93-c7b262605968 --force 2024-04-25T11:38:09.062 INFO:teuthology.orchestra.run.smithi196.stdout:Deleting cluster with fsid: bba277ec-02f4-11ef-bc93-c7b262605968 2024-04-25T11:38:09.359 INFO:tasks.cephadm:Removing cephadm ... 2024-04-25T11:38:09.360 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T11:38:09.378 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T11:38:09.394 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T11:38:09.409 INFO:tasks.cephadm:Teardown complete 2024-04-25T11:38:09.409 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T11:38:09.421 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T11:38:09.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T11:38:09.424 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T11:38:09.437 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T11:38:09.549 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T11:38:09.560 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T11:38:09.561 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:38:09.563 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:38:09.566 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:38:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-25T11:38:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-25T11:38:09.580 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +877us[ +863us] +/- 69ms 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -380us[ -394us] +/- 77ms 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -604us[ -618us] +/- 77ms 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 7 377 77 +891us[ +972us] +/- 68ms 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 11 -357us[ -357us] +/- 77ms 2024-04-25T11:38:09.583 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -618us[ -618us] +/- 77ms 2024-04-25T11:38:09.584 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:38:09.584 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T11:38:09.585 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-04-25T11:38:09.585 INFO:teuthology.orchestra.run.smithi196.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +860us[ +851us] +/- 69ms 2024-04-25T11:38:09.585 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -394us[ -394us] +/- 77ms 2024-04-25T11:38:09.585 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -631us[ -631us] +/- 77ms 2024-04-25T11:38:09.585 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T11:38:09.585 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T11:38:09.595 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T11:38:09.596 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T11:38:09.606 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T11:38:09.703 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T11:38:09.769 DEBUG:teuthology.orchestra.run.smithi196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T11:38:09.833 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T11:38:09.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:38:09.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T11:38:09.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:38:09.888 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T11:38:09.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:38:09.915 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T11:38:09.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T11:38:09.936 INFO:teuthology.task.internal:Duration was 1904.646234 seconds 2024-04-25T11:38:09.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T11:38:09.948 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T11:38:09.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T11:38:09.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T11:38:09.953 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T11:38:09.985 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T11:38:09.987 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T11:38:09.991 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T11:38:10.274 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T11:38:10.275 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-04-25T11:38:10.275 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T11:38:10.294 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-04-25T11:38:10.295 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T11:38:10.338 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-04-25T11:38:10.338 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T11:38:10.362 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T11:38:10.362 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T11:38:10.365 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T11:38:10.380 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T11:38:10.427 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T11:38:10.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T11:38:10.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T11:38:10.444 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T11:38:10.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T11:38:10.808 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T11:38:10.808 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T11:38:10.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T11:38:10.855 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T11:38:10.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T11:38:10.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:38:10.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:38:10.897 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:38:10.912 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-04-25T11:38:10.917 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-04-25T11:38:10.941 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-04-25T11:38:10.957 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:38:10.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:38:10.984 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:38:10.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:38:10.997 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:38:11.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:38:11.012 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T11:38:11.025 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T11:38:11.025 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi080 2024-04-25T11:38:11.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T11:38:11.067 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi082 2024-04-25T11:38:11.067 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T11:38:11.102 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673124/remote/smithi196 2024-04-25T11:38:11.102 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T11:38:11.137 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T11:38:11.137 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T11:38:11.140 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T11:38:11.142 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T11:38:11.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T11:38:11.199 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T11:38:11.199 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T11:38:11.210 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T11:38:11.210 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T11:38:11.213 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T11:38:11.215 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T11:38:11.225 INFO:teuthology.orchestra.run.smithi080.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 11:38 /home/ubuntu/cephtest 2024-04-25T11:38:11.227 INFO:teuthology.orchestra.run.smithi082.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 11:38 /home/ubuntu/cephtest 2024-04-25T11:38:11.240 INFO:teuthology.orchestra.run.smithi196.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 11:38 /home/ubuntu/cephtest 2024-04-25T11:38:11.241 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T11:38:11.253 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T11:38:11.280 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} duration: 1904.6462335586548 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T11:38:11.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T11:38:11.371 INFO:teuthology.run:pass